modeling#

Modeling classes for LayoutLMv2 model.

class LayoutLMv2Model(config)[源代码]#

基类：LayoutLMv2PretrainedModel

The bare LayoutLMv2 Model outputting raw hidden-states.

This model inherits from PretrainedModel. Refer to the superclass documentation for the generic methods.

This model is also a Paddle paddle.nn.Layer subclass. Use it as a regular Paddle Layer and refer to the Paddle documentation for all matter related to general usage and behavior.

参数:

  • vocab_size (int) -- Vocabulary size of the XLNet model. Defines the number of different tokens that can be represented by the inputs_ids passed when calling XLNetModel.

  • hidden_size (int, optional) -- Dimensionality of the encoder layers and the pooler layer. Defaults to 768.

  • num_hidden_layers (int, optional) -- Number of hidden layers in the Transformer encoder. Defaults to 12.

  • num_attention_heads (int, optional) -- Number of attention heads for each attention layer in the Transformer encoder. Defaults to 12.

  • intermediate_size (int, optional) -- Dimensionality of the "intermediate" (often named feed-forward) layer in the Transformer encoder. Defaults to 3072.

  • hidden_act (str, optional) -- The non-linear activation function in the feed-forward layer. "gelu", "relu" and any other paddle supported activation functions are supported. Defaults to "gelu".

  • hidden_dropout_prob (float, optional) -- The dropout probability for all fully connected layers in the embeddings and encoder. Defaults to 0.1.

  • attention_probs_dropout_prob (float, optional) -- The dropout probability for all fully connected layers in the pooler. Defaults to 0.1.

  • initializer_range (float, optional) -- The standard deviation of the truncated_normal_initializer for initializing all weight matrices. Defaults to 0.02.

resize_position_embeddings(new_num_position_embeddings)[源代码]#

Resizes position embeddings of the model if new_num_position_embeddings != config["max_position_embeddings"].

参数:

new_num_position_embeddings (int) -- The number of new position embedding matrix. If position embeddings are learned, increasing the size will add newly initialized vectors at the end, whereas reducing the size will remove vectors from the end.

forward(input_ids=None, bbox=None, image=None, token_type_ids=None, position_ids=None, attention_mask=None, head_mask=None, output_hidden_states=False, output_attentions=False)[源代码]#

Defines the computation performed at every call. Should be overridden by all subclasses.

参数:

  • *inputs (tuple) -- unpacked tuple arguments

  • **kwargs (dict) -- unpacked dict arguments

class LayoutLMv2PretrainedModel(*args, **kwargs)[源代码]#

基类：PretrainedModel

config_class#

LayoutLMv2Config 的别名

base_model_class#

LayoutLMv2Model 的别名

class LayoutLMv2ForTokenClassification(config)[源代码]#

基类：LayoutLMv2PretrainedModel

get_input_embeddings()[源代码]#

get input embedding of model

返回:

embedding of model

返回类型:

nn.Embedding

resize_position_embeddings(new_num_position_embeddings)[源代码]#

Resizes position embeddings of the model if new_num_position_embeddings != config.max_position_embeddings.

参数:

new_num_position_embeddings (int) -- The number of new position embedding matrix. If position embeddings are learned, increasing the size will add newly initialized vectors at the end, whereas reducing the size will remove vectors from the end.

forward(input_ids=None, bbox=None, image=None, attention_mask=None, token_type_ids=None, position_ids=None, head_mask=None, labels=None)[源代码]#

Defines the computation performed at every call. Should be overridden by all subclasses.

参数:

  • *inputs (tuple) -- unpacked tuple arguments

  • **kwargs (dict) -- unpacked dict arguments

class LayoutLMv2ForPretraining(config)[源代码]#

基类：LayoutLMv2PretrainedModel

resize_position_embeddings(new_num_position_embeddings)[源代码]#

Resizes position embeddings of the model if new_num_position_embeddings != config.max_position_embeddings.

参数:

new_num_position_embeddings (int) -- The number of new position embedding matrix. If position embeddings are learned, increasing the size will add newly initialized vectors at the end, whereas reducing the size will remove vectors from the end.

forward(input_ids=None, bbox=None, image=None, attention_mask=None, token_type_ids=None, position_ids=None, head_mask=None, masked_positions=None)[源代码]#

Defines the computation performed at every call. Should be overridden by all subclasses.

参数:

  • *inputs (tuple) -- unpacked tuple arguments

  • **kwargs (dict) -- unpacked dict arguments

class LayoutLMv2ForRelationExtraction(config)[源代码]#

基类：LayoutLMv2PretrainedModel

resize_position_embeddings(new_num_position_embeddings)[源代码]#

Resizes position embeddings of the model if new_num_position_embeddings != config.max_position_embeddings.

参数:

new_num_position_embeddings (int) -- The number of new position embedding matrix. If position embeddings are learned, increasing the size will add newly initialized vectors at the end, whereas reducing the size will remove vectors from the end.

forward(input_ids, bbox, labels=None, image=None, attention_mask=None, token_type_ids=None, position_ids=None, head_mask=None, entities=None, relations=None)[源代码]#

Defines the computation performed at every call. Should be overridden by all subclasses.

参数:

  • *inputs (tuple) -- unpacked tuple arguments

  • **kwargs (dict) -- unpacked dict arguments