utils

download_file(save_dir, filename, url, md5=None)[源代码]

Download the file from the url to specified directory. Check md5 value when the file is exists, if the md5 value is the same as the existed file, just use the older file, if not, will download the file from the url.

参数
  • save_dir (string) -- The specified directory saving the file.

  • filename (string) -- The specified filename saving the file.

  • url (string) -- The url downling the file.

  • md5 (string, optional) -- The md5 value that checking the version downloaded.

download_check(task)[源代码]

Check the resource statuc in the specified task.

参数

task (string) -- The name of specified task.

add_docstrings(*docstr)[源代码]

The function that add the doc string to doc of class.

class TermTreeNode(sid: str, term: str, base: str, node_type: str = 'term', term_type: Optional[str] = None, hyper: Optional[str] = None, level: Optional[int] = None, alias: Optional[List[str]] = None, alias_ext: Optional[List[str]] = None, sub_type: Optional[List[str]] = None, sub_term: Optional[List[str]] = None, data: Optional[Dict[str, Any]] = None)[源代码]

基类:object

Defination of term node. All members are protected, to keep rigorism of data struct.

参数
  • sid (str) -- term id of node.

  • term (str) -- term, common name of this term.

  • base (str) -- cb indicates concept base, eb indicates entity base.

  • term_type (Optional[str], optional) -- type of this term, constructs hirechical of term node. Defaults to None.

  • hyper (Optional[str], optional) -- parent type of a type node. Defaults to None.

  • node_type (str, optional) -- type statement of node, type or term. Defaults to "term".

  • alias (Optional[List[str]], optional) -- alias of this term. Defaults to None.

  • alias_ext (Optional[List[str]], optional) -- extended alias of this term, CANNOT be used in matching. Defaults to None.

  • sub_type (Optional[List[str]], optional) -- grouped by some term. Defaults to None.

  • sub_term (Optional[List[str]], optional) -- some lower term. Defaults to None.

  • data (Optional[Dict[str, Any]], optional) -- to sore full imformation of a term. Defaults to None.

classmethod from_dict(data: Dict[str, Any])[源代码]

Build a node from dictionary data.

参数

data (Dict[str, Any]) -- Dictionary data contain all k-v data.

返回

TermTree node object.

返回类型

[type]

classmethod from_json(json_str: str)[源代码]

Build a node from JSON string.

参数

json_str (str) -- JSON string formatted by TermTree data.

返回

TermTree node object.

返回类型

[type]

class TermTree[源代码]

基类:object

TermTree class.

add_term(term: Optional[str] = None, base: Optional[str] = None, term_type: Optional[str] = None, sub_type: Optional[List[str]] = None, sub_term: Optional[List[str]] = None, alias: Optional[List[str]] = None, alias_ext: Optional[List[str]] = None, data: Optional[Dict[str, Any]] = None)[源代码]

Add a term into TermTree.

参数
  • term (str) -- common name of name.

  • base (str) -- term is concept or entity.

  • term_type (str) -- term type of this term

  • sub_type (Optional[List[str]], optional) -- sub type of this term, must exists in TermTree. Defaults to None.

  • sub_terms (Optional[List[str]], optional) -- sub terms of this term. Defaults to None.

  • alias (Optional[List[str]], optional) -- alias of this term. Defaults to None.

  • alias_ext (Optional[List[str]], optional) -- . Defaults to None.

  • data (Optional[Dict[str, Any]], optional) -- [description]. Defaults to None.

find_term(term: str, term_type: Optional[str] = None)Tuple[bool, Optional[List[str]]][源代码]

Find a term in Term Tree. If term not exists, return None. If term_type is not None, will find term with this type.

参数
  • term (str) -- term to look up.

  • term_type (Optional[str], optional) -- find term in this term_type. Defaults to None.

返回

[description]

返回类型

Union[None, List[str]]

build_from_dir(term_schema_path, term_data_path, linking=True)[源代码]

Build TermTree from a directory which should contain type schema and term data.

参数

dir ([type]) -- [description]

classmethod from_dir(term_schema_path, term_data_path, linking)paddlenlp.taskflow.utils.TermTree[源代码]

Build TermTree from a directory which should contain type schema and term data.

参数

source_dir ([type]) -- [description]

返回

[description]

返回类型

TermTree

save(save_dir)[源代码]

Save term tree to directory save_dir

参数

save_dir ([type]) -- Directory.