Mi85 SSKrSSKJr SSKJrJrJrJrJrJ r J r J r SSK r SSK Jr SSKJr SSKJr SSKJr SS KJr SS KJr SS KJrJr SS KJrJr SS KJ r SSKJ!r! SSK"J#r# SSK$J%r% \\\ \&\'4\4r(\\'\ \\(\(\\&44r)\\'\\ \&\'4\ \&\'444r*\\'\\'\\ \&\'4\ \&\'4444r+S\\ S\\'\44Sjr,Sr-"SS\%5r.S\/S\ \/\/44Sjr0Sr1g)N)Path)AnyCallableDictIterableListOptionalTupleUnion)util)Errors)Language)Matcher)Scorer)IDS)DocSpan)normalize_token_attrsset_token_attrs)Example)SimpleFrozenList)Vocab)Pipeexamplesreturnc Sn0nUR[R"US40UD65 UR[R"US40UD65 UR[R"US4SU0UD65 UR[R"US4SU0UD65 UR[R"US40UD65 U$)Nc,[X5R$N)getattrkey)tokenattrs w/var/www/eduai.edurigo.com/storigo/production/storigo_env/lib/python3.13/site-packages/spacy/pipeline/attributeruler.pymorph_key_getter/attribute_ruler_score..morph_key_gettersu#'''tagposmorphgetterlemma)updaterscore_token_attrscore_token_attr_per_feat)rkwargsr&resultss r%attribute_ruler_scorer3s(G NN6**8UEfEF NN6**8UEfEF NN'U:JUfU NN(( g &6 :@   NN6**8WGGH Nr(c[$r )r3r(r%make_attribute_ruler_scorerr6/s  r(c z\rSrSrSrS'S\S.S\S\S\S\ \ S S 4 S jjjr S(S jr S S S S S .S\ \ /\ \4S\ \S\ \ \S\ \S\ \S S 4 SjjrS\S \4SjrS\4SjrSrS\\\\\\4\\\444S S 4SjrS\\\\\\\\4\\\4444S S 4SjrS)S\ \S\S\S S 4SjjrS\ \S S 4Sjr\ S \!\4Sj5r"\#"54S\ \S \$4S jjr%\#"54S!\$S\ \S S4S"jjr&\#"54S#\\'\4S\ \S S 4S$jjr(\#"54S#\\'\4S\ \S S4S%jjr)S&r*g )*AttributeRuler3zSet token-level attributes for tokens matched by Matcher patterns. Additionally supports importing patterns from tag maps and morph rules. DOCS: https://spacy.io/api/attributeruler F)validatescorervocabnamer:r;rNcX lXl[URUS9UlX0l/Ul/Ul/UlX@lg)aCreate the AttributeRuler. After creation, you can add patterns with the `.initialize()` or `.add_patterns()` methods, or load patterns with `.from_bytes()` or `.from_disk()`. Loading patterns will remove any patterns you've added previously. vocab (Vocab): The vocab. name (str): The pipe name. Defaults to "attribute_ruler". scorer (Optional[Callable]): The scoring method. Defaults to Scorer.score_token_attr for the attributes "tag", "pos", "morph" and "lemma" and Scorer.score_token_attr_per_feat for the attribute "morph". RETURNS (AttributeRuler): The AttributeRuler component. DOCS: https://spacy.io/api/attributeruler#init r:N) r=r<rmatcherr:attrs_attrs_unnormedindicesr;)selfr<r=r:r;s r%__init__AttributeRuler.__init__:s@0  tzzH=  !# +-"$  r(ct[URURS9Ul/Ul/Ul/Ulg)zReset all patterns.r?N)rr<r:r@rArBrCrDs r%clearAttributeRuler.clear[s.tzzDMMB  ! r()nlppatternstag_map morph_rules get_examplesrKrLrMrNcUR5 U(aURU5 U(aURU5 U(aURU5 gg)zInitialize the attribute ruler by adding zero or more patterns. Rules can be specified as a sequence of dicts using the `patterns` keyword argument. You can also provide rules using the "tag map" or "morph rules" formats supported by spaCy prior to v3. N)rI add_patternsload_from_tag_mapload_from_morph_rules)rDrOrKrLrMrNs r% initializeAttributeRuler.initializebsE    h '   " "7 +   & &{ 3 r(doccUR5nURU5nURX5 U$![anU"URX/U5sSnA$SnAff=f)zApply the AttributeRuler to a Doc and set all attribute exceptions. doc (Doc): The document to process. RETURNS (Doc): The processed Doc. DOCS: https://spacy.io/api/attributeruler#call N)get_error_handlermatchset_annotations Exceptionr=)rDrV error_handlermatcheses r%__call__AttributeRuler.__call__ys\..0  <jjoG   .J < D%; ; !%!3!3E!:g --11%.A!%!3!3E!:g HHgY &*r(cUHnXHnX2S./nXUn[U5upVSU;aEURRRUS5nURRUUS'OHU(aAURRRU5nURRUUS'URU/U5 M M g)aLoad attribute ruler patterns from morph rules. morph_rules (dict): The morph rules that map token text and fine-grained tags to coarse-grained tags, lemmas and morphological features. DOCS: https://spacy.io/api/attributeruler#load_from_morph_rules )ORTHr{r|N)r~r<rrre)rDrNr)wordrrArr+s r%rS$AttributeRuler.load_from_morph_rulessC#($(56#(.%7%>"e# JJ1155eGnEE%)ZZ%7%7%>E'N  JJ1155kBE%)ZZ%7%7%>E'N'E*)r(rArmc[[UR55nURR UR R R U5U5 URRU5 [UR U5nURRU5 URRU5 g)aAdd Matcher patterns for tokens that should be modified with the provided attributes. The token at the specified index within the matched span will be assigned the attributes. patterns (Iterable[List[Dict]]): A list of Matcher patterns. attrs (Dict): The attributes to assign to the target token in the matched span. index (int): The index of the token in the matched span to modify. May be negative to index from the end of the span. Defaults to 0. DOCS: https://spacy.io/api/attributeruler#add N) strlenrAr@rr<rerBappendrrC)rDrLrArmr"s r%rAttributeRuler.adds"#djj/" ++//4h? ##E*%djj%8 %  E"r(c:UHnUR"S0UD6 M g)a3Add patterns from a list of pattern dicts with the keys as the arguments to AttributeRuler.add. patterns (Iterable[dict]): A list of pattern dicts with the keys as the arguments to AttributeRuler.add (patterns/attrs/index) to add as patterns. DOCS: https://spacy.io/api/attributeruler#add_patterns Nr5)r)rDrLps r%rQAttributeRuler.add_patternssA HHMqMr(c/n[[UR55Hdn0nURR [ U55SUS'UR UUS'URUUS'URU5 Mf U$)zAll the added patterns.rrLrArm) rangerrAr@rrrrBrCr)rD all_patternsirs r%rLAttributeRuler.patternss s4::'AA LL,,SV4Q7AjM--a0AgJaAgJ    " ( r(excludec^^^0nUU4SjUS'U4SjUS'[R"UT5$)zSerialize the AttributeRuler to a bytestring. exclude (Iterable[str]): String names of serialization fields to exclude. RETURNS (bytes): The serialized object. DOCS: https://spacy.io/api/attributeruler#to_bytes c6>TRRTS9$N)r)r<to_bytes)rrDsr%)AttributeRuler.to_bytes..sTZZ%8%8%8%Ir(r<cD>[R"TR5$r )srsly msgpack_dumpsrLrHsr%rrs(;(;DMM(Jr(rL)r r)rDr serializes`` r%rAttributeRuler.to_bytess/ I ' J *}}Y00r( bytes_datacX^^U4SjnUU4SjUS.n[R"XT5 T$)zLoad the AttributeRuler from a bytestring. bytes_data (bytes): The data to load. exclude (Iterable[str]): String names of serialization fields to exclude. returns (AttributeRuler): The loaded object. DOCS: https://spacy.io/api/attributeruler#from_bytes cP>TR[R"U55 gr )rQr msgpack_loads)brDs r% load_patterns0AttributeRuler.from_bytes..load_patternss   e11!4 5r(c8>TRRUTS9$r)r< from_bytes)rrrDs r%r+AttributeRuler.from_bytes..#stzz44Q4Hr(r<rL)r r)rDrrr deserializes` ` r%rAttributeRuler.from_bytess- 6I%   9 r(pathcR^^UU4SjU4SjS.n[R"XT5 g)zSerialize the AttributeRuler to disk. path (Union[Path, str]): A path to a directory. exclude (Iterable[str]): String names of serialization fields to exclude. DOCS: https://spacy.io/api/attributeruler#to_disk c8>TRRUTS9$r)r<to_diskrrrDs r%r(AttributeRuler.to_disk..4stzz11!W1Er(cF>[R"UTR5$r )r write_msgpackrLrrDs r%rr5s%"5"5a"Gr(rN)r r)rDrrrs` ` r%rAttributeRuler.to_disk)s#FG  Tg.r(cX^^U4SjnUU4SjUS.n[R"XT5 T$)aLoad the AttributeRuler from disk. path (Union[Path, str]): A path to a directory. exclude (Iterable[str]): String names of serialization fields to exclude. RETURNS (AttributeRuler): The loaded object. DOCS: https://spacy.io/api/attributeruler#from_disk cP>TR[R"U55 gr )rQr read_msgpackrs r%r/AttributeRuler.from_disk..load_patternsEs   e003 4r(c8>TRRUTS9$r)r< from_diskrs r%r*AttributeRuler.from_disk..Istzz33Aw3Gr(r)r r)rDrrrrs` ` r%rAttributeRuler.from_disk9s- 5H%  t'2 r()rBrArCr@r=r;r:r<)attribute_ruler)rN)r)+__name__ __module__ __qualname____firstlineno____doc__r3rrboolr rrErIrrrAttributeRulerPatternType TagMapTypeMorphRulesTyperTrr_rYrZrr rdrRrSMatcherPatternTyperrQpropertyrrLrbytesrrrrr__static_attributes__r5r(r%r8r83s& %:    "  B#'BF(,044xHW,=(=>?4h  4 8$=>? 4 *% 4n-4 4.tfE FFr()2rpathlibrtypingrrrrrr r r rr errorsrlanguagerr@rr;rsymbolsrtokensrrtokens._retokenizerrtrainingrrr<rpiperrdrrrrrr3r6r8dictr~rr5r(r%rs4NNN G#$uS#X345 t&');T3F GG#tE#s(OU38_<== > c4T%S/5c?*J%K KLLMHW$5DcN&!ZTZz $d $uT4Z'8 $Gr(