MiX/ %SrSSKJrJrJrJrJrJr SSKJ r /SQr Sr 0r \\ \4\S'"SS5r"S S \5r"S S \5r"S S\5rS\ S\S\\4SjrS\\S\S\S\\4SjrS\\ \44Sjrg)z] emoji.tokenizer ~~~~~~~~~~~~~~~ Components for detecting and tokenizing emoji in strings. )List NamedTupleDictUnionIteratorAny) unicode_codes) EmojiMatch EmojiMatchZWJEmojiMatchZWJNonRGITokentokenize filter_tokensu‍ _SEARCH_TREEc \rSrSrSrSrS\S\S\S\\ \\ 4S44S jr S \ \\ 44S jr S \ 4S jrS \S 4SjrS \4SjrSrg)r zX Represents a match of a "recommended for general interchange" (RGI) emoji in a string. emojistartenddatarrrrNc:XlX lX0lX@lgNr)selfrrrrs i/var/www/eduai.edurigo.com/storigo/production/storigo_env/lib/python3.13/site-packages/emoji/tokenizer.py__init__EmojiMatch.__init__"s$ ! 86 breturncUR(a:URR5nURUS'URUS'U$URURS.$)z Returns a copy of the data from :data:`EMOJI_DATA` for this match with the additional keys ``match_start`` and ``match_end``. match_start match_end)r!r")rcopyrr)remj_datas r data_copyEmojiMatch.data_copy1sO 99yy~~'H&*jjH] #$(HHH[ !O#'::DHHE Erc([UR;$)zX Checks if this is a ZWJ-emoji. :returns: True if this is a ZWJ-emoji, False otherwise )_ZWJrrs ris_zwjEmojiMatch.is_zwj>stzz!!r)r r cFUR5(a [U5$U$)z Splits a ZWJ-emoji into its constituents. :returns: An :class:`EmojiMatchZWJ` containing the "sub-emoji" if this is a ZWJ-emoji, otherwise self )r*r r)s rsplitEmojiMatch.splitGs ;;== & &KrcURRSURSURSURS3$N(z, :)) __class____name__rrrr)s r__repr__EmojiMatch.__repr__Ss9..))*!DJJ F"" u:; S#Srr cl^\rSrSrSrSrS\4U4SjjrS\4Sjr S\ 4Sjr S S jr S\4S jr SrU=r$) r Wzj Represents a match of multiple emoji in a string that were joined by zero-width-joiners (ZWJ/``\u200D``).)emojismatchc >[TU]URURURUR 5 /UlURnURR[5Hfn[X2U[U5-[RRUS55nUR RU5 U[U5S-- nMh g)N)superrrrrrrDr-r(r lenr EMOJI_DATAgetappend)rrEiemr4s rrEmojiMatchZWJ.__init__^s ekk599ejjI(* 5 KK""4(A1SV]-E-E-I-I!T-RSA KK  q ! Q!OA)rrcN[RSUR55$)z! Joins a ZWJ-emoji into a string c38# UHoRv M g7frr.0rNs r %EmojiMatchZWJ.join..os6+Q+)r(joinrDr)s rrYEmojiMatchZWJ.joinjs yy6$++666rcg)NTrAr)s rr*EmojiMatchZWJ.is_zwjqsrcU$rrAr)s rr-EmojiMatchZWJ.splitts rcURRSUR5SURSURS3$r0)r4r5rYrrr)s rr6EmojiMatchZWJ.__repr__ws;..))*!DIIK=4::,azQRSSr)rr )r5r8r9r:r;r<r rr=rYr?r*r-r6r@ __classcell__)r4s@rr r WsL-I j 7c7T#TTrr c>\rSrSrSrS\S\4SjrSrS\4SjrS r g ) r {a  Represents a match of multiple emoji in a string that were joined by zero-width-joiners (ZWJ/``\u200D``). This class is only used for emoji that are not "recommended for general interchange" (non-RGI) by Unicode.org. The data property of this class is always None. first_emoji_matchsecond_emoji_matchc6X/UlUR5 gr)rD_update)rrdres rrEmojiMatchZWJNonRGI.__init__s(= 5 rc[RSUR55UlURSRUlURSR UlSUlg)Nc38# UHoRv M g7frrSrTs rrV.EmojiMatchZWJNonRGI._update..s< 1ww rXr)r(rYrDrrrrr)s rrgEmojiMatchZWJNonRGI._updatesMYY< << [[^)) ;;r?&& rnext_emoji_matchcZURRU5 UR5 gr)rDrLrg)rrns r_addEmojiMatchZWJNonRGI._adds +, r)rrrDrrN) r5r8r9r:r;r rrgrpr@rArrr r {s+**  Zrr c8\rSrSr%Sr\\S'\\\4\S'Sr g)r z A named tuple containing the matched string and its :class:`EmojiMatch` object if it is an emoji or a single character that is not a unicode emoji. charsvaluerAN) r5r8r9r:r;r=__annotations__rr r@rArrr r s J j !!rr stringkeep_zwjrc## [5n[Rn/nSn[U5n/nXV:GaSnXn XW;a2US- nU [:Xa!U(aUR [ X55 MCX;atUS-n X)n X:a)X U ;a!X;aOXU n U S- n X:a X U ;aM!SU ;a6U Sn XU n [XX5nU S- nSnUR [ X55 OU [:XaU(aUSRU;aUS:aXS- U;aUR U5 X4SRS[RS:Xa3U[S US S 55- nX[:Xa US- nUS O$US S 2 OU[USR5- nUS GMU(a US hvN /nU(d&U S :wa U S :waUR [ X55 US- nXV:aGMUS hvN g NKN7f)a Finds unicode emoji in a string. Yields all normal characters as a named tuple :class:`Token` ``(char, char)`` and all emoji as :class:`Token` ``(chars, EmojiMatch)``. :param string: String contains unicode characters. MUST BE UNICODE. :param keep_zwj: Should ZWJ-characters (``\u200D``) that join non-RGI emoji be skipped or should be yielded as normal characters :return: An iterable of tuples :class:`Token` ``(char, char)`` or :class:`Token` ``(chars, EmojiMatch)`` rFrGrTrlstatus componentc3L# UHn[UR5v M g7fr)rIrt)rUts rrVtokenize..s>+QCLL+s"$Nu︎u️) get_search_treer rJrIr(rLr r rtSTATUSsum)rwrxtreerJresultrMlengthignoreconsumedcharjsub_treer$ code_points match_objs rrrs:  D))JF A [F   *y ; FAt| eD/0  \AAzH*h!6;#1I.Q *h!6 !#F+$qk '{qC E eK;< DLr   J.A1u % MM! ":++,X6 '' 45 >&+>>>9$FAr rs F2J,,--2J    FDH,1A MM%+ , QE *H s1B)H -D H 9H:=H :H ?HH H matches emoji_only join_emojic ## U(dU(d UShvN gU(d$UHnUR[:wdMUv M gSnSnSn/nUGHnUnU(aUR[:XaSnM%[UR[5(Ga9U(GaU(Ga[USR[ 5(afUSRR UR5 [USR[-UR-USR5US'OUR5n[UR[5(deUR[UR[-UR-[ URUR555 OURU5 SnSnGM~SnSnUShvN U(dUv /nGM UShvN gGNN$N 7f)aH Filters the output of `tokenize()` :param matches: An iterable of tuples of the form ``(match_str, result)`` where ``result`` is either an EmojiMatch or a string. :param emoji_only: If True, only EmojiMatch are returned in the output. If False all characters are returned :param join_emoji: If True, multiple EmojiMatch are merged into a single :class:`EmojiMatchZWJNonRGI` if they are separated only by a ZWJ. :return: An iterable of tuples :class:`Token` ``(char, char)``, :class:`Token` ``(chars, EmojiMatch)`` or :class:`Token` ``(chars, EmojiMatchZWJNonRGI)`` NFTrl) rtr(ru isinstancer r rpr poprL) rrrtokenprevious_is_emojiprevious_is_zwjpre_previous_is_emoji accumulatorprevs rrrs" j E{{d"  O!!K 1 !4"O  Z 0 0$k"o335HIIO))..u{{;&+#B--4u{{B#B--'KO '??,D%djj*====&& JJ- ;/ EKKH""5) $ #O!& #O" " " KABa X #s9HG:#HFHG=H4G?5H=H?Hc[(di[RHUn[n[U5S- n[ U5H/up4XA;a0X'XnX2:XdM[RUUS'M1 MW [$)u$ Generate a search tree for demojize(). Example of a search tree:: EMOJI_DATA = {'a': {'en': ':Apple:'}, 'b': {'en': ':Bus:'}, 'ba': {'en': ':Bat:'}, 'band': {'en': ':Beatles:'}, 'bandit': {'en': ':Outlaw:'}, 'bank': {'en': ':BankOfEngland:'}, 'bb': {'en': ':BB-gun:'}, 'c': {'en': ':Car:'}} _SEARCH_TREE = {'a': {'data': {'en': ':Apple:'}}, 'b': {'a': {'data': {'en': ':Bat:'}, 'n': {'d': {'data': {'en': ':Beatles:'}, 'i': {'t': {'data': {'en': ':Outlaw:'}}}}, 'k': {'data': {'en': ':BankOfEngland:'}}}}, 'b': {'data': {'en': ':BB-gun:'}}, 'data': {'en': ':Bus:'}}, 'c': {'data': {'en': ':Car:'}}} _SEARCH_TREE / | ⧵ / | ⧵ a b c | / | ⧵ | | / | ⧵ | :Apple: ba :Bus: bb :Car: / ⧵ | / ⧵ | :Bat: ban :BB-gun: / ⧵ / ⧵ band bank / ⧵ | / ⧵ | bandi :Beatles: :BankOfEngland: | bandit | :Outlaw: rGr)rr rJrI enumerate)emjrlastidxrMrs rrr>sr` < ++C#H#hlG$S>'%'HN#><'4'?'?'DHV$ *, rN)r;typingrrrrrrrr __all__r(rr=rvr r r r r?rrrrArrrs@? ! d38n!:S:Sz!TJ!TH-2"J"XSXDXXe_XvB e_B*.B<@B e_BJ:c3h:r