+ R$$$ Y$$$s 5A A9 c VP4VP\P4VP \P 4VP \P 4VP \P4VP \P4VP \P4VP \P4VP \P4VP \P4VP \P4R#)zdInitialize the lexer with default dictionaries. Useful if you need to revert custom syntax settings.N)clear set_SQL_REGEXr SQL_REGEX add_keywordsKEYWORDS_COMMONKEYWORDS_ORACLEKEYWORDS_MYSQLKEYWORDS_PLPGSQL KEYWORDS_HQLKEYWORDS_MSACCESSKEYWORDS_SNOWFLAKEKEYWORDS_BIGQUERYKEYWORDSselfs&rr Lexer.default_initialization9s  8--. (223 (223 (112 (334 (//0 (445 (556 (445 (++,c ".Vn.VnR#)zClear all syntax configurations. Useful if you want to load a reduced set of syntax configurations. After this call, regexps and keyword dictionaries need to be loaded to make the lexer functional again.N _SQL_REGEX _keywordsrs&rr Lexer.clearHs r"c \P\P,pVUUu.uF'wr4\P!W24PV3NK) uppVnR#uuppi)z.Set the list of regex that will parse the SQL.N)re IGNORECASEUNICODEcompilematchr%)r rFLAGSrxtts&& rrLexer.set_SQL_REGEXPsP  *$ #ZZ " ( (" -#  s-A#c <VPPV4R#)z`Add keyword dictionaries. Keywords are looked up in the same order that dictionaries were added.N)r&append)r rs&&rrLexer.add_keywordsXs h'r"c VP4pVPFpW#9gK W2,V3u# \PV3#)zChecks for a keyword. If the given value is in one of the KEYWORDS_* dictionary it's considered a keyword. Otherwise, tokens.Name is returned. )upperr&rName)r valuevalkwdicts&& r is_keywordLexer.is_keyword]s@ kkmnnF}{E))%;;% %r"c# "\V\4'dVP4p\V\4'dM[\V\4'd.V'dVP V4pM+VP R4pM\R\V4: 24h\P!V4pVPp\V4pVEFwrgWd9d<VPV4pVe'VwrWWi3x\WYV, ^, 4KGVPFwrV !W4p V 'gK\V \ P"4'dWP%43xM5V \P&Jd"VP)V P%44x\W]P+4V, ^, 4K \ P,V3xEK R# \ dTP R4pELhi;i5i)as Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez'Expected text or file-like object, got N) isinstancerreadstrbytesdecodeUnicodeDecodeError TypeErrortyperfind_delimited_spansopeners enumerateresolverr%r _TokenTypegroupPROCESS_AS_KEYWORDr;endError)r textencodingdelimited_spans span_openersiterableposcharresolvedrMttyperexmatchactionms&&& r get_tokensLexer.get_tokensjs dJ ' '99;D dC  e $ ${{8,9;;w/DEd4j^TU U"77=&.. T?!IC "*2237'!)JCc..HCi!m4$(OO T'(9(9:: '')++x::://!'')44%%'C-!"34%4llD((5"*9;;'78D9s1AHH1G$E"H$HHHHr$N)__name__ __module__ __qualname____firstlineno____doc__r rr classmethodrr rrrr;r[__static_attributes____classdictcell__) __classdict__s@rrrsQN FE(%% - ( &;);)r"rcH\P4PW4#)zuTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )rrr[)sqlrPs&&rtokenizeris  % % ' 2 23 AAr"r]) rbr)ior threadingrsqlparserrsqlparse.utilsrrrir"rros. %"O)O)dBr"