*ë €'á:c sâdZdkZdkZdkZdkZdkZdklZlZl Z ydk l Z Wn" e j o!dk Z nX#y$dk lZWn&%e j o&dklZnX)deifd„ƒYZ-defd„ƒYZ8d efd „ƒYZEhZLd eifd „ƒYZhegƒZkd „Z”d„Z±deifd„ƒYZödeifd„ƒYZjdeifd„ƒYZgdeifd„ƒYZdS(sœimplement Martel parsers The classes in this module are used by other Martel modules and not typically by external users. There are two major parsers, 'Parser' and 'RecordParser.' The first is the standard one, which parses the file as one string in memory then generates the SAX events. The other reads a record at a time using a RecordReader and generates events after each read. The generated event callbacks are identical. At some level, both parsers use "_do_callback" to convert mxTextTools tags into SAX events. XXX finish this documentation XXX need a better way to get closer to the likely error position when parsing. XXX need to implement Locator N(s xmlreaders _exceptionsshandler(s TextTools(sStringIOsParserExceptioncs)dZ*+RS(s used when a parse cannot be done(s__doc__(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysParserException)s sParserPositionExceptioncs-.d„Z3d„ZRS(Ncs3./ti|0d|1tƒ2||_dS(Ns'error parsing at or beyond character %d(sParserExceptions__init__sselfspossNone(sselfspos((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__init__.s   cs334|i|7_5d|i|_6|SdS(Ns'error parsing at or beyond character %d(sselfspossoffsets_msg(sselfsoffset((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__iadd__3s(s__init__s__iadd__(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysParserPositionException-s sParserRecordExceptioncs8dZ9:RS(s4used by the RecordParser when it can't read a record(s__doc__(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysParserRecordException8s sMartelAttributeListcs‰LMd„ZOd„ZQd„ZSd„ZUd„ZWd„Z\d„Z^d„Z`d „Zbd „Z dd „Z RS( NcsMNdSdS(Ni((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys getLengthMscsOPt|‚dS(N(s IndexErrorsi(sselfsi((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysgetNameOscsQRt|‚dS(N(s IndexErrorsi(sselfsi((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysgetTypeQscsSTt|‚dS(N(s IndexErrorsi(sselfsi((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysgetValueSscsUVdSdS(Ni((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__len__Uscs?WXt|ƒtdƒjoYt|‚n [t|‚dS(Ni(stypeskeys IndexErrorsKeyError(sselfskey((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys __getitem__Wscs\]gSdS(N((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pyskeys\scs^_gSdS(N((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysvalues^scs`agSdS(N((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysitems`scsbcdSdS(Ni((sselfskey((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pyshas_keybscsde|SdS(N(s alternative(sselfskeys alternative((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysgetds( s getLengthsgetNamesgetTypesgetValues__len__s __getitem__skeyssvaluessitemsshas_keysget(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysMartelAttributeListLs          c sKkstx|dtr}u|\}} }}x|| joy|i||| !ƒn,|t o!|| jpt d|| f‚‚|djoƒ|i |t ƒn†|o‡t|| |||ƒn‰|i|| |!ƒŠ|}Œ|djo|i|ƒnqW‘||jo’|i|||!ƒndS(s=internal function to convert the tagtable into ContentHandler events 's' is the input text 'begin' is the current position in the text 'end' is 1 past the last position of the text allowed to be parsed 'taglist' is the tag list from mxTextTools.parse 'cont_handler' is the SAX ContentHandler isbegin = %d and l = %ds>ignoreN(staglistsitemstagslsrssubtagssbegins cont_handlers characterssss __debug__sAssertionErrors startElements_attribute_lists _do_callbacks endElementsend( sssbeginsendstaglists cont_handlersrstagsitemssubtagssl((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys _do_callbackks" +  csï”™š|o›dk}œd|_nžti||dt|ƒƒ\}}}¢|i t ijo¤t|d|||ƒn¦| o/§|o¨t|iƒSnªt|ƒSn)«|t|ƒjo ¬|Sn®tSdS(sÄparse the string with the tagtable and send the ContentHandler events Specifically, it sends the startElement, endElement and characters events but not startDocument and endDocument. Ni(s debug_levelsGenerates _positions TextToolsstagssstagtableslensresultstaglistsposs cont_handlers __class__shandlersContentHandlers _do_callbacksParserPositionExceptionsNone(ssstagtables cont_handlers debug_levelstaglistsGeneratesresultspos((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys_parse_elements”s  *   sParsercs_±dZ²´ddfd„ZÁd„ZÆd„ZÏd„ZÔd„Zód„ZRS( s"Parse the input data all in memoryiicsw´|\}}µtii|ƒ·to#t|ƒtfƒjp t d‚¸||_½||_¿||_dS(Ns(mxTextTools only allows a tuple tagtable( swant_groupref_namess debug_levels xmlreaders XMLReaders__init__sselfs __debug__stypestagtablesAssertionError(sselfstagtables.4swant_groupref_namess debug_level((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__init__´s -  cs6ÁÂtƒ}Ãti|i|ƒÄ|iƒSdS(N(sStringIOsxspprintsselfstagtablesgetvalue(sselfsx((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__str__Ás cs ÆËÍ|i|iƒƒdS(s“parse using the input file object XXX will be removed with the switch to Python 2.0, where parse() takes an 'InputSource' N(sselfs parseStringsfileobjsread(sselfsfileobj((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseFileÆscs#ÏÐÒ|iti|ƒƒdS(sparse using the URLN(sselfs parseFilesurllibsurlopenssystemId(sselfssystemId((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysparseÏscsÒÔÙÚ|iiƒÜ|ioÝtiƒnàt||i|iá|i ƒ}ã|t joånPçt |t iƒoé|ii|ƒn#í|}î|iit|ƒƒñ|iiƒdS(sŽparse using the given string XXX will be removed with the switch to Python 2.0, where parse() takes an 'InputSource' N(sselfs _cont_handlers startDocumentswant_groupref_namess _match_groupsclears_parse_elementsssstagtables debug_levelsresultsNones isinstances _exceptionss SAXExceptions _err_handlers fatalErrorspossParserPositionExceptions endDocument(sselfssspossresult((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseStringÔs  cs óôdS(N((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pyscloseós(s__doc__s__init__s__str__s parseFilesparses parseStringsclose(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysParser±s    s RecordParsercsYödZ÷øfd„Zd„Zd„ZWd„Z\d„Zfd„ZRS(s'Parse the input data a record at a timecsžø|\}}tii|ƒ ||_ to#t|ƒtfƒjp t d‚ ||_  ||_||_||_ ||_ dS(s.parse the input data a record at a time format_name - XML tag name for the whole data file record_tagtable - mxTexTools tag table for each record want_groupref_names - flag to say if the match_group table needs to be reset (will disappear with better support from mxTextTools) make_reader - callable object which creates a RecordReader; first parameter will be an input file object reader_args - optional arguments to pass to make_reader after the input file object s(mxTextTools only allows a tuple tagtableN(swant_groupref_namess debug_levels xmlreaders XMLReaders__init__sselfs format_names __debug__stypesrecord_tagtablesAssertionErrorstagtables make_readers reader_args(sselfs format_namesrecord_tagtables.6s make_readers reader_argsswant_groupref_namess debug_level((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__init__øs -    cs:tƒ}ti|i|ƒd|iƒSdS(Nsparse records: (sStringIOsxspprintsselfstagtablesgetvalue(sselfsx((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__str__s cs·|iiƒy# t|i|f|iƒ}Wn!tt fj o "‚nm#&t ƒ}'t i d|ƒ(|iit|iƒtiƒdƒƒ*|iiƒ+dSnX-|io.tiƒn0|ii|itƒ1d}2x{2dop3y4|iƒ}Wn5tt fj o 6‚nm7:t ƒ};t i d|ƒ<|iit|iƒtiƒdƒƒ>|iiƒ?dSnXA|tjoBPnCt||i |iD|i!ƒ}F|tjoHnaIt#|t$i%ƒo$K||7}L|ii&|ƒn'O||}P|ii&t(|ƒƒR|t)|ƒ}qWT|ii*|iƒU|iiƒdS(s“parse using the input file object XXX will be removed with the switch to Python 2.0, where parse() takes an 'InputSource' sfileiNi(+sselfs _cont_handlers startDocumentsapplys make_readersfileobjs reader_argssreadersKeyboardInterrupts SystemExitsStringIOsoutfiles tracebacks print_excs _err_handlers fatalErrorsParserRecordExceptionsgetvaluessyssexc_infos endDocumentswant_groupref_namess _match_groupsclears startElements format_names_attribute_listsfilepossnextsrecordsNones_parse_elementsstagtables debug_levelsresults isinstances _exceptionss SAXExceptionserrorspossParserPositionExceptionslens endElement(sselfsfileobjsreadersrecordsresultsoutfilespossfilepos((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseFilesT#  ,      ,   cs#WXZ|iti|ƒƒdS(sparse using the URLN(sselfs parseFilesurllibsurlopenssystemId(sselfssystemId((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysparseWscs)\act|ƒ}d|i|ƒdS(sŽparse using the given string XXX will be removed with the switch to Python 2.0, where parse() takes an 'InputSource' N(sStringIOsssstrfilesselfs parseFile(sselfsssstrfile((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseString\scs fgdS(N((sself((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysclosefs(s__doc__s__init__s__str__s parseFilesparses parseStringsclose(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys RecordParserös   @  sHeaderFooterParsercsJjdZkld„Z„d„ZŠd„ZŽd„Z‘d„ZRS(s9Header followed by 0 or more records followed by a footerc s¶l| \} } qtii|ƒs||_u||_v||_w||_ y||_ z||_ {||_ }||_ ~| |_| |_| |_‚| |_dS(N(swant_groupref_namess debug_levels xmlreaders XMLReaders__init__sselfs format_namesmake_header_readersheader_reader_argssheader_tagtables make_readers reader_argssrecord_tagtablesmake_footer_readersfooter_reader_argssfooter_tagtable(sselfs format_namesmake_header_readersheader_reader_argssheader_tagtables make_readers reader_argssrecord_tagtablesmake_footer_readersfooter_reader_argssfooter_tagtables.22swant_groupref_namess debug_level((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__init__ls           csL„…tƒ}†ti|i|i|if‡|ƒˆd|iƒSdS(Nsheader footer records: (sStringIOsxspprintsselfsheader_tagtablesrecord_tagtablesfooter_tagtablesgetvalue(sselfsx((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__str__„s  cs&Š‹t|ƒ}Œ|i|ƒdS(N(sStringIOsssstrfilesselfs parseFile(sselfsssstrfile((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseStringŠscs Ž|iti|ƒƒdS(N(sselfs parseFilesurllibsurlopenssystemID(sselfssystemID((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysparseŽscsn‘’|iiƒ“|ii|itƒ•|io–tiƒn™|i t j o¡šy5›t |i œ|f|i ƒ}|iƒ} Wnžttfj o Ÿ‚nm £tƒ} ¤tid| ƒ¥|iit| iƒtiƒdƒƒ§|iiƒ¨dSnX«| t jo ¬d} n®t| |i¯|i|i ƒ}±|t jo³n~´t"|t#i$ƒo.¶|ii|ƒ·|iiƒ¸dSn:»|} ¼|iit&| ƒƒ½|iiƒ¾dSnÃ|i t joÄ|df\}} nÆ|i)ƒ\}} Éy2Êt |i*|f|i+Ëh| d<ƒ}WnÌttfj o Í‚nmÎÑtƒ} Òtid| ƒÓ|iit| iƒtiƒdƒƒÕ|iiƒÖdSnXØ| t jo Ùd}nÛt.| ƒ}Ýt }ÞxëÞdoàßyà|iƒ}Wn|ãttfj o ä‚n\åétƒ} êtid| ƒët| iƒìtiƒdƒ}ít }îPnXð|t joòPnôt||i1õ|i|i ƒ}÷|t joùnâþ|i2t j oWt"|t#i$ƒo ||7}|t f}nt&||ƒt f}Pnx t"|t#i$ƒo; t"|t&ƒo||7}n|ii3|ƒn'||} |ii3t&| ƒƒ|t.|ƒ}q?W|i)ƒ\}}  |t j o#|| } n%|i2t j op'yD(t |i2)|f|i4*h| d<ƒ}+|iƒ} WnË,ttfj o -‚n«.2|t j o.3|ii|ƒ4|iiƒ5dSn8tƒ} 9tid| ƒ:|iit| iƒtiƒdƒƒ<|iiƒ=dSnX?| t jo @d} nBt| |i6C|i|i ƒ}E|t joGnëH|t j o.I|ii|ƒJ|iiƒKdSn­Lt"|t#i$ƒoYMt"|t&ƒoN|||i%7}nO|ii|ƒP|iiƒQdSn>T||} U|iit&| ƒƒV|iiƒWdSZ|i)ƒ\}} n\| p |i7dƒoG]|t.| ƒ} ^|iit&| ƒƒ_|iiƒ`dSnc|ii8|iƒd|iiƒdS(Nsfileiss lookaheadi(9sselfs _cont_handlers startDocuments startElements format_names_attribute_listswant_groupref_namess _match_groupsclearsmake_header_readersNonesapplysfileobjsheader_reader_argss header_readersnextsheadersKeyboardInterrupts SystemExitsStringIOsoutfiles tracebacks print_excs _err_handlers fatalErrorsParserRecordExceptionsgetvaluessyssexc_infos endDocuments_parse_elementssheader_tagtables debug_levelsresults isinstances _exceptionss SAXExceptionspossParserPositionExceptionsxs lookaheads remainders make_readers reader_argssreadersfileposslensrecord_exc_infosrecordsrecord_tagtablesmake_footer_readerserrorsfooter_reader_argssfootersfooter_tagtablesreads endElement(sselfsfileobjsxsrecord_exc_infosreadersfileposs header_readersresultsrecordsheaderspossfootersoutfiles lookahead((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseFile‘s    ,       ,              ,      (s__doc__s__init__s__str__s parseStringsparses parseFile(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysHeaderFooterParserjs     csJgdZhid„Zd„Z‡d„Z‹d„ZŽd„ZRS(s9Header followed by 0 or more records followed by a footerc s¶i| \} } ntii|ƒp||_r||_s||_t||_ v||_ w||_ x||_ z||_ {| |_|| |_~| |_| |_dS(N(swant_groupref_namess debug_levels xmlreaders XMLReaders__init__sselfs format_namesmake_header_readersheader_reader_argssheader_tagtables make_readers reader_argssrecord_tagtablesmake_footer_readersfooter_reader_argssfooter_tagtable(sselfs format_namesmake_header_readersheader_reader_argssheader_tagtables make_readers reader_argssrecord_tagtablesmake_footer_readersfooter_reader_argssfooter_tagtables.22swant_groupref_namess debug_level((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__init__is           csL‚tƒ}ƒti|i|i|if„|ƒ…d|iƒSdS(Nsheader footer records: (sStringIOsxspprintsselfsheader_tagtablesrecord_tagtablesfooter_tagtablesgetvalue(sselfsx((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys__str__s  cs&‡ˆt|ƒ}‰|i|ƒdS(N(sStringIOsssstrfilesselfs parseFile(sselfsssstrfile((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseString‡scs ‹Œ|iti|ƒƒdS(N(sselfs parseFilesurllibsurlopenssystemID(sselfssystemID((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysparse‹scsÒ Ž|iiƒ|ii|itƒ’|io“tiƒn–d}—d}˜|i t j oÀ™y5št |i ›|f|iƒ} œ| iƒ}Wn™ttfj o ž‚nyŸ¡tƒ} ¢tid| ƒ£t| iƒ¤tiƒdƒ}¥|ii|ƒ¦|ii ƒ§dSnXª|t jo «d}n¬|t!|ƒ7}®t"||i#¯|i|i$ƒ}°|t jo²n~³t&|t'i(ƒo.µ|ii|ƒ¶|ii ƒ·dSn:º|} »|iit*| ƒƒ¼|ii ƒ½dSnÂ|i t joÃ|df\} }nÅ| i,ƒ\} }Ç|i-t joxÉy2Êt |i.|f|i/Ëh|d<ƒ}Wn™Ìttfj o Í‚nyÎÑtƒ} Òtid| ƒÓt| iƒÔtiƒdƒ}Õ|ii|ƒÖ|ii ƒ×dSnXÙxÙdo’ÚyÛ|iƒ}Wn™Üttfj o Ý‚nyÞàtƒ} átid| ƒât| iƒãtiƒdƒ}ä|ii|ƒå|ii ƒædSnXè|t jo1ê|ii2|iƒë|ii ƒìdSnît"||i3ï|i|i$ƒ}ð|t joònNõt&|t'i(ƒoö||7}nøt*||ƒ}ù|ii4|ƒû|t!|ƒ7}qZWnýt5o|i-t j p t6d‚t }y2t |i.|f|i/h|d<ƒ}Wnottfj o ‚nO  tƒ}  tid| ƒt| iƒtiƒdƒ}nXx#|t joy|iƒ}Wnsttfj o ‚nStƒ} tid| ƒt| iƒtiƒdƒ}PnX|t jo!t*|ƒ}"Pn$t"||i3%|i|i$ƒ}&|t jo(n,t&|t'i(ƒo-||7}n/t*||ƒ}0|}3yf4d} 5|i,ƒ\} }6t |i-7|f|i98h||d<ƒ}9|iƒ} Wn:ttfj o ;‚nî<?|ii4|ƒ@t }C|i,ƒ\} }Dy9Et |i.F|f|i/Gh| |d<ƒ}WnsHttfj o I‚nSJMtƒ} Ntid| ƒOt| iƒPtiƒdƒ}QPnXnXWt"| |i;X|i|i$ƒ}Z|t jo§]|i,ƒ\} }^|p | i<dƒoG`t*|t!| ƒƒ}b|ii|ƒc|ii ƒddSnf|ii2|iƒg|ii ƒhdSnvl|i,ƒ\} }mt |i.n|f|i/oh| |d<ƒ}p|iƒ}q|ii4|ƒrt }t|t!|ƒ7}qÕWx|i,ƒ\} }yyDzt |i-{|f|i9|h|d<ƒ}}|iƒ} WnU~ttfj o ‚n5€‚|ii|ƒƒ|ii ƒ„dSnX†| t jo ‡d} nˆt"| |i;‰|i|i$ƒ}Š|t jo§|i,ƒ\} }Ž|p | i<dƒoGt*|t!| ƒƒ}’|ii|ƒ“|ii ƒ”dSn–|ii2|iƒ—|ii ƒ˜dSn+›|ii|ƒœ|ii ƒdSdS(Nissfileis lookaheadsinternal error(=sselfs _cont_handlers startDocuments startElements format_names_attribute_listswant_groupref_namess _match_groupsclearsfileposs lookaheadsmake_header_readersNonesapplysfileobjsheader_reader_argss header_readersnextsheadersKeyboardInterrupts SystemExitsStringIOsoutfiles tracebacks print_excsParserRecordExceptionsgetvaluessyssexc_infosexcs _err_handlers fatalErrors endDocumentslens_parse_elementssheader_tagtables debug_levelsresults isinstances _exceptionss SAXExceptionspossParserPositionExceptionsxs remaindersmake_footer_readers make_readers reader_argssreadersrecords endElementsrecord_tagtableserrors __debug__sAssertionErrors record_excsfootersfooter_reader_argss footer_readersfooter_tagtablesread(sselfsfileobjs footer_readersreadersrecordsexcsheaders remaindersresultsoutfilespossfootersxs header_readers record_excsfileposs lookahead((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys parseFileŽsz                   $                        (s__doc__s__init__s__str__s parseStringsparses parseFile(((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pysHeaderFooterParsergs     (s__doc__surllibspprints tracebackssyssstringsxml.saxs xmlreaders _exceptionsshandlersmxs TextToolss ImportErrors cStringIOsStringIOs SAXExceptionsParserExceptionsParserPositionExceptionsParserRecordExceptions _match_groupsAttributesImplsMartelAttributeLists_attribute_lists _do_callbacks_parse_elementss XMLReadersParsers RecordParsersHeaderFooterParser(spprints _exceptionss TextToolss _do_callbacks tracebackshandlers RecordParsersParserExceptionsurllibsParsersHeaderFooterParsersParserRecordExceptionsStringIOssyss _match_groups_attribute_listsMartelAttributeListsParserPositionExceptions xmlreaders_parse_elementssstring((s7/mit/seven/lib/python2.1/site-packages/Martel/Parser.pys?s, 0   ) Etý