"Ic@s(dZdZddkZddkZddkZddkZddkZddklZddk l Z ddk l Z ddk l Z dd klZdd klZdd klZdd klZed ZdZdZdZdefdYZdefdYZdZdS(sRefactoring framework. Used as a main program, this can refactor any number of files and/or recursively descend down directories. Imported as a module, this provides infrastructure to write your own refactoring tool. s#Guido van Rossum iN(t defaultdict(tchaini(tdriver(ttokenize(tpytree(tpatcomp(tfixes(tpygramcCst|ggdg}tii|i}g}ti|}|ixX|D]P}|ido:|ido*|o|d}n|i |d qSqSW|S(sEReturn a sorted list of all available fix names in the given package.t*tfix_s.pyii( t __import__tostpathtdirnamet__file__tlistdirtsortt startswithtendswithtappend(t fixer_pkgt remove_prefixtpkgt fixer_dirt fix_namestnamestname((s-/mit/python/lib/python2.6/lib2to3/refactor.pytget_all_fix_names"s  cCst|titifot|igSt|tio&|iot|iStdgSt|ti oFt}x5|iD]*}x!|D]}|i t|qWqW|St d|dS(sf Accepts a pytree Pattern Node and returns a set of the pattern types which will match first. s$Oh no! I don't understand pattern %sN( t isinstanceRt NodePatternt LeafPatterntsetttypetNegatedPatterntcontenttget_head_typestNonetWildcardPatterntupdatet Exception(tpattrtptx((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR#0s   cCsntt}x[|D]S}|ip|di|qnx(t|iD]}||i|qKWqW|S(s^ Accepts a list of fixers and returns a dictionary of head node type --> fixer list. N(RtlisttpatternR$RR#(t fixer_listt head_nodestfixertt((s-/mit/python/lib/python2.6/lib2to3/refactor.pytget_headnode_dictIs  cCs0g}t|tD]}||d|q~S(sN Return the fully qualified names for fixers in the package pkg_name. t.(RtFalse(tpkg_namet_[1]tfix_name((s-/mit/python/lib/python2.6/lib2to3/refactor.pytget_fixers_from_packageUst FixerErrorcBseZdZRS(sA fixer could not be loaded.(t__name__t __module__t__doc__(((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR9]stRefactoringToolcBseZhed6ZdZdZdddZdZdZ dZ dZ dZ eed Z eed Zeed Zd Zed ZdZdZdedZddZdZdZdZdZdZdZdZdZRS(tprint_functiontFixR cCs||_|pg|_|ii|_|dj o|ii|ng|_ti d|_ g|_ t |_ |idotiid=ntitidtid|i |_|i\|_|_t|i|_t|i|_g|_dS(sInitializer. Args: fixer_names: a list of fixers to import options: an dict with configuration. explicit: a list of fixers to run even if they are explicit. R=R>tprinttconverttloggerN(tfixerstexplicitt_default_optionstcopytoptionsR$R&terrorstloggingt getLoggerRBt fixer_logR4twroteRtpython_grammartkeywordsRtDriverRRAt get_fixerst pre_ordert post_orderR2tfiles(tselft fixer_namesRGRD((s-/mit/python/lib/python2.6/lib2to3/refactor.pyt__init__hs$      c Csg}g}x|iD]}t|hhdg}|iddd}|i|io|t|i}n|id}|idig}|D]}||i q~} yt || } Wn)t j ot d|| fnX| |i |i} | io7|itj o'||ijo|id|qn|id || id jo|i| q| id jo|i| qt d | iqWtid } |id| |id| ||fS(sInspects the options to load the requested patterns and handlers. Returns: (pre_order, post_order), where pre_order is the list of fixers that want a pre-order AST traversal, and post_order is the list that want post-order traversal. RR3iit_tsCan't find %s.%ssSkipping implicit fixer: %ssAdding transformation: %stpretpostsIllegal fixer order: %rt run_ordertkey(RCR trsplitRt FILE_PREFIXtlentsplitt CLASS_PREFIXtjointtitletgetattrtAttributeErrorR9RGRKRDtTruet log_messaget log_debugtorderRtoperatort attrgetterR( RTtpre_order_fixerstpost_order_fixerst fix_mod_pathtmodR7tpartsR6R*t class_namet fix_classR0tkey_func((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRPs: 7cOsdS(sCalled when an error occurs.N((RTtmsgtargstkwds((s-/mit/python/lib/python2.6/lib2to3/refactor.pyt log_errorscGs)|o||}n|ii|dS(sHook to log a message.N(RBtinfo(RTRtRu((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRgscGs)|o||}n|ii|dS(N(RBtdebug(RTRtRu((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRhscCsdS(s0Called with lines of output to give to the user.N((RTtlines((s-/mit/python/lib/python2.6/lib2to3/refactor.pyt print_outputscCsRxK|D]C}tii|o|i|||q|i|||qWdS(s)Refactor a list of files and directories.N(R R tisdirt refactor_dirt refactor_file(RTtitemstwritet doctests_onlyt dir_or_file((s-/mit/python/lib/python2.6/lib2to3/refactor.pytrefactors c Csxti|D]\}}}|id||i|ix[|D]S}|id o<|ido,tii||}|i|||qJqJWg} |D]!} | idp | | qq~ |(qWdS(sDescends down a directory and refactor every Python file found. Python files are assumed to have a .py extension. Files and subdirectories starting with '.' are skipped. sDescending into %sR3tpyN( R twalkRhRRRR RbR~( RTtdir_nameRRtdirpathtdirnamest filenamesRtfullnameR6tdn((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR}s  !c Cs yt|}Wn)tj o}|id||dSXz|id}Wd|iX|o`|id||i||}||jo|i|||d|q|id|nX|i||}|o.|i o$|it |d |d|n|id|dS( sRefactors a file.sCan't open %s: %sNs sRefactoring doctests in %sRsNo doctest changes in %sisNo changes in %s( topentIOErrorRwtreadtcloseRhtrefactor_docstringtprocessed_filetrefactor_stringt was_changedtstr( RTtfilenameRRtfterrtinputtoutputttree((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR~s$  $cCsry|ii|d}Wn2tj o&}|id||ii|dSX|id||i|||S(sFRefactor a given input string. Args: data: a string holding the code to be refactored. name: a human-readable name for use in error/log messages. Returns: An AST corresponding to the refactored input stream; None if there were errors during the parse. isCan't parse %s: %s: %sNsRefactoring %s(Rt parse_stringR'Rwt __class__R:Rht refactor_tree(RTtdataRRR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs  cCstii}|oT|id|i|d}||jo|i|d|q|idnN|i|d}|o'|io|it|d|n|iddS(NsRefactoring doctests in stdinssNo doctest changes in stdinsNo changes in stdin( tsyststdinRRhRRRRR(RTRRRR((s-/mit/python/lib/python2.6/lib2to3/refactor.pytrefactor_stdin s  cCstt|iit|ii}x|D]}|i||q4W|i|i|i|i|i|ix|D]}|i||qW|iS(sARefactors a parse tree (modifying the tree in place). Args: tree: a pytree.Node instance representing the root of the tree to be refactored. name: a human-readable name for this tree. Returns: True if the tree was modified, False otherwise. (RRQtvaluesRRt start_treet traverse_byt finish_treeR(RTRRt all_fixersR0((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRscCs|pdSx|D]}x||i|dD]|}|i|}|o`|i||}|dj o=||jpt|t|jo|i||}qq/q/WqWdS(sTraverse an AST, applying a set of fixers to each node. This is a helper method for refactor_tree(). Args: fixers: a list of fixer instances. traversal: a generator that yields AST nodes. Returns: None N(R R$tmatcht transformRtreplace(RTRCt traversaltnodeR0tresultstnew((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR3s  c Cs|ii||djoayt|d}Wn)tj o}|id||dSXz|i}Wd|iXn||jo|id|dS|i t ||||o|i |||n|id|dS(sP Called when a file has been refactored, and there are changes. R)sCan't read %s: %sNsNo changes to %ssNot writing changes to %s( RSRR$RRRwRRRhR{t diff_textst write_file(RTtnew_textRtold_textRRR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRKs"  cCsO|d}tii|o@yti|Wq]tij o}|id|q]Xnyti||Wn+tij o}|id||nXyt|d}Wn,tij o}|id||dSXzCy|i |Wn+tij o}|id||nXWd|i X|i d|t |_ dS( sWrites a string to a file. It first shows a unified diff between the old text and the new text, and then rewrites the file; the latter is only done if the write option is set. s.baksCan't remove backup %ssCan't rename %s to %stwsCan't create %s: %sNsCan't write %s: %ssWrote changes to %s(R R tlexiststremoveterrorRgtrenameRRwRRRhRfRL(RTRRRtbackupRR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRcs.  s>>> s... c Csg}d}d}d}d}x5|itD]$}|d7}|ii|io_|dj o#|i|i||||n|}|g}|i|i} || }q.|dj oF|i||i p|||i i djo|i |q.|dj o#|i|i||||nd}d}|i |q.W|dj o#|i|i||||ndi |S(sRefactors a docstring, looking for doctests. This returns a modified version of the input string. It looks for doctests, which start with a ">>>" prompt, and may be continued with "..." prompts, as long as the "..." is indented the same as the ">>>". (Unfortunately we can't use the doctest module's parser, since, like most parsers, it is not geared towards preserving the original source.) iis RXN( R$t splitlinesRftlstripRtPS1textendtrefactor_doctesttfindtPS2trstripRRb( RTRRtresulttblockt block_linenotindenttlinenotlineti((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs<       c Csby|i|||}Wnytj om}|iitio.x+|D]}|id|idqIWn|id|||i i ||SX|i ||ot |i t}||d ||d} }|didp|dcd7>>" (possibly indented), while the remaining lines start with "..." (identically indented). s Source: %ss s+Can't parse docstring in %s line %s: %s: %siii(t parse_blockR'tlogt isEnabledForRItDEBUGRhRRwRR:RRRRfRRtpopR( RTRRRRRRRRtclippedR6((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs&! 8c Cs'|io d}nd}|ip|id|n2|id|x|iD]}|i|qRW|io2|idx"|iD]}|i|qWn|iott|idjo|idn|idt|ix1|iD]"\}}}|i|||qWndS( Ntweres need to besNo files %s modified.sFiles that %s modified:s$Warnings/messages while refactoring:isThere was 1 error:sThere were %d errors:(RLRSRgRKRHR_(RTRtfiletmessageRtRuRv((s-/mit/python/lib/python2.6/lib2to3/refactor.pyt summarizes*         cCs|ii|i|||S(sParses a block into a tree. This is necessary to get correct line number / offset information in the parser diagnostics and embedded into the parse tree. (Rt parse_tokenst wrap_toks(RTRRR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRsc csti|i||i}xe|D]]\}}\}}\} } } ||d7}| |d7} ||||f| | f| fVq%WdS(s;Wraps a tokenize stream to systematically modify start/end.iN(Rtgenerate_tokenst gen_linestnext( RTRRRttokensR tvaluetline0tcol0tline1tcol1t line_text((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs !ccs||i}||i}|}xm|D]e}|i|o|t|Vn7||idjo dVntd||f|}q'Wxto dVqWdS(sGenerates lines as expected by tokenize from a list of lines. This strips the first len(indent + self.PS1) characters off each line. s sline=%r, prefix=%rRXN(RRRR_RtAssertionErrorRf(RTRRtprefix1tprefix2tprefixR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs    N(R:R;R4RERaR^R$RVRPRwRgRhR{RR}R~RRRRRRRRRRRRRR(((s-/mit/python/lib/python2.6/lib2to3/refactor.pyR=as4  (          +    c Cs:|i}|i}ti||||ddddS(s%Return a unified diff of two strings.s (original)s (refactored)tlinetermRX(Rtdifflibt unified_diff(tatbR((s-/mit/python/lib/python2.6/lib2to3/refactor.pyRs    (R<t __author__R RRRIRjt collectionsRt itertoolsRtpgen2RRRXRRRRRfRR#R2R8R'R9tobjectR=R(((s-/mit/python/lib/python2.6/lib2to3/refactor.pyt s,