; Ðâ"Ic@s"dZdZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z ddl m Z dd lmZdd lmZdd lmZdd lmZed „Zd„Zd„Zd„ZGd„deƒZGd„deƒZd„ZdS(uÛRefactoring framework. Used as a main program, this can refactor any number of files and/or recursively descend down directories. Imported as a module, this provides infrastructure to write your own refactoring tool. u#Guido van Rossum iN(u defaultdict(uchaini(udriver(utokenize(upytree(upatcomp(ufixes(upygramcCs­t|ggdgƒ}tjj|jƒ}g}xsttj|ƒƒD]\}|jdƒoF|jdƒo6|o|dd…}n|j |dd…ƒqIqIW|S(uEReturn a sorted list of all available fix names in the given package.u*ufix_u.pyiNiýÿÿÿ( u __import__uosupathudirnameu__file__usortedulistdiru startswithuendswithuappend(u fixer_pkgu remove_prefixupkgu fixer_diru fix_namesuname((u-/mit/python/lib/python3.0/lib2to3/refactor.pyuget_all_fix_names"s cCsÓt|tjtjfƒot|jgƒSt|tjƒo&|jot|jƒStdgƒSt|tj ƒoFtƒ}x5|jD]*}x!|D]}|j t|ƒƒq™WqŒW|St d|ƒ‚dS(uf Accepts a pytree Pattern Node and returns a set of the pattern types which will match first. u$Oh no! I don't understand pattern %sN( u isinstanceupytreeu NodePatternu LeafPatternusetutypeuNegatedPatternucontentuget_head_typesuNoneuWildcardPatternuupdateu Exception(upaturupux((u-/mit/python/lib/python3.0/lib2to3/refactor.pyuget_head_types.s   cCsnttƒ}x[|D]S}|jp|dj|ƒqnx(t|jƒD]}||j|ƒqKWqW|S(u^ Accepts a list of fixers and returns a dictionary of head node type --> fixer list. N(u defaultdictulistupatternuNoneuappenduget_head_types(u fixer_listu head_nodesufixerut((u-/mit/python/lib/python3.0/lib2to3/refactor.pyuget_headnode_dictGs  cs‡fd†tˆdƒDƒS(uN Return the fully qualified names for fixers in the package pkg_name. cs#g}|]}|ˆd|q S(u.((u.0u_[1]ufix_name(upkg_name(u-/mit/python/lib/python3.0/lib2to3/refactor.pyu Ws F(uget_all_fix_namesuFalse(upkg_name((upkg_nameu-/mit/python/lib/python3.0/lib2to3/refactor.pyuget_fixers_from_packageSs cBs|EeZdZdS(uA fixer could not be loaded.N(u__name__u __module__u__doc__(u __locals__((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu FixerError[s u FixerErrorcBs|EeZidd6ZdZdZddd„Zd„Zd„Z d„Z d„Z d„Z ddd „Z ddd „Zddd „Zd „Zdd „Zd„Zd„Zddd„Zd„ZdZdZd„Zd„Zd„Zd„Zd„Zd„ZdS(uprint_functionuFixufix_cCs||_|pg|_|jjƒ|_|dk o|jj|ƒng|_tj dƒ|_ g|_ d|_ |jdotjjd=ntjtjdtjd|j ƒ|_|jƒ\|_|_t|jƒ|_t|jƒ|_g|_dS(uÒInitializer. Args: fixer_names: a list of fixers to import options: an dict with configuration. explicit: a list of fixers to run even if they are explicit. uRefactoringTooluprint_functionuprintuconvertuloggerNF(ufixersuexplicitu_default_optionsucopyuoptionsuNoneuupdateuerrorsuloggingu getLoggeruloggeru fixer_loguFalseuwroteupygramupython_grammarukeywordsudriveruDriverupytreeuconvertu get_fixersu pre_orderu post_orderuget_headnode_dictufiles(uselfu fixer_namesuoptionsuexplicit((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu__init__fs$      c Cság}g}x™|jD]Ž}t|iidgƒ}|jddƒd}|j|jƒo|t|jƒd…}n|jdƒ}|jdjd„|Dƒƒ}yt ||ƒ}Wn*t k ot d ||fƒ‚YnX||j |j ƒ} | jo7|jdk o'||jko|jd |ƒqn|jd |ƒ| jd ko|j| ƒq| jd ko|j| ƒqt d| jƒ‚qWtjdƒ} |jd| ƒ|jd| ƒ||fS(uInspects the options to load the requested patterns and handlers. Returns: (pre_order, post_order), where pre_order is the list of fixers that want a pre-order AST traversal, and post_order is the list that want post-order traversal. u*u.iiÿÿÿÿNu_ucSs!g}|]}||jƒq S((utitle(u.0u_[1]up((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu “s uCan't find %s.%suSkipping implicit fixer: %suAdding transformation: %supreupostuIllegal fixer order: %ru run_orderukeyT(ufixersu __import__ursplitu startswithu FILE_PREFIXulenusplitu CLASS_PREFIXujoinugetattruAttributeErroru FixerErroruoptionsu fixer_loguexplicituTrueu log_messageu log_debuguorderuappenduoperatoru attrgetterusort( uselfupre_order_fixersupost_order_fixersu fix_mod_pathumodufix_nameupartsu class_nameu fix_classufixerukey_func((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu get_fixersƒs:  cOs‚dS(uCalled when an error occurs.N((uselfumsguargsukwds((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu log_error«scGs)|o||}n|jj|ƒdS(uHook to log a message.N(uloggeruinfo(uselfumsguargs((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu log_message¯scGs)|o||}n|jj|ƒdS(N(uloggerudebug(uselfumsguargs((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu log_debugµscCsdS(u0Called with lines of output to give to the user.N((uselfulines((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu print_outputºscCsRxK|D]C}tjj|ƒo|j|||ƒq|j|||ƒqWdS(u)Refactor a list of files and directories.N(uosupathuisdiru refactor_diru refactor_file(uselfuitemsuwriteu doctests_onlyu dir_or_file((u-/mit/python/lib/python3.0/lib2to3/refactor.pyurefactor¾s c CsÃx¼tj|ƒD]«\}}}|jd|ƒ|jƒ|jƒx[|D]S}|jdƒ o<|jdƒo,tjj||ƒ}|j|||ƒqJqJWd„|Dƒ|dd…Ös N( uosuwalku log_debugusortu startswithuendswithupathujoinu refactor_file( uselfudir_nameuwriteu doctests_onlyudirpathudirnamesu filenamesunameufullname((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu refactor_dirÆs  !c Cs;yt|ƒ}Wn>tk o2}z|jd||ƒdSWYdd}~XnXz|jƒd}Wd|jƒX|o`|jd|ƒ|j||ƒ}||ko|j|||d|ƒq7|jd|ƒn^|j||ƒ}|o4|j o*|jt |ƒdd…|d|ƒn|jd|ƒdS( uRefactors a file.uCan't open %s: %sNu uRefactoring doctests in %suwriteuNo doctest changes in %siÿÿÿÿuNo changes in %s( uopenuIOErroru log_errorureaducloseu log_debugurefactor_docstringuprocessed_fileurefactor_stringu was_changedustr( uselfufilenameuwriteu doctests_onlyufuerruinputuoutpututree((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu refactor_fileØs$  *cCs„y|jj|ƒ}WnGtk o;}z%|jd||jj|ƒdSWYdd}~XnX|jd|ƒ|j||ƒ|S(uFRefactor a given input string. Args: data: a string holding the code to be refactored. name: a human-readable name for use in error/log messages. Returns: An AST corresponding to the refactored input stream; None if there were errors during the parse. uCan't parse %s: %s: %sNuRefactoring %s(udriveru parse_stringu Exceptionu log_erroru __class__u__name__u log_debugu refactor_tree(uselfudataunameutreeuerr((u-/mit/python/lib/python3.0/lib2to3/refactor.pyurefactor_stringòs  cCs»tjjƒ}|oT|jdƒ|j|dƒ}||ko|j|d|ƒq·|jdƒnN|j|dƒ}|o'|jo|jt|ƒd|ƒn|jdƒdS(NuRefactoring doctests in stdinuuNo doctest changes in stdinuNo changes in stdin( usysustdinureadu log_debugurefactor_docstringuprocessed_fileurefactor_stringu was_changedustr(uselfu doctests_onlyuinputuoutpututree((u-/mit/python/lib/python3.0/lib2to3/refactor.pyurefactor_stdins  cCs¨tt|jjƒŒt|jjƒŒƒ}x|D]}|j||ƒq4W|j|j|jƒƒ|j|j|jƒƒx|D]}|j||ƒq‡W|jS(uARefactors a parse tree (modifying the tree in place). Args: tree: a pytree.Node instance representing the root of the tree to be refactored. name: a human-readable name for this tree. Returns: True if the tree was modified, False otherwise. (uchainu pre_orderuvaluesu post_orderu start_treeu traverse_byu finish_treeu was_changed(uselfutreeunameu all_fixersufixer((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu refactor_treescCs·|pdSx¤|D]œ}x“||j|dD]|}|j|ƒ}|o`|j||ƒ}|dk o=||kpt|ƒt|ƒko|j|ƒ|}q«q/q/WqWdS(uTraverse an AST, applying a set of fixers to each node. This is a helper method for refactor_tree(). Args: fixers: a list of fixer instances. traversal: a generator that yields AST nodes. Returns: None N(utypeuNoneumatchu transformustrureplace(uselfufixersu traversalunodeufixeruresultsunew((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu traverse_by1s  cCs|jj|ƒ|dkovyt|dƒ}Wn>tk o2}z|jd||ƒdSWYdd}~XnXz|jƒ}Wd|jƒXn||ko|jd|ƒdS|j t |||ƒƒ|o|j |||ƒn|jd|ƒdS(uP Called when a file has been refactored, and there are changes. uruCan't read %s: %sNuNo changes to %suNot writing changes to %s( ufilesuappenduNoneuopenuIOErroru log_errorureaducloseu log_debugu print_outputu diff_textsu write_file(uselfunew_textufilenameuold_textuwriteufuerr((u-/mit/python/lib/python3.0/lib2to3/refactor.pyuprocessed_fileIs"  cCs×yt|dƒ}WnAtjk o2}z|jd||ƒdSWYdd}~XnXzUy|j|ƒWn=tjk o.}z|jd||ƒWYdd}~XnXWd|jƒX|jd|ƒd|_dS(uÑWrites a string to a file. It first shows a unified diff between the old text and the new text, and then rewrites the file; the latter is only done if the write option is set. uwuCan't create %s: %sNuCan't write %s: %suWrote changes to %sT( uopenuosuerroru log_erroruwriteucloseu log_debuguTrueuwrote(uselfunew_textufilenameuold_textufuerr((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu write_fileas+ u>>> u... c Cs™g}d}d}d}d}x;|jdƒD]*}|d7}|jƒj|jƒoe|dk o#|j|j||||ƒƒn|}|g}|j|jƒ} |d| …}q.|dk oF|j||j ƒp|||j j ƒdko|j |ƒq.|dk o#|j|j||||ƒƒnd}d}|j |ƒq.W|dk o#|j|j||||ƒƒndj |ƒS(uËRefactors a docstring, looking for doctests. This returns a modified version of the input string. It looks for doctests, which start with a ">>>" prompt, and may be continued with "..." prompts, as long as the "..." is indented the same as the ">>>". (Unfortunately we can't use the doctest module's parser, since, like most parsers, it is not geared towards preserving the original source.) iiNu uT( uNoneu splitlinesuTrueulstripu startswithuPS1uextendurefactor_doctestufinduPS2urstripuappendujoin( uselfuinputufilenameuresultublocku block_linenouindentulinenoulineui((u-/mit/python/lib/python3.0/lib2to3/refactor.pyurefactor_docstringzs<       c spyˆj||ˆƒ}WnŽtk o‚}zlˆjjtjƒo.x+|D]}ˆjd|jdƒƒqLWnˆjd|||j j |ƒ|SWYdd}~XnXˆj ||ƒo¯t |ƒj d ƒ}|d|d…||dd…} }|djdƒp|dcd7>>" (possibly indented), while the remaining lines start with "..." (identically indented). u Source: %su u+Can't parse docstring in %s line %s: %s: %sNiiÿÿÿÿics&g}|]}|ˆˆj|q S((uPS2(u.0u_[1]uline(uindentuself(u-/mit/python/lib/python3.0/lib2to3/refactor.pyu ¿s T(u parse_blocku Exceptionulogu isEnabledForulogginguDEBUGu log_debugurstripu log_erroru __class__u__name__u refactor_treeustru splitlinesuTrueuendswithuPS1upop( uselfublockulinenouindentufilenameutreeuerrulineunewuclipped((uindentuselfu-/mit/python/lib/python3.0/lib2to3/refactor.pyurefactor_doctest¥s&! )%c Cs'|jo d}nd}|jp|jd|ƒn2|jd|ƒx|jD]}|j|ƒqRW|jo2|jdƒx"|jD]}|j|ƒqŠWn|jott|jƒdko|jdƒn|jdt|jƒƒx1|jD]"\}}}|j|||ŽqùWndS( Nuwereu need to beuNo files %s modified.uFiles that %s modified:u$Warnings/messages while refactoring:iuThere was 1 error:uThere were %d errors:(uwroteufilesu log_messageu fixer_loguerrorsulen(uselfuwereufileumessageumsguargsukwds((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu summarizeÂs*         cCs|jj|j|||ƒƒS(u³Parses a block into a tree. This is necessary to get correct line number / offset information in the parser diagnostics and embedded into the parse tree. (udriveru parse_tokensu wrap_toks(uselfublockulinenouindent((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu parse_blockÙsc csŠtj|j||ƒjƒ}xe|D]]\}}\}}\} } } ||d7}| |d7} ||||f| | f| fVq%WdS(u;Wraps a tokenize stream to systematically modify start/end.iN(utokenizeugenerate_tokensu gen_linesu__next__( uselfublockulinenouindentutokensutypeuvalueuline0ucol0uline1ucol1u line_text((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu wrap_toksás !ccs¥||j}||j}|}xs|D]k}|j|ƒo|t|ƒd…Vn7||jƒdko dVntd||fƒ‚|}q'WxdVq™dS(u–Generates lines as expected by tokenize from a list of lines. This strips the first len(indent + self.PS1) characters off each line. Nu uline=%r, prefix=%ru(uPS1uPS2u startswithulenurstripuAssertionError(uselfublockuindentuprefix1uprefix2uprefixuline((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu gen_linesïs    NF(u__name__u __module__uFalseu_default_optionsu CLASS_PREFIXu FILE_PREFIXuNoneu__init__u get_fixersu log_erroru log_messageu log_debugu print_outputurefactoru refactor_diru refactor_fileurefactor_stringurefactor_stdinu refactor_treeu traverse_byuprocessed_fileu write_fileuPS1uPS2urefactor_docstringurefactor_doctestu summarizeu parse_blocku wrap_toksu gen_lines(u __locals__((u-/mit/python/lib/python3.0/lib2to3/refactor.pyuRefactoringTool_s4   (          +    uRefactoringToolc Cs:|jƒ}|jƒ}tj||||ddddƒS(u%Return a unified diff of two strings.u (original)u (refactored)ulinetermu(u splitlinesudifflibu unified_diff(uaubufilename((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu diff_textss    (u__doc__u __author__uosusysudifflibulogginguoperatoru collectionsu defaultdictu itertoolsuchainupgen2udriverutokenizeuupytreeupatcompufixesupygramuTrueuget_all_fix_namesuget_head_typesuget_headnode_dictuget_fixers_from_packageu Exceptionu FixerErroruobjectuRefactoringToolu diff_texts(((u-/mit/python/lib/python3.0/lib2to3/refactor.pyu s,       ÿ¥