Re: recursive file editing

From: Peter Otten (__peter___at_web.de)
Date: 04/04/04 

Date: Sun, 04 Apr 2004 12:11:25 +0200

TaeKyon wrote:

> I'm a python newbie; here are a few questions relative to a
> problem I'm trying to solve; I'm wandering if python is the best
> instrument or if awk or a mix of bash and sed would be better:
>
> 1) how would I get recursively descend
> through all files in all subdirectories of
> the one in which my script is called ?
>
> 2) each file examined should be edited; IF a string of this type is found
>
> foo.asp=dev?bar (where bar can be a digit or an empty space)
>
> it should always be substituted with this string
>
> foo-bar.html (if bar is an empty space the new string is foo-.html)
>
> 3) the names of files read may themselves be of the sort foo.asp=dev?bar;
> the edited output file should also be renamed according to the same rule
> as above ... or would this be better handled by a bash script ?
>
> Any hints appreciated
>

The following code comes with no warranties. Be sure to backup valuable data
before trying it. You may need to edit the regular expressions. Call the
script with the directory you want to process.

Peter

import os, re, sys

class Path(object):
    def __init__(self, folder, name):
        self.folder = folder
        self.name = name

    def _get_path(self):
        return os.path.join(self.folder, self.name)
    path = property(_get_path)

    def rename(self, newname):
        if self.name != newname:
            os.rename(self.path, os.path.join(self.folder, newname))
            self.name = newname

    def processContents(self, operation):
        data = file(self.path).read()
        newdata = operation(data)
        if data != newdata:
            file(self.path, "w").write(newdata)

    def __str__(self):
        return self.path

def files(rootfolder):
    for folder, folders, files in os.walk(rootfolder):
        for name in files:
            yield Path(folder, name)

fileExpr = re.compile(r"^(.+?)\.asp\=dev\?(.*)$")
filePattern = r"\1-\2.html"

textExpr = re.compile(r"([/\'\"])(.+?)\.asp\=dev\?(.*?)([\'\"])")
textPattern = r"\1\2-\3.html\4"

if __name__ == "__main__":
    for f in files(sys.argv[1]):
        f.rename(fileExpr.sub(filePattern, f.name))
        f.processContents(lambda s: textExpr.sub(textPattern, s))

Relevant Pages

  • Re: OT:macros or software?
    ... when a .PDF file is stored there, ... words and depending on weather those words are found in that document, move it to a predetermined folder. ... Easy enough if it were a text document, or even Word, as you could write a DOS script, or a VBS script if you had to load Word to read Word documents, although writing such a script can be harder to a beginner than some might think. ... If the string was in the name of the file it would be less work - you can set up the rather marvellous "robocopy" but that won't read inside a file, and certainly not a pdf! ...
    (uk.comp.homebuilt)
  • Re: rename files in directory
    ... When I run your script I get an error: " Microsoft VBScript runtime error: ... contain a " - " string. ... as part of the query. ... if the target folder has files with names in a format other ...
    (microsoft.public.scripting.vbscript)
  • Re: Search data with vbscript
    ... folder, the string to search for, and if sub folders are to be searched. ... You could modify the script to instead load the files into ... Notepad before opening the next file. ...
    (microsoft.public.scripting.vbscript)
  • Re: Searching & editing all text files in a folder
    ... >> then search all txt files in the folder for a specific string and then ... >> delete the string if it exists. ... > You don't say exactly how the target folder is "passed" to the script, ... > testing to verify the files. ...
    (microsoft.public.windows.server.scripting)
  • Re: Searching & editing all text files in a folder
    ... > I need a script which would have a folder passed as an argument, ... > delete the string if it exists. ... You don't say exactly how the target folder is "passed" to the script, ... testing to verify the files. ...
    (microsoft.public.windows.server.scripting)