NAME¶

File::Wildcard - Enhanced glob processing

SYNOPSIS¶

  use File::Wildcard;
  my $foo = File::Wildcard->new(path => "/home/me///core");
  while (my $file = $foo->next) {
     unlink $file;
  }

DESCRIPTION¶

When looking at how various operating systems do filename wildcard expansion (globbing), VMS has a nice syntax which allows expansion and searching of whole directory trees. It would be nice if other operating systems had something like this built in. The best Unix can manage is through the utility program "find". This module provides this facility to Perl. Whereas native VMS syntax uses the ellipsis "...", this will not fit in with POSIX filenames, as ... is a valid (though somewhat strange) filename. Instead, the construct "///" is used as this cannot syntactically be part of a filename, as you do not get three concurrent filename separators with nothing between (three slashes are used to avoid confusion with //node/path/name syntax). You don't have to use this syntax, as you can do the splitting yourself and pass in an arrayref as your path. The module also forms a regular expression for the whole of the wildcard string, and binds a series of back references ($1, $2 etc.) which are available to construct new filenames.

new¶

"File::Wildcard-"new( $wildcard, [,option => value,...]);>

  my $foo = File::Wildcard->new( path => "/home/me///core");
  my $srcfnd = File::Wildcard->new( path => "src///*.cpp",
               match => qr(^src/(.*?)\.cpp$),
               derive => ['src/$1.o','src/$1.hpp']);

This is the constructor for File::Wildcard objects. At a simple level, pass a single wildcard string as a path. For more complicated operations, you can supply your own match regexp, or use the derive option to specify regular expression captures to form the basis of other filenames that are constructed for you. The $srcfnd example gives you object files and header files corresponding to C++ source files. Here are the options that are available:

"path"

This is the input parameter that specifies the range of files that will be looked at. This is a glob spec which can also contain the ellipsis '///' (it could contain more than one ellipsis, but the benefit of this is questionable, and multiple ellipsi would cause a performance hit).

 

Note that the path can be relative or absolute. new will do the right thing, working out that a path starting with '/' is absolute. In order to recurse from the current directory downwards, specify './//foo'.

 

As an alternative, you can supply an arrayref with the path constituents already split. If you do this, you need to tell new if the path is absolute. Include an empty string for an ellipsis. For example:

 

  'foo///bar/*.c' is equivalent to ['foo','','bar','*.c']
    

 

You can also construct a File::Wildcard without a path. A call to next will return undef, but paths can be added using the append and prepend methods.

"absolute"

This is ignored unless you are using a pre split path. If you are passing a string as the path, new will work out whether the path is absolute or relative. Pass a true value for absolute paths.

 

If your original filespec started with '/' before you split it, specify absolute => 1. absolute is not required for Windows if the path contains a drive specification, e.g. C:/foo/bar.

"case_insensitive"

By default, the module will use Filesys::Type to determine whether the file system of your wildcard is defined. This is an optional module (see Module::Optional), and File::Wildcard will guess at case sensitivity based on your operating system. This will not always be correct, as the file system might be VFAT mounted on Linux or ODS-5 on VMS.

 

Specifying the option "case_insensitive" explicitly forces this behaviour on the wildcard.

 

Note that File::Wildcard will use the file system of the current working directory if the path is not absolute. If the path is absolute, you should specify the case_sensitivity option explicitly.

"exclude"

You can provide a regexp to apply to any generated paths, which will cause any matching paths not to be processed. If the root of a directory tree matches, no processing is done on the entire tree.

 

This option can be useful for excluding version control repositories, e.g.

 

  exclude => qr/.svn/
    

"match"

Optional. If you do not specify a regexp, you get all the files that match the glob; in addition, new will set up a regexp for you, to provide a capture for each wildcard used in the path.

 

If you do provide a match parameter, this will be used instead, and will filter the results.

"derive"

Supply an arrayref with a list of derived filenames, which will be constructed for each matching file. This causes next to return an arrayref instead of a scalar.

"follow"

If given a true value indicates that symbolic links are to be followed. Otherwise, the symbolic link target itself is presented, but the ellipsis will not traverse the link.

 

This module detects a looping symlink that points to a directory higher up, and will only present the tree once.

"ellipsis_order"

This can take one of the following values: normal, breadth-first, inside-out. The default option is normal. This controls how File::Wildcard handles the ellipsis. The default is a normal depth first search, presenting the name of each containing directory before the contents.

 

The inside-out order presents the contents of directories first before the directory, which is useful when you want to remove files and directories (all O/S require directories to be empty before rmdir will work). See t/03_absolute.t as this uses inside-out order to tidy up after the test.

 

Breadth-first is rarely needed (but I do have an application for it). Here, the whole directory contents is presented before traversing any subdirectories.

 

Consider the following tree:
a/
a/bar/
a/bar/drink
a/foo/
a/foo/lish

 

breadth-first will give the following order: qw(a/ a/bar/ a/foo/ a/bar/drink a/foo/lish). normal gives the order in which the files are listed. inside-out gives the following: qw(a/bar/drink a/bar/ a/foo/lish a/foo/ a/).

"sort"

By default, globbing returns the list of files in the order in which they are returned by the dirhandle (internally). If you specify sort => 1, the files are sorted into ASCII sequence (case insensitively if we are operating that way). If you specify a CODEREF, this will be used as a comparison routine. Note that this takes its operands in @_, not in $a and $b.

"debug" and "debug_output"

You can enable a trace of the internal states of File::Wildcard by setting debug to a true value. Set debug_output to an open filehandle to get the trace in a file. If you are submitting bug reports for File::Wildcard, attaching debug trace files would be very useful.

 

debug_output defaults to STDERR.

match¶

  my $foo_re = $foo->match;
  $foo->match('bar/core');

This is a get and set method that gives access to the match regexp that the File::Wildcard object is using. It is possible to change the regex on the fly in the middle of a search (though I don't know why anyone would want to do this).

append¶

  $foo->append(path => '/home/me///*.tmp');

appends a path to an object's todo list. This will be globbed after the object has finished processing the existing wildcards.

prepend¶

  $srcfnd->prepend(path => $include_file);

This is similar to append, but prepends the path to the todo list. In other words, the current wildcard operation is interrupted to serve the new path, then the previous wildcard operation is resumed when this is exhausted.

next¶

  while (my $core = $foo->next) {
      unlink $core;
  }
  my ($src,$obj,$hdr) = @{$srcfnd->next};

The "next" method is an iterator, which returns successive files. Returns matching files if there was no derive option passed to new. If there was a derive option, returns an arrayref containing the matching filespec and all derived filespecs. The derived filespecs do not have to exist. Note that "next" maintains an internal cursor, which retains context and state information. Beware if the contents of directories are changing while you are iterating with next; you may get unpredictable results. If you are intending to change the contents of the directories you are scanning (with unlink or rename), you are better off deferring this operation until you have processed the whole tree. For the pending delete or rename operations, you could always use another File::Wildcard object - see the spike example below:

all¶

  my @cores = $foo->all;

"all" returns an array of matching files, in the simple case. Returns an array of arrays if you are constructing new filenames, like the $srcfnd example. Beware of the performance and memory implications of using "all". The method will not return until it has read the entire directory tree. Use of the "all" method is not recommended for traversing large directory trees and whole file systems. Consider coding the traversal using the iterator "next" instead.

reset¶

"reset" causes the wildcard context to be set to re-read the first filename again. Note that this will cause directory contents to be re-read. Note also that this will cause the path to revert to the original path specified to new. Any additional paths appended or prepended will be forgotten.

close¶

Release all directory handles associated with the File::Wildcard object. An object that has been closed will be garbage collected once it goes out of scope. Wildcards that have been exhausted are automatically closed, (i.e. "all" was used, or c<next> returned undef). Subsequent calls to "next" will return undef. It is possible to call "reset" after "close" on the same File::Wildcard object, which will cause it to be reopened.

EXAMPLES¶

•

The spike

 

  my $todo = File::Wildcard->new;
  ...
  $todo->append(path => $file);
  ...
  while (my $file = $todo->next) {
  ...
  }
    

 

You can use an empty wildcard to store a list of filenames for later processing. The order in which they will be seen depends on whether append or prepend is used.

•

Shell style globbing

 

  my $wc_args = File::Wildcard->new;
  $wc_args->append(path => $_) for @ARGV;
  while ($wc_args->next) {
  ...
  }
    

 

On Unix, file wildcards on the command line are globbed by the shell before perl sees them, unless the wildcards are escaped or quoted. This is not true of other operating systems. MS-DOS does no globbing at all for example.

 

File::Wildcard gives you the bonus of elliptic globbing with '///'.

CAVEAT¶

This module takes POSIX filenames, which use forward slash '/' as a path separator. All operating systems that run Perl can manage this type of path. The module is not designed to work with native file specs. If you want to write code that is portable, convert native filespecs to the POSIX form. There is of course no difference on Unix platforms.

BUGS¶

Please report bugs to http://rt.cpan.org

AUTHOR¶

        Ivor Williams
        ivorw-file-wildcard010 at xemaps.com

COPYRIGHT¶

This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The full text of the license can be found in the LICENSE file included with this module.

SEE ALSO¶

glob(3), File::Find, File::Find::Rule.