Looping through a directory on the web and displaying its contents (files and other directories) via Python

Question

In the same vein as Process a set of files from a source directory to a destination directory in Python I\'m wondering if it is possible to create a function that when given a w

Answer 1

You may got the concept confused. Directory is file system concept. URL do not have a concept of directory. It looks similar to the path name of a file system and often maps to a directory. But there is no requirement for it to be backed by a file system.

For example, Process a set of files from a source directory to a destination directory in Python may map to a directory

/htdocs/questions/2593399/

But more likely it is generated from a database query and does not map to anything in the file system.

Answer 2

What is a web directory?

A web page has links. The page with the links may, or may not be, generated by the web server based on the contents of the directory.

An example of automatically generating links is found here, and is possibly the result of something like mod_dir configuration in the Web server, Apache.

What tools like wget, and curl, do, is take a page and download all links on that page, possibly recursively. I think that is the best you can achieve. And I have the feeling that questions about python + curl are abundant here in SO.