Answer by Brian Z for How can I view all files in a website's directory?

I was just wondering the same thing. The following is probably not the most efficient solution, but it seems to work. It recreates the directory structure of the webserver locally. (Found the first command via stackoverflow)

wget --spider -r --no-parent http://some.served.dir.ca/ls -l some.served.dir.ca