Web Crawler can be used to get links, emails, images and files from a webpage or site.
Web Crawler has a simple and intuitive interface.
The crawler is multithreaded and optimized for performance. It scans the webpage based on MIME types and file extensions, so it can find hidden links.
Two applications are included in the package. A Windows Forms application and a new WPF application with extended functionality. The “Deep crawl” feature allows the crawler to search all the linked pages from the selected website.