This is a project I worked quite a bit on (mostly because of the sh*tty GUI). This webcrawler can only search for hyperlinks on a webpage by looking for 'href', 'src' and 'action'. It might actually ...

Example of Web Crawler to get data from the Web with Python Scrapy and MongoDB . You have access to several sites: http://www.placesonline.com/ & http://www ...