 |
| Scrapy: New Python web crawling & scraping framework (built on Twisted) (dev.scrapy.org) | ||
| recommended by 1 user | 2008 | 92 points by lunchbox | web development | original thread | | ||
| One user recommended this thread. What they said: |
| gilrain Mar 5, 2013 | on: Crawling - The Most Underrated Hack | context |
Mechanize is excellent. If you'd like to do some scraping but prefer to work in Python, check out Scrapy[1], discussed[2] a while back and only getting better. I've been very pleased with it for some personal projects that rely on scraping.
[1]: http://scrapy.org/
[2]: http://news.ycombinator.com/item?id=411733