Comments on: Web scraping with Python http://www.akasig.org/2004/09/03/web-scraping-with-python/ Innover, servir, entreprendre. Tue, 16 Mar 2010 14:17:59 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Sig http://www.akasig.org/2004/09/03/web-scraping-with-python/comment-page-1/#comment-151761 Sig Wed, 07 Oct 2009 11:10:45 +0000 http://sig.levillage.org/?p=563#comment-151761 JohnMc, thanks for pointing to PyQuery and lxml. I was a bit concerned that lxml would not handle malformed HTML files. But it now can interface with BeautifulSoup and use its parsing abilities for malformed HTML files. Here is the lxml module for this : <a href="http://codespeak.net/lxml/elementsoup.html" rel="nofollow">http://codespeak.net/lxml/elementsoup.html</a> JohnMc, thanks for pointing to PyQuery and lxml. I was a bit concerned that lxml would not handle malformed HTML files. But it now can interface with BeautifulSoup and use its parsing abilities for malformed HTML files. Here is the lxml module for this :

http://codespeak.net/lxml/elementsoup.html

]]> By: JohnMc http://www.akasig.org/2004/09/03/web-scraping-with-python/comment-page-1/#comment-150663 JohnMc Mon, 07 Sep 2009 03:58:29 +0000 http://sig.levillage.org/?p=563#comment-150663 Beautifulsoup is ok, but it does have lexical issues on certain constructs. Nor it is consistent. Something I find much better is lxml and PyQuery. lxml is extremely fast. PyQuery's advantage is that if you know jQuery already you bypass the learning curve in using the tool. Beautifulsoup is ok, but it does have lexical issues on certain constructs. Nor it is consistent.

Something I find much better is lxml and PyQuery. lxml is extremely fast. PyQuery’s advantage is that if you know jQuery already you bypass the learning curve in using the tool.

]]> By: Sig http://www.akasig.org/2004/09/03/web-scraping-with-python/comment-page-1/#comment-19467 Sig Mon, 14 Mar 2005 08:47:13 +0000 http://sig.levillage.org/?p=563#comment-19467 Check also <a href="http://sig.levillage.org/?p=599" rel="nofollow">Web scraping with Python (part II)</a> where I present a python app that helps you scraping the web. Check also Web scraping with Python (part II) where I present a python app that helps you scraping the web.

]]> By: AkaSig » Web scraping with python (part 1 : crawling) http://www.akasig.org/2004/09/03/web-scraping-with-python/comment-page-1/#comment-8134 AkaSig » Web scraping with python (part 1 : crawling) Wed, 29 Dec 2004 15:41:32 +0000 http://sig.levillage.org/?p=563#comment-8134 [...] wling design is based on the John L. Lee’s mechanize framework for python. There are <a href="http://sig.levillage.org/index.php?p=563">other tools available in Python</a> (see also . And several other approaches are available when you want to [...] [...] wling design is based on the John L. Lee’s mechanize framework for python. There are other tools available in Python (see also . And several other approaches are available when you want to [...]

]]>