Comments on: Chunk Data for Easier Scraping http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html Internet Marketing, Web Development and Programming Stuff Wed, 15 Sep 2010 02:35:24 +0000 hourly 1 http://wordpress.org/?v=3.0.1 By: arraial dajuda http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html/comment-page-1#comment-876 arraial dajuda Wed, 15 Sep 2010 02:35:24 +0000 http://www.adammoro.com/blog/?p=56#comment-876 Some interesting codes here! I have to learn Python as fast as possible! Some interesting codes here! I have to learn Python as fast as possible!

]]> By: Adam Moro http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html/comment-page-1#comment-296 Adam Moro Fri, 14 May 2010 22:58:06 +0000 http://www.adammoro.com/blog/?p=56#comment-296 I'll definitely be looking into the libraries you suggested for the next ones. Thanks again for pointing them out. Perhaps one day I'll make a full switch to Python for these types of jobs. Recently, however, the majority of my work has been almost entirely marketing-related so that day will likely come later than sooner. But hey, at least that's a choice I've made and not an order fulfilled to satisfy, "the first three." ;) I’ll definitely be looking into the libraries you suggested for the next ones. Thanks again for pointing them out.

Perhaps one day I’ll make a full switch to Python for these types of jobs. Recently, however, the majority of my work has been almost entirely marketing-related so that day will likely come later than sooner. But hey, at least that’s a choice I’ve made and not an order fulfilled to satisfy, “the first three.” ;)

]]> By: kip http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html/comment-page-1#comment-281 kip Thu, 13 May 2010 08:53:34 +0000 http://www.adammoro.com/blog/?p=56#comment-281 Python is my favourite. I switched from PHP to Python as well, indeed it was a littlebit awkward to learn at first--syntactical whitespace and that 'self' keyword in class methods everywhere--but after 2 or 3 simple quicky scripts, I got the hang of it. I wouldn't go back to PHP, I think Python is much "cleaner" and readable, and to be fair, the string processing functions are much more straightforward. Plus, you can use PyQuery for doing jQuery-style manipulation and extraction of HTML documents. Another language, which was basically built for this kind of work, is of course Perl. It's a pretty good language, and has the added bonus of making you feel like an oldskool elite hacker when coding :-P But, Perl is an even older language than PHP, and that shows. The field of scripting languages has come a long way since then, and we know better how to make scripting languages as much of "simply tell the computer what to do" as possible, which is why I prefer Python. Python is my favourite. I switched from PHP to Python as well, indeed it was a littlebit awkward to learn at first–syntactical whitespace and that ‘self’ keyword in class methods everywhere–but after 2 or 3 simple quicky scripts, I got the hang of it. I wouldn’t go back to PHP, I think Python is much “cleaner” and readable, and to be fair, the string processing functions are much more straightforward.

Plus, you can use PyQuery for doing jQuery-style manipulation and extraction of HTML documents.

Another language, which was basically built for this kind of work, is of course Perl. It’s a pretty good language, and has the added bonus of making you feel like an oldskool elite hacker when coding :-P But, Perl is an even older language than PHP, and that shows. The field of scripting languages has come a long way since then, and we know better how to make scripting languages as much of “simply tell the computer what to do” as possible, which is why I prefer Python.

]]> By: Adam Moro http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html/comment-page-1#comment-262 Adam Moro Mon, 10 May 2010 16:52:10 +0000 http://www.adammoro.com/blog/?p=56#comment-262 Hi Kip, thanks for the tip. The only other language I've used for scraping jobs is Python which was much faster performance-wise, it just took me a lot longer to write the scripts. Which language(s) would you suggest? Hi Kip, thanks for the tip. The only other language I’ve used for scraping jobs is Python which was much faster performance-wise, it just took me a lot longer to write the scripts. Which language(s) would you suggest?

]]> By: kip http://www.adammoro.com/blog/chunk-data-for-easier-scraping.html/comment-page-1#comment-253 kip Sun, 09 May 2010 09:46:34 +0000 http://www.adammoro.com/blog/?p=56#comment-253 um yeah, except if you gonna parse HTML better use a library like PHPQuery (jQuery for PHP) or you could replace /\W+/ with a single space instead of the empty string, to leave delimiters in tact. and ... PHP? really? um yeah, except if you gonna parse HTML better use a library like PHPQuery (jQuery for PHP)

or you could replace /\W+/ with a single space instead of the empty string, to leave delimiters in tact.

and … PHP? really?

]]>