Re: Plucker: is it dead? Any alternatives?



Ian Rawlings wrote:
On 2006-01-16, Toby Newman <google@xxxxxxxxxxx> wrote:

I use Plucker Desktop to harvest my web pages whenever I hotsync. It's
very slow because it harvests the pages serially rather than in
parallel.

I tried that, but it wasn't very good, I wrote some scripts to automatically grab a list of sites depending on when they'd last been grabbed, e.g. some get grabbed hourly, some daily, some monthly etc. It ends up grabbing up to 5 sites in parallel which is less painful than one at a time serially, but still not very good.

I installed a new distiller 'Sunrise' to see if this was improved, but
I've not had time to evaluate it yet.
www.freewarepalm.com/utilities/sunrise.shtml

Windows stuff, so won't work for me. I tried sitescooper, but it doesn't seem to offer much more than straight plucker-build, but I'll prod it some more at a later date.


Sunrise is Java and multiplatform, and is very good software. I've used it for as long as I can remember, and I use it for daily news, ebook conversions, text and images. It will also handle RSS very well, so you can have an RSS feed from your own flickr pages, for example.
.