FAQ   Search   Memberlist  
Profile    Log in to check your private messages    Register    Log in
Web Crawler

 
Post new topic   Reply to topic    BLAG Forum Index -> open discussion
View previous topic :: View next topic  
Author Message
Jason
PostPosted: Fri Jul 09, 2004 11:29 pm    Post subject: Web Crawler Reply with quote

Can any of you guys recommend a decent webcrawler for Linux for archiving sites onto your local computer. We aren't allowed to hook our laptops up to the network at work (grr) so we are reduced to offline reading. wget -p is great but it does miss images whose paths are embedded inside the css stylesheet. So any other suggestions would be great.
jebba
PostPosted: Fri Jul 09, 2004 11:35 pm    Post subject: Reply with quote

Check out webbot.

Code:
apt-get update && apt-get install w3c-libwww-apps


/usr/bin/webbot

Display posts from previous:   
Post new topic   Reply to topic    BLAG Forum Index -> open discussion
Page 1 of 1

Protected by Anti-Spam ACP