BLAG

BLAG Forums
It is currently Fri Dec 19, 2014 9:42 pm

All times are UTC




Post new topic Reply to topic  [ 2 posts ] 
Author Message
 Post subject: Web Crawler
PostPosted: Fri Jul 09, 2004 11:29 pm 
Offline
Site Admin

Joined: Sun Mar 14, 2004 4:45 pm
Posts: 621
Location: London
Can any of you guys recommend a decent webcrawler for Linux for archiving sites onto your local computer. We aren't allowed to hook our laptops up to the network at work (grr) so we are reduced to offline reading. wget -p is great but it does miss images whose paths are embedded inside the css stylesheet. So any other suggestions would be great.


Top
 Profile  
 
 Post subject:
PostPosted: Fri Jul 09, 2004 11:35 pm 
Offline
Site Admin

Joined: Sun Mar 14, 2004 3:17 pm
Posts: 4492
Location: Loveland, Colorado, USA
Check out webbot.

Code:
apt-get update && apt-get install w3c-libwww-apps


/usr/bin/webbot


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 2 posts ] 

All times are UTC


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group