Puppy Linux Discussion Forum

gposil

PMirrorget is page grabber...you point it at the path or index page you want and it grabs the text links to that page and downloads them to your local machine...with thanks to Lobster for the original to work off.

.

Lobster · Posted: Sun 26 Apr 2009, 08:22 Post subject:

Very useful Smile

Well done.
Many thanks for using pwget, which is in Puppy and maybe this could be combined with that - or should they be separate?
Hope this finds its way into Puppy

Anyway I used your program to download a website for local/offline viewing. Works as advertised Wink

Have enclosed the code (find it at user/bin/pmwget) to give people an indication of how simple GTK + a command line utility such as wget can be . . .

aarf · Joined: 30 Aug 2007 Posts: 3620 Location: around the bend

this is just what i have been thinking of asking for. having used webzip.exe for windows quite a lot i feel your gui needs some extra fields to be competitive. eg link block for google ads etc., required file types, follow link depth and to where... , see the webzip appication for more ideas.

hillside · Posted: Sun 26 Apr 2009, 14:23 Post subject:

This made it very easy to get a quick backup of everything on my website.

Backup. I have to remember to do that now and then.

aarf · Joined: 30 Aug 2007 Posts: 3620 Location: around the bend

for what it is worth,

here is the code I used to use when I was paying an arm and a leg for intenet access.

aarf · Joined: 30 Aug 2007 Posts: 3620 Location: around the bend

Oh yes the rawbookmarks.html doesnt contain any

droope · Joined: 31 Jul 2008 Posts: 814 Location: Uruguay, Mercedes

Somehting that would be usefull would be to have the possibility of choosing to DL only the links that are in between a particular div.

Maybe it's too complex, but i think it'd be really really usefull.

Cheers,
Droope

smokey01 · Joined: 30 Dec 2006 Posts: 1605 Location: South Australia

Is it possible to use pmwget to download a blog from google blogspot.

I can use their export facility but that only gives me an xml file which is of no use.

I want to be able to do an exact backup in html format. I want to be able to capture all the comments and photographs I had previously uploaded.

I have even added the -k parameter on the command line but it did not work either. I think the problem is username and password associated. I even tried adding these to the command line without success.

My desired outcome is to copy the entire blog onto a CD or DVD or maybe just to the HDD so it can be viewed as if it was on the web.

Anyone got any ideas.

Thanks

smokey01 · Joined: 30 Dec 2006 Posts: 1605 Location: South Australia

I wonder if it has something to do with the security I have setup.

Only people I give access to can see it.

Maybe I need to make it public to download it.

smokey01 · Joined: 30 Dec 2006 Posts: 1605 Location: South Australia

Ok, I made the site public and pmwget worked a treat.

It did not download the entire site as there were 6 pages. I had to download each page separately then do a little manual html linking between pages.

It didn't download the bigger photos either, just the thumbnails but if you click on the thumbnail when you are online it will display the larger photo. Not a bad compromise.

I didn't bother trying to make the comments work either although they were downloaded. It looked like too much trouble but all of the posts downloaded and displayed just like they were on the web.

Good outcome.