(old)Puppy Linux Discussion Forum

*httrack-3.44.1* released 28 Feb 2011, (compiled in Puppy 3.01)
- http://dokupuppylinux.info/programs:website_mirroring

HTTrack is an easy-to-use offline browser utility. It allows you to download a Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the mirrored Web site in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. WebHTTrack is a Web-based GUI for HTTrack.

I tried this , the pet is missing a directory for the webgui, /usr/share/httrack/html

Hello all.

As per a request by member gnmartin:
-- https://www.adrive.com/public/fAxbJs/(w ... plete).pet --

Thanks are due to gc, actually. I wanted to do this for awhile, he just
gave me a good reason!

As the filename implies, this archive contains

• webhttrack (the browser interface)
  httrack (the console app, if you prefer to work it that way)
  libhttrack.so.2, etc. (the libraries)

I put this pet together from files scattered all over the ubuntu
Precise repo. So, as the filename implies, this archive contains the
complete suite of apps for httrack! Dont' go looking, it's all here!

Comments welcome.

I used to use the WhineDose version of HtTrack about 10-15 years ago,
to mirror web sites that some of our clients wanted our group to translate.
So it's been around a while, and it's very good at what it does. There's
probably a way to configure wget to do the same thing, but HtTrack is
less spartan, and its browser interface has a "you can't miss it"
presentation (IMO).

Don't enjoy! TWYL.

musher0

This utility is especially handy for what @BarryK has provided. On his download folder (here) I need all of its contents, locally, to quickly follow his directions at my local PCs speed versus the web navigation speed.

You have provided us an excellent tool for this and for other PUPs sites as well which use similar layouts.

THANKS muchly!

My pleasure!

A "webhttrack" entry should show in the "Network" sub-menu. A click on it
opens the httrack interface in your browser. The console app httrack does
not have a menu entry; console apps never do.

@all:
Also, if you can, it is advisable to ask permission by e-mail or phone
before you mirror a site with HtTrack. You should explain the reason why
(like gc did above).

Some sites / webmasters have software sensors for this. If not
forewarned, they may think that you want to plagiarize their site: they'll
kick you off it and blacklist you.

TWYL

musher0

I like the utility service. I started using it today for downloading the April72 offering from @BarryK. But, it is painfully slow and would have required a complete day just to download his site's approximate 10 files.

Has anyone else seen this problem?

gcmartin wrote:I like the utility service. I started using it today for downloading the April72 offering from @BarryK. But, it is painfully slow and would have required a complete day just to download his site's approximate 10 files.

Has anyone else seen this problem?

Hi, gc.

Yeah. ibiblio is known for being slow. That's why BK and other Puppy
developers also mirror to nluug.nl. It has nothing to do with HtTrack!

From BK:

"Download and installation
The primary download site is here:

x86_64: http://distro.ibiblio.org/quirky/quirky ... /releases/
i686: http://distro.ibiblio.org/quirky/quirky6/x86/releases/

There are faster mirrors, for example nluug in Europe:

x86_64: http://ftp.nluug.nl/os/Linux/distr/quir ... /releases/
i686: http://ftp.nluug.nl/os/Linux/distr/quir ... /releases/ "

Try one of the latter. nluug.nl is much faster.

BFN.

musher0

+1! I found the same over the years. Please note, I will test again on one of the mirrors, (later, not today) and report back. In the meantime ...

My experience yesterday was rather odd:

• Without HTtrack
  Earlier before HTtrack, I had downloaded each file independently. It was typical iBiblio where its not the fastest site for downloading but, within the single hour, I was able to independently capture each of the files for my local needs to begin testing. ... this was before HTtrack.
  
  With HTtrack
  I found this thread and installed the PET on the same 32bit distro which was used to independently download so I could provide feedback on the HTtrack's utility success on my TahrPUP. I start HTtrack, followed its browser screens and it started its downloading of Barry's folder. It was then discovered from the utility's progress screen that it would have taken approximately 20 hours to complete its download.

Screens in the order of use are below; with the last screen showing progress & times:

Tested:HTtrack does not install on a 64bit TahrPUP.

Thus it is a 32bit app for probably all of the 32bit PUPs. Test shown earlier are from the 32bit TahrPUP602.

Hi gc.

Ah. Good to know. Thanks.
Did you notice if it was reported on the HTtrack home site?
If not, maybe it should.

BFN.

musher0