 |
Puppy Linux Discussion Forum Puppy HOME page : puppylinux.com "THE" alternative forum : puppylinux.info
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in|
The time now is Sat 25 May 2013, 10:31 All times are UTC - 4 |
 Forum index » House Training » HOWTO ( Solutions ) |
|
how to download a complete website
Moderators: Flash, Ian, JohnMurga |
 
|
View previous topic :: View next topic |
| Page 1 of 2 [27 Posts] | Goto page: 1, 2 Next |
| Author | Message | ||||||||
|---|---|---|---|---|---|---|---|---|---|
|
aarf
Joined: 30 Aug 2007 Posts: 3620 Location: around the bend |
copy and paste (use shift+Ins(ert) to paste into a console) this onto a console.
explanations
_________________ ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G _-¤-_ <º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º> |
||||||||
|
|||||||||
 |
|||||||||
eztuxer
 Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
Thanks ! Interesting website by the way. _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
|
eztuxer
Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
Too bad it only downloads the index page here:
What could I do to force total copy of this forum ? http://pupitup.phpbb3now.com/ _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
paulh177
 Joined: 22 Aug 2006 Posts: 870 Location: ST862228 |
wget -m might do it _________________ Want to report a bug or problem? Have a read of this first ... |
||||||||
|
|||||||||
|
|||||||||
|
eztuxer
Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
Didn't work either. The problem is that this host is bugs ridden, or partially locked ? (can't register any new members), this could also affect wget. Or they purposely configured the server to not respond to wget (by implementing a minimum delay period between pages view ?) to make their "clients" captive of their lousy service. I've downloaded another forum with the same parameters, and it worked fine. _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
gposil
 Joined: 06 Apr 2009 Posts: 1305 Location: Stanthorpe (The Granite Belt), QLD, Australia |
Try PMirrorget...its in new Puppy but not on iblio yet... let me know http://www.gposil.com/pets/PMirrorget-0.1.pet .Tested on your site and works perfectly...for me _________________  Dpup Home |
||||||||
|
|||||||||
|
|||||||||
|
BarryK
Puppy Master  Joined: 09 May 2005 Posts: 6866 Location: Perth, Western Australia |
Yes, Gposil's nice little Pmirrorget will be in 4.3beta (or pre-beta) but it is delayed a couple of days. Expect it mid-week. See announcement re Pmirrorget: http://puppylinux.com/blog/?viewDetailed=00915 _________________ http://bkhome.org/blog2/ |
||||||||
|
|||||||||
|
|||||||||
|
eztuxer
Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
It's working ! 
Thank you gposil, I'll just have to FTP it when finished downloading. Great soft cause HTTrack wasn't working on this site either. You saved my butt. And yes, Barry, it is a must have standard soft in the new Puppy, small size, great job. _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
|
eztuxer
Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
OOOPPPSSS !!! It downloaded the forum OK, but when trying to view it off line it's not working, I guess it's normal cause the pages links haven't been rearranged for off line operation, and presume it should work All Right once uploaded within the forum via ftp. I'll do that AFTER walking Arobas (my dog), and let you know. _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
|
tlchost
Joined: 05 Aug 2007 Posts: 1487 Location: Baltimore, Maryland USA |
Does it respect the robot.txt file and thus not look in directories protected by robots.txt ? Will it download files in /cgi-bin and other files such as graphics and css files that are called by the website, but stored on the server other than the site directory itself? Thanks |
||||||||
|
|||||||||
|
|||||||||
|
aarf
Joined: 30 Aug 2007 Posts: 3620 Location: around the bend |
without taking anything away from PMirrorget which i haven't tried and didn't know of previously,
www.pupitup.phpbb3now.com is possibly the problem, pupitup.phpbb3now.com may work
started it and it seems to go ok then stopped it. seems to be downloading a lot of files with .html extensions (perhaps remove --html-extension) which might make it difficult to upload, unless you can use the batch file name changer in rox. With html extension they will link locally, with/for php extensions they will need a locally installed php enabled server to display properly plus you will also need the original php code for the pages which you will NOT get using non privileged access to any website. overall though your best bet would be to do a backup of the database from within admin and then upload that backup file to your new hosting site database. perhaps ask the site owner for the backup file if you are not privileged to that resource else it is still a lot of work you are aiming at. _________________ ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G _-¤-_ <º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º> Last edited by aarf on Sun 26 Jul 2009, 11:40; edited 2 times in total |
||||||||
|
|||||||||
|
|||||||||
|
aarf
Joined: 30 Aug 2007 Posts: 3620 Location: around the bend |
have edited the wget code to be as it should in my last post. as far as i know mirroring a site that has a database is NOT possible in any way, shape or form that is reasonably useful via internet global user access. the only way to mirror a forum successfully is to get the 'backup.sql' from the database on the server then use that to create tables in your new site. it may or may not also be possible to relocate a forum from within phpbb2 admin depending on your privileges. using any form of over the web copy/mirror of a php forum is a recipe for vast amounts of time wasting effort. however that is your choice. _________________ ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G _-¤-_ <º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º> |
||||||||
|
|||||||||
|
|||||||||
|
aarf
Joined: 30 Aug 2007 Posts: 3620 Location: around the bend |
i haven't had a look at PMirrorget but i very much doubt that you will get the source code out of the cgi-bin however a html image of cgi-bin output is possible as are graphics files. css files are downloaded with/by wget so I cant see that they would be a problem for PMirrorget. robot.txt is also downloaded first but how or if it is used in any way i dont know. wget cannot access htaccess locked directories without having the username/password. Whether robot.txt is able to give that sort of denial protection i dont know and haven't tested it. _________________ ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G _-¤-_ <º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º> |
||||||||
|
|||||||||
|
|||||||||
|
eztuxer
Joined: 06 Nov 2008 Posts: 461 Location: Belgium |
After a 4 miles walk and over an hour of Taï Chi Chuan, I feel refreshed and I'm back in the starting blocks. As I was fearing, this is no simple challenge and it goes way beyond my knowledge in Linux and Puppy. I've managed a few forums as admin, but this is my first time for domain based phpBB3. Here's the URL with me logged in as admin: http://pupitup.phpbb3now.com/adm/index.php?sid=ad157ef79760fa499eecfe13da175d27&i=bots&mode=bots I don't know if this might help. I do not have access to the data base, and the folks running phpBB3now are not reachable: http://forum.phpbb3now.com/ Can't register either: http://forum.phpbb3now.com/ucp.php?mode=register&sid=e945b6e37cab250141aa2c85bb3e45ee One thing I could do is add a new bot to let robot.txt roam trough freely, maybe. If it would be possible to convert (if necessary) links so that it could work @ http://pupitup.org/forum/phpBB3/ that would be a breeze. If not,I'll jusst copy/paste all forum sections manually, and would eventually forget about the existing posts. _________________ Don't poop it down... Pup it Up ! http://pupitup.org/ |
||||||||
|
|||||||||
|
|||||||||
|
gposil
Joined: 06 Apr 2009 Posts: 1305 Location: Stanthorpe (The Granite Belt), QLD, Australia |
PMirrorget will download all normal site files, html, css, txt and graphics pointed to by site files, it will not download sql database material... _________________ Dpup Home |
||||||||
|
|||||||||
|
|||||||||
how to download a complete website
| Page 1 of 2 [27 Posts] | Goto page: 1, 2 Next |
|
|
View previous topic :: View next topic |
|
Forum index » House Training » HOWTO ( Solutions ) |
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum You cannot attach files in this forum You can download files in this forum |
Powered by phpBB © 2001, 2005 phpBB Group