Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Sun 20 Apr 2014, 20:41
All times are UTC - 4
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Browsers and Internet
ThreadGet
Post new topic   Reply to topic View previous topic :: View next topic
Page 1 of 3 [38 Posts]   Goto page: 1, 2, 3 Next
Author Message
seaside

Joined: 11 Apr 2007
Posts: 878

PostPosted: Tue 23 Nov 2010, 16:46    Post subject:  ThreadGet
Subject description: Download forum thread to a single html file
 

- ThreadGet -

A program to download phpBB forum threads (like Puppys'). It's based somewhat on Mu's original program Fetchforum, written in basic.

Here's how it works -

After you've made selections, ThreadGet downloads each page of the forum thread, saves it as a single sequentially numbered html file in a subdirectory of a created /root/ForumThreads directory.

When all pages have been downloaded, the separate html files are combined into a single one. The individual pages are then deleted.

Usuage:

Find the forum thread you like and go to the first page. Then copy and paste the URL line (be sure that the line ends with only a number - no "&start" or other symbols)

Enter the last page number of the thread you've chosen or enter the last page you'd like to download. (In attempting to ensure that all pages are downloaded, you may get a couple of extra unfilled pages at the end, due to rounding and partial pages)

Enter the name of the file you'd like to save the thread under (e.g configure-wifi). No need to enter any extension, as .htm will be added to the name (e.g. configure-wifi.htm)

You'll now have a single searchable html file with all those informative posts. Very Happy

UPDATE:3-30-2011 Added "Start Page" and append to existing files

Cheers,
s

Below is a Pic & Pet....
ThreadGet.pet
Description  ThreadGet
pet

 Download 
Filename  ThreadGet.pet 
Filesize  1.51 KB 
Downloaded  707 Time(s) 
ThreadGet.png
 Description   
 Filesize   19.64 KB
 Viewed   2466 Time(s)

ThreadGet.png


Last edited by seaside on Wed 30 Mar 2011, 10:38; edited 1 time in total
Back to top
View user's profile Send private message 
aragon

Joined: 15 Oct 2007
Posts: 1696
Location: Germany

PostPosted: Tue 23 Nov 2010, 17:39    Post subject:  

awesome Exclamation Exclamation Exclamation

my loved "The Text-User Interface" in one html-file...

will test a little more tomorrow.

thanks
aragon

_________________
PUPPY SEARCH: http://wellminded.com/puppy/pupsearch.html
Back to top
View user's profile Send private message 
Sit Heel Speak


Joined: 30 Mar 2006
Posts: 2595
Location: downwind

PostPosted: Tue 23 Nov 2010, 20:03    Post subject:  

Very Happy Yes indeed-y !!! Two dew-claws up !!!
Back to top
View user's profile Send private message 
plankenstein


Joined: 15 Nov 2008
Posts: 119
Location: Arkansas, USA

PostPosted: Tue 23 Nov 2010, 20:17    Post subject:  

This sounds awsome! I'll definitely be trying this one out. Very Happy
_________________
I carefully plan ALL my random acts! Laughing
Back to top
View user's profile Send private message 
TheAsterisk!


Joined: 10 Feb 2009
Posts: 403
Location: SE Wisconsin, US

PostPosted: Tue 23 Nov 2010, 21:41    Post subject:  

Thanks! This could be really helpful!
Back to top
View user's profile Send private message Visit poster's website 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 10671
Location: Arizona USA

PostPosted: Tue 23 Nov 2010, 22:01    Post subject:  

Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices. Smile
Back to top
View user's profile Send private message 
aarf

Joined: 30 Aug 2007
Posts: 3620
Location: around the bend

PostPosted: Thu 25 Nov 2010, 11:45    Post subject:  

successfully just got six pages from a non-phpbb but near clone.
have often been in need of this pet in the past so no doubt will in future. thanks muchly.

_________________

ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G
_-¤-_

<º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º>
Back to top
View user's profile Send private message Visit poster's website 
chrome307


Joined: 15 Jan 2009
Posts: 713

PostPosted: Thu 02 Dec 2010, 07:51    Post subject:  

I have tried this out and got a strange result.

When I download a link, a new directory named Thread is created in:

usr/share/applications

however there is no content.

There is also another directory created 'Forum threads' which does have the content as mentioned in your thread.

Is there a reason why the additional directory is created?

I am using BrowserLinux, which is a cut down version of Puppy Linux 4.31.

The application works great and is a life saver for reading long threads. Smile
Back to top
View user's profile Send private message 
scsijon

Joined: 23 May 2007
Posts: 997
Location: the australian mallee

PostPosted: Sat 19 Mar 2011, 04:50    Post subject:  

Flash wrote:
Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices. Smile


Like ttuuxxx's Classic 2.14X you mean, 281 pages at last view, must be close to the record by now.
Back to top
View user's profile Send private message Visit poster's website 
tlchost

Joined: 05 Aug 2007
Posts: 1641
Location: Baltimore, Maryland USA

PostPosted: Sat 19 Mar 2011, 07:04    Post subject: Thanks!  

Great script.....no more saving each page, then adding them all together.

Perhaps allow the user to specify the destination for the file? I set up a symlink to have then stored in /mnt/home.

Thanks!

Thom
Back to top
View user's profile Send private message Visit poster's website 
tlchost

Joined: 05 Aug 2007
Posts: 1641
Location: Baltimore, Maryland USA

PostPosted: Fri 25 Mar 2011, 06:03    Post subject: Feature Request  

Would it be possible to add a feature that would allow us to specify a starting page and the option to save with append to or overwrite the local file?

Lets assume we wanted to save the Fluppy 013 thread...it has 117 pages. When new posts are added to the forum, having the ability to start at page 118 and add those new posts to the local file would not only be very convenient, but also reduce bandwidth used by the forum.

Thom
Back to top
View user's profile Send private message Visit poster's website 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 10671
Location: Arizona USA

PostPosted: Fri 25 Mar 2011, 08:49    Post subject:  

The little box just to the left of the word "Posted" at the top left of a post is the URL to that post. If you copy that URL and enter it in the GUI box, does it start downloading from that post?
Back to top
View user's profile Send private message 
seaside

Joined: 11 Apr 2007
Posts: 878

PostPosted: Mon 28 Mar 2011, 17:08    Post subject:  

I think I could add a starting page for downloading and perhaps a way to append to existing downloaded threads.

If there is interest, l'll mull over how to implement this.

Cheers,
s
Back to top
View user's profile Send private message 
russoodle


Joined: 12 Sep 2008
Posts: 639
Location: Down-Under in South Oz

PostPosted: Tue 29 Mar 2011, 08:39    Post subject:  

Thank you seaside, what a brilliant idea!
_________________
This aging business really bugs me - it didn't bother me years ago, so why is it happening now??
meownplanet - puppylinuxstuff
Back to top
View user's profile Send private message 
tlchost

Joined: 05 Aug 2007
Posts: 1641
Location: Baltimore, Maryland USA

PostPosted: Tue 29 Mar 2011, 14:39    Post subject:  

russoodle wrote:
Thank you seaside, what a brilliant idea!


Glad I suggested it...and looking forward to seeing it.

Thom
Back to top
View user's profile Send private message Visit poster's website 
Display posts from previous:   Sort by:   
Page 1 of 3 [38 Posts]   Goto page: 1, 2, 3 Next
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Browsers and Internet
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0747s ][ Queries: 13 (0.0114s) ][ GZIP on ]