| Author |
Message |
seaside
Joined: 11 Apr 2007 Posts: 837
|
Posted: Tue 23 Nov 2010, 16:46 Post subject:
ThreadGet Subject description: Download forum thread to a single html file |
|
- ThreadGet -
A program to download phpBB forum threads (like Puppys'). It's based somewhat on Mu's original program Fetchforum, written in basic.
Here's how it works -
After you've made selections, ThreadGet downloads each page of the forum thread, saves it as a single sequentially numbered html file in a subdirectory of a created /root/ForumThreads directory.
When all pages have been downloaded, the separate html files are combined into a single one. The individual pages are then deleted.
Usuage:
Find the forum thread you like and go to the first page. Then copy and paste the URL line (be sure that the line ends with only a number - no "&start" or other symbols)
Enter the last page number of the thread you've chosen or enter the last page you'd like to download. (In attempting to ensure that all pages are downloaded, you may get a couple of extra unfilled pages at the end, due to rounding and partial pages)
Enter the name of the file you'd like to save the thread under (e.g configure-wifi). No need to enter any extension, as .htm will be added to the name (e.g. configure-wifi.htm)
You'll now have a single searchable html file with all those informative posts.
UPDATE:3-30-2011 Added "Start Page" and append to existing files
Cheers,
s
Below is a Pic & Pet....
 |
| Description |
ThreadGet
|

Download |
| Filename |
ThreadGet.pet |
| Filesize |
1.51 KB |
| Downloaded |
479 Time(s) |
| Description |
|
| Filesize |
19.64 KB |
| Viewed |
2167 Time(s) |

|
Last edited by seaside on Wed 30 Mar 2011, 10:38; edited 1 time in total
|
|
Back to top
|
|
 |
aragon
Joined: 15 Oct 2007 Posts: 1690 Location: Germany
|
Posted: Tue 23 Nov 2010, 17:39 Post subject:
|
|
awesome
my loved "The Text-User Interface" in one html-file...
will test a little more tomorrow.
thanks
aragon
_________________ PUPPY SEARCH: http://wellminded.com/puppy/pupsearch.html
|
|
Back to top
|
|
 |
Sit Heel Speak

Joined: 30 Mar 2006 Posts: 2595 Location: downwind
|
Posted: Tue 23 Nov 2010, 20:03 Post subject:
|
|
Yes indeed-y !!! Two dew-claws up !!!
|
|
Back to top
|
|
 |
plankenstein

Joined: 15 Nov 2008 Posts: 118 Location: Arkansas, USA
|
Posted: Tue 23 Nov 2010, 20:17 Post subject:
|
|
This sounds awsome! I'll definitely be trying this one out.
_________________ I carefully plan ALL my random acts! 
|
|
Back to top
|
|
 |
TheAsterisk!

Joined: 10 Feb 2009 Posts: 399 Location: SE Wisconsin, US
|
Posted: Tue 23 Nov 2010, 21:41 Post subject:
|
|
Thanks! This could be really helpful!
|
|
Back to top
|
|
 |
Flash
Official Dog Handler

Joined: 04 May 2005 Posts: 9850 Location: Arizona USA
|
Posted: Tue 23 Nov 2010, 22:01 Post subject:
|
|
Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices.
|
|
Back to top
|
|
 |
aarf
Joined: 30 Aug 2007 Posts: 3620 Location: around the bend
|
Posted: Thu 25 Nov 2010, 11:45 Post subject:
|
|
successfully just got six pages from a non-phpbb but near clone.
have often been in need of this pet in the past so no doubt will in future. thanks muchly.
_________________
ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G
_-¤-_
<º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º>
|
|
Back to top
|
|
 |
chrome307

Joined: 15 Jan 2009 Posts: 713
|
Posted: Thu 02 Dec 2010, 07:51 Post subject:
|
|
I have tried this out and got a strange result.
When I download a link, a new directory named Thread is created in:
usr/share/applications
however there is no content.
There is also another directory created 'Forum threads' which does have the content as mentioned in your thread.
Is there a reason why the additional directory is created?
I am using BrowserLinux, which is a cut down version of Puppy Linux 4.31.
The application works great and is a life saver for reading long threads.
|
|
Back to top
|
|
 |
scsijon
Joined: 23 May 2007 Posts: 923 Location: the australian mallee
|
Posted: Sat 19 Mar 2011, 04:50 Post subject:
|
|
| Flash wrote: | Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices.  |
Like ttuuxxx's Classic 2.14X you mean, 281 pages at last view, must be close to the record by now.
|
|
Back to top
|
|
 |
tlchost
Joined: 05 Aug 2007 Posts: 1487 Location: Baltimore, Maryland USA
|
Posted: Sat 19 Mar 2011, 07:04 Post subject:
Thanks! |
|
Great script.....no more saving each page, then adding them all together.
Perhaps allow the user to specify the destination for the file? I set up a symlink to have then stored in /mnt/home.
Thanks!
Thom
|
|
Back to top
|
|
 |
tlchost
Joined: 05 Aug 2007 Posts: 1487 Location: Baltimore, Maryland USA
|
Posted: Fri 25 Mar 2011, 06:03 Post subject:
Feature Request |
|
Would it be possible to add a feature that would allow us to specify a starting page and the option to save with append to or overwrite the local file?
Lets assume we wanted to save the Fluppy 013 thread...it has 117 pages. When new posts are added to the forum, having the ability to start at page 118 and add those new posts to the local file would not only be very convenient, but also reduce bandwidth used by the forum.
Thom
|
|
Back to top
|
|
 |
Flash
Official Dog Handler

Joined: 04 May 2005 Posts: 9850 Location: Arizona USA
|
Posted: Fri 25 Mar 2011, 08:49 Post subject:
|
|
The little box just to the left of the word "Posted" at the top left of a post is the URL to that post. If you copy that URL and enter it in the GUI box, does it start downloading from that post?
|
|
Back to top
|
|
 |
seaside
Joined: 11 Apr 2007 Posts: 837
|
Posted: Mon 28 Mar 2011, 17:08 Post subject:
|
|
I think I could add a starting page for downloading and perhaps a way to append to existing downloaded threads.
If there is interest, l'll mull over how to implement this.
Cheers,
s
|
|
Back to top
|
|
 |
russoodle

Joined: 12 Sep 2008 Posts: 600 Location: Down-Under in South Oz
|
Posted: Tue 29 Mar 2011, 08:39 Post subject:
|
|
Thank you seaside, what a brilliant idea!
_________________ Every time i hear the word, "exercise", i wash my mouth out with chocolate
http://www.puppylinuxstuff.meownplanet.net/
Puppy Linux Links
|
|
Back to top
|
|
 |
tlchost
Joined: 05 Aug 2007 Posts: 1487 Location: Baltimore, Maryland USA
|
Posted: Tue 29 Mar 2011, 14:39 Post subject:
|
|
| russoodle wrote: | | Thank you seaside, what a brilliant idea! |
Glad I suggested it...and looking forward to seeing it.
Thom
|
|
Back to top
|
|
 |
|