Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Sat 25 Oct 2014, 03:18
All times are UTC - 4
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Browsers and Internet
ThreadGet
Post_new_topic   Reply_to_topic View_previous_topic :: View_next_topic
Page 1 of 3 Posts_count   Goto page: 1, 2, 3 Next
Author Message
seaside

Joined: 11 Apr 2007
Posts: 887

PostPosted: Tue 23 Nov 2010, 16:46    Post_subject:  ThreadGet
Sub_title: Download forum thread to a single html file
 

- ThreadGet -

A program to download phpBB forum threads (like Puppys'). It's based somewhat on Mu's original program Fetchforum, written in basic.

Here's how it works -

After you've made selections, ThreadGet downloads each page of the forum thread, saves it as a single sequentially numbered html file in a subdirectory of a created /root/ForumThreads directory.

When all pages have been downloaded, the separate html files are combined into a single one. The individual pages are then deleted.

Usuage:

Find the forum thread you like and go to the first page. Then copy and paste the URL line (be sure that the line ends with only a number - no "&start" or other symbols)

Enter the last page number of the thread you've chosen or enter the last page you'd like to download. (In attempting to ensure that all pages are downloaded, you may get a couple of extra unfilled pages at the end, due to rounding and partial pages)

Enter the name of the file you'd like to save the thread under (e.g configure-wifi). No need to enter any extension, as .htm will be added to the name (e.g. configure-wifi.htm)

You'll now have a single searchable html file with all those informative posts. Very Happy

UPDATE:3-30-2011 Added "Start Page" and append to existing files

Cheers,
s

Below is a Pic & Pet....
ThreadGet.pet
Description  ThreadGet
pet

 Download 
Filename  ThreadGet.pet 
Filesize  1.51 KB 
Downloaded  823 Time(s) 
ThreadGet.png
 Description   
 Filesize   19.64 KB
 Viewed   2725 Time(s)

ThreadGet.png


Edited_time_total
Back to top
View user's profile Send_private_message 
aragon

Joined: 15 Oct 2007
Posts: 1698
Location: Germany

PostPosted: Tue 23 Nov 2010, 17:39    Post_subject:  

awesome Exclamation Exclamation Exclamation

my loved "The Text-User Interface" in one html-file...

will test a little more tomorrow.

thanks
aragon

_________________
PUPPY SEARCH: http://wellminded.com/puppy/pupsearch.html
Back to top
View user's profile Send_private_message 
Sit Heel Speak


Joined: 30 Mar 2006
Posts: 2595
Location: downwind

PostPosted: Tue 23 Nov 2010, 20:03    Post_subject:  

Very Happy Yes indeed-y !!! Two dew-claws up !!!
Back to top
View user's profile Send_private_message 
plankenstein


Joined: 15 Nov 2008
Posts: 121
Location: Arkansas, USA

PostPosted: Tue 23 Nov 2010, 20:17    Post_subject:  

This sounds awsome! I'll definitely be trying this one out. Very Happy
_________________
I carefully plan ALL my random acts! Laughing
Back to top
View user's profile Send_private_message 
TheAsterisk!


Joined: 10 Feb 2009
Posts: 403
Location: SE Wisconsin, US

PostPosted: Tue 23 Nov 2010, 21:41    Post_subject:  

Thanks! This could be really helpful!
Back to top
View user's profile Send_private_message Visit_website 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 11121
Location: Arizona USA

PostPosted: Tue 23 Nov 2010, 22:01    Post_subject:  

Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices. Smile
Back to top
View user's profile Send_private_message 
aarf

Joined: 30 Aug 2007
Posts: 3620
Location: around the bend

PostPosted: Thu 25 Nov 2010, 11:45    Post_subject:  

successfully just got six pages from a non-phpbb but near clone.
have often been in need of this pet in the past so no doubt will in future. thanks muchly.

_________________

ASUS EeePC Flare series 1025C 4x Intel Atom N2800 @ 1.86GHz RAM 2063MB 800x600p ATA 320G
_-¤-_

<º))))><.¸¸.•´¯`•.#.•´¯`•.¸¸. ><((((º>
Back to top
View user's profile Send_private_message Visit_website 
chrome307


Joined: 15 Jan 2009
Posts: 713

PostPosted: Thu 02 Dec 2010, 07:51    Post_subject:  

I have tried this out and got a strange result.

When I download a link, a new directory named Thread is created in:

usr/share/applications

however there is no content.

There is also another directory created 'Forum threads' which does have the content as mentioned in your thread.

Is there a reason why the additional directory is created?

I am using BrowserLinux, which is a cut down version of Puppy Linux 4.31.

The application works great and is a life saver for reading long threads. Smile
Back to top
View user's profile Send_private_message 
scsijon

Joined: 23 May 2007
Posts: 1047
Location: the australian mallee

PostPosted: Sat 19 Mar 2011, 04:50    Post_subject:  

Flash wrote:
Um, some threads in this forum are several hundred pages long. If a lot of people download them, it's going to really tie up the forum server and bandwidth. All I'm saying is, please be discriminating in your choices. Smile


Like ttuuxxx's Classic 2.14X you mean, 281 pages at last view, must be close to the record by now.
Back to top
View user's profile Send_private_message Visit_website 
tlchost

Joined: 05 Aug 2007
Posts: 1727
Location: Baltimore, Maryland USA

PostPosted: Sat 19 Mar 2011, 07:04    Post_subject: Thanks!  

Great script.....no more saving each page, then adding them all together.

Perhaps allow the user to specify the destination for the file? I set up a symlink to have then stored in /mnt/home.

Thanks!

Thom
Back to top
View user's profile Send_private_message Visit_website 
tlchost

Joined: 05 Aug 2007
Posts: 1727
Location: Baltimore, Maryland USA

PostPosted: Fri 25 Mar 2011, 06:03    Post_subject: Feature Request  

Would it be possible to add a feature that would allow us to specify a starting page and the option to save with append to or overwrite the local file?

Lets assume we wanted to save the Fluppy 013 thread...it has 117 pages. When new posts are added to the forum, having the ability to start at page 118 and add those new posts to the local file would not only be very convenient, but also reduce bandwidth used by the forum.

Thom
Back to top
View user's profile Send_private_message Visit_website 
Flash
Official Dog Handler


Joined: 04 May 2005
Posts: 11121
Location: Arizona USA

PostPosted: Fri 25 Mar 2011, 08:49    Post_subject:  

The little box just to the left of the word "Posted" at the top left of a post is the URL to that post. If you copy that URL and enter it in the GUI box, does it start downloading from that post?
Back to top
View user's profile Send_private_message 
seaside

Joined: 11 Apr 2007
Posts: 887

PostPosted: Mon 28 Mar 2011, 17:08    Post_subject:  

I think I could add a starting page for downloading and perhaps a way to append to existing downloaded threads.

If there is interest, l'll mull over how to implement this.

Cheers,
s
Back to top
View user's profile Send_private_message 
russoodle


Joined: 12 Sep 2008
Posts: 665
Location: Down-Under in South Oz

PostPosted: Tue 29 Mar 2011, 08:39    Post_subject:  

Thank you seaside, what a brilliant idea!
_________________
This aging business really bugs me - it didn't bother me years ago, so why is it happening now??
meownplanet - puppylinuxstuff
Back to top
View user's profile Send_private_message 
tlchost

Joined: 05 Aug 2007
Posts: 1727
Location: Baltimore, Maryland USA

PostPosted: Tue 29 Mar 2011, 14:39    Post_subject:  

russoodle wrote:
Thank you seaside, what a brilliant idea!


Glad I suggested it...and looking forward to seeing it.

Thom
Back to top
View user's profile Send_private_message Visit_website 
Display_posts:   Sort by:   
Page 1 of 3 Posts_count   Goto page: 1, 2, 3 Next
Post_new_topic   Reply_to_topic View_previous_topic :: View_next_topic
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Browsers and Internet
Jump to:  

Rules_post_cannot
Rules_reply_cannot
Rules_edit_cannot
Rules_delete_cannot
Rules_vote_cannot
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0797s ][ Queries: 13 (0.0086s) ][ GZIP on ]