Puppy Linux Discussion Forum

Caneri · Joined: 04 Sep 2007 Posts: 1580 Location: Canada

Hi Tom,

I wonder if adding puppyfiles.ca to the search in Petch would be helpful as well.

MU mirrors his dotpups.de there and if he is down then puppyfiles.ca is available. There are instructions on how to use puppyfiles.ca on the front page there from MU.

I'm not sure if there is a package list for puppyflies.ca though, but there must be as PSI can use it...Maybe Mark can answer that one.

Best,
Eric

MU · Posted: Tue 16 Sep 2008, 13:37 Post subject:

these folders have dotpups.txt, also in small .bz2 format:
http://puppyfiles.ca/dotpupsde/dotpups/
http://puppyfiles.ca/dotpupsde/puppy3/dotpups/

I just see, this one has none yet, I will add it this week:
http://puppyfiles.ca/dotpupsde/puppy4/dotpups/

Mark

tombh · Joined: 12 Jan 2007 Posts: 422 Location: Bristol, UK

@ndujoe1: Didn't see yer post there before, thanks!

@Eric: Where should Petch live on .ca then? Puppyfiles.ca is already included, that's what I really mean when I say dotpups.de as I assumed that the former is a mirror of the latter.

@MU: Thanks, I already had http://puppyfiles.ca/dotpupsde/dotpups/ but not
http://puppyfiles.ca/dotpupsde/puppy3/dotpups/ so I added it.

Pizzasgood · Posted: Thu 18 Sep 2008, 12:27 Post subject:

Cool. This would be even better if we set up that attachment list, because then it could grab stuff from the forum too. What would be ideal in that respect is just a single .php page that ran an sql query for all .pet, .pup, etc. files (so we don't get things like conky.jpg screenshots).

I happen to have a (disabled) phpBB forum on my site, so I'll see about throwing something like that together this weekend. If I can get something more or less working on my end I can email it to John and see if he'll upload it to the server.

cb88 · Joined: 28 Jan 2007 Posts: 1169 Location: USA

thanks tombh this is a great development

Lobster · Posted: Thu 18 Sep 2008, 19:26 Post subject:

Works OK in Muppy
Should be in Puppy - is it too late for 4.1? Crying or Very sad

Certainly should be in 4.2 Cool

Brilliant!
This could be called from the package manager . . .

tombh · Joined: 12 Jan 2007 Posts: 422 Location: Bristol, UK

@Pizzasgood: Yes it would be even better wouldn't it. I imagine phpBB stores all its attachments in a sub-folder somewhere -- so if worse comes to worse I guess at the least we could just have a PHP script (without any SQL calls) make a daily list of, say all .pets, below a certain directory.

So for anyone that's interested I've attached the script that MU wrote to do this on dotpups.de and how Caneri now does it on puppylinux.ca too.

@cb88: Thanks.

@Lobster: I don't know if Barry will want it in his Puppy because it doesn't just search the official ibiblio repository. But he's very welcome if he does though!
No worries about meeting up Smile

HairyWill · Joined: 26 May 2006 Posts: 2949 Location: Southampton, UK

tom
how about getting petch to look for updated packages

for each installed package search for versions with a higher version number

If you call petch on an already installed package it could report the current installed version number.

Pizzasgood · Posted: Mon 22 Sep 2008, 20:18 Post subject:

I looked at that file and dug up the one it creates at puppylinux.ca. Is there any particular reason for the second path entry for each item?

The forums attachments are all stored in the files/ subdirectory, but there's an index.php file there to block a file list from being generated by the server. So we could use something like what you posted, except that it wouldn't filter out packages that are inside a PM. I doubt that anybody would put something confidential inside a .pet package, but you never know. A more likely concern is if they put something inside a .tar.gz file, which I currently have this set to grab.

So I went ahead and wrote something that runs a couple simple queries so it can filter out attachments. Just making something to output a list is too simple, so I added a second mode to it. You can visit it with no options and have a more detailed list, with the file creation time, the attachment description, a link to the post it was posted in, the username of the person who uploaded it, and a link to that user's profile. That list also shows the package's original name, before the forum adjusts things to avoid overwriting existing packages.

The basic mode is accessed by providing the ?view=basic option in the URL. Then it outputs plain-text (set the header to text/plain so the browser treats it like a .txt file) formatted just like the dotpups.txt file on Caneri's server.

One thing to note is that the forum does rename a package after you upload it if the name would conflict with an existing package. It stores the original name, and under normal circumstances I suppose it copies the file to a temporary directory and renames it to that before letting you download it. Nether modes of this script bother with that. The fancy view will display the original name in the link, but the downloaded file uses the actual name the forum named it. The basic view only shows the actual name, since AFAIK I can't have it show the real name without messing up the format (unless this is the function of that duplicate path, which is the main reason I asked about it).

Right now it will grab any file with the following extensions, except those that are inside a PM: 'pet', 'pup', 'zip', 'tar', 'gz', 'rar', 'rpm', 'deb', 'tgz', 'tbz', 'bz2'

I don't have a demo up yet, because it turned out I needed to install the modifications that this forum is using, and I was too lazy to mess around with doing that remotely with my website. I do have a local server running that I tested it on, so I can attach some screenshots along with the actual script. I'll try to rig up a demo later tonight, or maybe tomorrow after I get done with my errands and homework.

Incidentally, the entry in the screenshot that says "anon" and "N.A." is an attached file that isn't associated with any post or PM. They happened accidentally when I was uploading something but didn't finish the post. Apparently the forum doesn't associate them with anything until the post/PM has been submitted, so they were stranded with no data in the DB to link them to a user. In the admin panel they turn up as belonging to "Guest" and can be manually deleted. There are also some buttons to "clean up" the forum, so I imagine one of them can probably deal with such items.

lluamco · Joined: 16 Mar 2007 Posts: 207 Location: Banyoles, Spain

Hi Tom.
Thank you for your nice and useful program! I have detected one problem, though. Pets located at dotpups.de do not appear. It seems that the source dotpups.de is not recognized by the search engine. Or am I misunderstanding something?
Thanks

tombh · Joined: 12 Jan 2007 Posts: 422 Location: Bristol, UK

@HairyWill: What a neat idea! I'll look into it Smile

@Pizzasgood: Umm, I can't see any reason for there being a second path entry for each item, that's just the way MU's original script is. At the moment though the search script takes the SOURCE field from the first path entry and the DIRECTORY field from the actual URL of the text file that all the entries are contained within (e.g. http://127.0.0.1/puppytest/package_list.php?view=basic). Therefore, I don't think the second path entry is actual used at all!

Well it looks great Smile

Maybe one thing to consider could be saving the output as a stand alone file, if the file was accessed a lot then it would incur less CPU load if PHP/SQL calls weren't being run all the time -- obviously then you'd need a cron job to update that text file every so often. But hopefully we can set it up so that Petch never calls your script directly, but calls a copy of it stored on puppylinux.org.

@lluamco: Thanks Smile

Can you give some examples?

lluamco · Joined: 16 Mar 2007 Posts: 207 Location: Banyoles, Spain

Caneri · Joined: 04 Sep 2007 Posts: 1580 Location: Canada

Hi Lluis,

puppyfiles.ca here in Canada is the mirror for MU's dotpups.de in Germany and should be exactly the same as MU's main server.

When you see this
[ 1] - puppylinux.ca | puppyfiles | cups-1.1.23-1.pet (1606782)
this file is exactly the same on dotpups.de.

I'll let MU speak on that to be sure.

Petch is evolving so some directories/package lists will be updated in the near future...but tombh,MU will be the ones to respond to this.

Best,
Eric

lluamco · Joined: 16 Mar 2007 Posts: 207 Location: Banyoles, Spain

Thanks Eric,
I was erroneously expecting to read dotpups.de as Source, my mistake.
Thanks again for clarifying and sorry for the noise...

Caneri · Joined: 04 Sep 2007 Posts: 1580 Location: Canada

Hi lluamco,

Questions are not noise but helpful.

Now I see that trying to pull a specific pet form puppyfiles.ca/dotpups.de is not working for me also.

My above post is wrong..the phrase [ 1] - puppylinux.ca | puppyfiles | cups-1.1.23-1.pet (1606782) is coming from puppylinux.ca/puppyfiles..sorry...hey I'll figure this out yet.. Wink

Best,
Eric

PS I'll keep my mouth shut and listen for awhile..then I may be of use.