Puppy Online Database

Under development: PCMCIA, wireless, etc.
Message
Author
tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

Puppy Online Database

#1 Post by tlchost »

There is a new online database for Puppy pet and sfs files, and another one is in development for derivatives.

The database is user maintained, has minimal eye candy, and can be searched on any field.

The goal of the database is to provide a location where information about pets and sfs files can be easily found and accessed.

None of the files are stored on the site, but links to the files and appropriate discussion areas are maintained.

The database structure is as follows:
--------------------------------------------------------------------
ID:
Name:
Date:
ITEM_Name:
ITEM_Type:
Desktop
Utility
Document
Network
Fun
System
File_System
Calculate
Internet
Drivers
Setup
Graphics
Personal
MultiMedia
Windows_Manager
INFO_URL:
DOWNLOAD_URL:
Purpose:
Notes:
Comments:
--------------------------------------------------------------------------------

Sample Entry
------------------------------------------------------------------------------
ID: 1
Name: tlchost
Date: 21-May-2009
ITEM_Name: growler-amp_412.sfs
ITEM_Type: Internet
INFO_URL: http://www.murga-linux.com/puppy/viewto ... 7&start=21
DOWNLOAD_URL: http://minipc.org/lamp/growler-amp_412.sfs
Purpose: LAMPP(Apache,phpMyAdmin,MySql) for puppy
Notes: For web development, virtual hosts may not work correctly on bootable USB drive.
Comments:
---------------------------------------------------------------------------------

If you know of, or have developed a pet or sfs that you feed should be included in the database, or simply want to view it, please visit
puppylinux.us

I am in the process of finalizing the structure for a database to handle derivatives. At this point the I'm thinking of
---------------------------------------------------------
ID:
Name:
Date:
ITEM_Name:
PUPPY_BASE:
Kernel:
INFO_URL:
DOWNLOAD_URL:
Purpose:
Notes:
Comments:
--------------------------------------------------------

Comments and suggestions are requested and voluteers who can assist in information checking and/or editing are welcome.

Thom
Last edited by tlchost on Sat 01 Aug 2009, 16:51, edited 1 time in total.

User avatar
Lobster
Official Crustacean
Posts: 15522
Joined: Wed 04 May 2005, 06:06
Location: Paradox Realm
Contact:

Re: Puppy Online Database

#2 Post by Lobster »

tlchost wrote: The database is user maintained, has minimal eye candy, and can be searched on any field.
Well done :)
Are you intending to integrate/work with this initiative?
http://www.petstore.puppyspace.org/

tlchost wrote: Comments and suggestions are requested and volunteers who can assist in information checking and/or editing are welcome.

Thom
I hope you and Guy find volunteers
but you may end up having to find, upload and maintain :shock:
(there are those that love the idea of helping
and then there are those with the capacity)

Any volunteers?
Puppy Raspup 8.2Final 8)
Puppy Links Page http://www.smokey01.com/bruceb/puppy.html :D

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

Re: Puppy Online Database

#3 Post by tlchost »

Lobster wrote:
tlchost wrote: The database is user maintained, has minimal eye candy, and can be searched on any field.
Well done :)
Are you intending to integrate/work with this initiative?
http://www.petstore.puppyspace.org/
Thanks for the compliment. I don't think the petstore and this project can be integrated....they have different design bases. I suppose each one could reference the other.

Lobster wrote: I hope you and Guy find volunteers but you may end up having to find, upload and maintain :shock:
(there are those that love the idea of helping and then there are those with the capacity)
Good point....but like the various things I've given to others...if they use it wisely they profit...if they don't, then it's their loss.

Hopefully there will be a number of folks that take the small amount of time to make entries so that others will benefit

Sort of like like teaching a man to fish instead of giving him a fish when he's hungry.

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#4 Post by BarryK »

Hi, it's ok to have your own database, but you should get it to generate a database-file in the format now used for Woof-builds, and which will be the standard for future puppies.

http://puppylinux.com/woof/index.html
http://puppylinux.com/woof/ppm.htm
http://puppylinux.com/woof/pkg-db-format.htm

A script on your site could generate that database file, and then the Puppy Package Manager can read it and offer the packages for installation.

Note that all pet packages built by recent alpha puppies using the 'dir2pet' utility have a 'pet.specs' file in them which is the database entry for that package.
[url]https://bkhome.org/news/[/url]

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#5 Post by tlchost »

BarryK wrote:Hi, it's ok to have your own database, but you should get it to generate a database-file in the format now used for Woof-builds, and which will be the standard for future puppies.
It appears that the only way that would work is if the database
structure was changed to be in this format:

http://puppylinux.com/woof/pkg-db-format.htm

Would that mean whoever adds to the database would have to enter all the information in the above format?

I did not envision the database to be as sophisticated as to install things, but simply offer a description and a link to discussion threads and/or downloads.

Perhaps what you're detailing could be a future database project.

Thanks for the input.

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#6 Post by BarryK »

Your suggested database entries, description, puppy-base, etc., already cover what would be in the standard puppy data base format.
It would just be a matter of reading that information, plus the subdirectory where the package is located and name of package, and generating a database file that the PPM can read.

Not hard at all.

The only thing extra is the dependencies. This is something that is overlooked by the various PET repos, but is most important. The user can be asked to enter a list of other pet pkgs that are dependencies, if they aren't already builtin to Puppy -- the format in which that list is entered would be up to you, it could just be a comma-separated list.
-- the only difference in my standard database entries is that each dependency is prefixed with a '+' or a '-' -- again, a script can easily insert that.

In other words, it does not require a "future database project", just a script that can read your database and generate the standard puppy database file. It would be a single file, and all I would need to know is the URL of the file and I can point the PPM to it.

Of course, if you are not into Bash scripting, then you would need help to do it.
[url]https://bkhome.org/news/[/url]

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#7 Post by tlchost »

BarryK wrote:Your suggested database entries, description, puppy-base, etc., already cover what would be in the standard puppy data base format.

In other words, it does not require a "future database project", just a script that can read your database and generate the standard puppy database file. It would be a single file, and all I would need to know is the URL of the file and I can point the PPM to it.

Of course, if you are not into Bash scripting, then you would need help to do it.
The database is flatfile....and the application is in perl. I'd be happy to setup the fields to do what you're saving.

The current database entry looks like this
13|gposil|16-Jul-2009|OpenOffice310_JRE_lzma_413.sfs|http://|http://gposil.com/sfs/OpenOffice310_JRE_lzma_413.sfs|OpenOffice 3.10|||gposil

Thom

Most likely I could use some help with the scripting....I have a habit of shooting myself in the foot...and I'm getting low on toes.

I have a trepidation....how can we assure the information input will be accurate? Perhaps I've missed something.

User avatar
gposil
Posts: 1300
Joined: Mon 06 Apr 2009, 10:00
Location: Stanthorpe (The Granite Belt), QLD, Australia
Contact:

#8 Post by gposil »

tlchost,

as long as we put a PACKAGES.txt file with the database entries as follows:

pkgname|nameonly|version|pkgrelease|category|size|path|fullfilename|dependencies|description|

we will be right
[img]http://gposil.netne.net/images/tlp80.gif[/img] [url=http://www.dpup.org][b]Dpup Home[/b][/url]

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#9 Post by tlchost »

gposil wrote:tlchost,

as long as we put a PACKAGES.txt file with the database entries as follows:

pkgname|nameonly|version|pkgrelease|category|size|path|fullfilename|dependencies|description|

we will be right
I can understand what Barry wants/needs .... but I also want stuff that a non-tekkie user, like me, might need.

What I don't see in the above is kernel....and for me, I need to know what kernel is used because my Acer laptop doesn't live with all kernels.

I think if we all work together, things will really convenient for folks....I look at the Online Database as an entry portal, what you have done as detailed information and source for downloads, and what Barry wants to do as "official"

I can see that the pet/sfs database needs to have a 'category' field added....I think I'll use what you have to cut down the confusion...

Now to modify the database without destroying it....I guess I may loose some more toes as I aim for me feet.

Thom

User avatar
russoodle
Posts: 707
Joined: Fri 12 Sep 2008, 17:36
Location: Down-Under in South Oz

Wanna borrow some more toes?

#10 Post by russoodle »

tlchost wrote: .... but I also want stuff that a non-tekkie user, like me, might need.

Now to modify the database without destroying it....I guess I may loose some more toes as I aim for me feet.

Thom
I'm another non-tekkie user and what i know about scripting wouldn't fill a flea's ear but i reckon i might have some toes with Puppy's name on, so if you think i could help in some way, give me a holler.

:D

russoodle
[i][color=Green][size=92]The mud-elephant, wading thru the sea, leaves no tracks..[/size][/color][/i]

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#11 Post by BarryK »

The kernel, yes, I was thinking of adding that to my database, as field-14.

There are currently three optional fields on the end,

compiled-distro|distro-release|repo-name|

For example:
ubuntu|jaunty|official|
...means that the package was compiled in Ubuntu Jaunty (or our equivalent Upup) and is hosted on the 'official' repo at ibiblio.org.
Any of those fields are optional, and probably in most cases the 'repo-name' could be left out.

Anyway, I might support this:

ubuntu|jaunty||2.6.29.6|

That is, the kernel it is compiled for as field-14. The line must always have a trailing '|'.

But, I was thinking of supporting a notation like this
+=2.6.29.6
==2.6.29.6
-=2.6.29.6
Using the '+' instead of '>' and '-' instead of '<' as we use gtkdialog which has xml files and need to avoid '>' and '<' characters (I have code that filters them out).

The meaning would be that '+=' the package is designed for that kernel version or greater, '==' the package must be used with that kernel only, '-=' the package must be used with that kernel or less.
No prefix, just '|2.6.29.6|' would be just informational, stating what kernel was used.

I will probably be extending the dependencies field to support package versions, with these '+=', '==' and '-=' prefixes.

No problem if your database has the normal '>=' or '>=' or '>' or '<' as I can translate it.

Note, if a PET package is compiled for the Puppy 4.x series, those extra fields should be at least:

|puppy|4|||

...recommended to have that information, aids the PPM to filter out inappropriate packages.
[url]https://bkhome.org/news/[/url]

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#12 Post by BarryK »

In other words:

pkgname|nameonly|version||category|size|path|fullfilename|dependencies|description|puppy|4||

...extra info on the end to show this package is compiled for Puppy 4.x.

Of course, an architecture-independent package, one that only has scripts, may work on any puppy, Upup, Dpup, Ppup, Tpup, etc., so leave those last fields off or just empty:

pkgname|nameonly|version||category|size|path|fullfilename|dependencies|description||||
[url]https://bkhome.org/news/[/url]

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#13 Post by BarryK »

I am also discussing this in my blog:

http://puppylinux.com/blog/?viewDetailed=00931
[url]https://bkhome.org/news/[/url]

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

Re: Wanna borrow some more toes?

#14 Post by tlchost »

russoodle wrote:I'm another non-tekkie user and what i know about scripting wouldn't fill a flea's ear but i reckon i might have some toes with Puppy's name on, so if you think i could help in some way, give me a holler.
I can think of lots of ways that folks missing toes can help. Once I add a drop down selector for catagories, I can see that folks using a pet/sfs file. even if they didn't develop it, could add information.

Have you looked at the database? I'm open to comments and suggestions.

Thanks,
Thom

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#15 Post by tlchost »

BarryK wrote:In other words:

pkgname|nameonly|version||category|size|path|fullfilename|dependencies|description|puppy|4||
The | in a field causes a problem, as the application uses | as
as a marker for the beginning of a field. Is there anyway around that?
BarryK wrote: ...extra info on the end to show this package is compiled for Puppy 4.x.
.............
so leave those last fields off or just empty:

If no information is entered for a field, there is nothing before the | end of field marker.

So, a name database for First, Middle, Last might look like this
|Sam||Smith
|Alfred|E|Newman

If you think it might be of help, I can set up a database that we can use for testing.

Thanks for considering adding kernel information....and I'll watch the blog.

Thom

User avatar
BarryK
Puppy Master
Posts: 9392
Joined: Mon 09 May 2005, 09:23
Location: Perth, Western Australia
Contact:

#16 Post by BarryK »

You don't have to use '|' as a delmiter. If you create a database file on your site, which has all the information I require for the puppy standard database, PPM can download your file and parse it, convert to the standard format.
[url]https://bkhome.org/news/[/url]

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#17 Post by tlchost »

BarryK wrote:You don't have to use '|' as a delmiter. If you create a database file on your site, which has all the information I require for the puppy standard database, PPM can download your file and parse it, convert to the standard format.
Hmmm, I do have to use | as a delimiter...but if you can convert it, that's great.

Give me the exact fields you need(I think you were considering adding at least one for kernel and I'll create a database that can be used for testing.
Once it works and you can use the data I can put it online.

I would expect that some way to import information from petstore will
have to be developed.

Thom

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

Database Modification

#18 Post by tlchost »

The Online Puppy Database has been modified to allow for the entry of a type designator for sfs and/or pet files.

Folks who have previously entered items are encouraged to modify their entries. The types are selectable from the list below:

ITEM_Type:
Desktop
Utility
Document
Network
Fun
System
File_System
Calculate
Internet
Drivers
Setup
Graphics
Personal
MultiMedia
Windows_Manager
Thom

puppyite

#19 Post by puppyite »

You asked for suggestions and I have two:
1 Please give the username and password on your site for puppylinux.asia.
2 People like myself who are on dialup would appreciate knowing the file size before attempting to download a file.

My 2 cents.

tlchost
Posts: 2057
Joined: Sun 05 Aug 2007, 23:26
Location: Baltimore, Maryland USA
Contact:

#20 Post by tlchost »

puppyite wrote:You asked for suggestions and I have two:
1 Please give the username and password on your site for puppylinux.asia.
2 People like myself who are on dialup would appreciate knowing the file size before attempting to download a file.
Hmmmm, good points.....let me see if I can modify the database.

Thom

Post Reply