Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Tue 29 Jul 2014, 10:56
All times are UTC - 4
 Forum index » Advanced Topics » Puppy Projects
Pdebthing DEB downloader and packager 005
Moderators: Flash, JohnMurga
Post new topic   Reply to topic View previous topic :: View next topic
Page 1 of 3 [32 Posts]   Goto page: 1, 2, 3 Next
Author Message
Iguleder


Joined: 11 Aug 2009
Posts: 1872
Location: Israel, somewhere in the beautiful desert

PostPosted: Sat 21 Aug 2010, 12:49    Post subject:  Pdebthing DEB downloader and packager 005
Subject description: A tool for fast downloading and packaging of DEB packages with all their dependencies
 

Hello, puppians! Meet Pdebthing, my latest and greatest gift to the Puppy world. Very Happy

What is it?

Pdebthing is a tool for downloading Ubuntu or Debian packages and all their dependencies. It can also extract the downloaded packages so you can make SFSs.

The bottom line: Pdebthing offers fully automated and easy SFS creation for Ubuntu or Debian-based puppies.

What can I do with it?

You can use Pdebthing to download DEB packages with all, but ALL their dependencies.

Pdebthing shines when dealing with big and heavy packages like KDE, Amarok or all GNOME stuff. Pdebthing is really powerful with handling dependencies and can definitely aid you when dealing with such packages.

Also, Pdebthing can extract all the packages it downloads to form one big package. Later, you can use the it for SFS creation. The possibilities are endless.

What are the requirements to run Pdebthing?.

- Run Lupu or any other Ubuntu-built Puppy Wink
- You must have the devx installed.

How do I use it?

First of all, Pdebthing is not for average and non-techy users. You need to be familiar with Puppy and the console in order to be able to use Pdebthing.

Pdebthing has two configuration files: config/preferences and config/packages.

The former contains all preferences. Here's my configuration file (Pdebthing comes with it by default):
Code:
# the Debian version the packages are built for
distroVersion="squeeze"

# the repositories to support: the the Trinity (the KDE 3.x fork) Debian repo, the USA Debian mirror and Debian Multimedia
repositories="http://mirror.its.uidaho.edu/pub/trinity/trinity/debian http://ftp.us.debian.org/debian http://debian-multimedia.org"

# the repository sections to support
sections="main contrib non-free"

# the package architecture (i386/amd64)
arch="i386"

# download all packages (true) or just those that don't come with Puppy (false, the default)?
# (download all packages, including those that ship with Puppy, or only those that don't?)
downloadInstalled="false"


This file contains only 4 parameters:
- A list of Ubuntu or Debian repositories, such as http://mirrors.kernel.org/ubuntu (the official Ubuntu mirror). Remove repositories you don't need.
- The version of the Ubuntu or Debian the packages are compiled for. Can be “hardy", “jaunty", “karmic", “lucid" or “maverick", "lenny", "squeeze" and so on. Use “lucid" if you want to make packages for Lupu and "squeeze" if you make packages for dpup.
- The sections of the repository to support - in Ubuntu you have "main", "multiverse" , "restricted" and "universe", but Debian has "main", "contrib" and "nonfree". Leave all unless you know what you're doing.
- The architecture the packages are compiled for - i386 or amd64. Leave the default of i386 unless you use Fatdog.
- A setting called "downloadInstalled", can be either "true" or "false": if set to "false", packages that come with your Puppy won't be downloaded. Ideal if you want to make SFSs. Bear in mind that the detection of packages that came with your Puppy works only with Lupu or dpup (since their packages use their Ubuntu or Debian names) and packages that went into the devx are treated as packages that came with it.

The "config" directory has two sample files, for Debian Squeeze and Ubuntu Maverick Meerkat. Just take one of them and modify it to suit your needs - just make sure you use the right distro version.

EDIT: add "free" to the repo sections if you use Ubuntu. I found out Medibuntu has just "free" and "nonfree" sections, the former isn't listed in the sample configuration file.

Also, Pdebthing needs a list of packages to download; that’s config/packages. Check their names through packages.ubuntu.com, because some package names are different on Ubuntu and Debian (for instance, glibc’s package is named “libc6“ and libmad’s package is named ”libmad0”).

Here's my package list (Pdebthing comes with it):

Code:
menu-xdg
extra-xdg-menus
kdelibs-trinity
kdebase-trinity


It contains the base Trinity desktop and some freedesktop.org stuff Puppy lacks.

Remember, dependencies are handled automatically. You do not need to specify them, Pdebthing will detect them for you. Just put the names of the packages you want, Pdebthing will take care of the rest.

There's another important thing you should pay attention to - the Trinity repo has all the KDE 3 packages, but the names are different. For example, kdegraphics is named "kdegraphics-tirinity" and kdebase is named "kdebase-trinity". If you want KDE 3.x applications, make sure to add "-trinity" to their names.

EDIT: Trinity packages have a suffix in their name, so they can be installed alongside KDE 4.x packages. The suffix is either "-trinity" or "-kde3" (amarok-trinity, kdebase-kde3). Go to the Trinity website and check the Trinity installation instructions for your distro and distro version of choice, so you know what suffix you should add to package names.

Pdebthing consists of 3 scripts:
- 0download: used to download and process the package lists from the respositories.
- 1download: used to download the packages in the package list. You must run 0setup before you run it, so the package lists are processed and Pdebthing is able to resolve dependencies. It will create three text files: all.txt (all the packages Pdebthing attempted to download), failed.txt (a list of packages Pdebthing could not find or download) and succeeded.txt (a user-friendly list with details of all downloaded packages).
- 2preppkg: an optional script that extracts all downloaded packages into a directory named “sfs”. Inside it, you’ll see a directory named “stuff”, which contains the extracted contents of all downloaded packages. The script will also make a copy of succeeded.txt that can accompany your packages, that’s good for users.

To conclude, in order to run Pdebthing, you need to do the following commands in the terminal (assuming you downloaded Pdebthing to /root):
Code:
# extract Pdebthing and enter its directory
tar xvf Pdebthing-005.tar
cd Pdebthing-005

# edit the configuration and the package list
geany config/preferences
geany config/packages

# process the package lists
./0setup

# get the packages
./1download

# extract the packages
./2preppkg


Then, use dir2sfs or dir2pet to create SFSs or PETs, respectively.

That’s it! Easy!

Does it work? I mean ... is it stable?

Yes, it is stable. I have tested it thoroughly, I can definitely say it works perfectly when I use it to download KDE 3, which is very very very very very heavy, in terms of dependencies and complexity.

Don't you ever forget ... use at your own risk.

Notes

- I run it on a Core 2 Duo and on an Atom N450 netbook, it's slow on the Atom.
- You can run it on any Puppy and pretty much any distro, but you'll need the realpath executable if it's another distro.
- The license is GPL 3. Do whatever you want with it, but please PM me first, I'd like to see what future prospects this project has Smile

Changelog

005:
- Much faster dependency resolution
- Debian compatibility
- Other improvements I don't remember

004:
- Faster getinfo!
- Even faster dependency resolution! OMFG!
- 2preppkg, integration of my package tools.
- Various fixes here and there.

003:
- Rewritten downloadpackage script.
- New getinfo script, this time in Bash and not in Perl, way faster.
- New mkdb script and a new way to process the package lists that makes things go zooooooooooom!
- Way faster dependency resolving thanks to the new getinfo and new mkdb.

002:
- More verbosity
- Improved 1download
- Detection of installed packages
Pdebthing-005.tar
Description  MD5: e9a804a8ab664360433f7d2fe469e4c2
tar

 Download 
Filename  Pdebthing-005.tar 
Filesize  30 KB 
Downloaded  1003 Time(s) 
Pdebthing-004.tar
Description  MD5: ae3d27e27b0ddf5a602135ab85e99e4b
tar

 Download 
Filename  Pdebthing-004.tar 
Filesize  30 KB 
Downloaded  725 Time(s) 
Pdebthing-003.tar
Description  MD5: 1f0f4ce396e60398d532ee88b780d576
tar

 Download 
Filename  Pdebthing-003.tar 
Filesize  20 KB 
Downloaded  717 Time(s) 
Pdebthing-002.tar
Description 
tar

 Download 
Filename  Pdebthing-002.tar 
Filesize  20 KB 
Downloaded  685 Time(s) 
Pdebthing-001.tar.gz
Description  MD5: 7f2218eba7d296fcc5c1eac1cc3dcc11
gz

 Download 
Filename  Pdebthing-001.tar.gz 
Filesize  2.93 KB 
Downloaded  685 Time(s) 

_________________
My homepage

Last edited by Iguleder on Thu 04 Nov 2010, 06:22; edited 16 times in total
Back to top
View user's profile Send private message Visit poster's website MSN Messenger 
ICQ Number 
stu90


Joined: 25 Feb 2010
Posts: 1401
Location: England. Dell Inspiron 1501. Dpup

PostPosted: Sat 21 Aug 2010, 15:32    Post subject:  

Hi Iguleder,
This seems an interesting project you have here - I have made a few .pets with 01micko's alien2puppy but probably fall outside of the ' ultra-uber-super-duper Puppy geeks and totally crazy people' camp but i like to give things a go anyway Very Happy

I have downloaded Pdebthing but seem to be running into some problems.

Setup is frugal install of Lucid 5.1 (do i need to use devx)

Preferences:
Code:
# the Ubuntu/Debian/[...] version the packages are built for
distroVersion="lucid"

# the repositories to support (separated by tabs)
repositories="http://mirrors.kernel.org/ubuntu"

# the repository sections to support
sections="main multiverse restricted universe"

# the package architecture (i386/amd64)
arch="i386"


Packages:
Code:

predict
predict-gsat

(these two packages are in the ubuntu repositories in puppy package manager.

However i seem to to be doing something wrong ?

Here is screen shot of the out put in terminal after running 0setup and 1download
Back to top
View user's profile Send private message 
Iguleder


Joined: 11 Aug 2009
Posts: 1872
Location: Israel, somewhere in the beautiful desert

PostPosted: Sun 22 Aug 2010, 01:36    Post subject:  

Your Perl is bad. Try the devx, if it doesn't have the Switch.pm module Perl needs, try a DEB from packages.ubuntu.com.

Kinda weird, worked like a charm on my Lupu (with the devx), I tested it.

EDIT: I did "find /initrd/pup* -name Switch.pm" ... I think Perl modules are located in the devx, so I guess it is required for Pdebthing to work.

_________________
My homepage
Back to top
View user's profile Send private message Visit poster's website MSN Messenger 
ICQ Number 
paulhomebus


Joined: 21 Jan 2010
Posts: 120
Location: New Zealand

PostPosted: Thu 26 Aug 2010, 23:51    Post subject:  

Success..

Thanks Iguleder, I've used this for a creating a few pets for Lucid 5.1 so far....

Fontmatrix, Scribus 1.3.8b, Gimp 2.7.3, & more to come....
You'll find them in the forum... I upload them to MU's dotpups.de generally.

Again thanks for developing such an awesome tool
Paul
Back to top
View user's profile Send private message Visit poster's website AIM Address 
stu90


Joined: 25 Feb 2010
Posts: 1401
Location: England. Dell Inspiron 1501. Dpup

PostPosted: Fri 27 Aug 2010, 13:08    Post subject:  

paulhomebus wrote:
Success..

Thanks Iguleder, I've used this for a creating a few pets for Lucid 5.1 so far....

Fontmatrix, Scribus 1.3.8b, Gimp 2.7.3, & more to come....
You'll find them in the forum... I upload them to MU's dotpups.de generally.

Again thanks for developing such an awesome tool
Paul


How do you get Gimp 2.7.3, what repositories address do you use?
Back to top
View user's profile Send private message 
paulhomebus


Joined: 21 Jan 2010
Posts: 120
Location: New Zealand

PostPosted: Fri 27 Aug 2010, 15:47    Post subject:  

I used this repository... http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/

I just browsed the files there and found the latest...
https://launchpad.net/~matthaeus123/+archive/mrw-gimp-svn/+packages

Hope this helps Stu90!
Back to top
View user's profile Send private message Visit poster's website AIM Address 
stu90


Joined: 25 Feb 2010
Posts: 1401
Location: England. Dell Inspiron 1501. Dpup

PostPosted: Fri 27 Aug 2010, 16:05    Post subject:  

paulhomebus wrote:
I used this repository... http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/

I just browsed the files there and found the latest...
https://launchpad.net/~matthaeus123/+archive/mrw-gimp-svn/+packages

Hope this helps Stu90!


Hi Paul
thanks for the reply however I still seem to be doing something wrong, when i add http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/
to DEbthing prefrences file and run ./0setup i get this:


error 404 not found.

And with https://launchpad.net/~matthaeus123/+archive/mrw-gimp-svn/+packages i get:

error cannot verify launchpad certificate.

I must have mypreference file set up wrong or something?

preference file:
Code:
# the Ubuntu/Debian/[...] version the packages are built for
distroVersion="lucid"

# the repositories to support
repositories="http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/ http://mirrors.kernel.org/ubuntu"

# the repository sections to support
sections="main multiverse restricted universe"

# the package architecture (i386/amd64)
arch="i386"

# download all packages (true) or just those that don't come with Puppy? (false)
downloadInstalled="false"
Back to top
View user's profile Send private message 
paulhomebus


Joined: 21 Jan 2010
Posts: 120
Location: New Zealand

PostPosted: Fri 27 Aug 2010, 16:45    Post subject:  

yep remove the / (backslash) from here...

Code:
repositories="http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/ <<<!!!! http://mirrors.kernel.org/ubuntu"


And always start with a clean Pdebthing - I don't run it twice... once you have the .deb's just move them out of the repos folder and delete the Pdebthing instance....

I have dpkg -x working on my Lucid, because I installed some apt-get stuff, I assume...
So I just run dpkg -x ******whatever*****.deb ./
on each file in that repo folder... which gives me my install files for the dotpet....

Hope that helped, stu90
Paul
Back to top
View user's profile Send private message Visit poster's website AIM Address 
stu90


Joined: 25 Feb 2010
Posts: 1401
Location: England. Dell Inspiron 1501. Dpup

PostPosted: Sat 28 Aug 2010, 00:06    Post subject:  

paulhomebus wrote:
yep remove the / (backslash) from here...

Code:
repositories="http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu/ <<<!!!! http://mirrors.kernel.org/ubuntu"


And always start with a clean Pdebthing - I don't run it twice... once you have the .deb's just move them out of the repos folder and delete the Pdebthing instance....

I have dpkg -x working on my Lucid, because I installed some apt-get stuff, I assume...
So I just run dpkg -x ******whatever*****.deb ./
on each file in that repo folder... which gives me my install files for the dotpet....

Hope that helped, stu90
Paul


Hi Paul thanks for the tips worked a treat Cool

Now have gimp 2.7.3, i also made the latest stellarium 0.10.5 (pet & sfs) and transmission 2.04 (pet)


Pdebthing is a great little tool, thanks Iguleder
Back to top
View user's profile Send private message 
Iguleder


Joined: 11 Aug 2009
Posts: 1872
Location: Israel, somewhere in the beautiful desert

PostPosted: Sat 28 Aug 2010, 09:53    Post subject:  

I'm really glad to see this tool actually helps somehow Smile

I integrated all my package tools into Pdebthing 003 and added some improvements, this time it's a little bit faster and has the new 2preppkg script that extracts all DEBs, strips everything, optimizes all PNG images and gzip archives, separates DEV/DOC/NLS and makes a SFS from the main part. In other words, it turns Pdebthing into a full SFS/PET creation kit for Lupu Smile

It also keeps the directories with the main, DEV, DOC and NLS components, so you can modify them manually or create packages from them Very Happy

Now I'm doing some testing on my Core 2 Duo, my netbook's Atom can't handle this ... takes time and kills my battery.

Puppy 4eva!!!!! Laughing

EDIT: uploaded, but I decided to leave the PET/SFS creation for the user. Just go to the "sfs" directory, the steamin' hot package is waiting for you there.

_________________
My homepage
Back to top
View user's profile Send private message Visit poster's website MSN Messenger 
ICQ Number 
reckrhodes

Joined: 30 May 2007
Posts: 116

PostPosted: Sat 28 Aug 2010, 11:07    Post subject:    

Hi Iguleder. A happy computing day!

First of all thank you for this tool. (down loading it now)

I wanted to use the Pdebthing to download necessary files for gbrainy and gcompris.

How i wish you could give me some simple guidelines to use your great tool in downloading and making pets or sfs (openoffice and supertux included).

I know that somewhere these packages are already in some places on the forum but i wanted to show some of my co-teachers someday on how to use this Pdebthing of yours. Good luck on your wonderful projects.

By the way, i am using Lucid Puppy Version 5.1. I am so happy with this Puppy. Thank so much to Barry K., playdayz, 01micko, WhoDo and and the rest of the devs and friendly people around here.

I am just lurking around, reading and learning, once again thank you.
Back to top
View user's profile Send private message 
Iguleder


Joined: 11 Aug 2009
Posts: 1872
Location: Israel, somewhere in the beautiful desert

PostPosted: Sat 28 Aug 2010, 11:44    Post subject:  

I'll rewrite this topic with a detailed HowTo just for you Smile

EDIT: done. Wink

_________________
My homepage
Back to top
View user's profile Send private message Visit poster's website MSN Messenger 
ICQ Number 
reckrhodes

Joined: 30 May 2007
Posts: 116

PostPosted: Sat 28 Aug 2010, 20:44    Post subject:  

hi Iguleder, thank you so much for the quick guidelines.

I've got a little error here.

these are what i have done so far

- change the content of /config/packages. i am editing it to supertux
- and preferences to

repositories="http://mirrors.kernel.org/ubuntu http://ppa.launchpad.net/matthaeus123/mrw-gimp-svn/ubuntu"

- key in the following commands. ./0setup, ./1download, ./2preppkg
- i've got stuck to ./2preppkg. it gives error like this

Stripping everything
../strippkg: line 58: optipng: not found
../strippkg: line 58: advpng: not found
../strippkg: line 58: optipng: not found
../strippkg: line 58: advpng: not found
../strippkg: line 58: advdef: not found

- i checked the content of failed.txt. It has these texts
perlapi-5.10.0
upstart-job

I cannot continue with the command dir2sfs or dir2pet because there are no directories that named supertux(s) when i checked the /sfs/stuff directory.

Thank you and I am glad that you take time to response in my previous post.
Back to top
View user's profile Send private message 
paulhomebus


Joined: 21 Jan 2010
Posts: 120
Location: New Zealand

PostPosted: Sat 28 Aug 2010, 22:09    Post subject:  

Sounds like you missed downloading the .deb packages for Optipng and advancecomp.....

Check Iguleder's first post... those packages are seperate from Pdebthing 004

Quote:
- If you want 2preppkg to be able to strip and optimize packages, get AdvanceCOMP and OptiPNG.
Back to top
View user's profile Send private message Visit poster's website AIM Address 
Iguleder


Joined: 11 Aug 2009
Posts: 1872
Location: Israel, somewhere in the beautiful desert

PostPosted: Sun 29 Aug 2010, 04:20    Post subject:  

reckrhodes wrote:
- i've got stuck to ./2preppkg. it gives error like this

Stripping everything
../strippkg: line 58: optipng: not found
../strippkg: line 58: advpng: not found
../strippkg: line 58: optipng: not found
../strippkg: line 58: advpng: not found
../strippkg: line 58: advdef: not found


Get OptiPNG and AdvanceCOMP as I said.

reckrhodes wrote:
- i checked the content of failed.txt. It has these texts
perlapi-5.10.0
upstart-job


That's normal, I always see those packages as failed when I mess with KDE and I see no problems with my packages.

reckrhodes wrote:
I cannot continue with the command dir2sfs or dir2pet because there are no directories that named supertux(s) when i checked the /sfs/stuff directory.


You're supposed to see a directory named "sfs" with a directory named "stuff" under it. The latter is your package. The "sfs" directory should contain stuff_DEV, stuff_DOC and stuff_NLS (in most cases) and a file named included-packages.txt.

By the way: all paths are relative, the "sfs" directory is under the Pdebthing directory, not in /.

_________________
My homepage
Back to top
View user's profile Send private message Visit poster's website MSN Messenger 
ICQ Number 
Display posts from previous:   Sort by:   
Page 1 of 3 [32 Posts]   Goto page: 1, 2, 3 Next
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » Advanced Topics » Puppy Projects
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.1266s ][ Queries: 13 (0.0063s) ][ GZIP on ]