OpenEmbedded: compile Puppy from source

[BarryK]

OpenEmbedded, with my "meta-quirky" customization layer, is available as a tarball:

http://barryk.org/news/?viewDetailed=00546

To run it, your host OS will need the "devx" installed, and python3 -- in the latter case, install it from the PPM, along with all deps.

Afterward, do this:
# ln -s python3.5 /usr/bin/python3
# ln -s python2.7 /usr/bin/python2

as OE wants those names.

After expanding the tarball, you will find a getting started file.

So, anyone who is game, can give it s go. An interesting exercise, that I have not yet tried, will be to configure it for a different target architecture, such as i686 or armv7.

[slackfan]

Some earlier pups, for example Wary and Racy, used binary packages that were compiled from source in T2 (see http://t2-project.org/), however, T2 is not maintained, only one guy does some work on it.

An alternative is OpenEmbedded, which the Yocto project uses. This has 75+ active developers. Despite mainly used for embedded devices, OE can compile anything, even LibreOffice.
So, OE could be used to compile the packages for Woof*, even the Linux kernel.

I don't know if that is really a criterium.

Today, Nutyx appears as a distribution, a kind of standard one, along about 10 years with only one real developper, the Swiss man Thierry Nuttens (and a second one, "pierre" how was always adding one big but accessory environment package, the all KDE compiling it each parution of a new Nutyx one!) being always compiled from A .. Z: all comes from LFS and LFS was never delivered pre-compiled (excepted you go to, even, Nutyx, to get LFS in pre compiled form!).

All 6 .. 12 month did Thierry in the past about renounce to continue his work, so difficult it is to produce and follow as an one-man-show at it's fast rythm of parution the LinuxFromScratch...

but it is now the probably first distribution able to compile all Standard Linux including, now, a lot of other classic environments, not "only" KDE any more, at home from the user, if he is willing so (for ex. to try to compile exactly for his own processor and other hardware etc.) better as install a ready to use distribution.

the process is not automatic any more (3..4 years ago, Nuttens did announce -to fast- to publish his distribution in the future only in not pre compiled form but prepared to be compile from A..Z in real automatic way . but if you follow http://nutyx.org/en/build-pre, the major difficulty is only to mark each next step from the prepared commando lines about unchanged with you mouse in one of your consoles, hit «enter» and continue on the next line and page if you see no error message at this step). The intervention of human is only needing to avoid a complex gestion of the changing stage of login as "root" or "user" and controll the progression of operations (nutyx has also a script permetting the net installation installation out nutyx itself, of course, but also Puppy as far the version of Puppy uses a compatible bash with the bash of LFS. As some Puppy use LFS I suppose those are able to operate it!), and it contribute to let the PC disponible at compiling time for other "users" (youself working or playing at somewhat different!) as you are and let yourself all the time the "director" of all permissions!

but I am sorry to admit, that it is often nonsens for the most people to compile all Linux themself excepted you really will to publish complete distributions!

it is to much!

you can do nothing more excepted that and I see out the other highly interesting home pages from people like Barry Kauler (his page about small camping! Wonderfull!!! Thank you for the page Barry) Barry himself has certainly more interests as only compile and compile all the time !

ideal would be to compile so, as Nutyx does it, a one bone of Puppy including a remastering routine to produce an ISO or a big kernel with all Puppy in it.

advantage: the extrem stability of the system against errors and changes after that is done equal where (home use, community of friends, associations, school, enterprise)...

I, for example, need today only few app's. leafpad, a small browser (luakit is ideal as extensible and permitting all excepted, perhaps, spell control), didiwiki, not forget didiwiki!, rox-filer and rox-terminal (to copy contents from window to window including in CLI!), flashplayer services, mtpaint and viewnior, mplayer2, to see videos, and nted, as I find a person with culture has to be able to use / offer to his children a way to write in music writing, and I install since a few years calligrasheets / calligrawords / kwave / skanlitle / kate as all those are smaller as to install full LO or OO over Puppy and permit, if so or so preinstalled, to continue with low memory need with more powerfull app's from KDE world if you need them as the minimal KDE/QT4 or 5 is already preinstalled (marble, usw.). I always need merkaartor to cartography my environment. I did constat it with the kde4.sfs derivated from Slax: is it loaded, and you have immediately an extended environment mit konqueror, okular, gwenview etc.

so is a full puppy / quirky for me false today: to much stuff I will never more use (my experience with Abiword is, I am sorry: great difficulties with far east writing where Calligra has no problem! Also are Calligra texts like about all standard KDE in about all languages available in constant form including 2 artificial linguages: Esperanto and Interlingue!)...

note after change: Nuttens requires now to use the script to install a nutyx version. it was not required in the past and better as it was possible to compile themself the first Nutyx installation on the own HD (Nutyx can work with "embedded" Chroot's without separate partitions and respects so better the disk organisation of the user as, for ex. TOPLESS!) being working at other things in a good prealable Linux environment including some Puppy's, not all. But there are divers restrictions perturbing the job if not Nutyx, and Nuttens, in his position as one-man-operator also on the forum, he is about always present and ready to help, can really wish, not to be confronted any more to the unprevisible difficulties resulting from a differenting desk surface to work!

[TeX Dog]

Would like to try an ARM build.

I see there are already OpenEmbedded RaspberryPi writeups. Is there a merge step? do we run parallel creates and merge differences after, also can we run in target mode on say big intel box for ARM or are we stuck compiling ARM on ARM?




https://raspinterest.wordpress.com/2017 ... erry-pi-3/

[BarryK]

slackfan and Tex Dog,
I just now had a quick look at Nutyx.

Yes, a one-man show is fine, if the person is dedicated to it. In the case of T2, the developer has a full-time job, and does not put in the time to fix problems or to bring it up-to-date. So many of the packages are ancient, with old techniques, such as still using "module-init-utils" instead of "kmod", and heaps of bugs.

He did comment recently, that he would love to put more time into it, if he was paid for it. But nobody hits his "donate" button.

On the otherhand, OpenEmbedded has 75+ active developers, and has industry participation.

Another important point is that LFS is not a cross-compile system. It is only for x86[_64]. You have to be running a host x86 Linux OS, and build for a x86 target.

T2 and OE on the otherhand, are cross-compiler systems. You run on a x86_64 host Linux OS, and can build for various targets, including ARM (at least with OE you can, T2 is mostly broken these days).
Which I haven't tried yet, keen to do so.

A build for the Pi is on my to-do list ...soon, hopefully.

[don570]

For developers on the Arm platform there is a Kickstarter project
https://liliputing.com/2016/12/firefly- ... r-139.html

_____________________________________________________

[technosaurus]

For developers on the Arm platform there is a Kickstarter project
https://liliputing.com/2016/12/firefly- ... r-139.html

_____________________________________________________

Don't bother. The octa-core odroid XU4 has better support for half the price (2 usb3 ports for 8Tb+ and emmc for fast root filesystem and swap)

[BarryK]

My "meta-quirky" layer for OpenEmbedded is now on github.

Blog announcement:

http://barryk.org/news/?viewDetailed=00576

And github, with a nice readme:

https://github.com/bkauler/oe-qky-src

[scsijon]

Since you told me too, i'm playing with oe (your version), but..

After a bit of reading, and a lot of playing, i'm a little confused still, can I ask for guidance please.

1- How do I find out what packages are already in the list, whether enabled or not, is there an equivalent (think of T2's config file) and where would it be?

2- And where do I add files I want included, that don't seem to be already there?

I'm using xerus 8.3 and there are a few name changes and extras not as dependancies, from xerus8.1.6 for the extra packages. Do you want a 8.3 list?

Oh, yes, using a frugal build seems to fail as we are using all the ram up before a build is completed. I'm going to reinstall a full xerus 8.3 as the partition was origonally just for testing and has nothing keepable on it.

thanks
-------
ps barryk.org brings up a contact support message." Webmaster please contact hostgater.com" and the associated links are being redirected to what I call JUNK pages.
ie, unrelated to puppy. Do you need to change your domain account?

[BarryK]

Since you told me too, i'm playing with oe (your version), but..

After a bit of reading, and a lot of playing, i'm a little confused still, can I ask for guidance please.

1- How do I find out what packages are already in the list, whether enabled or not, is there an equivalent (think of T2's config file) and where would it be?

2- And where do I add files I want included, that don't seem to be already there?

I'm using xerus 8.3 and there are a few name changes and extras not as dependancies, from xerus8.1.6 for the extra packages. Do you want a 8.3 list?

Oh, yes, using a frugal build seems to fail as we are using all the ram up before a build is completed. I'm going to reinstall a full xerus 8.3 as the partition was origonally just for testing and has nothing keepable on it.

thanks

You need to build in a partition with heaps of space, maybe 200GB - 500GB.

Instructions:

https://github.com/bkauler/oe-qky-src/b ... /readme.md

...it explains that "# bitbake -g core-image-quirky" will create a package-list.

To add or remove packages, edit buildPC/conf/local.conf

[s243a]

Barry, I can recommend the Synology DS216J 2-Bay NAS. This is a reliable, fast and quiet NAS.

The DiskStation OS is topnotch, with lots of configuration settings. It even has its own 'app' store!

I use this NAS (in 'RAID 1' aka mirroring) for storage and streaming media. My older DS212j 2-bay unit I bought years ago now serves as an archive.

http://www.austin.net.au/synology-ds216j-2-bay-nas.html

Just in case anyone else decides to do this research, I looked into the most economical method of getting a 1Gbit SATA file server and found the banana pi m1 (in headless mode) to be the most bang for the buck (<$40)... plus you get an extra dual core arm system with a mali GPU for distributed builds. Note that later versions of the banana pi use an inferior usb2->sata controller that severely limits speed. Although the product page states that the m1's drive size is limited to 2Tb, various forums report success with 4Tb.

Edit: for usb3 the lemon pi is a similar price point, but it appears to be poorly documented, which in my experience usually means some of the driver work is still incomplete/experimental.

Here are two boards with USB 3.0:
Banana Pi R2

ROC-RK3328-CC (Renegade)

[scsijon]

...., using a frugal build seems to fail as we are using all the ram up before a build is completed. I'm going to reinstall a full xerus 8.3 as the partition was origonally just for testing and has nothing keepable on it.

thanks

You need to build in a partition with heaps of space, maybe 200GB - 500GB.

Instructions:

https://github.com/bkauler/oe-qky-src/b ... /readme.md

...it explains that "# bitbake -g core-image-quirky" will create a package-list.

To add or remove packages, edit buildPC/conf/local.conf

The partition space wasn't the problem as I gave it 512gig to play around in, it was that I was trying to build from 8.3 frugal which seems to want to run everything in ram. Changed over to a 8.3 full install and it built ok. I was trying an initial test run with -minimal rather than -quirky. Now I know it's right I will start a test run with -quirky next and see how that goes.

However, in the last couple of weeks, i've been pointed at sourcemage, the spinoff from when sorcerer initially vanished from the linux world. I have been starting to play with it and it's interesting. However using the wayback machine i've found git and iso copysets from sourcerer itself which in turn a couple of days ago lead me to a git dated dec2017, so someone is still working on sourcerer. I want to see which packages it contains and how up to date it's packages are, and if it can deal with updates, so that goes first for this month. It'd be nice to add apps dynamically by building them and their dependencies on the fly and that's what the sourcerer and sourcemage linux's are proposed to do.
Maybe I'll start a puppy sourcery http://puppylinux.org/wikka/PuppySourceryinstead of fighting my way through with T2 again. Look like a basic Puppy, but allow users to build those extra packages they themselves want dynamically. I won't bet on it yet as I suspect there are a few getchas in the pipe to work through.

[scsijon]

And a full build is underway.......

Two minor changes with your latest set of oe-qky-source-master.zip build package.

Bacon has updated to 3.7, if we/you need to use 3.5.4 it's now in the museum directory rather than stable, i'll try first with 3.7 after working how to use recipetool and adding your code from 3.5.4 to the new bacon-3.7.dd. I've left the 3.5.4.dd there by adding a .org on the end and the builder seems to have ignored it;
EDIT1: no failed on compile so will go back to 3.5.4 for now and see what happens there.

Vcdimager's .dd file has wrong source paths pointing to kernel.org rather than gnu.org, copied the origonal one to a .dd.org and modified the .dd and it now finds the source ok.

EDIT2+ for now below

Schroedinger's home and download pages have changed to https://launchpad.net/schroedinger. The sourceforge url takes you to a website that hasn't been populated yet.

Sane has it's own site http://www.sane-project.org/source.html but uses debian (usa) for storage of versions https://alioth.debian.org/frs/?group_id=30186. The origonal link takes you to a site with the latest version 1.0.27, not 1.0.25.

Anything happens tomorrow will just halt it as i'll be elsewhere for most part.

[BarryK]

And a full build is underway.......

Two minor changes with your latest set of oe-qky-source-master.zip build package.

Bacon has updated to 3.7, if we/you need to use 3.5.4 it's now in the museum directory rather than stable, i'll try first with 3.7 after working how to use recipetool and adding your code from 3.5.4 to the new bacon-3.7.dd. I've left the 3.5.4.dd there by adding a .org on the end and the builder seems to have ignored it;
EDIT1: no failed on compile so will go back to 3.5.4 for now and see what happens there.

Vcdimager's .dd file has wrong source paths pointing to kernel.org rather than gnu.org, copied the origonal one to a .dd.org and modified the .dd and it now finds the source ok.

I think mcewanw already tried to bump up the version of bacon, but it failed.

There is another problem with bacon. Although the 'popup' utility compiles, it is partly broken.

Compiled with a much old version of bacon, it works properly.

So, in Easy, I have created z_popup PET package, with popup compiled in a running easy, with bacon 3.0.2.

...that's only a temporary workaround.