Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Fri 21 Sep 2018, 02:39
All times are UTC - 4
 Forum index » Advanced Topics » Cutting edge
Another re-write of the "init" script - using OverlayFs?
Moderators: Flash, Ian, JohnMurga
Post new topic   Reply to topic View previous topic :: View next topic
Page 9 of 14 [196 Posts]   Goto page: Previous 1, 2, 3, ..., 7, 8, 9, 10, 11, 12, 13, 14 Next
Author Message
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Tue 23 Jan 2018, 08:57    Post subject:  

peebee wrote:
New delta for LxPupSc made with overlay_init-0.2....
Don't bother trying to boot this using isoBooter, it won't work.
The 'init' script ignores the BOOT_SPECS file. The whole booting from an iso stuff in 'init', needs to be reworked.
gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Tue 23 Jan 2018, 09:52    Post subject:  

peebee wrote:
New delta for LxPupSc made with overlay_init-0.2....
I just tried using this iso with the "UEFI Installer" in Tahrpup 6.0.6, and it failed on 2 accounts.
1. It didn't copy the BOOT_SPECS file from the iso.
2. It didn't provide a "pupsfs" (or "pdrv") boot parameter.
After manually fixing these 2 ommissions, it all worked fine.

This deficency in the installer is not surprising, since in the past neither of these were requirements.

So, this still ends up being a manual frugal install.

gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Wed 24 Jan 2018, 08:58    Post subject:  

I've uploaded an iso delta file of the current version 0.2++, against "artfulpup-17.11+12.iso".

With some help from peebee, I've written a script that creates a patched iso that actually boots.
And now I've produced a delta from "artfulpup-17.11+12.iso" to "artful-overlay-17.11+12.iso".

This is not a release of a new version, rather a test of producing an iso and a delta.
I uploaded it mainly because it represents an iso that actually boots, and the delta is so small (1.8MiB).

Fixing the "init" and utilities to work correctly with actually booting an iso, is what I've been working on since the release of version 0.2.

For what it's worth, here it is.
Download from http://www.fishprogs.software/puppy/initrd/artfulpup-17.11+12.iso___artful-overlay-17.11+12.iso.delta.

Note: My script uses an overlayfs stack to "merge" my mods with the parent iso.
I created a "mods" directory containing the patched files.
Mounted the parent iso on a "release" directory, and copied it's "isolinux.bin" to "mods".
Then mounted an overlay stack on the directory "stack", with "mods" as the read/write directory, and "release" as the lower read-only directory.
I then did a "mkisofs" using the "stack" directory.

gyro
Back to top
View user's profile Send private message 
ally


Joined: 19 May 2012
Posts: 1838
Location: lincoln, uk

PostPosted: Wed 24 Jan 2018, 11:29    Post subject:  

full ISO here: http://archive.org/download/Puppy_Linux_Artfulpup/artful-overlay-17.11_plus12.iso

Smile
Back to top
View user's profile Send private message Visit poster's website 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Wed 24 Jan 2018, 16:19    Post subject:  

@ally,
Thanks.
gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Sun 04 Feb 2018, 03:58    Post subject: Release of overlay_init-0.3  

Release of overlay_init-0.3

Download from http://www.fishprogs.software/puppy/initrd/overlay_init-0.3.tar.

There's also a delta for artfulpup-17.11+12.iso http://www.fishprogs.software/puppy/initrd/artfulpup-17.11+12.iso___artfulpup-overlay0.3-17.11+12.iso.delta.
And an untested http://www.fishprogs.software/puppy/initrd/artfulpup-17.11+13.iso___artfulpup-overlay0.3-17.11+13.iso.delta.
I'm open to suggestions for other deltas.

I'm uploading deltas simply because they are so small compared to a full iso.
And I assume that you already have the ".iso" of the Puppy you would like to test.

This release is mainly about support for booting an ".iso", using a multi-session DVD or isoBooter.

Changes:

1. I've reverted pupmode=37 back to pupmode=21.

2. Introduced a pupmode=93. This is what you get when you choose "Archive" as a save mechanism when booting a multi-session DVD.
It's a lot like pupmode=77, only different.
Like pupmode=21, on shutdown, it makes a tar archive of the rw layer in tmpfs.
On reboot it extracts the latest tar image into the empty rw layer in tmpfs.

3. To facilitate item 2, there is a new utility called "dvd-append-files" to write a list of files to a multi-session DVD.
For any other media it will do nothing.
It accepts multiple files, since sometimes "rc.shutdown" has to write a new copy of BOOT_SPECS as well as the tar archive.
It automatically adds a 4 digit number to the provided file names to ensure that the files written to the DVD are unique,
and that the latest will sort as the last filename.
There is also a "dvd-check" utility wich will indicate any problems with the media in a specified device.

4. Both pupmode=21 and pupmode=93 create ".tar.gz" files, to save space, without sacrificing too much time.

5. BOOT_SPECS is now called "${DISTRO_FILE_PREFIX}BOOT_SPECS" e.g. "slackoBOOT_SPECS".
Based on the curtrrent parctice of "${DISTRO_FILE_PREFIX}save" e.g. "slackosave".
This is to provide some uniqueness when it gets written to the root of a device.

6. "init" now supports a default BOOT_SPECS in the "initrd.gz".
This is to enable Puppy non-standard sfs files to be included in first boot, e.g. "overlay_mods.sfs".
This is created by the "overlay-setup" script, and my script to update an iso.

7. "init" now supports the "psavemark=" boot parameter,

8. "init" now runs 'date "+%F %R %z"' after any clock set.
The output of this command ends up in "/initrd/tmp/bootinit.log".

9. "init" will now boot with only 1 sfs file.
For later convenience, this "init" creates a read-only overlay stack of all the sfs files, mounted at "/initrd/pup_sfs".
Unfortunately overlayfs does not support the creation of such a stack with only 1 layer.
This can occur if several of the sfs files get renamed and hence fail to mount, so you are left with only a puppy...sfs.
"init" now handles this situation, and continues the boot, (although booting a modern Puppy without a zdrv is often not pretty).

To try this version, use the same procedure as for overlay_init-0.1,
see http://www.murga-linux.com/puppy/viewtopic.php?t=110636&start=96.
Please note step 0, things to check before you start.

Note:
I obviously need to make available a utility to generate an overlay iso from a standard iso.
The one I currently use is not very transportable, and depends on "overlayfs" being active, and uses the utilities contained in "overlay_mods.sfs".
So, currently you need a running overlay Puppy to produce an overlay iso.

gyro

Last edited by gyro on Sun 04 Feb 2018, 04:12; edited 3 times in total
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Sun 04 Feb 2018, 04:07    Post subject:  

ally wrote:
full ISO here: http://archive.org/download/Puppy_Linux_Artfulpup/artful-overlay-17.11_plus12.iso

Smile
Now that I have released overlay_init-0.3 deltas.
Would you please delete this file as it represents no particular version of overlay_init.
gyro
Back to top
View user's profile Send private message 
peebee


Joined: 21 Sep 2008
Posts: 3467
Location: Worcestershire, UK

PostPosted: Sun 04 Feb 2018, 07:27    Post subject: Re: Release of overlay_init-0.3  

gyro wrote:
Release of overlay_init-0.3

And an untested http://www.fishprogs.software/puppy/initrd/artfulpup-17.11+13.iso___artfulpup-overlay0.3-17.11+13.iso.delta.

gyro

Looks good here.....
Screenshot.png
 Description   
 Filesize   58.03 KB
 Viewed   328 Time(s)

Screenshot.png


_________________
LxPup = Puppy + LXDE
Back to top
View user's profile Send private message Visit poster's website 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Sun 04 Feb 2018, 08:11    Post subject:  

@peebee,
Great, thanks for testing.
gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Sun 04 Feb 2018, 08:34    Post subject: mk-overlay-iso script  

A "mk-overlay-iso" script is attached as "mk-overlay-iso-0.1.gz".

To use:
Download into an empty directory and rename to "mk-overlay-iso".
Download "overlay_init-0.3.tar" into the same directory.
In a console window in this directory, run "mk-overlay-iso /path/to/puppy.iso".
It should produce a "puppy-overlay0.3.iso" file in the same directory.

Unfortunately this version uses "overlayfs" and some utilities in "overlay_mods.sfs", (contained in "overlay_init-0.3.tar").
It will refuse to do anything if these are not available.
If you don't have a running overlay_init-0.3 Puppy, you should be able to use "mk-overlay-iso" if your kernel supports "overlayfs", by issuing a "modprobe overlay" command, and loading "overlay_mods.sfs" with "sfs_load".

I tested this script against "slacko-700-RC3_k4.4.70-PAE_2017-12-10.iso", the resultant iso booted fine under isoBooter.
So I uploaded a delta http://www.fishprogs.software/puppy/initrd/slacko-700-RC3_k4.4.70-PAE_2017-12-10.iso___slacko-overlay0.3-700-RC3_k4.4.70-PAE_2017-12-10.iso.delta.

gyro
mk-overlay-iso-0.1.gz
Description  Fake .gz, simply rename to "mk-overlay-iso"
gz

 Download 
Filename  mk-overlay-iso-0.1.gz 
Filesize  2.43 KB 
Downloaded  84 Time(s) 
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Mon 05 Feb 2018, 00:01    Post subject: Using an overlay iso with Puppy installers - warning  

If you generate an overlay iso and try to use it with one of the Puppy install programs to do a frugal install, the result install will probably not boot.
1. The installer probably failed to copy the overlay_mods.sfs to the install directory.
2. The installer did not specify a "psfspart=" boot parameter, (or a "pdev1=", or "pupsfs=" or "pdrv=").
This "init" needs to be told which partition the Puppy is installed on.
This is done by using one of the above boot parameters.
And of course, if the insatll is to a sub-directory, this needs to be specified with a "psfsdir=" boot parameter, (or "psubdir=").

gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Mon 05 Feb 2018, 00:19    Post subject: isoBooter recommendation  

If booting an overlay iso using isoBooter, I recommend:

1. Use a 2 partition device.
Partition 1 as vfat for isoBooter.
Partition 2 as Linux partition, for savefolder, e.g. ext4

2. Answer '2' to the "Choose a partition" question.

3. Answer 'n' to the "splash screen" question.
This means grub4dos boots using the Puppy files inside the iso, rather than booting the iso itself.
This provides you with a "kernel" line in "menu.lst", to which you can add boot parameters.

4. Edit the "menu.lst" file and replace "pfix=fsck" with a "TZ=" parameter appropriate to your timezone.
For Queensland, Australia, I add "TZ=AEST-10".

Note: "overlay_mods.sfs" contains a "showTZ" utility which displays a TZ parameter that should be appropriate to your timezone.

gyro
Back to top
View user's profile Send private message 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Sun 11 Feb 2018, 12:21    Post subject: Release of overlay_init-0.4  

Release of overlay_init-0.4

Download from http://www.fishprogs.software/puppy/initrd/overlay_init-0.4.tar.

There's also a delta for artfulpup-17.11+13.iso http://www.fishprogs.software/puppy/initrd/artfulpup-17.11+13.iso___artfulpup-overlay0.4-17.11+13.iso.delta.
And one for slacko-700-RC3_k4.4.70-PAE_2017-12-10.iso http://www.fishprogs.software/puppy/initrd/slacko-700-RC3_k4.4.70-PAE_2017-12-10.iso___slacko-overlay0.4-700-RC3_k4.4.70-PAE_2017-12-10.iso.delta.

I'm uploading deltas simply because they are so small compared to a full iso.
And I assume that you already have the ".iso" of the Puppy you would like to test.

This release is just a bug fix release. Only some utilities in "overlay_mods.sfs" have changed.
So if you have a working overlay_init-0.3, you only need to replace "overlay_mods.sfs".

Changes:

1. "saveconfig" -> "Folder" contains a "Default" button which was frequently not shown when it could have been.
The "Default" button is now shown more appropriately.

2. Replaced "overlay-setup" with "overlay-setup-frugal".
It will now update a normal frugal install if it has either,
both "initrd.overlay.gz" and "overlay_mods.sfs" added to it,
or, an "overlay_init-" ".tar" file added to it.
It also does a more complete cleanup of un-needed files.

3. It includes a new "overlay-make-iso" utility.
Open a console in a directory containing only an "overlay_init-0.4.tar" file,
and issue a command like "overlay-make-iso /path/to/puppy-7.iso".
This will produce a new "puppy-overlay0.4-7.iso".

Note on multisession DVD:
I was able to "upgrade" my overlay_init0.3 DVD, with the following:
I used "dvd-append-files" to append the new "overlay_mods.sfs" to the DVD.
This resulted in a file called "overlay_mods-1001.sfs" being written to the DVD.
I then booted the DVD and used "System-SFS manager" to modify the "ABOVE" sfs list,
by removing the "overlay_mods.sfs" entry, and adding "overlay_mods-1001.sfs", (and moving it to the top of the list).
On reboot, it loaded "overlay_mods-1001.sfs", and so became a working overlay_init0.4 DVD.

gyro
Back to top
View user's profile Send private message 
01micko


Joined: 11 Oct 2008
Posts: 8680
Location: qld

PostPosted: Mon 12 Feb 2018, 07:16    Post subject:  

Generated from delta the slacko version, booted fine without any messages without a timezone arg.

Setup timezone, touchpad, wireless, my shares (client side) had a quick browse then, for lack of a working installation tool [ I really should merge f2fs installer and UEFI usb installer and make them overlay compliant and offer ext2,3,4 filesystems ], rebooted and saved the archive back to DVD. Rebooted fine, connected to network and shares working. Everything else saved fine. Posting from said now.

Cheers!

_________________
Puppy Linux Blog - contact me for access
Back to top
View user's profile Send private message Visit poster's website 
gyro

Joined: 28 Oct 2008
Posts: 1542
Location: Brisbane, Australia

PostPosted: Fri 16 Feb 2018, 05:55    Post subject:  

@01micko,
Thanks for testing.

That's one of the thiings I like about the "Archive" save mechanism,
when you realise you don't have everything setup for a "Folder" based install,
you can just choose "Archive" and not lose any of the mods you have made.

gyro
Back to top
View user's profile Send private message 
Display posts from previous:   Sort by:   
Page 9 of 14 [196 Posts]   Goto page: Previous 1, 2, 3, ..., 7, 8, 9, 10, 11, 12, 13, 14 Next
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » Advanced Topics » Cutting edge
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.1006s ][ Queries: 13 (0.0274s) ][ GZIP on ]