A SAVE-session to directory option added for PUPs [REOPENED]

A home for all kinds of Puppy related projects
Message
Author
User avatar
greengeek
Posts: 5789
Joined: Tue 20 Jul 2010, 09:34
Location: Republic of Novo Zelande

#321 Post by greengeek »

gyro wrote:So, I have no idea what is deleting the appropriate ".wh." file on your system.
I'm bothered by .wh files. I don't like the error messages I saw once when remastering slacko. Are .wh files something to do with correcting problems with layering? Could puppy be made to run without .wh files?
I don't like .wh files.
:(

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#322 Post by mavrothal »

gyro wrote:Looks like we may need to ditch the ydrv and produce at least a patched puppy_slacko_5.7.sfs.
Yep.
Or just include the indicated additional changes in the ydrv.
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

Jasper

#323 Post by Jasper »

Hi greengeek and those who know,

My technical knowledge is near zero (even negative) but, I seem to recall reading that whiteouts are merely a means of hiding files/folders in a display and that they are entirely removed upon remastering?

My regards

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

#324 Post by gyro »

mavrothal wrote:Or just include the indicated additional changes in the ydrv.
Could you please tell me how to get the patched sources for these files, and I will create a new ydrv.

I just unsquashed puppy_slacko_5.7.sfs and shinobar's ydrv_slacko_5.7.sfs. Moved everything from the ydrv into puppy_slacko, Then straight mksquashfs. This works fine, but it's huge, 186MB. I wanted to avoid this. It would take a long time for me to upload such a file.

gyro

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

#325 Post by gyro »

peebee wrote:Then sfs-on-the-fly could not "see" an sfs in the frugal install folder (actually a symlink to an sfs) and would not load it.
It actually is not related to it being a symlink. The problem is that "sfs_load" does not find the frugal install folder, if a "save directory" called just "slackosave" is being used.

@shinobar
Line 1876 of "sfs_load" in Slacko 5.7,

Code: Select all

  SAVEFILE=$(echo $PUPSAVE| cut -sd',' -f3| grep '\.') # PUPMODE=6 or 77 have not '.'
assumes that in pupmode=12, a save file name contains '.'. If the "save file" happens to be a "save directory" called "slackosave", this assumption is false, and $SAVEFILE is empty. Removing "| grep '\.'" from the line allows "sfs_load" to find the frugal install folder in pupmode=12, but I have no idea if it ruins "sfs_load" in other situations.

gyro

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

#326 Post by peebee »

gyro wrote:This works fine, but it's huge, 186MB. I wanted to avoid this. It would take a long time for me to upload such a file.
gyro
Why not make a delta file to be applied to the Slacko iso.....although this will not show the changes being made like the ydrv.sfs does if opened.....
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#327 Post by mavrothal »

gyro wrote:
mavrothal wrote:Or just include the indicated additional changes in the ydrv.
Could you please tell me how to get the patched sources for these files, and I will create a new ydrv.

Code: Select all

git clone https://github.com/puppylinux-woof-CE/woof-CE.git
cd woof-CE
git checkout testing
The files are in their respective place woof-code/rootfs-skeleton/
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

gcmartin

#328 Post by gcmartin »

@Shinobar and @Gyro, might you, again, consider joining WOOF-CE. @Mavrothal has appealed outside of this thread for membership.

Reason: It would allow the contributions you are developing a "slam-dunk" contribution to the overall PUPPY structure versus needed a WOOF-CE person to the mediator for this contribution's entry into PUPPY system builds.

This will NOT affect the testing we do, or the discussion, but would certainly place you in position for things to move easily into and out of the main-branch. Thus, a win-win!

No responses required by anyone to this post!

Here to help

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

updated version of ydrv_slacko_5.7.sfs

#329 Post by gyro »

@mavrothal
Thanks for the code to acess git, I've downloaded it.

@shinobar
Apologies for my hacking of your "sfs_load". It's just to demonstrate where the difficulty is.

@peebee
Creating deltas is a technology I'm not familiar with. Hence the new ydrv.

I've uploaded a new version of the slacko ydrv to http://www.fishprogs.info/puppy/slacko/ ... ko_5.7.sfs.
I started with shinobar's latest ydrv, and replaced/addded the following:
From woof-ce:
bootflash
bootmanager
puppyinstaller
removepreview.sh
And a patched sfs_load, hacked by me.

Note: It might work in PAE slacko, if you just rename it.

gyro

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#330 Post by mavrothal »

From woof-ce:
bootflash
bootmanager
puppyinstaller
removepreview.sh
Just to let you know that today's 666philb's Tahr Puppy 5.8.0.8 has all the latest changes in woof-CE including support in the init and the scripts discussed in this thread for savefolder and a/ydrv!
All is missing is shinobar's shutdownconfig.
So if a pet is provided will be much easier to test and much closer to woof (so hopefully next Tahr puppy will include it :wink: ).

So please use this new puppy for further savefolder development. Will help developing this new puppy and make my life easier :lol:
Of course as gcmartin said would be much easier if you provide woof-CE pull requests :wink:
For example a cleaned up version (ie without the mock-related code and the saveconfig redirection) of shino's shutdownconfig would be a nice pull... :wink: :wink:
Then adding the savefileconfig part as a pet would be up to the developer but at least the full savefolder functionality will be provided in woof.
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

User avatar
peebee
Posts: 4370
Joined: Sun 21 Sep 2008, 12:31
Location: Worcestershire, UK
Contact:

Re: updated version of ydrv_slacko_5.7.sfs

#331 Post by peebee »

gyro wrote:Creating deltas is a technology I'm not familiar with. Hence the new ydrv.
Hi gyro

FYI....

Menu - Utility - Xdelta file difference manager

Cheers
peebee
ImageLxPup = Puppy + LXDE
Main version used daily: LxPupSc; Assembler of UPups, ScPup & ScPup64, LxPup, LxPupSc & LxPupSc64

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

#332 Post by gyro »

mavrothal wrote:So please use this new puppy for further savefolder development. Will help developing this new puppy and make my life easier.
Please note that the "sfs_load" in Tahr Puppy 5.8.0.8 is not patched, and will not find any sfs files in the frugal install directory, if a save directory is used.

gyro

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

#333 Post by gyro »

@peebee
I should have added;
It's also something that's not on my bucket list.
gyro

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#334 Post by mavrothal »

gyro wrote:Please note that the "sfs_load" in Tahr Puppy 5.8.0.8 is not patched, and will not find any sfs files in the frugal install directory, if a save directory is used.
Correct.
SFS_load not in woof but I'm sure shinobar will fix that in his next version (I think there is also another fix by 01Micko, about the new woof icon set, that is pending)
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

User avatar
01micko
Posts: 8741
Joined: Sat 11 Oct 2008, 13:39
Location: qld
Contact:

#335 Post by 01micko »

mavrothal wrote:(I think there is also another fix by 01Micko, about the new woof icon set, that is pending)
No, that was grub4dos-config, but similar does apply.
Puppy Linux Blog - contact me for access

User avatar
shinobar
Posts: 2672
Joined: Thu 28 May 2009, 09:26
Location: Japan
Contact:

My status

#336 Post by shinobar »

Thanks to all.
I am slow but following you.
Downloads for Puppy Linux [url]http://shino.pos.to/linux/downloads.html[/url]

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

Utility to convert a save file to a save directroy

#337 Post by gyro »

I have attached a script called "savefile2dir". It converts a save file to a save directory.
It needs to be run in another puppy or after a "pfix=ram" boot.
It attempts to be safe and detect if the save file is mounted, or stored on an unsupported partition.

The script is a severely hacked "filemnt".

The file has a fake ".gz" extension. Store it somewhere in /mnt/home and rename it to remove the ".gz".

gyro
Attachments
savefile2dir.gz
It's a script, remove the fake ".gz" extension.
(3.93 KiB) Downloaded 578 times

gyro
Posts: 1798
Joined: Tue 28 Oct 2008, 21:35
Location: Brisbane, Australia

encrypted save directory

#338 Post by gyro »

Earlier in the thread, shinobar commented that an encrypted save directory should be possible using something like "cryptofs" or "ecryptfs".
I've done a little investigation, and played with a similar product called "encfs", in a running system. I chose "encfs" because it's totally in user space, and I could download it from the Wheezy repo.
It all looks rather promising because they "mount" an encrypted directory on to an unencrypted directory.
So, in the "init" script using "ecryptfs",

Code: Select all

mount -o bind /mnt/dev_save${PUPSAVEFILE} $CREATEPUPSAVE2FS
becomes

Code: Select all

mount -t ecryptfs /mnt/dev_save${PUPSAVEFILE} $CREATEPUPSAVE2FS
for an encrypted save directory.
Of course it will be a bit more complicated than just that.
The downside is that "ecryptfs" is a kernel module which is not enabled in puppy kernels. So it's going to be difficult to test "ecryptfs" until someone compiles a puppy kernel with

Code: Select all

CONFIG_ECRYPT_FS=m
gyro

gcmartin

#339 Post by gcmartin »

This kernel change would be needed in both 32 & 64 bit future PUPs. And kernel developers would need to know as well. Which for "DUMBIES" like me, I ask:
  • Is there a "PUP Standard Kernel parameters" offering which maps to the kernel which fell into the "Official" PUPs of the past?
  • AND, Is there one that is setup for the WOOF-CE developers, today?
  • Is there value for distro developers to have such?
If one does not already exist, seemingly a discussion area to continue to tweak an agreed kernel parameter set would be useful as time and Linux advances.

The PCs that are in this community do NOT match anything we were seeing, generally, 5 years ago. And, with Microsoft's newest releases in hardware and Apple's upcoming releases, our community will undergo the effects of these new devices; just as ARM devices have affected us. Thus the kernel parameter consistency across PUPs will be generally very important in user reporting and use.

Here to help

User avatar
mavrothal
Posts: 3096
Joined: Mon 24 Aug 2009, 18:23

#340 Post by mavrothal »

@shinobar
Noticed that your shutdownconfig has "fido" inactivated. However I could not see any problem when reinstated. Is it because is not present in pupsaveconfig or somehow is incompatible with svefolder? (how?)
== [url=http://www.catb.org/esr/faqs/smart-questions.html]Here is how to solve your[/url] [url=https://www.chiark.greenend.org.uk/~sgtatham/bugs.html]Linux problems fast[/url] ==

Post Reply