Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Tue 23 Sep 2014, 22:32
All times are UTC - 4
 Forum index » House Training » HOWTO ( Solutions )
Partially automated remastering of sfs files
Moderators: Flash, Ian, JohnMurga
Post new topic   Reply to topic View previous topic :: View next topic
Page 2 of 3 [31 Posts]   Goto page: Previous 1, 2, 3 Next
Author Message
RSH


Joined: 05 Sep 2011
Posts: 2420
Location: Germany

PostPosted: Wed 15 Jan 2014, 20:00    Post subject:  

Quote:
No need to shout, mikeb.

Quote:
Just want to bring some colour to thee world.

Anyway, ever heard of anyone shouting in green?

As far as I know, I never heard of calling it "a shout" if one is using large fonts.

Only if using strictly capital characters (ABCDEFG).

How ever: did never understand that. To me its just another "stupid law" of internet behavior.

_________________
LazY Puppy
RSH's DNA
SARA B.
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Wed 15 Jan 2014, 20:09    Post subject:  

Its ok...I saw green as apposed to red....

the therapy is kicking in and I feel fine now Smile

mike

lets have a party instead

Back to top
View user's profile Send private message 
artsown

Joined: 12 Sep 2012
Posts: 147

PostPosted: Thu 16 Jan 2014, 15:05    Post subject:  

Smithy, I located a discussion on removing the .XLOADED file and the fix works to get rid
of the bootup mesage concerning a power fail when running without a personal Save file
after remastering. You add the line:
rm /etc/.XLOADED
to /etc/rc.d/rc.local

To make this stick I created a personal Save file temporarily instead of editing during the
remastering process. That way, I can simply use the full normal remaster script without
interruption and editing.

So this is the second addition to my original procedure (which assumes the use of a personal
Save file initially while doing modifications to puppy). I haven't yet experimented with simply
turning off compression completely in mkquashfs instead of using the version with very
light compression. Been busy with other things here.

Thanks to all for your inputs. Hope my inputs help those interested in remastering machine-
specific and personalised pups we can use without personal Save files.

Art
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Thu 16 Jan 2014, 16:04    Post subject:  

Size and speed without any compression are similar to using tar. a 50MB save on this pentium 3 takes half a second to a second to hard drive for example.

I think the xloaded detection is in /etc/profile...its pretty pointless so you might want to remove it...if its not there its in xwin... on windows and been a while and dodgy memory.

mike
Back to top
View user's profile Send private message 
artsown

Joined: 12 Sep 2012
Posts: 147

PostPosted: Thu 16 Jan 2014, 18:28    Post subject:  

Mike, I tried using no compression and the total remaster time dropped from 100 to 80
seconds while the resulting squash file size increased from 221 meg to 395 meg. The
221 meg was with the minimal compression ... with full compression the file size is
about 200 meg. There is some boot speedup without compression since no decompression
is required ....a drop from about 40 seconds to 30 seconds full to no compression.

I'm working on some other things, and don't know if I'll be running more tests and accumulating
more data or not. Seems to me that users would be very interested in seeing the results
of such tests.

Anyway, thanks for nudging me into trying out the no compression option.

Art
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Thu 16 Jan 2014, 18:51    Post subject:  

no problem ...perhaps some of the time consumed is related to data transfer rather then compression. I had 5 seconds compared 1 second... in my case making an sfs of pup_rw containing ~30mb data using full and zero compression...pentium 3 machines with decent ide drives/cache.

Another point is mksquashfs has options for which part of the system is compressed and how duplicate files are handled... though the bulk of time savings are with compressing the main data.

Was your figure with the lower compression special build of mksquashfs..I am not clear on that. If so that does sounds interesting if we can have ~40% compression with only a 20% penalty. Loading times varied only a little...it was the save at shutdown that speed became a factor.

When making sfs files I do find up to 50% faster if I use sfs without lzma (standard squashfs) as apposed to with, with a size gain of 10-20%, but in those instances speed is not essential.

Some more scientifically compile statistics would be a good idea ...I will apply myself to that

mike
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Thu 16 Jan 2014, 18:56    Post subject:  

Ok a quick reread...are your time figures including the cp parts? Would explain the marginal gain there....

mike
Back to top
View user's profile Send private message 
artsown

Joined: 12 Sep 2012
Posts: 147

PostPosted: Thu 16 Jan 2014, 19:40    Post subject:  

Mike, yes and yes. The low compression refers to that special mksquashfs having low
compression ... that link I had posted. And yes, total times include copying times.

Art
Back to top
View user's profile Send private message 
Smithy


Joined: 12 Dec 2011
Posts: 431

PostPosted: Thu 16 Jan 2014, 19:42    Post subject:  

Just adding my remastering notes that have been gathered from the guys on the forum. Think they match up Artsown.
Removal of:
X seems to have exited uncleanly the last time you ran puppy
this is usually because of a power failure.
If not just wait 30 seconds to start

Another simple way to get around this is to just add to /etc/rc.d/rc.local:
Code:
Code:   
rm  /etc/.XLOADED (Confirmed, this is the best one).


When X is started, /etc/.XLOADED is created, so if X wasn't exited properly (like the classic "fsckme" flag: on a proper shutdown it will be deleted ; if it's not deleted you know the system has crashed).
If the periodic saving is used (or if the user manually saves with snapmergepuppy), then the saving happens while X is running, thus .XLOADED is also saved to the save file (mounted on /initrd/pup_ro1), so you need to delete it or X won't automatically start on next boot.
The same happens if you backup your save file.


ANSWER:
/etc/.XLOADED is one of the very few files you need not to copy into /tmp/etc while remastering .
Otherwise the dialogue is to be found in /usr/bin/xwin script .

The do not remove flash drive message....
usr/sbin/delayedrun..Lines 116-124 comment out. Breaks Puppy badly.
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Thu 16 Jan 2014, 19:53    Post subject:  

Ok makes sense...I was considering ONLY mksquashfs times (standard remaster and sfs save) where you would probably find a large speed difference but in your script ..cp of the whole system plus save will be taking a good chunk of the time. So I am not going mad Very Happy ..just my usual confused state.

For my saves obviously mksquashfs is the only factor since nothing else is used and speed of shutdown has to be good.

Not exactly comparing apples and oranges but useful info has been brought up regardless......

mike
Back to top
View user's profile Send private message 
Smithy


Joined: 12 Dec 2011
Posts: 431

PostPosted: Tue 28 Jan 2014, 15:36    Post subject:  

Mike,are you saying that one could theoretically shove all the contents of puppy onto a usb stick for example, all uncompressed, and that it would boot up really fast?

I was thinking that if they were all uncompressed at least you could tweak things, and it would all be done there and then without having to squash it up again.

I'm pretty much done with isos these days and just use vmlinux, initrd.gz, puppy main sfs and the syslinux cfg and the msg and pretty picture on boot.
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Tue 28 Jan 2014, 15:49    Post subject:  

Quote:
Mike,are you saying that one could theoretically shove all the contents of puppy onto a usb stick for example, all uncompressed, and that it would boot up really fast?

no lol

I was in my case referring to how I save on puppy.

What you might be after is making a full install on a usb stick...there have been threads on the subject in the past.

Closest I have is a frugal save file containing the full system...so like a full in a frugal buit thats aimed at fat32/ntfs partitions.

mike
Back to top
View user's profile Send private message 
Smithy


Joined: 12 Dec 2011
Posts: 431

PostPosted: Tue 28 Jan 2014, 16:54    Post subject:  

Quote:
What you might be after is making a full install on a usb stick...there have been threads on the subject in the past.


Maybe, but the post highway could be littered with puppy roadkill of abandoned experiments Wink

It took me weeks to wonder why the sticks wouldn't boot puppy until a good old rcrn51 howto produced the magic code:

2. Plug in the flash drive but don't mount it. Type:

Code:
Code:
syslinux /dev/sdxy


So I sort of stick to how Barry K designed it to be used (I think).
Like you said, there was some good stuff brought up on remastering from those at the coalface. I'm handing out the canaries at the lift shaft
Back to top
View user's profile Send private message 
mikeb


Joined: 23 Nov 2006
Posts: 8253

PostPosted: Tue 28 Jan 2014, 17:15    Post subject:  

Hmm i would guess the method was to make the installer think the flash stick was a hard drive.

That info is gained from /etc/rc.d/PUPSTATE where usb and hard drives are listed separately ...moving over or adding the flash drive might be all thats needed the follow the hard drive procedure.

syslinux for booting or I usually use grub4dos with bootlace.com /dev/sd(x)

a full on a stick is probably less of a problem than pupmode 13 and speed wise few of use still have only usb1 around...I actually did run XP from an SD card on a netbook...was fine so I cannot see puppy being a problem.

mike
Back to top
View user's profile Send private message 
Smithy


Joined: 12 Dec 2011
Posts: 431

PostPosted: Tue 28 Jan 2014, 17:27    Post subject:  

Yes, I would think puppy would thrash much less than xp.
Did you turn off virtual memory in xp when you ran from sd card?

I know you are a fan of win2k, a guy once told me you could run a city on win2k.

Maybe that mayor of New York pressed a button to close the bridges and caused traffic chaos.
Back to top
View user's profile Send private message 
Display posts from previous:   Sort by:   
Page 2 of 3 [31 Posts]   Goto page: Previous 1, 2, 3 Next
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » House Training » HOWTO ( Solutions )
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0806s ][ Queries: 11 (0.0038s) ][ GZIP on ]