Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Sat 14 Dec 2019, 16:03
All times are UTC - 4
 Forum index » Taking the Puppy out for a walk » Announcements
Arch Linux new package format
Moderators: Flash, Ian, JohnMurga
Post new topic   Reply to topic View previous topic :: View next topic
Page 1 of 1 [6 Posts]  
Author Message
mistfire

Joined: 04 Nov 2008
Posts: 1284
Location: PH

PostPosted: Wed 16 Oct 2019, 10:25    Post subject:  Arch Linux new package format  

Arch Linux will replace xz compression with zstd for distributing their packages. The new extension will be "*.pkg.tar.zst". Time to update the PPM and packit

https://www.archlinux.org/news/required-update-to-recent-libarchive/
Back to top
View user's profile Send private message 
sc0ttman


Joined: 16 Sep 2009
Posts: 2772
Location: UK

PostPosted: Mon 02 Dec 2019, 06:14    Post subject: Re: Arch Linux new package format  

mistfire wrote:
Arch Linux will replace xz compression with zstd for distributing their packages. The new extension will be "*.pkg.tar.zst". Time to update the PPM and packit

https://www.archlinux.org/news/required-update-to-recent-libarchive/

And Pkg I guess..

I'd like to do so, to keep the door open to the possibility or making an Arch or Alpine based Puppy,
so I intend to support those package types in Pkg..

..So even we don't get round to supporting Arch and Alpine repos themselves, users will still be able
to download and install those packages, if they wish.

That's the plan anyway, so thanks for bringing this to my attention.

_________________
Pkg, mdsh, Woofy, Akita, VLC-GTK, Search
Back to top
View user's profile Send private message 
lmemsm

Joined: 27 Jun 2012
Posts: 43

PostPosted: Thu 05 Dec 2019, 14:33    Post subject:  

Was interested to read about this and decided to try out zstd compression. libarchive (bsdtar) is supposed to have support for zstd according to the libarchive web site. However, when I tried it out, it didn't look like the support was built it. Downloaded the zstd source and installed the library. Then I rebuilt libarchive. I did some tests of building tarballs with different compression formats using libarchive as the package. gzip and bzip2 resulted in files with more than twice the size of the zstd file. However, when I compared it to lzma and xz, the results weren't so spectacular. For this particular test case, lzma did better followed by xz and then zstd. The difference between all of three of them was within 2K. I used zstd -19 when compressing.

Leaves me wondering why Arch is making the switch to zstd. I didn't see a significant improvement in space saved. The compression time wasn't even worth measuring for this test case. Was considering whether I should integrate zstd support in BSD gzip. It already has xz support. From what I've seen so far, don't know if it would be worth the effort. Besides gnu tar and libarchive/bsdtar and the Arch Linux package management tools, are there any other applications that have integrated zstd compression/decompression support?
Back to top
View user's profile Send private message 
tallboy


Joined: 21 Sep 2010
Posts: 1572
Location: Drøbak, Norway

PostPosted: Sat 07 Dec 2019, 00:05    Post subject:  

If nobody but Arch users use it, it will die out by itself...
_________________
True freedom is a live Puppy on a multisession CD/DVD.
Back to top
View user's profile Send private message 
01micko


Joined: 11 Oct 2008
Posts: 8739
Location: qld

PostPosted: Sat 07 Dec 2019, 02:34    Post subject:  

Raspbian squasfs-tools supports zstd, tar too.

In my tests on raspup squash, it does compress/decompress faster than xz on all my boards (pi zero, pi 3, pi 4) however size is closer to gzip compression. I'm guessing debian is supporting zstd as well. I do know that slackware has support for it in the kernel and tar in -current, and probably squash.

IDK what the fuss is about - was invented by facebook devs!

_________________
Puppy Linux Blog - contact me for access
Back to top
View user's profile Send private message Visit poster's website 
lmemsm

Joined: 27 Jun 2012
Posts: 43

PostPosted: Sat 07 Dec 2019, 10:00    Post subject:  

Read somewhere that it might be used in browsers to speed up transfer of certain types of files on the Internet. Some browsers are also using Google's brotli for that sort of thing. Unfortunately, I think it's just making browser code more complex to have so many formats to support.

Also read that it's been incorporated in GNU tar and I just rebuilt libarchive (bsdtar) with zstd support. The library source is here:
https://github.com/facebook/zstd
If it's built before libarchive, libarchive tries to use it as a dependency. Haven't found it in use anywhere else yet. Am wondering whether it's worth adding in when I build my compression/decompression tools or not. I did mention it on the lfs-chat list and someone on the BLFS project added it in as optional for libarchive ( http://www.linuxfromscratch.org/blfs/view/svn/general/libarchive.html ).

There is a setting in the zstd command line program to emphasize compression time or compression size. So, compression may not be as good if you don't have it set properly. As mentioned, I tested with a setting of 19.
Back to top
View user's profile Send private message 
Display posts from previous:   Sort by:   
Page 1 of 1 [6 Posts]  
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » Taking the Puppy out for a walk » Announcements
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0382s ][ Queries: 12 (0.0062s) ][ GZIP on ]