Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Thu 27 Nov 2014, 12:18
All times are UTC - 4
 Forum index » House Training » Users ( For the regulars )
Wget gets error using Ubuntu file search page.
Moderators: Flash, Ian, JohnMurga
Post new topic   Reply to topic View previous topic :: View next topic
Page 1 of 1 [5 Posts]  
Author Message
sunburnt


Joined: 08 Jun 2005
Posts: 5042
Location: Arizona, U.S.A.

PostPosted: Tue 06 Nov 2012, 04:43    Post subject:  Wget gets error using Ubuntu file search page.  

The Ubuntu site has a search page for packages and files. http://packages.ubuntu.com/

I need to find and download the packages that needed files are in, especially libraries.

This is the resulting page URL from searching for a library:
http://packages.ubuntu.com/search?searchon=contents&keywords=libfusion-1.2.so&mode=filename&suite=precise&arch=i386

The wget command line:
Code:
wget -P /mnt/sdb3/AppPkg/tools/0_dnld http://packages.ubuntu.com/search?searchon=contents&keywords=libfusion-1.2.so&mode=filename&suite=lucid&arch=i386

Using the Ubuntu page manually finds the file, but wget downloads an error page.
The error:
Code:
  <h1 class="documentFirstHeading">Error</h1><!-- messages.tmpl --><div class="perror">
 <p>keyword not valid or missing</p>

I`m a little surprised it does not work, after all it`s the same URL.
Ubuntu it seems is being tricky with their site access.

tecnosaurus gave me a repository search page, but it fails to find the file also.
I tried many combinations of the values in the search page`s URL, none worked.

### This is critical to building packages automatically. ###

I can`t think of another way to find the package containing a given file.
It would be great if Ubuntu had a download file listing "file to package".
Even with a "package to file" list I could write a script to make one.

Once the package is known, the mirrors can be easily navigated for download.
Back to top
View user's profile Send private message 
sunburnt


Joined: 08 Jun 2005
Posts: 5042
Location: Arizona, U.S.A.

PostPosted: Tue 06 Nov 2012, 05:40    Post subject:  

I found exactly what I need in a parent directory of one of Ubuntu`s mirrors.
It`s a "contense" file that`s 257 MB in size. But it does file to package.

But including this huge file in an app. is kinda out of the question.
I still really need a good online search engine to do this.
Either that or the app. will download the 257 MB file to the user`s PC.


# UPDATE: I was able to grep the file down to libs. only, now it`s 2.1 MB.!
So it` 235 KB gzipped, not bad at all if I do say so myself...

Not all lib. files start with lib, and not all have .so in them ( but most do ).
Back to top
View user's profile Send private message 
SFR


Joined: 26 Oct 2011
Posts: 1101

PostPosted: Tue 06 Nov 2012, 07:20    Post subject: Re: Wget gets error using Ubuntu file search page.  

sunburnt wrote:
The wget command line:
Code:
wget -P /mnt/sdb3/AppPkg/tools/0_dnld http://packages.ubuntu.com/search?searchon=contents&keywords=libfusion-1.2.so&mode=filename&suite=lucid&arch=i386

Using the Ubuntu page manually finds the file, but wget downloads an error page.
The error:
Code:
  <h1 class="documentFirstHeading">Error</h1><!-- messages.tmpl --><div class="perror">
 <p>keyword not valid or missing</p>


Hey Sunburnt.

Try wrapping the URL in quotes.

I guess the problem is that the URL string contains &, so without quotes the URL is probably truncated right before the first occurence of &:
wget -P /mnt/sdb3/AppPkg/tools/0_dnld http://packages.ubuntu.com/search?searchon=contents
and the process is sent to background...

Greetings!

_________________
[O]bdurate [R]ules [D]estroy [E]nthusiastic [R]ebels => [C]reative [H]umans [A]lways [O]pen [S]ource
Omnia mea mecum porto.
Back to top
View user's profile Send private message 
RSH


Joined: 05 Sep 2011
Posts: 2420
Location: Germany

PostPosted: Tue 06 Nov 2012, 07:44    Post subject:  

Hi.

Using wget in console and url without the double quotes downloads the error page.

Using wget in console and url with double quotes downloads the page.



Seems to be the &.

I just did saw the new post by SFR and did know he has something like a solution. Cool

_________________
LazY Puppy
RSH's DNA
SARA B.
Back to top
View user's profile Send private message 
sunburnt


Joined: 08 Jun 2005
Posts: 5042
Location: Arizona, U.S.A.

PostPosted: Wed 07 Nov 2012, 18:31    Post subject:  

Hey thanks guys!

I prefer the idea of using active web site pages. That way it`s always up to date.
A static page has creeping errors from web site changes and has to be updated.

This should be the last item for the AppPkg Builder to be able to do local packages.
Now to just tie it all together, I`ve got most of that done, lots of testing to do.
Back to top
View user's profile Send private message 
Display posts from previous:   Sort by:   
Page 1 of 1 [5 Posts]  
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » House Training » Users ( For the regulars )
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0564s ][ Queries: 11 (0.0031s) ][ GZIP on ]