[BiO BB] How to FTP 34,000 protein files? Is it possible?

[Theodore H. Smith]

Aha,

So that was what I was missing. --retr-symlinks thanks!

I also updated my wget to version 1.10.2, from the old 1.8.2, so  
hopefully this version can handle a large number of files.

On 11 Dec 2005, at 13:44, Lutfullah Kakakhel wrote:

> I just had a look at the ftp site given in the orignal message .  
> The filenames are actually symbolic links.
> $ wget -m -c --retr-symlinks ftp://ftp.rcsb.org/pub/pdb/data/ 
> structures/all/pdb
> will retrieve them all in one go:
>
> =================================================
> --18:04:34--  ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb/ 
> pdb160d.ent.Z
>            => `ftp.rcsb.org/pub/pdb/data/structures/all/pdb/ 
> pdb160d.ent.Z'
> ==> CWD not required.
> ==> PASV ... done.    ==> RETR pdb160d.ent.Z ... done.
> Length: 34
>
> 100%[====================================>] 14,097        15.93K/s
>
> 18:04:37 (15.89 KB/s) - `ftp.rcsb.org/pub/pdb/data/structures/all/ 
> pdb/pdb160d.ent.Z' saved [14,097]
>
> --18:04:37--  ftp://ftp.rcsb.org/pub/pdb/data/structures/all/pdb/ 
> pdb160l.ent.Z
>            => `ftp.rcsb.org/pub/pdb/data/structures/all/pdb/ 
> pdb160l.ent.Z'
> ==> CWD not required.
> ==> PASV ... done.    ==> RETR pdb160l.ent.Z ... done.
> Length: 34
>
> 100%[====================================>] 39,930         9.37K/ 
> s    ETA 00:00
>
> The directory structure saved is :
> your_home_directory/ftp.rcsb.org/pub/pdb/data/structures/all/pdb
>
> into which you should see all the downloaded files:
> pdb05c1.noc.Z  pdb0in3.noc.Z  pdb100d.ent.Z  pdb114d.ent.Z   
> pdb131d.ent.Z
>
> --Lutfullah
>
> _______________________________________________
> Bioinformatics.Org general forum  -   
> BiO_Bulletin_Board at bioinformatics.org
> https://bioinformatics.org/mailman/listinfo/bio_bulletin_board


--
http://elfdata.com/plugin/

What does our work achieve, if it's not making the world a happier  
place?
http://www.whatnextjournal.co.uk/Pages/Next/Happiness.html
When's the last time you thought deeply about how to improve our lives?