How to download multiple SRA files with prefetch in ubuntu?
0
0
Entering edit mode
3.4 years ago

I created a download list

grep -E 'SRR|ERR' XDR_169_ids.txt > downloads.txt

## Find SRAs from SRS:
grep 'SRS' XDR_169_ids.txt | parallel "esearch -db sra -query {} | efetch --format runinfo | cut -d ',' -f 1 | grep SRR" >> downloads.txt

## Now make sure there are no duplicates, then download using GNU parallel to have 4 (or as many your disk can handle) streams in parallel:
sort -u downloads.txt | parallel -j 4 "prefetch {}"

Files were not downloaded.

RNA-Seq • 1.4k views
ADD COMMENT
0
Entering edit mode

prefetch does not unpack the files, just prefetches them (places them in a storage system for later commands that need it)

if you want to see files you need to use fastq-dump

ADD REPLY
0
Entering edit mode

In which folder did you check? It does not load it to the current directory unless you tell it to. Otherwise it goes to the one that is specified in vdb-config -i. There should be files with .sra suffix. See also Fast download of FASTQ files from the European Nucleotide Archive (ENA) or get direct download links via sra-explorer.info

ADD REPLY
0
Entering edit mode

or as many your disk can handle

Don't forget about your network. If you don't have enough bandwidth you may end up killing all downloads.

ADD REPLY

Login before adding your answer.

Traffic: 2004 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6