Prefetch error while downloading data from sequence read archive
0
0
Entering edit mode
4.1 years ago
Denis ▴ 290

Hi! I'm using prefetch command from SRA Toolkit on HPC cluster to download SRA data, but got stuck into error:

2020-03-26T16:34:59 prefetch.2.10.0 int: transfer incomplete while reading file within network system module - Cannot KStreamRead: https://sra-downloadb.be-md.ncbi.nlm.nih.gov/sos2/sra-pub-run-13/SRRXXXXXXX/SRRXXXXXX.X

How can i fix that?

software error • 2.3k views
ADD COMMENT
1
Entering edit mode

Did you check these?

https://github.com/ncbi/sra-tools/issues/100

https://github.com/ncbi/sra-tools/issues/143

How many downloads run in parallel?

ADD REPLY
0
Entering edit mode

Thaks for your reply. I don't run them in parallel, but sequentially one by one inside one for loop. Before prefetch running i've executed:

/home/sratoolkit.2.10.0-ubuntu64/bin/vdb-config -s /http/timeout/read=1000000000

It seems that above command helps but not in all cases.

ADD REPLY
1
Entering edit mode

Alternatively, you can also search for your accessions via https://sra-explorer.info/ and it will produce several download links you can try including direct download from the ftp servers from NCBI.

This tutorial here covers download directly in fastq format from ENA but be aware that ENA is performing maintenance work right now so download might not be possible. Fast download of FASTQ files from the European Nucleotide Archive (ENA)

ADD REPLY
0
Entering edit mode

Thanks a lot. Will try different solutions.

ADD REPLY
0
Entering edit mode

Besides, i should to note that initially i have approximately 60 accessions and got error with prefetch only for 11 of them (everything were fine with the rest ones). Then i ran again exactly the same prefetch command for these 11 accessions and downloaded half of them (for 6 got error).

ADD REPLY

Login before adding your answer.

Traffic: 2768 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6