how to import multiple fastq files from NCBI without using fastq-dump?
Entering edit mode
14 months ago

Hello I need to import to my server the following dataset:

it consist of 492 fastq files.

I know that I can go to the ERR files thar are available here:

and use fastq-dump, but this seems to be the raw data and making quality control over such data can be a waste of time given the fact that I can get the filtered reads into my server directly.

so how can I load such data iteratively using wget or curl ?

additionaly, it can be the situation in which the server's internet falls during the importation. is there a way that wget or curl can retake the download process if something like that happens?

Thanks for reading :)

curl wget multi-samples importing • 324 views
Entering edit mode

I assume since the files on first link have the word clean in them you think they are already processed? You could look at the source code for that page (right-click on page --> "view page source" or similar depending on your browser) and parse out all links that have the URL's. Then use wget and a file with these URL's in to download the data.


Login before adding your answer.

Traffic: 1368 users visited in the last hour
Help About
Access RSS

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6