Slow Download From TCGA
1
1
Entering edit mode
8.0 years ago
dirigible2012 ▴ 320

Is anybody else having problems with a slow download of files from TCGA? At the moment it's taking me 1 hour to download 1 Gb of data using the File Search. My downloads of files from other sources run at about 5MB/second.

Is there anything I can do about this?

Thanks,

Stephanie

TCGA • 2.5k views
ADD COMMENT
0
Entering edit mode

Suddenly, Biostars feels like a homey bioinformatics lab, where everyone pings each other over IM when the cluster disks are being slow. :)

ADD REPLY
2
Entering edit mode
8.0 years ago

I'm getting decent speeds of 4.7 to 5 MB/s, or roughly 40 Mb/s, from the TCGA DCC housed in Bethesda MD, while I'm located relatively nearby in New York. Instead of using File Search, have you tried downloading data directly from the public https share? For example, to download the clinical data matrix for TCGA BRCA, you could do something like:

curl -LO https://tcga-data.nci.nih.gov/tcgafiles/ftp_auth/distro_ftpusers/anonymous/tumor/luad/bcr/biotab/clin/nationwidechildrens.org_clinical_patient_luad.txt

If you have credentials to access data in the protected https share, then you can use wget with --user specified, and --ask-password so that it prompts you for one.

ADD COMMENT

Login before adding your answer.

Traffic: 1579 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6