Question: How to create a FTP link which can be downloaded by 'wget' command?
0
gravatar for xuling2015
9 months ago by
xuling201510
United States
xuling201510 wrote:

I have a 30Gb fasta file. I'd like to upload it to IMG/ER, but they asked me to provide a FTP link (with the link, the data can be downloaded by 'wget' command). I tried to follow this instruction and generate a FTP link https://stackoverflow.com/questions/37453841/download-a-file-from-google-drive-using-wget. But when they tried to download data with 'wget my_ftp_link', they only got a useless html file. Does anybody know how to generate a FTP link for my data and anyone with my link can download my fasta file with 'wget' command? Thanks a lot!

next-gen • 520 views
ADD COMMENTlink modified 9 months ago by Jean-Karim Heriche17k • written 9 months ago by xuling201510
1

But not work

https://meta.stackexchange.com/questions/147616/

ADD REPLYlink written 9 months ago by Pierre Lindenbaum116k
1

I don't see how this is a proper bioinformatics question, sorry.

ADD REPLYlink written 9 months ago by Michael Dondrup45k

I understand correctly that you uploaded your data to google-drive such that they can download it from there, right?

then why not ask them for a ftp link so you can upload (ftp) to them?

ADD REPLYlink written 9 months ago by lieven.sterck3.5k

Yes, you're right! Although I uploaded my data to google drive and generated a FTP link as the instruction, but IMG staff only got a html file with 'wget my_ftp_link' command. I don't understand why it doesn't work. 'I'm wondering what do you mean by "ask them for a ftp link so you can upload (ftp) to them"? Thanks!

ADD REPLYlink modified 9 months ago • written 9 months ago by xuling201510

'I'm wondering what do you mean by "ask them for a ftp link so you can upload (ftp) to them"?

If they host an ftp server, they can provide you with access to it (or even anonymous) so you can then upload your data directly to their system

alternatively, if you have access to an ftp server (or a public web server) you can put the file online for them to download it directly from your system

ADD REPLYlink modified 9 months ago • written 9 months ago by lieven.sterck3.5k

Have you seen this? You can check yourself to see if this works.

ADD REPLYlink written 9 months ago by genomax60k

It doesn't work. :(

wget "https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8" --2018-04-05 16:14:46-- https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8 Resolving drive.google.com drive.google.com)... 172.217.9.206, 2607:f8b0:4004:811::200e Connecting to drive.google.com drive.google.com)|172.217.9.206|:443... connected. HTTP request sent, awaiting response... 404 Not Found 2018-04-05 16:14:46 ERROR 404: Not Found.

ADD REPLYlink written 9 months ago by xuling201510

Some more suggestions to try here.

ADD REPLYlink written 9 months ago by genomax60k

I tried this page before, it doesn't work. Same error :(

ADD REPLYlink written 9 months ago by xuling201510

are you sure your google drive link is OK? if i check the link I get the 404 as well ?

ADD REPLYlink written 9 months ago by lieven.sterck3.5k

Yes, that file ID is ok. It's here https://drive.google.com/open?id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8. I replaced it with https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8 as the instruction. But I don't understand why it doesn't work.

ADD REPLYlink written 9 months ago by xuling201510

For a command-line interface for Google Drive, you may gdrive. The site provides statically linked binaries, so there is no trouble to install it.

ADD REPLYlink written 9 months ago by h.mon22k

Someone else is supposed to download the file and they insist on using wget and a working link.

ADD REPLYlink written 9 months ago by genomax60k

I just assumed the wget requirement is actually some command-line program.

ADD REPLYlink written 9 months ago by h.mon22k
2
gravatar for Jean-Karim Heriche
9 months ago by
EMBL Heidelberg, Germany
Jean-Karim Heriche17k wrote:

The trick is to use the Google drive API, in particular, the export command specifying the desired format:

wget "https://docs.google.com/document/d/1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8/export?format=txt" -O test.txt

You can also do

https://drive.google.com/uc?export=download&id=1gs4V2QbTY9bVf0MavV--a0qmS7-MWWUidRngjg-ooH8

but only for files that you uploaded. It doesn't seem to work for files that were created in Google docs.

The API seems to have evolved over time so a lot of things found on the net probably doesn't work anymore. It's best to check the docs.

ADD COMMENTlink modified 9 months ago • written 9 months ago by Jean-Karim Heriche17k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1403 users visited in the last hour