Question: How to get 1000 Genomes data in bulk?
0
gravatar for kynnjo
2.3 years ago by
kynnjo40
United States
kynnjo40 wrote:

I am looking for an efficient way to get 1000 Genomes data for ~70k dbSNP ids. (I am primarily interested in putative impact and allele frequencies.)

Is there a convenient way to do this?

A good solution would be some way to query 1000 Genomes programmatically and in bulk (as opposed to one dbSNP id at at time), but I have not found it yet.

Another possibility would be do download files from 1000 Genomes that I can process locally, but I have not been able to locate a reasonably-sized download that has the information I'm looking for. I could download all of ftp://ftp.1000genomes.ebi.ac.uk/vol1/ftp/release/20130502, but that could take a long time, and pretty much fill up my hard disk, without any guarantee that what I'm looking for is in that massive download.

ADD COMMENTlink modified 2.3 years ago by Kevin Blighe67k • written 2.3 years ago by kynnjo40
2

If you are able to use Amazon AWS then the data is available there and won't require a download.

ADD REPLYlink written 2.3 years ago by genomax92k

How to get 1000 Genomes data in bulk?

Title of this post can be refined to indicate your exact requirement.

You know how to get the data in bulk but you are looking for an efficient way to just get the data for 70k dbSNP id's that you want. Is that correct?

ADD REPLYlink modified 2.3 years ago • written 2.3 years ago by genomax92k
2
gravatar for Pierre Lindenbaum
2.3 years ago by
France/Nantes/Institut du Thorax - INSERM UMR1087
Pierre Lindenbaum131k wrote:

The following java program should do the trick:

ADD COMMENTlink written 2.3 years ago by Pierre Lindenbaum131k
2
gravatar for Kevin Blighe
2.3 years ago by
Kevin Blighe67k
Republic of Ireland
Kevin Blighe67k wrote:

Thought to give a quick answer as this thread will likely get a fair bit of traffic in the future.

If you follow steps 1-3 of my tutorial, here: Produce PCA bi-plot for 1000 Genomes Phase III in VCF format, then you'll have the data in BCF format. On my disk, the entire 1000 Genomes data (phased genotypes) in a single BCF file occupies 8.3 gigabytes. I interrogate it frequently for diverse projects.

Kevin

ADD COMMENTlink modified 2.3 years ago • written 2.3 years ago by Kevin Blighe67k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1816 users visited in the last hour