Speed up BLASTp vs NCBI nr database

1

Entering edit mode

7.9 years ago

biotech ▴ 570

I'm trying to add functional information to a fungus genome annotated with AUGUSTUS. Here is my command. Is taking forever. Just one protein inside 'example_1.faa'

blastp -db /home/bernardo/Databases/BLAST/nr -query example_1.faa -out AWNI01.tab -evalue 0.000001 -outfmt "6 qseqid stitle pident length mismatch gapopen qstart qend sstart send evalue bitscore qcovs qcovhsp" -max_target_seqs 1 -num_threads 16 # note outfmt and max_target_seqs

I thought about changing to other database. Maybe swissprot or refseq_protein, but possibly I will miss annotations.

Thanks

blast • 4.1k views

ADD COMMENT • link 7.9 years ago by biotech ▴ 570

2

Entering edit mode

If this is a standalone machine you may have done all you probably can but have you checked to see if all of your CPU cores are 100% busy (top/htop etc)? If they are not it could be an indication that your system is I/O bound and you can't do much else but be patient.

ADD REPLY • link 7.9 years ago by GenoMax 141k

1

Entering edit mode

Do you have some benchmarking data for BLASTp? I have 6K proteins in my input file. I will have to wait maybe two or three days?

ADD REPLY • link 7.9 years ago by biotech ▴ 570

1

Entering edit mode

You said you have only one protein in the file. So this is just a test?

If you have 6K proteins to do then you would want to do this somewhere else. Ideally a cluster with your input file split into 100 sequence chunks, in parallel.

ADD REPLY • link 7.9 years ago by GenoMax 141k

1

Entering edit mode

Yes it's just a test. Thanks for the chunks idea.

ADD REPLY • link 7.9 years ago by biotech ▴ 570

1

Entering edit mode

I'm trying to annotate a fungus. Maybe extracting a group of fungus data from the nr database would be an alternative.

ADD REPLY • link 7.9 years ago by biotech ▴ 570

1

Entering edit mode

Did you download the complete nr database from the ftp site (most recent has 49 parts)? Did you do makeblastdb on all parts of the nr db (you should have gotten an error if you didn't)? This post could also help: Blast Help On Nucleotide Collection Nr/Nt

ADD REPLY • link 7.9 years ago by st.ph.n ★ 2.7k

1

Entering edit mode

It's running. I have correct output. Dowloaded the preformatted BLAST database for nr.

ADD REPLY • link 7.9 years ago by biotech ▴ 570

1

Entering edit mode

I did this nohup wget ftp://anonymous@ftp.ncbi.nih.gov/blast/db/nr.* > foo_wget3.out 2> foo_wget3.err < /dev/null &

ADD REPLY • link 7.9 years ago by biotech ▴ 570

1

Entering edit mode

I will go towards custom database for now. I will use all proteins of sequenced same fungus genus. Seems there are some full genomes available. Just 26K, what a tiny thing!!