Question: AdjList memory error
gravatar for sebastien.renaut
4.3 years ago by
sebastien.renaut0 wrote:

I'm using abyss 2.0 to assemble a large genome (~1.5 GB). I'm running abyss-pe, but the process dies when the "AdjList" command is launched. I'm pretty sure it's a memory issue because my ".fa" file is too big (8.3G), but not sure how to solve it? Please help!!!

Here's the command that causes trouble:

AdjList -v   -k99 -m50 --dot results/assembly_k99_np12_24Gram_B3G_H3_1Gseq-1.fa >results/

and the error message:

Finding overlaps of fewer than k-1 bp...
terminate called after throwing an instance of 'std::bad_alloc'
what():  std::bad_alloc
/bin/bash: line 1: 32487 Aborted                 AdjList -v -k99 -m50 --dot results/assembly_k99_np12_24Gram_B3G_H3_1Gseq-1.fa > results/assembly_k99_np12_24Gram_B3G_H3_
make: *** [results/] Error 134
make: *** Deleting file `results/'
abyss assembly • 1.2k views
ADD COMMENTlink modified 4.3 years ago • written 4.3 years ago by sebastien.renaut0

Errors due to lack of adequate amount of actual memory can only be solved by finding another machine/resource that has an adequate amount.

In academic interest how much memory does your current machine have?

ADD REPLYlink modified 4.3 years ago • written 4.3 years ago by GenoMax96k

I have access to up to 4 nodes (2,67 GHz) X 12cores (each core has 8 GB of RAM) on a Unix computer cluster. + in fact I used in this example a kmer value of 99 to reduce memory consumption, even though kmergenie tells me optimum kmer value should be more like 37.

ADD REPLYlink written 4.3 years ago by sebastien.renaut0

I think it may be the other way - the higher the kmer the more memory you will need, try reducing your k

ADD REPLYlink written 4.3 years ago by Tonor430

Please use ADD REPLY/ADD COMMENT when responding to existing posts to keep threads logically organized.

Are you using a job scheduler where each core is limited to 8G? If not technically you should be able to access entire 96G of RAM on node from a single core.

ADD REPLYlink modified 4.3 years ago • written 4.3 years ago by GenoMax96k

I'm using a job scheduler and talked to my sysadmin to manage to have access to all 96G RAM and now it works! Thank you!

ADD REPLYlink modified 4.2 years ago • written 4.2 years ago by sebastien.renaut0
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 993 users visited in the last hour