Problem using PicardTools MarkDuplicates: SortingCollection: There is not enough memory per file for buffering. Reading will be unbuffered.
0
0
Entering edit mode
8 months ago
pengxw1990 • 0

MarkDuplicates -I KPGP-00001.final.bam -O KPGP-00001.markdup.bam -M KPGP-00001.markdup.metrics -CREATE_INDEX true -REMOVE_DUPLICATES true -ASSUME_SORTED true -VALIDATION_STRINGENCY LENIENT -TMP_DIR /mnt/12T/tmp

OpenJDK 64-Bit Server VM 1.8.0_275-b01; Deflater: Intel; Inflater: Intel; Provider GCS is not available; Picard version: 2.24.2

INFO    2021-02-23 01:53:53 MarkDuplicates  After buildSortedReadEndLists freeMemory: 49282740792; totalMemory: 49578770432; maxMemory: 49578770432
INFO    2021-02-23 01:53:53 MarkDuplicates  Will retain up to 1549336576 duplicate indices before spilling to disk.
INFO    2021-02-23 01:54:34 MarkDuplicates  Traversing read pair information and detecting duplicates.

WARNING 2021-02-23 01:57:49 SortingCollection   There is not enough memory per file for buffering. Reading will be unbuffered.**

INFO    2021-02-23 02:31:19 MarkDuplicates  Traversing fragment information and detecting duplicates.
INFO    2021-02-23 03:19:01 MarkDuplicates  Sorting list of duplicate records.
INFO    2021-02-23 03:20:05 MarkDuplicates  After generateDuplicateIndexes freeMemory: 36950789560; totalMemory: 49681006592; maxMemory: 49681006592
genome • 758 views
ADD COMMENT
1
Entering edit mode

You can increase memory like java -Xms10G -Xmx20G -jar /path/to/picard-tools/picard.jar MarkDuplicates.

min: 10

max: 20

ADD REPLY
0
Entering edit mode

Thanks, I will try it.

ADD REPLY
1
Entering edit mode

This is a WARNING. You should still be able to get the output.

ADD REPLY
0
Entering edit mode

Yeah, i did get a output file, but it's not complete. Thanks a lot.

ADD REPLY
1
Entering edit mode

How do you know that? Were there additional errors?

ADD REPLY
0
Entering edit mode

hah, you are right! for hours later, this command started running again! might it just had a rest....

ADD REPLY

Login before adding your answer.

Traffic: 2811 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6