Apologies for the title, I couldn't think of a more appropriate one.
Just trying to understand a part of the OMA pipeline , Im using the -s flag and still on the multiprocessing part.
I currently have 1032 proccesors running with my OMA analysis. The nodes seem to be all working and efficiency is seemingly high, but all log files show something like below as the last line i.e. about to start a part but not yet starting
job_731906_task_6_of_1032.log <== [pid 11158]: Computing genomeA vs genomeB (Part 3830 of 4200). Mem: 0.856GB
I would have expected to find some of the last lines to be 'mid process' between two parts like :
[pid 17178]: 95.00% complete, time left for this part=0.56h, 53.3% of AllAll done. Mem: 0.856GB
What exactly is going on when the last line of the log is like below ?
Computing genomeA vs genomeB (Part 3830 of 4200). Mem: 0.856GB