Supergnova stuck in tutorial
1
0
Entering edit mode
10 weeks ago
Gerard ▴ 10

I am trying to use Supergnova (https://github.com/YiliangTracyZhang/SUPERGNOVA) to calculate local genetic correlations from multiple GWAS summary statistics. To start with, I'm trying to run the tutorial they provide, but the final command:

python3 supergnova.py ./data/sumstats/ASD.txt.sumstats.gz ./data/sumstats/CP.txt.sumstats.gz \
--N1 46351 \
--N2 257828 \
--bfile data/bfiles/eur_chr@_SNPmaf5 \
--partition data/partition/eur_chr@.bed \
--out results.txt

gets stuck without showing any error after it has been running for more than 24 hours. From what I have read, the expected process time is between 30 min and 1 hour, which clearly suggests that something is not working properly.

I have created a conda environment with the packages required to use Supergnova (Python 3, numpy scipy, pandas, sklearn, bitarray) but since there are no previous steps and I am simply following all the steps in the tutorial, I don't know what might be going on. I would appreciate if someone could suggest me something I could try to do to solve it.

Thanks.

Genetic Correlations Python Supergnova Conda • 379 views
ADD COMMENT
0
Entering edit mode

Without an error it would be difficult to diagnose this. Kill the process if it has not produced any output for 24 h. You may want to specify a value for threads --threads 2 and see if that helps.

ADD REPLY
0
Entering edit mode

Thanks for your answer and suggestion.

I am copying the message that the terminal returned after I manually stopped it if it can be helpful:

File "/home/gerard/SUPERGNOVA/supergnova.py", line 93, in <module>
    pipeline(parser.parse_args())
  File "/home/gerard/SUPERGNOVA/supergnova.py", line 65, in pipeline
    out = calculate(args.bfile, bed, args.thread, gwas_snps, ld_scores, N1, N2, pheno_corr, pheno_corr_var)
  File "/home/gerard/SUPERGNOVA/calculate.py", line 193, in calculate
    all_dfs.append(_supergnova(cur_bfile, partition, thread, gwas_snps, ld_scores, n1, n2, pheno_corr, pheno_corr_var))
  File "/home/gerard/SUPERGNOVA/calculate.py", line 170, in _supergnova
    pool.join()
  File "/home/gerard/anaconda3/envs/superg/lib/python3.9/multiprocessing/pool.py", line 662, in join
    self._worker_handler.join()
  File "/home/gerard/anaconda3/envs/superg/lib/python3.9/threading.py", line 1060, in join
    self._wait_for_tstate_lock()
  File "/home/gerard/anaconda3/envs/superg/lib/python3.9/threading.py", line 1080, in _wait_for_tstate_lock
    if lock.acquire(block, timeout):
KeyboardInterrupt

I forgot to mention that I have already tried to use a different number of threads but the problem persisted.

ADD REPLY
0
Entering edit mode

Which version of python3 are you using on your system? It appears based on the message above that the job was possibly stuck on threading step. Can you try to run using a single thread --threads 1 and see if that allows the job to proceed.

ADD REPLY
0
Entering edit mode

I am using Python 3.9.13.

I also thought that the error was coming from the use of several threads, but I tried to run it using only one and the job didn't proceed either.

ADD REPLY
0
Entering edit mode

You can try creating an issue (with this error) https://github.com/YiliangTracyZhang/SUPERGNOVA/issues to see if the developer would be able to help.

ADD REPLY
1
Entering edit mode
8 weeks ago
Gerard ▴ 10

Thanks for all the suggestions. I created an issue but, unfortunately, was not answered.

I managed to solve the issues I was having changing the versions of the Python packages SUPERGNOVA requires. I will let them noted here in case anyone needs them:

Numpy 1.19.5 Scipy 1.5.4 pandas 0.25.3 bitarray 2.1.0 sklearn = scikit-learn 0.24.2

ADD COMMENT

Login before adding your answer.

Traffic: 1268 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6