I am downloading hundreds of bigWig files in bulk.
To reduce the time it takes to do this, I am running multiple downloads in parallel, and file system updates are not always immediate, so it is very rarely possible for a download to be overwritten and corrupted, in the case where
os.path.exists in the parent Python script I am using for downloads ends up returning a false negative.
Is there a way to test a bigWig file for its integrity without opening up the file with pyBigWig or bigWigToBedGraph etc. and reading its entire contents? Basically, something similar to
samtools quickcheck for BAM?
I'm investigating if file hashes are available. I'd be curious to know about options that could be used to test the file integrity directly (if they exist).