Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large >270Mb contigs vs >14Gb reference #160

Open
Ural-Yunusbaev opened this issue Apr 13, 2023 · 0 comments
Open

Large >270Mb contigs vs >14Gb reference #160

Ural-Yunusbaev opened this issue Apr 13, 2023 · 0 comments

Comments

@Ural-Yunusbaev
Copy link

Hey there,

I am trying to align >14Gb allopolyploid wheat genome assembly contigs (N50>30Mb, longest>270Mb) to a >14Gb reference (longest chromosome>850Mb) with the following parameters:
ragtag.py scaffold --mm2-params '-x asm5 -t '${cpu}' -I 16G' -t ${cpu} reference.fasta contigs.fasta
in a node with 400Gb memory.

After 4 hours I am getting the following error:
Wed Apr 12 16:06:48 2023 --- INFO: Running: minimap2 -x asm5 -t 15 -I 16G /dev/shm/ragtag/reference.fasta /dev/shm/ragtag/contigs.fasta > /dev/shm/ragtag/ragtag_output/ragtag.scaffold.asm.paf 2> /dev/shm/ragtag/ragtag_output/ragtag.scaffold.asm.paf.log
Traceback (most recent call last):
File "/homes/user/.local/bin/ragtag_scaffold.py", line 4, in
import('pkg_resources').run_script('RagTag==2.1.0', 'ragtag_scaffold.py')
File "/homes/user/.local/lib/python3.7/site-packages/pkg_resources/init.py", line 656, in run_script
self.require(requires)[0].run_script(script_name, ns)
File "/homes/user/.local/lib/python3.7/site-packages/pkg_resources/init.py", line 1460, in run_script
exec(script_code, namespace, namespace)
File "/homes/user/.local/lib/python3.7/site-packages/RagTag-2.1.0-py3.7.egg/EGG-INFO/scripts/ragtag_scaffold.py", line 577, in
File "/homes/user/.local/lib/python3.7/site-packages/RagTag-2.1.0-py3.7.egg/EGG-INFO/scripts/ragtag_scaffold.py", line 420, in main
File "/homes/user/.local/lib/python3.7/site-packages/RagTag-2.1.0-py3.7.egg/ragtag_utilities/Aligner.py", line 128, in run_aligner
File "/homes/user/.local/lib/python3.7/site-packages/RagTag-2.1.0-py3.7.egg/ragtag_utilities/utilities.py", line 73, in run_oe
RuntimeError: Failed : minimap2 -x asm5 -t 15 -I 16G /dev/shm/ragtag/reference.fasta /dev/shm/ragtag/contigs.fasta > /dev/shm/ragtag/ragtag_output/ragtag.scaffold.asm.paf 2> /dev/shm/ragtag/ragtag_output/ragtag.scaffold.asm.paf.log

ragtag.py -v
v2.1.0

seff output:
Nodes: 1
Cores per node: 16
CPU Utilized: 09:11:30
CPU Efficiency: 14.96% of 2-13:26:08 core-walltime
Job Wall-clock time: 03:50:23
Memory Utilized: 278.09 GB
Memory Efficiency: 69.52% of 400.00 GB

When I broke apart all the contigs >75Mb and it reran, the same minimap2 command worked perfectly.
What is the reason? How can I go with contigs longer than 75Mb?
Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant