DeepGRP is a python package used to predict genomic repetitive elements with a deep learning model consisting of bidirectional gated recurrent units with attention. The idea of DeepGRP was initially based on dna-nn, but was re-implemented and extended using TensorFlow 2.1. DeepGRP was tested for the prediction of HSAT2,3, alphoid, Alu and LINE-1 elements.
For installation you can use the PyPI version with:
pip install deepgrp
or install from this repository with:
git clone https://github.com/fhausmann/deepgrp cd deepgrp pip install .
Additionally you can install the developmental version with poetry:
git clone https://github.com/fhausmann/deepgrp cd deepgrp poetry install
For training and hyperparameter optimization the data have to be preprocessed. For inference / prediction the FASTA sequences can directly be used and you can skip this process. The provided script parse_rm can be used to extract repeat annotations from RepeatMasker annotations to a TAB seperated format by:
parse_rm GENOME.fa.out > GENOME.bed
The FASTA sequences have to be converted to a one-hot-encoded representation, which can be done with:
preprocess_sequence FASTAFILE.fa.gz
preprocess_sequence creates a one-hot-encoded representation in numpy compressed format in the same directory.
For Hyperparameter optimization the github repository provides a jupyter notebook which can be used.
Hyperparameter optimization is based on the hyperopt package.
Training of a model can be performed with:
deepgrp train <parameter.toml> <TRAIN>.fa.gz.npz <VALIDATION>.fa.gz.npz <annotations.bed>
The prefix of <TRAIN> and <VALIDATION> should be as row identifier in the first column of <annotations.bed>.
For more fine-grained control of the training process you can also use the provided jupyter notebook.
The prediction can be done with the deepgrp main function like:
deepgrp <modelfile> <fastafile> [<fastafile>, ...]
where <modelfile> contains the trained model in HDF5 format and <fastafile> is a (multi-)FASTA file containing DNA sequences. Several FASTA files can be given at once.
Requirements are listed in pyproject.toml.
Additionally for compiling C/Cython code, a C compiler should be installed.
First of all any contributing are very welcome. If you want to contribute, please make a Pull request with your changes. Your code should be formatted using yapf using the default settings, they and they should pass all tests without issues. For testing currently mypy and pylint static tests are used, while pytest is used for functional tests.
If you're adding new functionalities please provide corresponding tests in the tests directory.
Feel free to ask in case of any questions.
DeepGRP is published here . If you use DeepGRP please cite:
- @Article{Hausmann2021,
- author={Hausmann, Fabian and Kurtz, Stefan}, title={DeepGRP: engineering a software tool for predicting genomic repetitive elements using Recurrent Neural Networks with attention}, journal={Algorithms for Molecular Biology}, year={2021}, month={Aug}, day={23}, volume={16}, number={1}, pages={20}, issn={1748-7188}, doi={10.1186/s13015-021-00199-0}, url={https://doi.org/10.1186/s13015-021-00199-0}
}
You can find material to reproduce the results from the paper in the repository deepgrp_reproducibility.