Auxiliary Data Import

These instructions provide examples of importing certain auxiliary annotation data used the GMS, such as reference genomes, feature sets, and transcript annotations.

These instructions assume that you have followed the installation instructions up to and including the prime-system.pl command. If do not require the demonstration dataset, it is possible to prime the system without downloading the demonstration data by using the --data=none option to prime-system.pl.

Importing a New Human Reference Genome

A new human reference genome can be imported by defining a new imported-reference-sequence model. Defining the model also starts a build of that model.

Below is an example of downloading and importing GRCh37-lite. The URI shell variable is used in this example is used for the sake of brevity. The processing-profile-id and species-name refer to processing profile and taxon that were imported into GMS during system priming.

$ URI='ftp://ftp.ncbi.nih.gov/genbank/genomes/Eukaryotes/'\
'vertebrates_mammals/Homo_sapiens/GRCh37/special_requests/GRCh37-lite.fa.gz'
$ wget $URI
$ gunzip GRCh37-list.fa.gz
$ genome model define imported-reference-sequence             \
  --fasta-file=$PWD/GRCh37-lite.fa                            \
  --processing-profile-id=1990904                             \
  --species-name=human                                        \
  --version=37-lite-test                                      \
  --prefix=GRC                                                \
  --assembly-name=GRCh37-lite                                 \
  --build-name=GRCh37-lite-build37                            \
  --sequence-uri=$URI

Creating a Modified Reference based on an Existing Reference Genome

An existing reference genome may be used as the basis for a new reference genome which is the combination both the existing reference and new fasta file. In order to create the modified reference, the build id of the existing reference and the path to the new fasta file are required.

The existing reference genomes may be listed to show the existing reference genomes along with their build IDs:

$ genome model build list --filter="model.type_name='imported reference sequence'" 

Once the build ID of the existing reference and the path to the new fasta are both known, a new model can be defined. Defining this model automatically starts a build of this model, so there is no need to separately start a build.

$ genome model define imported-reference-sequence  \
  --append-to=106942997                            \
  --fasta-file=/ERCC/ERCC92.fa                     \
  --use-default-sequence-uri                       \
  --species-name=human                             \
  --version=37_ERCC

Importing a New Version of dbSNP

$ genome model imported-variation-list import-dbsnp-build
  --vcf-file-url ftp://ftp.ncbi.nih.gov/snp/organisms/human_9606_b141_GRCh37p13/VCF/00-All.vcf.gz
  --version 141
  --reference-sequence-build 106942997
  --flat-file-pattern ds_flat_chX.flat.gz
  --contig-names-translation-file /reference/scaffold_names
  --from-names-column 2
  --to-names-column 3

Importing a New Version of Ensembl