Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v2.0.0-alpha.5 #244

Merged
merged 37 commits into from
Mar 19, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
3161c07
Update base.config
smlmbrt Feb 2, 2024
cc163b7
Use groovy to parse samplesheets (#243)
nebfield Feb 15, 2024
d40342d
Update report (renv and include licenses) (#203)
nebfield Feb 15, 2024
d071600
keep empty file in assets folder for optional input
nebfield Feb 16, 2024
ea73f8c
Drop aggregation during report generation (#249)
nebfield Feb 29, 2024
d6b0755
Fix cache names (#260)
smlmbrt Mar 4, 2024
e4fa3b0
set pytest version
nebfield Mar 4, 2024
cf16c0e
fix node deprecation warnings
nebfield Mar 4, 2024
c926dd1
bump pytest-workflow
nebfield Mar 4, 2024
4bf8d57
downgrade pytest
nebfield Mar 4, 2024
d815d59
fix node deprecation warning
nebfield Mar 4, 2024
2dfb5fa
bump python action again
nebfield Mar 4, 2024
255e7b5
fix tmpdir errors in report
nebfield Mar 4, 2024
918c433
fix --genotypes_cache
nebfield Mar 4, 2024
e5100f5
make temporary dir in working directory
nebfield Mar 4, 2024
0859eca
fix missing cachedir
nebfield Mar 4, 2024
91e7547
cache relabelled afreq and variants separately
nebfield Mar 5, 2024
664a802
oops
nebfield Mar 5, 2024
1578b80
add changelog to docs
nebfield Mar 5, 2024
5eefb43
bump report from dev to production
nebfield Mar 5, 2024
75d5c05
fix report distribution plots for non-ancestry runs
nebfield Mar 6, 2024
a6622f1
Update arm.rst with new profile
nebfield Mar 8, 2024
d2ed086
add deeep cache
nebfield Mar 14, 2024
3314592
stop using wildcards
nebfield Mar 14, 2024
731848f
swap cross operator -> combine
nebfield Mar 14, 2024
b5634de
set pgscatlaog_utils version to v0.5.2
nebfield Mar 14, 2024
50bdfdb
fix log output
nebfield Mar 14, 2024
a4f8fd5
fix match_combine cache
nebfield Mar 15, 2024
03ad3d7
oops
nebfield Mar 15, 2024
6057047
fix score aggregation cache
nebfield Mar 15, 2024
719709c
error if scoring files don't get a calculation result
nebfield Mar 15, 2024
47616e7
update error strategy
nebfield Mar 15, 2024
a5421cf
fix missing quarto package
nebfield Mar 18, 2024
6ad412a
Fix race condition in cache (#262)
nebfield Mar 18, 2024
9c3a8ac
Add information about versions
smlmbrt Mar 19, 2024
6d02f21
Merge pull request #264 from PGScatalog/docs_version
smlmbrt Mar 19, 2024
ec748b0
add version to report (#265)
nebfield Mar 19, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/ancestry-conda.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,15 +16,15 @@ jobs:

steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- name: Set environment variables
run: |
echo "ANCESTRY_REF_DIR=$RUNNER_TEMP" >> $GITHUB_ENV
echo "ANCESTRY_TARGET_DIR=$RUNNER_TEMP" >> $GITHUB_ENV

- name: Restore reference data
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand Down Expand Up @@ -52,7 +52,7 @@ jobs:
sudo mv nextflow /usr/local/bin/

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down
22 changes: 11 additions & 11 deletions .github/workflows/ancestry-vcf.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,13 +30,13 @@ jobs:
echo "ANCESTRY_TARGET_DIR=$RUNNER_TEMP" >> $GITHUB_ENV

- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore docker images
id: restore-docker
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: ${{ runner.temp }}/docker
key: ${{ inputs.container-cache-key }}
Expand All @@ -48,7 +48,7 @@ jobs:
find ${{ runner.temp }}/docker/ -name '*.tar' -exec sh -c 'docker load < {}' \;

- name: Restore reference data
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand All @@ -65,7 +65,7 @@ jobs:
run: plink2 --pfile ${ANCESTRY_TARGET_DIR}/GRCh38_HAPNEST_TARGET_ALL vzs --export vcf bgz --out ${ANCESTRY_TARGET_DIR}/GRCh38_HAPNEST_TARGET_ALL

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down Expand Up @@ -97,13 +97,13 @@ jobs:
echo "ANCESTRY_TARGET_DIR=$RUNNER_TEMP" >> $GITHUB_ENV

- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore singularity setup
id: restore-singularity-setup
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: /opt/hostedtoolcache/singularity/${{ env.SINGULARITY_VERSION }}/x64
key: ${{ runner.os }}-singularity-${{ env.SINGULARITY_VERSION }}
Expand All @@ -115,13 +115,13 @@ jobs:

- name: Restore singularity container images
id: restore-singularity
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ env.NXF_SINGULARITY_CACHEDIR }}
key: ${{ inputs.container-cache-key }}

- name: Restore reference data
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand All @@ -138,7 +138,7 @@ jobs:
run: plink2 --pfile ${ANCESTRY_TARGET_DIR}/GRCh38_HAPNEST_TARGET_ALL vzs --export vcf bgz --out ${ANCESTRY_TARGET_DIR}/GRCh38_HAPNEST_TARGET_ALL

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down
22 changes: 11 additions & 11 deletions .github/workflows/ancestry.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,13 +30,13 @@ jobs:
echo "ANCESTRY_TARGET_DIR=$RUNNER_TEMP" >> $GITHUB_ENV

- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore docker images
id: restore-docker
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: ${{ runner.temp }}/docker
key: ${{ inputs.container-cache-key }}
Expand All @@ -48,7 +48,7 @@ jobs:
find ${{ runner.temp }}/docker/ -name '*.tar' -exec sh -c 'docker load < {}' \;

- name: Restore reference data
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand All @@ -59,7 +59,7 @@ jobs:
fail-on-cache-miss: true

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down Expand Up @@ -91,13 +91,13 @@ jobs:
echo "ANCESTRY_TARGET_DIR=$RUNNER_TEMP" >> $GITHUB_ENV

- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore singularity setup
id: restore-singularity-setup
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: /opt/hostedtoolcache/singularity/${{ env.SINGULARITY_VERSION }}/x64
key: ${{ runner.os }}-singularity-${{ env.SINGULARITY_VERSION }}
Expand All @@ -109,13 +109,13 @@ jobs:

- name: Restore singularity container images
id: restore-singularity
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ env.NXF_SINGULARITY_CACHEDIR }}
key: ${{ inputs.container-cache-key }}

- name: Restore reference data
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand All @@ -126,7 +126,7 @@ jobs:
fail-on-cache-miss: true

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/conda.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ jobs:

steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: conda-incubator/setup-miniconda@v2
with:
Expand Down
18 changes: 9 additions & 9 deletions .github/workflows/module.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,13 +27,13 @@ jobs:

steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore docker images
id: restore-docker
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: ${{ runner.temp }}/docker
key: ${{ inputs.cache-key }}
Expand All @@ -45,7 +45,7 @@ jobs:
find ${{ runner.temp }}/docker/ -name '*.tar' -exec sh -c 'docker load < {}' \;

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down Expand Up @@ -75,13 +75,13 @@ jobs:

steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2

- name: Restore singularity setup
id: restore-singularity-setup
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: /opt/hostedtoolcache/singularity/${{ env.SINGULARITY_VERSION }}/x64
key: ${{ runner.os }}-singularity-${{ env.SINGULARITY_VERSION }}
Expand All @@ -93,13 +93,13 @@ jobs:

- name: Restore singularity container images
id: restore-singularity
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ env.NXF_SINGULARITY_CACHEDIR }}
key: ${{ inputs.cache-key }}

- name: Set up test requirements
uses: actions/setup-python@v3
uses: actions/setup-python@v5
with:
python-version: '3.10'
cache: 'pip'
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/preload-docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- name: Pull and save docker
run: |
Expand All @@ -22,7 +22,7 @@ jobs:

- name: Save docker
id: cache-docker
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ runner.temp }}/docker
key: docker-${{ github.sha }}
2 changes: 1 addition & 1 deletion .github/workflows/preload-reference.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ jobs:

- name: Cache reference data
id: cache-ref
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: |
${{ env.ANCESTRY_TARGET_DIR }}/GRCh38_HAPNEST_TARGET_ALL.pgen
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/preload-singularity.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,11 +15,11 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Check out pipeline code
uses: actions/checkout@v3
uses: actions/checkout@v4

- name: Cache singularity setup
id: cache-singularity-setup
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: /opt/hostedtoolcache/singularity/${{ env.SINGULARITY_VERSION }}/x64
key: ${{ runner.os }}-singularity-${{ env.SINGULARITY_VERSION }}
Expand All @@ -44,7 +44,7 @@ jobs:

- name: Cache singularity images
id: cache-singularity-pull
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ env.NXF_SINGULARITY_CACHEDIR }}
key: singularity-${{ github.sha }}
10 changes: 5 additions & 5 deletions .github/workflows/standard-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,13 +33,13 @@ jobs:
run: echo "branch=${GITHUB_HEAD_REF:-${GITHUB_REF#refs/heads/}}" >> $GITHUB_OUTPUT
id: extract_branch

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2
with:
version: ${{ matrix.nxf_ver }}

- name: Restore docker images
id: restore-docker
uses: actions/cache/restore@v3
uses: actions/cache/restore@v4
with:
path: ${{ runner.temp }}/docker
key: ${{ inputs.cache-key }}
Expand Down Expand Up @@ -70,13 +70,13 @@ jobs:
run: echo "branch=${GITHUB_HEAD_REF:-${GITHUB_REF#refs/heads/}}" >> $GITHUB_OUTPUT
id: extract_branch

- uses: nf-core/setup-nextflow@v1
- uses: nf-core/setup-nextflow@v2
with:
version: ${{ matrix.nxf_ver }}

- name: Restore singularity setup
id: restore-singularity-setup
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: /opt/hostedtoolcache/singularity/${{ env.SINGULARITY_VERSION }}/x64
key: ${{ runner.os }}-singularity-${{ env.SINGULARITY_VERSION }}
Expand All @@ -88,7 +88,7 @@ jobs:

- name: Restore singularity container images
id: restore-singularity
uses: actions/cache@v3
uses: actions/cache@v4
with:
path: ${{ env.NXF_SINGULARITY_CACHEDIR }}
key: ${{ inputs.cache-key }}
Expand Down
4 changes: 4 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,7 @@ results/
testing/
testing*
*.pyc
.Rproj.user
assets/report/renv/
assets/report/report.Rproj
.Rprofile
Empty file added assets/NO_FILE
Empty file.
Empty file added assets/NO_FILE_INTERSECT_COUNT
Empty file.
12 changes: 11 additions & 1 deletion assets/examples/samplesheet.json
Original file line number Diff line number Diff line change
@@ -1 +1,11 @@
[{"sampleset":"cineca_synthetic_subset","vcf_path":null,"chrom":22,"bed":"https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.bim","bim":"https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.bed","fam":"https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.fam"}]
[
{
"sampleset": "hgdp",
"chrom": null,
"vcf_import_dosage": false,
"geno": "https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.bed",
"pheno": "https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.fam",
"variants": "https:\/\/gitlab.ebi.ac.uk\/nebfield\/test-datasets\/-\/raw\/master\/pgsc_calc\/cineca_synthetic_subset.bim",
"format": "bfile"
}
]
6 changes: 6 additions & 0 deletions assets/examples/scorefiles/customgrch37.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
#pgs_name=testlift
#trait_reported=test
#genome_build=GRCh37
chr_name chr_position effect_allele other_allele effect_weight
1 4859488 A G -0.0504139458332669
1 5297845 G A 0.040436175688854
6 changes: 6 additions & 0 deletions assets/examples/scorefiles/customgrch38.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
#pgs_name=test
#trait_reported=test
#genome_build=GRCh38
chr_name chr_position effect_allele other_allele effect_weight
1 4799428 A G -0.0504139458332669
1 5237785 G A 0.040436175688854
Loading