Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standardize conversion workflow #369

Merged
merged 114 commits into from
Dec 2, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
114 commits
Select commit Hold shift + click to select a range
52fa9ca
comment out for development
Aug 19, 2024
bbf299c
refact modules for STAR aligner
Aug 19, 2024
c3eb5ea
directly pass txp2gene
Aug 19, 2024
4771ed1
simplify module lines
Aug 19, 2024
af85f87
emit h5ad on starsolo
Aug 19, 2024
d2a5386
add versions emition
Aug 19, 2024
0e55051
update module to use templates and cleanup way of priting versions
Aug 19, 2024
994d5a5
fix h5ad generator script
Aug 20, 2024
b317165
simplify check
Aug 20, 2024
72e9d50
Fix h5ad structure
Aug 21, 2024
8829080
updated concat module
Aug 30, 2024
9fc75b4
workflow misses emptydrops and seurat & mtx conversion modules
Aug 30, 2024
dc69f47
start emptydrops cellbender subworkflow
Sep 12, 2024
9c20420
fix paths
Sep 13, 2024
6831195
started the anndatar standardization module
Sep 13, 2024
237d1ca
concat h5ad with anndatar h5ad
Sep 13, 2024
f5fb4a2
update tag information
Sep 13, 2024
752666b
update tags
Sep 13, 2024
d0ad7f6
module is only to convert to rds
Sep 13, 2024
20ac4ae
update directives
Sep 13, 2024
da5b036
update comments
Sep 13, 2024
b90f388
add cellbender to workflow
Sep 13, 2024
7c304cc
start organisation of files
Sep 13, 2024
8320431
fix file naming
Sep 26, 2024
1c95e85
resolve emptydrops naming
Sep 26, 2024
e6fff34
also convert emptydrops filter matrices
Sep 26, 2024
e9c88e8
move files to BKP since they will be replaced
Sep 26, 2024
f7f5fa5
add conversion for alevin
Sep 26, 2024
73c91c2
re-organise star modules
Sep 26, 2024
417bf69
fixed publishDir directives
Sep 27, 2024
94bf9c1
add h5ad conversion module
Sep 30, 2024
43a29c2
integrate to mtx_conversion module
Sep 30, 2024
7fc32f0
reorganize module levels and fix docker image
Sep 30, 2024
e366396
reorganize star modules
Sep 30, 2024
76f126e
re-structure and include cellranger
Oct 4, 2024
b92af8b
add alevin to new structure
Oct 4, 2024
c57b09f
add star to new structure
Oct 4, 2024
d0d1f81
Add kallisto standard workflow to structure
Oct 4, 2024
aa99cd1
Account for non-standard kallisto workflows
Oct 4, 2024
0ca1161
Simplify alevin template
Oct 4, 2024
28251b0
reorganise star template
Oct 7, 2024
c1e8357
write uncompressed
fmalmeida Oct 30, 2024
ae85710
use .astype(str)
fmalmeida Oct 30, 2024
ae8809a
simplify iteration
fmalmeida Oct 30, 2024
68464de
perform join left operation
fmalmeida Oct 30, 2024
fdedc4d
do not compress output h5ad
fmalmeida Oct 30, 2024
187dbf6
perform join left operation
fmalmeida Oct 30, 2024
98af608
not compress h5ad output
fmalmeida Oct 30, 2024
efd6299
simplify iteration
fmalmeida Oct 30, 2024
f357fd7
simplify index iteration
fmalmeida Oct 30, 2024
bd1a74c
fix unmatched parenthesis
fmalmeida Oct 30, 2024
4731e00
fix use of igenomes ... pipeline was not properly selecting igenomes …
fmalmeida Oct 30, 2024
a71348f
correct values parsing
fmalmeida Oct 30, 2024
d2f9cfd
fix container registry
fmalmeida Oct 30, 2024
5c31226
do not save versions files
fmalmeida Oct 30, 2024
8278429
also convert concat h5ads
fmalmeida Oct 30, 2024
2b199d0
manage subdirectory in publishDir
fmalmeida Oct 30, 2024
cb67797
match template scripts with new publishDir
fmalmeida Oct 30, 2024
7230095
have outputs separated
fmalmeida Oct 30, 2024
206a7c1
make parsing inside sub-workflow
fmalmeida Oct 30, 2024
c4a09e0
added kallisto to correct structure
fmalmeida Oct 30, 2024
971667b
correct mix of channels
fmalmeida Oct 30, 2024
8122113
correct for cellranger multi
fmalmeida Oct 30, 2024
44d1cb7
correct stub
fmalmeida Oct 30, 2024
18cfdd7
remove glob in txp2gene
fmalmeida Oct 30, 2024
079bb7e
added small comment to local modules
fmalmeida Oct 30, 2024
a0bf7ab
split mtx to h5ad conversion and general conversion, so h5ad is gener…
fmalmeida Nov 15, 2024
2fd1d41
fix star index channel generation
Nov 25, 2024
b615e01
fixed tuple size
fmalmeida Nov 25, 2024
ae74481
Update kallisto script
grst Nov 25, 2024
bf78578
update alevin nf-test and snaps
fmalmeida Nov 25, 2024
e8e5094
Merge branch 'standardize-conversion-workflow' of https://github.com/…
fmalmeida Nov 25, 2024
8f3f187
added singlecellobject export
fmalmeida Nov 25, 2024
fae2099
include singlecellexperiment object in nf-test and update namings
fmalmeida Nov 25, 2024
9d8577b
avoind assessing params from modules
fmalmeida Nov 25, 2024
705df81
add snippet to make values unique
Nov 25, 2024
e1a8844
Merge branch 'standardize-conversion-workflow' of https://github.com/…
Nov 25, 2024
804d5cd
fix star channel parsing
fmalmeida Nov 25, 2024
916ddb6
Merge branch 'standardize-conversion-workflow' of https://github.com/…
fmalmeida Nov 25, 2024
41731ac
simplified kallisto so non-standardo workflow have spliced and unspli…
Nov 25, 2024
4a03b7f
Merge branch 'standardize-conversion-workflow' of https://github.com/…
Nov 25, 2024
298c491
update star nf-test, snaps and file namings
fmalmeida Nov 25, 2024
c4eda69
Merge branch 'standardize-conversion-workflow' of https://github.com/…
fmalmeida Nov 25, 2024
208c11b
fix channel size
Nov 26, 2024
f120824
Fix kallisto mtx script
grst Nov 26, 2024
8e88384
add a little comment line
Nov 26, 2024
a15a28b
updated cellranger nf-test sizes, namings and snaps
fmalmeida Nov 26, 2024
245ae5b
Update kallisto script (again)
grst Nov 26, 2024
bee74f6
update kallisto nf-test size, namings and snaps
fmalmeida Nov 26, 2024
dfb439a
adding versions.yml output for modules CONCAT_H5AD, MTX_TO_H5AD and A…
fmalmeida Nov 26, 2024
eed41c0
correct ifelse order for file renames
fmalmeida Nov 26, 2024
c001a0f
Merge branch 'dev' of https://github.com/nf-core/scrnaseq into standa…
Nov 28, 2024
b245be2
re-add missing star_align ext.args
Nov 28, 2024
80e7850
correct the parsing of getGenomeAttribute as a nextflow variable, sin…
Nov 28, 2024
395a3e8
current version of star is incompatible with the star index available…
Nov 28, 2024
6ddcf15
add checkIfExists: true to file loading calls
Nov 28, 2024
72c2242
remove old conversion scripts
Nov 28, 2024
dd41a8b
update changelog
Nov 29, 2024
9c6d405
add TODO
Nov 29, 2024
f07cac6
update emptydrops documentation
Nov 29, 2024
d12f64d
update cellranger snaps
fmalmeida Nov 29, 2024
595be8b
Merge branch 'standardize-conversion-workflow' of https://github.com/…
fmalmeida Nov 29, 2024
a6f47f5
update kallisto snaps
fmalmeida Nov 29, 2024
a2c1a11
update alevin snaps
fmalmeida Nov 29, 2024
d106e6e
Update modules/local/templates/barcodes.py
fmalmeida Nov 29, 2024
b84770e
fix anndatar to nf-core container
fmalmeida Nov 29, 2024
a2fc476
add resources control to cellrangermulti testing profile
fmalmeida Nov 29, 2024
d194bfa
add metadata
fmalmeida Nov 29, 2024
e9836fd
allow regex to also find cellrangermulti results
fmalmeida Nov 29, 2024
3e3608c
update cellranger multi nf-test snaps
fmalmeida Nov 29, 2024
2830093
update star nf-test snaps
fmalmeida Nov 29, 2024
fae53a2
prettier fix
fmalmeida Nov 29, 2024
84a83c2
avoid fetching star index from iGenomes due version incompatibility
Nov 29, 2024
b498ddc
add .var_names_make_unique() to star code which was missing
Dec 2, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

- Add `--save_align_intermeds` parameter that publishes BAM files to the output directory (for `starsolo`, `cellranger` and `cellranger multi`) ([#384](https://github.com/nf-core/scrnaseq/issues/384))
- Added support for pre-built indexes in `genomes.config` file for `cellranger`, `cellranger-arc`, `simpleaf` and `simpleaf txp2gene` ([#371](https://github.com/nf-core/scrnaseq/issues/371))
- Cleanup and fix bugs in matrix conversion code, and change to use anndataR for conversions, and cellbender for emptydrops call. ([#369](https://github.com/nf-core/scrnaseq/pull/369))
- Fix problem with `test_full` that was not running out of the box, since code was trying to overwrite parameters in the workflow, which is not possible ([#366](https://github.com/nf-core/scrnaseq/issues/366))

## v2.7.1 - 2024-08-13

Expand Down
52 changes: 0 additions & 52 deletions bin/concat_h5ad.py

This file was deleted.

52 changes: 0 additions & 52 deletions bin/emptydrops_cell_calling.R

This file was deleted.

160 changes: 0 additions & 160 deletions bin/mtx_to_h5ad.py

This file was deleted.

54 changes: 0 additions & 54 deletions bin/mtx_to_seurat.R

This file was deleted.

Loading