Frozen data version 1 (#63)

* upgrade pycytominer and pandas * update profiling pipeline for upgraded pycytominer also adding recoded dose to all annotated profiles * add dose utility file * fix compression in aggregate * add cyto_utils import and run black * add an execution script * remove instructions from duplicate sources * reprocess batch 2 data * reprocess batch 1 data * rerun comparison module with reprocessed profiles * update consensus signatures for data freeze * update spherized data freeze * update per cell line spherize * add link to drop outlier features in #65 * update documentation adding dose info to profile readme, adding outlier feature drop to consensus readme * add additional blocklist features * remove outlier features using a file * add consensus profiles * fix spherize two ways: spherize based on both time and cell line, and perform blocklist feature selection beforehand * add updated spherized profiles * add umap visualization of spherized data * track large umap pdfs
broadinstitute · May 21, 2021 · 60d85f6 · 60d85f6
1 parent f865c79
commit 60d85f6
Show file tree

Hide file tree

Showing 1,687 changed files with 5,224 additions and 4,320 deletions.
diff --git a/.gitattributes b/.gitattributes
@@ -1 +1,2 @@
 *.gz filter=lfs diff=lfs merge=lfs -text
+spherized_profiles/figures/ filter=lfs diff=lfs merge=lfs -text
diff --git a/comparison/0.get-cytominer-tool-differences.ipynb b/comparison/0.get-cytominer-tool-differences.ipynb
diff --git a/comparison/1.summarize-cytominer-tool-differences.ipynb b/comparison/1.summarize-cytominer-tool-differences.ipynb
diff --git a/comparison/figures/2016_04_01_a549_48hr_batch1/feature_select_summary.png b/comparison/figures/2016_04_01_a549_48hr_batch1/feature_select_summary.png
diff --git a/...son/figures/2016_04_01_a549_48hr_batch1/level_3/level_3_metrics_per_feature.png b/...son/figures/2016_04_01_a549_48hr_batch1/level_3/level_3_metrics_per_feature.png
diff --git a/...rison/figures/2016_04_01_a549_48hr_batch1/level_3/level_3_metrics_per_plate.png b/...rison/figures/2016_04_01_a549_48hr_batch1/level_3/level_3_metrics_per_plate.png
diff --git a/...n/figures/2016_04_01_a549_48hr_batch1/level_4a/level_4a_metrics_per_feature.png b/...n/figures/2016_04_01_a549_48hr_batch1/level_4a/level_4a_metrics_per_feature.png
diff --git a/...son/figures/2016_04_01_a549_48hr_batch1/level_4a/level_4a_metrics_per_plate.png b/...son/figures/2016_04_01_a549_48hr_batch1/level_4a/level_4a_metrics_per_plate.png
diff --git a/...n/figures/2016_04_01_a549_48hr_batch1/level_4b/level_4b_metrics_per_feature.png b/...n/figures/2016_04_01_a549_48hr_batch1/level_4b/level_4b_metrics_per_feature.png
diff --git a/...son/figures/2016_04_01_a549_48hr_batch1/level_4b/level_4b_metrics_per_plate.png b/...son/figures/2016_04_01_a549_48hr_batch1/level_4b/level_4b_metrics_per_plate.png
diff --git a/..._a549_48hr_batch1/pycytominer_select/pycytominer_select_metrics_per_feature.png b/..._a549_48hr_batch1/pycytominer_select/pycytominer_select_metrics_per_feature.png
diff --git a/...01_a549_48hr_batch1/pycytominer_select/pycytominer_select_metrics_per_plate.png b/...01_a549_48hr_batch1/pycytominer_select/pycytominer_select_metrics_per_plate.png
diff --git a/comparison/figures/2016_04_01_a549_48hr_batch1/summary_metrics_full.png b/comparison/figures/2016_04_01_a549_48hr_batch1/summary_metrics_full.png
diff --git a/comparison/figures/2016_04_01_a549_48hr_batch1/summary_metrics_zoom.png b/comparison/figures/2016_04_01_a549_48hr_batch1/summary_metrics_zoom.png
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_4b_feature_select.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_4b_feature_select.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_mean.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_mean.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_median.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_median.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_sum.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_3_sum.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_mean.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_mean.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_median.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_median.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_sum.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4a_sum.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_mean.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_mean.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_median.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_median.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_sum.tsv.gz b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_level_4b_sum.tsv.gz
diff --git a/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_metric_summary.tsv b/comparison/results/2016_04_01_a549_48hr_batch1/comparison_result_metric_summary.tsv
diff --git a/...ison/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_mean.tsv.gz b/...ison/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_mean.tsv.gz
diff --git a/...on/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_median.tsv.gz b/...on/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_median.tsv.gz
diff --git a/...rison/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_sum.tsv.gz b/...rison/results/2016_04_01_a549_48hr_batch1/comparison_result_pycytominer_select_sum.tsv.gz