Skip to content

Latest commit

 

History

History
116 lines (79 loc) · 5.96 KB

README.md

File metadata and controls

116 lines (79 loc) · 5.96 KB
Raw

DRP QA

Introduction

This repository contains the pipeline and corresponding tasks for the quality assurance (QA) of the Prime Focus Spectrograph (PFS) Data Release Production (DRP) pipeline. The QA tasks are implementations of the PipelineTask class in the LSST Science Pipelines. The tasks are run on the output of the DRP pipeline to assess the quality of the data products.

QA Pipeline

The QA pipelines is located at pipelines/drpQA.yaml, which runs all of the QA tasks.

Note: individual tasks can be specified by using the pipelines/drpQA.yaml#extractionQA syntax. See documentation for details.

Also see the example notebook examples/QA Pipelines.ipynb.

The pipeline contains the following tasks:

Tasks

dmResiduals

Measures the residuals in the spatial and wavelength directions between the detector map and the arcline centroids. The residuals are measured for each visit.

Options
  • dmResiduals:useSigmaRange: Use the sigma range for the color scale in the residual plots. Default is False.
  • dmResiduals:spatialRange: The range of the x-center (i.e. spatial) in the residual plots. Default is 0.1.
  • dmResiduals:wavelengthRange: The range of the y-center (i.e. wavelength) in the residual plots. Default is 0.1.
  • dmResiduals:binWavelength: The bin size in wavelength for the residual plots in nm. Default is 0.1.
Outputs
DataSet Type Dimensions Description
dmQaResidualStats instrument, visit, arm, spectrograph Summary statistics for the given detector and visit.
dmQaResidualPlot instrument, visit, arm, spectrograph 1D and 2D plots of the residual between the detectormap and the arclines for a given visit.

dmCombinedResiduals

Determines the aggregate statistics for all detectors across all given visits.

Options

N/A

Outputs
DataSet Type Dimensions Description
dmQaCombinedResidualPlot instrument 1D and 2D plots of the residual between the detectormap and the arclines for the entire detector.
dmQaDetectorStats instrument Statistics of the residual analysis per detector.

extractionQa

Determines the quality of the fiber extraction.

Options
  • extractionQa:fixWidth: Fix the widths during Gaussian fitting, default False.
  • extractionQa:rowNum: Number of rows picked up for profile analysis, default 200.
  • extractionQa:thresError: Threshold of the fitting error, default 0.1.
  • extractionQa:thresChi: Threshold for chi standard deviation, default 1.5.
  • extractionQa:fiberWidth: Half width of a fiber region (pix), default 3.
  • extractionQa:fitWidth: Half width of a fitting region (pix), default 3.
  • extractionQa:plotWidth: Half width of plot (pix), default 15.
  • extractionQa:plotFiberNum: Maximum fiber number of detailed plots, default 20.
  • extractionQa:figureDpi: resolution of plot for residual, default 72.
Outputs
DataSet Type Dimensions Description
extQaStats instrument, visit, arm, spectrograph Summary plots. Results of the residual analysis of extraction are plotted.
extQaImage instrument, visit, arm, spectrograph Residual, and chi comparisons of the postISRCCD profile and fiberProfiles are plotted for some fibers with bad extraction quality.
extQaImage_pickle instrument, visit, arm, spectrograph Statistics of the residual analysis.

fiberNormsQa

Plot the fiber normalization for the given detector and visit.

Options
  • fiberNormsQa:plotLower: Lower bound for plot (standard deviations from median), default 2.5.
  • fiberNormsQa:plotUpper: Upper bound for plot (standard deviations from median), default 2.5.
Outputs
DataSet Type Dimensions Description
fiberNormsPlot instrument, visit, arm Plot of the fiber normalizations for a visit.

fluxCalQa

Options
  • fluxCalQa:filterSet: Filter set to use, default ps1.
  • fluxCalQa:includeFakeJ: Include the fake narrow J filter, default True.
  • fluxCalQa:fakeJoffset: Offset from the ps1 bands for the fake narrow J, default 0.054.
  • fluxCalQa:diffFilter: Filter to use for the color magnitude difference, default g_ps1.
Outputs
DataSet Type Dimensions Description
fluxCalStats instrument, visit Statistics of the flux calibration analysis.
fluxCalMagDiffPlot instrument, visit Plot of the flux calibration magnitude difference.