Algorithm Documentation

The structure and step-by-step algorithms for the JWST calibration pipeline are documented along with the process that is used for deciding the calibration pipeline algorithms as well as any updates.

On this page

See also: Data Processing and Calibration FilesOfficial Software Documentation, Associations

Calibration pipeline organization

The calibration pipeline consists of three stages. Each stage consists of many steps. Where practical, calibration pipeline stages and steps are shared across instruments and observing modes. For example, the near-infrared instruments use similar detectors, allowing similar calibration steps in the initial detector processing stage. In later stages of the calibration pipeline, significantly different steps are needed leading to an increasing divergence in the steps used to process the data (e.g., imaging versus spectroscopy).

Algorithm decisions

The algorithms for use in the calibration pipeline are the result of input from the instrument teams and a few mode specific working groups. These inputs are reviewed and discussed in the JWST Calibration Working Group (CalWG) to ensure that the best possible algorithms. The overall goal of the CalWG is to adopt the best possible algorithms based on experience from previous missions and observatories (Hubble, Spitzer, ground-based) and experience from the ground-testing of the JWST instruments. The membership of the JWST CalWG is composed of all members of the instrument and community that are interested in contributing to the effort of defining the best possible algorithms for JWST. After acceptance by the JWST CalWG, they are implemented in code by the Science Software Branch with the JWST Data Management Systems WG (DMSWG) ensuring that the requested algorithms are implemented through extensive testing of the as-built calibration pipeline.

Figure 1. JWST pipeline algorithm decision workflow

The nominal flow of algorithm decisions is shown. Input is provided by the JWST Instrument Teams and three mode specific working groups (Coronagraphy, Time Series Observations, and Moving Targets). The inputs are reviewed by the JWST CalWG. The resulting algorithms are passed to the JWST DMSWG who ensure that the calibration pipeline coded by the Science Software Branch is as requested.

Baseline version

The goal of the baseline version of the calibration pipeline is to produce basic data reduction for all instruments and observing modes prior to launch. This has focused the efforts of the JWST CalWG to find algorithms for each step in the calibration pipeline that will produce good quality science at launch while at the same time requiring reasonable computational resources.

Enhanced version

The enhanced version of the calibration pipeline will produce the best quality data reductions. The enhanced algorithms for each step start with the baseline and are updated if and when there is a better algorithm proposed. As a result, the enhanced version of the calibration pipeline is a continuing goal, approached asymptotically, with continuing development of the calibration pipeline through the JWST mission.


The details of the algorithms are given by Stages of Processing.



Latest updates