JWST Operational Pipeline Build Information
Information about current and previous build deliveries of the calibration pipeline software, as well as known issues or shortcomings of each build and planned enhancements.
On this page
Words in bold italics are also buttons
or parameters in GUI tools. Bold
style represents GUI menus/
panels & data software packages.
In some cases, users might see patch releases in-between builds of the JWST operational pipeline. While these patches may not include changes to the JWST Science Calibration Pipeline, they still impact the calibration products. The JWST Science Calibration Pipeline can also be updated and released to users before it is integrated into the operational pipeline. These are done via minor releases of the jwst package via conda pip and are included in operations with the next operational build.
This article provides links to release notes for different builds of the operational pipeline and patches affecting the calibration products. When the information is maintained elsewhere, links are provided to that documentation.
The current build
The current build of the calibration pipeline is build 8.0—please refer to the release notes for additional details.
Known issues
The following issues were not resolved in the jwst calibration pipeline package (version 1.5.2) that was released with build 8.0:
- The redesigned algorithm in the resample_spec step for computing the output WCS frame of NIRSpec fixed slit and MOS spectra is quite slow, resulting in processing times of hours for observations containing many slits/sources. A fix for this issue is ready for release in build 8.1.
- The calwebb_image3 and calwebb_spec3 pipelines can occasionally fail with memory allocation errors when processing observations containing very large image mosaics or many hundreds of spectra. Improvements in memory management are underway and at least an initial phase of improvements will be released in build 8.1.
Also, the following infrastructure-related issues affect this build:
- Due to a software bug, the NIRCam level-1b products for TSO grism data require manual developer intervention, which causes the timing information to be incorrect and prevents processing through stage 1 of the pipeline. This is targeted to be resolved in build 8.1.
- WFSS program data can produce a significant number of files, so ingestion of data into MAST may be delayed by a few days after completion of the program.
Future enhancements for the JWST Science Calibration Pipeline
STScI continues to actively validate the products produced by the JWST Science Calibration Pipeline as well as plan and assess recommendations for enhancements. Check back on July 14, 2022, for updates on planned fixes and future enhancements, along with the tentative timeline to include them in the Science Calibration Pipeline software.
Previous builds
As additional builds are delivered beyond build 8.0, this section will be populated with the earlier build information as a historical record of the ongoing changes to the JWST Science Calibration Pipeline.