JWST Post-Pipeline Data Analysis

The JWST post-pipeline data analysis ecosystem consists of several components (i.e., analysis software, visualization tools, and example Jupyter notebooks) that can be integrated for seamless viewing and analyzing of JWST data.   

The various tools and notebooks have their own installation instructions. However, we generally recommend using Miniconda to easily manage a compatible Python environment. Miniconda should work with most modern shells, except CSH/TCSH.

The suite of post-pipeline data analysis tools is intended to help astronomers with the often iterative and interactive workflow involved in converting these science calibration pipeline data products into meaningful scientific results. This involves tasks such as:

  • inspecting data and data quality information;
  • masking or flagging data and using those annotations to guide later steps in the analysis;
  • using the results of interactive analysis to guide a custom run of the pipeline (e.g., tweaking spectral extraction parameters or background estimates);
  • performing optimized spectral extraction techniques; 
  • combining data sets in various ways, with careful attention to astrometry, PSF matching, and other issues;
  • source detection and photometry using different choices or algorithms than those used in the pipeline;
  • measuring lines and continuum in spectral data;
  • fitting models to data or otherwise testing hypotheses.

A typical workflow involves highly interactive exploratory analysis on small portions of the data, followed by the development of custom scripts to automate the analysis on larger data sets.  Further training is available via the JWebbinar series.

All software is open source and community contributions are welcome in the form of suggestions, bug reports, or actual code. Further details on how to contribute can be found at the Data Analysis Tools Development Forum.

Community contributions

Words in bold are GUI menus/
panels or data software packages; 
bold italics are buttons in GUI
tools or package parameters.

Astropy is a community library, and the JWST analysis tools' success relies on community members, like you, to engage in the development process via bug reports (most effectively filed as GitHub issues, but the JWST help desk is fine as well), or by code contributions through GitHub pull requests. Use of the development versions of the code straight from GitHub comes with the following caveats: at any given time, the code may not actually run or return correct results, and the documentation may be inconsistent with the code. Users who are not interested in contributing to the development software should use fully released versions (a standard pip install). Details regarding the difference in the installation instructions can be found in the respective documentation for each package.

Latest updates
    Updates for ERO and commissioning data public release.

    Updated notebooks for Build E release.

    Added section on Jdaviz, updated notebooks for Build D release, added section on JWebbinars

    Added links to JDAT Jdaviz tools.

    Updated Software Package and Notebook status to be consistent with Build C for Data Analysis Notebook delivery.  Removed additional resources section.
Originally published