Getting Started with JWST Data

A general guide to understanding and getting started with JWST data. 

On this page

A general workflow on getting started with JWST data is provided below. Depending on your science goals and background, the steps and order may vary.

(tick) Know how to navigate the documentation

Unlike HST, JWST has a unified science calibration pipeline for all  instruments. To keep the software technical documentation closely tied to each version of the calibration pipeline, it is distributed with the software via Read the Docs. Much of this documentation is external to JDox, and is updated with each public release of the science calibration pipeline.  Similarly, the MAST portal maintains their own cross-mission general user documentation with some highlights relevant to JWST here in JDox.

The JDox pages are grouped into 4 categories, each containing their respective collection of articles that provide an introductory level approach with links to more detailed information:

  1. Understanding JWST Data Files includes information about the data products, file types and formats, naming conventions, and header keywords.

  2. Obtaining JWST Data provides highlights on how to search, explore, and retrieve data using the MAST portal, which is the repository for all JWST data (as well as data from other missions).

  3. JWST Science Calibration Pipeline articles hold information on installing and running the pipeline, as well as descriptions of each pipeline step and stage.

  4. Post-Pipeline Data Analysis Tools describes software available for analyzing JWST data, such as visualization tools and example Jupyter notebooks.

Additional training resources and examples are available at the JWebbinar training sessions (see "Materials and Recordings"). These archived webinars will be hosted on the JWST Observer YouTube channel in the near future. 

(tick) Install the necessary software

Words in bold italics are buttons 
or parameters in GUI tools. Bold 
style represents GUI menus/
panels & data software packages.

We recommend the following steps for working with JWST data on your machine:

  1. Install the JWST Science Calibration Pipeline and calibration references files
  2. Install Astropy
  3. Install the JWST Data Analysis Visualization Tool, Jdaviz
  4. Clone the JWST Analysis Notebooks Repo for examples on your local machine

STScI currently supports development of software in the Python environment. Most of the software packages you will be using are installed via pip and the instructions assume you are already familiar with creating new environments.  If you are new to Python and looking for easy ways to manage your environments, Conda is a common open source package and environment management system.*  It may be of interest for you to know the difference between Conda and pip, even though the two are often used synonymously.  

We also suggest you become familiar with Git and GitHub. In many cases, software and examples may be stored in GitHub repositories so that cloning an existing GitHub repository is the the easiest way to run the files on your own machine.   

The JWST visualization tools can be opened as standalone tools, but are designed to be integrated into a Python Jupyter notebook workflow. There are many advantages to working in a Jupyter notebook, including, but not limited to, easy documentation, cell by cell execution, visualizing individual steps, and sharing work.  

STScI maintains a free Conda channel named AstroConda, which allows you to install all the necessary packages in one large bundle. However, with the growing number of software packages and interdependencies, AstroConda will be phased out in the next six months. Therefore, there is no linking to AstroConda pages here. Jdaviz and the JWST Science Calibration Pipeline can be installed via pip, which also installs the required packages for the software. They do not have a dependence on the AstroConda channel. 

(tick) Download and Inspect Your Data

  1. Download data. Real JWST data, when it becomes available, can be downloaded from MAST. Until then, you can use example simulated data or generate your own using JWST simulated data software such as MIRAGE and MIRISim. There are detailed example instructions for MIRAGE simulations and MIRISim simulations in the user guides for the software. 

  2. Inspect your data. You can use JWST data analysis tools to inspect the highest level of science calibration pipeline products produced for a given instrument mode's data to determine whether they are satisfactory for your science.

  3. Run the science calibration pipeline, if desired, to reprocess the data. Standard science calibration pipeline processing should produce publication-quality data products for most cases.  

(tick) Analyzing data

While JWST data can be analyzed with any of your favorite tools, STScI recommends working with a suite of software specifically developed for JWST data formats. The post-pipeline data analysis ecosystem includes a number of Astropy astronomical analysis packages (partly maintained by STScI). Also included are the previously-mentioned JWST data analysis visualization tools (composed of Imviz, Specviz, Cubeviz, and Mosviz configurations), and a set of Jupyter notebooks that illustrate workflows for analyzing JWST data.

Latest updates
Originally published