Data identified with a search may be retrieved in a number of ways, including the MAST Portal download manager, HTML download, ftp, and with user software. The best method of retrieval is largely a matter of convenience, although requests for very large volumes of data may require special effort. Only authenticated and authorized users may retrieve data within the exclusive access period.
Retrieving JWST data from MAST
Data that have been identified through a search may be retrieved in a number of ways by authorized users. The best method of retrieval is largely a matter of convenience, although requests for very large volumes of data may require special effort.
Anonymous users may access public datasets in MAST without registering and without logging in. But only authenticated and authorized users may access data within the exclusive access period. See the Data Access Policy for details and information on data access restrictions.
MAST portal retrieval options
Users who have identified data of interest within the MAST Data Discovery Portal may retrieve the files (or collections of files) by placing them in the "basket" and clicking the "save" icon. See Portal UI Data Retrieval for details. The MAST Portal also allows for exporting of results data tables and some batch retrieval options including DVD shipment, or staging data for later download. The standard download basket procedure offers the user a choice of zip, tar, tar.gz, or cURL options for the download package, but stipulates a 5.12 GB total file volume maximum. Above this limit, the user will be obligated to use the cURL script option or the MAST API within a script (see below) for a non-batch retrieval. Batch retrieval options may be ideal if exceeding this volume limit, though this may be true of smaller sizes depending on the user's network connection.
Table 1. Batch retrieval methods
Note that a valid email address must be provided for all batch data retrieval requests, though an STScI MyST ID is not required for public data.
MAST portal download examples
The MAST programmatic API
It is possible to retrieve data using scripts in various programming languages, such as Unix shell scripts or Python, through the Mashup API for MAST. See Programmatic Interfaces for details.
A variety of community applications can retrieve data from astronomical archives, including MAST. These tools use Virtual Observatory protocols to discover and retrieve data files. Table 2. proviedes with a list of some of them.
Table 2. List of applications and cabilities
|Aladin||Sky atlas tool|
|SAOImage/DS9||Image and catalog display tool|
|TOPCAT||Catalog joins, subsetting, editing, and visualization|
|VizieR||Extensive VO catalog offerings|
|VOClient||Standalone software for querying and downloading VO data from USVAO|
These tools currently lack the ability to provide user authentication credentials to archive services, and so cannot be used to retrieve data archived within the exclusive access period.
VizieR retrieval examples
Published July 11, 2017