Tips for a Smooth Review - Cycle 4
This page provides tips for those participating in the JWST peer review process to help make this a smooth experience.
On this page
Budget your time and make a plan
Anticipate how much time it will take to review proposals based on your own experience. Past surveys indicate that review times can vary significantly from person to person, on average they report about 30–45 minutes per proposal. Plan accordingly and budget your time.
Note the deadlines and block off reading time in your calendar early. It is a lot less stressful to do a few proposals per day than attempting to review all in few days, and leads to better reviews and comments for the proposers.
Read the abstracts
It helps to start by reading the abstracts for all for your assigned proposals before diving straight in to reviews.
This will give you an overview of the task and the pool of proposals, and is especially useful for identifying any additional conflicts of interest (e.g., competing proposals or unidentified close collaborators).
I'm not qualified to review this proposal!
Yes, you are! The proposals are graded on both their in-field impact and out-of-field impact, having reviewers with closely-overlapping expertise and others with more distant expertise is extremely useful. Proposals should be written to be accessible and compelling to both experts and non-experts. If you do not find a proposal to be such, consider that this may be the fault of the proposal, not you as a reviewer, and your grades should reflect the lack of clarity.
Each proposal in External panels is read and graded by 5 panelists. Each proposal in Virtual panels is read and graded by 6 panelists in the preliminary grading phase and by all (un-conflicted) panelists during the meeting. It would not be possible to recruit enough panelists such that every proposal can be read by 5 or 6 un-conflicted niche experts, neither is it possible to assign to a reviewer only proposals perfectly aligned with their expertise. Nor would we wish to for a well-rounded review.
I'm pretty sure I know who wrote this anonymous proposal
Please do not spend time trying to guess the proposers, since is directly contradictory to the goals of Dual Anonymous Review. Nor should this guess influence your review of the proposal. Not least because, in our experience, most guesses about an individual or team responsible for a proposal are usually incorrect. In particular, do not assume that the proposers are the same people as the authors of any heavily cited papers or included figures, or the same investigators as those on other referenced programs.
Worldwide community
JWST is a shared resources and we receive proposals from all over the world, many from non-native English speakers. The proposal should be understandable, but please take care to judge the science in the proposal, not the quality of the language or the grammar. In this context, note that proposers are discouraged from using GAI in constructing proposals and if they do use such tools, they must describe how they were used as part of the proposal submission. This statement should be included in the Team Expertise section.
Next: Who to Contact for Help - Cycle 4