Panel Support Scientists
This page describes the role of the Panel Support Scientist (PSS) during the JWST peer review process. PSSs are the point-person connecting the panelists to STScI. They facilitate their Discussion Panel Meetings.
On this page
See also: Guide for Panel Support Scientists, Review Policies and Instructions, Discussion Panel Meetings, Orientation Materials
The Guide for Panel Support Scientists provides an overview of roles, responsibilities, deadlines, and resources for PSSs.
Panel Support Scientists (PSSs) represent STScI at the review and provide continuity through their insight into the operations of JWST, STScI, and the review process. Their main tasks are to answer questions, to ensure that the panel meetings proceed smoothly, to record the results of the panel discussions, and to bring any critical issues promptly to the attention of SPD and/or relevant STScI technical staff. The PSSs do not take part in the scientific discussions of the panel and do not grade.
The PSS is also present to monitor the panel discussion and ensure that it focuses on the scientific merit of the proposals. The PSS also listens to how the panel discusses the science goals and technical challenges.
If the discussion tends towards comments on the proposing team, their past work, their validity, or their identities, the PSS's job is to refocus the discussion.
The PSS has the authority to stop the discussion on a proposal.
Before the Panel Meeting
- Reviewer assignments: Proposals are assigned to reviewers by SPD based on the information submitted by each panelist. If a panelist identifies a conflict after they receive their assignments, they should contact the PSS and the PSS should re-assign that proposal to another unconflicted reviewer. The PSS may consult with SPD if necessary. The PSS should inform SPD of the re-assignment to ensure that the appropriate information is updated in the database. The panel Chair should also be informed about reassignments; the PSS should ascertain from the Chair whether they prefer to be updated with each reassignment or to receive the final assignment list after all swaps are made (just before the review).
- Proposal content: The PSS should read (at a minimum) each proposal's abstract and observation summary in order to acquire an overall familiarity with the proposal content of their panel, to assist the Chairs in organizing the material and running the meetings.
- Panelist questions prior to the meeting: Panelists are instructed to direct all questions prior to the preliminary grading deadline to their PSS. For policy questions, PSSs are not expected to know the answers to all of these questions and should check with their panel manager on how to respond. For questions regarding instrumentation, technical performance, scheduling, etc., PSSs should direct panelists to the JWST Help Desk (https://jwsthelp.stsci.edu).
- Advise panelists to identify themselves as a TAC member when filing a ticket. If the question is about a specific proposal, the proposal ID should be stated in the question.
- Advise panelists to identify themselves as a TAC member when filing a ticket. If the question is about a specific proposal, the proposal ID should be stated in the question.
- Dual Anonymous Issues: Prior to the meeting, panelists are asked to inform their PSS if they have concerns that any proposal is not following the dual anonymous protocols. STScI will determine whether those proposals should be considered non-compliant and flagged for possible rejection. In some cases, there may be an occasional slip-up that can be ignored and does not affect the panel discussion. The STScI Director will make the final decision. If the proposal is deemed non-compliant, it will be removed prior to the panel discussion.
During the Panel Meeting
The PSS functions as an executive assistant to the Chair. They organize the materials, provide input on any technical issues noted before the meeting, coordinate real-time consultation with STScI specialists, monitor the grading and final ranking process as well as the status of the proposal feedback comments. More specifically, the principal activities during the meetings are as follows.
- Assist the Chair in the organization of the materials and discussion, and provide any other assistance requested by the Chair.
- Coordinate requests for consultations with STScI experts. A list of contacts and phone numbers for on-call experts will be available in each panel. An STScI specialist should be consulted on every significant feasibility or policy issue, and no proposal may be rejected on feasibility or policy grounds without such consultation. Any consultation must be reported in SPIRIT.
- Panelists should record mandatory comments from the panel: duplications specifically allowed by the panel should be noted in the 'notification comments' of the database as being approved; verified technical issues should be entered into the 'Technical Comments' section of the Web-Reviewer tool.
- The PSS should keep careful notes on any controversies, conflicts, or other exceptional issues, and the resolutions of them recommended by the panels, for subsequent consideration during the Director's Review. These notes should be of a quality such that they would be intelligible to someone else (e.g., SPD staff responding months later to appeals from rejected proposers). An example of such information is keeping track of who leaves the room for each proposal, due to a conflict of interest. Another example would be noting where concerns were raised about the technical feasibility of a proposal, and how those concerns were addressed. (PSSs are not required to keep notes of every conversation.)
- Although it may be difficult, the PSS should completely refrain from making any scientific, technical, scheduling or policy comments, even if asked to do so by the Chair, and even if they have expertise in that science or technical area.
- Monitor progress on the writing of proposal feedback comments (see below) via the Web-based system. Ensure that all proposal feedback comments are finished and signed off by the primary reviewers before they leave the meeting. Ensure that the Panel Chair is aware of the comments status and proof-read the submitted proposal feedback comments as time permits.
- Each panel member gives a numerical grade for each of the 3 grading criteria to the proposal in the web-based review system SPIRIT. We strongly encourage panelists to review proposals as submitted; however, in exceptional cases, the panel may wish to change the time allocation, this should be voted on before grading. The PSS must verify the time allocations are the same as entered in the Web Tool. The importance of care and accuracy in this activity cannot be overemphasized, since it is the only record of the panel's intent. (Changing the time allocation is extremely rare – if your panel is discussing doing this, please call for an SPD member to come to your panel.)
- After the grading stage follows a ranking stage. Ranks should be modified in the Web-Reviewer tool, as agreed upon by the panel. Grades can not be changed during the ranking stage. The last stage is the discussion of the team expertise for the recommended proposals to the 1N line.
- The final product of each panel will be a ranked list for all proposals, the proposal feedback comments written by the primary reviewer, and a panel report written by the Panel Chair.
Dual Anonymous Issues: Panelists may also raise concerns about proposals during the meeting. In those circumstances, the PSS can help the panel determine the appropriate course of action. If the mistake is slight, the PSS will help re-focus the discussion on the science case. However, if an investigator’s self-revealed identify becomes impossible to ignore, and that identity has a clear impact on the discussion, the proposal should be flagged for disqualification. The PSS should bring this to the attention of the panel if they feel this threshold has been crossed. The STScI Director will make the final decision.
After the Panel Meeting
After the Panel Meeting, the PSS will be asked to make sure all proposals in the panel have proposal feedback comments. This is also the case for the External Panels.
Next: Science Policy Division (SPD) Members