All XRAS clients use a similar review interface. XRAS Review, typically found hosted at URL similar to https://review-client-review.xras.org/, allows reviewers to view submissions and enter their reviews. The site can also be used to support supports panel meetings by providing with a sortable listing of submissions that can serve as an agenda or the more interactive Meeting App. 

The Help item in the top navigation bar provides detailed instructions to help reviewers with the various XRAS Review components. In this section, we summarize the features and highlight aspects of particular interest to Administrators.

...

...

This feature works much like the user impersonation feature in XRAS Submit and is only available if the “XRAS Review impersonator” permission has been specifically granted to an individual in XRAS Admin. At the right of the top navigation bar, click on your Admin username and enter the username of the reviewer you wish to impersonate. To stop impersonating, click on the reviewer username at top right and select “Stop Impersonating.”

...

• Purple shading and “(A)” in the Last Name column indicates the reviewer is assigned to a submission.

• Gray shading and “(C)” in the Last Name column indicate that the reviewer has a conflict of interest (COI) with the submission. XRAS does not allow a reviewer to click through to such submissions for which they have a COI.

Rate Requests

The Rate Requests feature in XRAS allows reviewers to express their level of interest in rating the submissions for a given opportunity. You can control this optional feature on the Create/Edit Opportunity screen. 

...

You can configure XRAS Review to display a link to guidance for reviewers specific to your site’s allocations process, for example, your review criteria, rubrics, or policies. You can provide this link in the Client Settings.

Entering Reviews and Viewing Requests

...

The Report COI tab lets a reviewer report a conflict of interest (COI) with a particular submission. While XRAS tries to automatically identify several common COIs, a reviewer may discover that they have a less common conflict type only after seeing the request details. Conflicts of interest are typically defined in the policies for your allocation process. . You can add custom COI types under Client Settings.

From the Review/View page for a submission, a reviewer can select the “Report COI” tab, select the type of COI and provide a comment, then click the Submit COI button.

When a COI is reported, XRAS records the COI, clears the reviewer’s assignment (if applicable), and sends the reviewer back to their home Assignments screen. You can also configure XRAS to send an email notification to your Admin(s) that a COI was reported and review assignment was removed.

Meeting

...

App

The Meeting UI app App is a tool designed to help the flow of review meetings. It allows all users to see a list of requests and some quick details about any selected requests. This includes the request title, the primary investigator, the request type, any and all CoPIs, any and all key personnel, conflicts of interest, the abstract, and the reviews for the request. It also allows admins to enter recommended amounts discussed at the meeting and non-admins to see the amounts entered by admins in real time.

On the The information page for a specific Opportunity, there is an opportunity has a section at the top titled "Meeting “Meeting Information".” If there is an upcoming or current meeting, a button titled "Review Meeting App" will be visible in this section. Clicking the button will open the Review Meeting UI appApp.

The app is divided into two main sections, : the Agenda agenda on the left and the Request Details request details on the right. The request details section is divided into smaller sections. The first section contains the Title project title, which matches the format on the Agendaagenda, the Request Type, CoPIs, Conflicts of Interest, Reviewer Instructionsrequest type, key personnel, conflicts of interest, reviewer instructions (if any), and the Abstractabstract. The reviewer instructions and abstract sections are hidden by default and can be expanded by clicking the > “>” (right pointing arrow).

Agenda

The Agenda agenda contains all of the requests for the opportunity. Each entry will list the Request Numberrequest number, the PI, a brief snippet of the abstract, any conflicts of interest, and any meeting review tags. Clicking on a request will load it for viewing in the Request Details section.

The list agenda listing is also color coded, depending on the status of the request.

At the top of the Agenda agenda are filtering options, hidden by default until the magnifying glass icon is clicked. The list can be filtered by:

• The name of a reviewer

• The name of a conflict

• The name of the PI

• The name of a Resource

The filters can also be combined to further narrow down the list.Clicking on a request will load it for viewing in the

Request Details

...

Request Details

The request details section is divided into smaller sections. The first section contains the Title project title which matches the format on the Agendaagenda, the Request Type, CoPIs, Conflicts of Interestrequest type, key personnel, conflicts of interest, reviewer instructions (if any), and the Abstractabstract. The reviewer instructions and abstract is are hidden by default and can be shown by clicking the > “>” (right pointing arrow) next to the word Abstract.

The next section contains the Reviewsreviews. Each review is listed with the name of the reviewer, their overall evaluation, and a button to show the full review. The full review is hidden by default, clicking the "Full “Full Review >" >” text will expand the review. The review will then show all of the fields for which the reviewer entered text forvalues.

The Admin Notes admin notes section is next and is only visible /editable to to and editable by your XRAS Admins. In this area, an admin can take notes about the request as well as see the notes that other admins have entered.

The Tags tags section allows admins to click on relevant tags to assign to the request. NonReviewers and other non-admins can only view which tags have been clicked.

The Recommendations recommendations section lists the allocation begin and end dates, a list of the requested resources, the amount requested, and the amount recommended by the review panel. Non-admins can see the content of the allocation dates and the recommended amounts, but can't edit the contents. Admins can change the allocation dates, can enter numbers into the recommended amounts, and have the option to click the "Fill with Requested" shortcut to fill the recommended boxes with the requested amounts.

Lastly there is , a toggle to mark that the review is completed and two save buttons . These controls are only available to Adminsadmins. The toggle allows an admin to mark that the review is completed. The "Save" button will save all of the recommended amounts and tags to the database. The "Save Notes Only" will only save the Admin Notesadmin notes; the recommended amounts will not be saved.

In the event another Admin that more than one admin has entered recommended amounts, allocation dates, or tags, the system will check for differences between the entries. If the other Adminanother admin's entries are in conflict with any part of the current user's entry, a pop-up will appear before the current user's entries are saved. The user will see the items that are in conflict. The user can then choose to use the other Adminadmin's  entriess entries, use the current user's their own entries, or cancel the save altogether and return to the request view.

...

To view and modify your XRAS reviewer profile, click your name in the upper right, then click User PofileProfile. From this screen, you will be able to view all of your current and past panel memberships, as well as modify your Field(s) of Science expertise.

To add a primary or secondary field of science, click the blue "Add FOS" “add” button, and select one or more fields of science from the list.