2023-12-19 ACCESS EC Meeting Agenda & Summary
Attendees:
RAMPS: Stephen Deems (v), Dave Hart
MATCH: Shelley Knuth (v), Alana Romanella
CONECT: Tim Boerner (v), Leslie Froeschl
MMS: Tom Furlani (v), Joe White
OpenCI: John Towns (v), Shawn Strande, Lavanya Podila, Lisa Kaczmarczyk, Shannon Bradley
NSF: Tom Gulbransen, Sharon Geva
Guest Speaker: Paul Parsons, Claire Stirm, Dina Meek
(v) indicates a voting member
Decisions made during the meeting:
- Evaluation Plan approved by EC Vote - 12/19/2023
Use Decision Macro
Agenda/Notes
SGX3 ACCESS website usability engagement @Paul and @Claire (30 mins)
This is an educational and informative session to understand the work of SGX3 Usability Consulting.
Paul is an associate professor at Purdue. He leads the usability consulting for SGX3, completed over 60 projects in different domains and sciences.
Projects range are different depending on what the user is trying to do, identify best practices and patterns, have methods to understand usability
The team tries to evaluate how to improve the usability of the product
Student team at Purdue with oversight from Paul
Engagement timeline 2-3 months
Students setup meetings and do milestone check ins
Generate reports with findings, summary and next steps. Then go into usability and different methods, where things can be confusing and misleading. They identify issues and then come up with recommendations and explanations.
Questions for the team; The process looks extensive and through, have you been able to measure impact of the work you've done?
Paul: impact is a bit hard to assess. Claire maybe able to help. One thing the team has done is to go back and talk to people and understand what has been beneficial. He doesn’t have any quantitative metrics.
Claire: Each gateway has different ways to measure impact. Helped with cleaner navigation, see the traction higher. Do not have to provide more information on following navigating the sites.
They have also seen, that the vocabulary has been improved
Folks who don’t have developers, it can be difficult to measure the impact
When you do assessments, have you had a request where you are trying to serve different types of users/personas?
Paul: Very frequently, when we start the engagement we ask about the core users. Who are the key stakeholders and then try to optimize for those groups.
ACCESS is a set of individual awards and individual websites. Is there a model where we can drill on the personas
Paul: Not as common but we see that. It's a single website but there's a lot of complexity and infrastructure hierarchy. And trying to built that into a cohesive vision.
Claire: What's the launch point or landing page for each of the core users depending on their workflows? We want to know from you about the core users. Then we can start mapping from there.
Can you please drill down on the process after you have identified the stakeholders?
Paul: High level process, have a kick off meeting to understand the direction. Identify users/stakeholders.
After that the team refines their plan.
Sometimes they reach out to these stakeholders. But varies depending on the projects.
If we have the necessary information handy, then we might skip the interviewing part.
Do you sit down with each of the users and do pre testing? Maybe give them a task and see how they navigate the website?
Paul: Yes the team does pre testing but it can be time consuming with scheduling issues.
Cost of these services is about $9k (Correction from Shawn: a site engagement is no-cost; additional sites are about $9K. However SGX3 would do an all-ACCESS site engagement for sufficiently narrow scope.)
Approval of summaries from prior EC meetings @John Towns (5 mins)
2023-11-21 EC Meeting Summary (approved)
Program Milestone Check @John Towns (5 mins)
Action item for the awardees to update their program milestones
no additional comments or updates
Reminder: Do not edit "Dashboard" tab, please edit "ACCESS program milestones" tab as needed
Need to fix the newsletter milestones.
EC Review on Communication Plan (5 mins)
https://docs.google.com/document/d/1BqLGEzE4ME4gj8Mp7NNGWbOAjkw7odShSX9XEFsJRLc/edit?pli=1#heading=h.e0ce5of25nir (updating link)
EC is asked to review and make recommendations on the refreshed Communications Plan
It's out there for review by the EC.
This revised plan tries to leverage the working groups.
Will have this item for next EC meeting for a vote.
March Quarterly Meeting @Lavanya Podila (15 mins)
Potential location options
Arizona, Chicago (Big Ten Center), Indianapolis, anywhere else?
Location finalized: Chicago
Dates
Dates finalized: 27th, 28th and 29th February
Audience: PIs/Co-PIs and leads similar to Boulder meeting
There will be a full day EAB meeting. This is the cadence that will be followed starting In Feb and will happen once a year in person.
How many EAB members should attend? it might be overwhelming for all EAB members to attend the program meeting.
Is there interest in holding a full or half-day DEI workshop as part of this meeting? If so, do teams have budget to contribute? Yes
DEI Working Group would like to schedule a workshop in person. We can have a half day or a full day, at least 3 hours preferably at the beginning. The intention is to have a consultant lead the session.
Leslie, Ag and Stephen will take it back to the DEI working group and see how long the session might take.
Evaluation Plan @David Hart (15 mins)
Assuming we need surveys, we need to have an approval of the plan.
Should the evaluation plan be broader than what was originally stated?
Possible comprise; The plan includes an annual review of the evaluation working group. John believes that we arrived on the 3 surveys, this can be the plan for the coming year but then reconsider if it needs to be broader.
Dave agrees that there are several things that need to be nailed down.
Eval Plan approved with EC vote
NAIRR Pilot Update @David Hart (5 mins)
Deferred to next EC meeting
Informational Items (10 mins)
Allocations Stephen Deems
Researcher Advisory Committee Agenda Topics (Requested from RAC)
Next meeting will be: Monday, February 26, from 2:30 – 4:00 PM (Central time)
Input is requested from EC on topics. See current list of topics here: ACCESS Researcher Advisory Committee
Items recommended/suggested by the RAC are merged with the EAB tracker: https://docs.google.com/spreadsheets/d/1CtAMssCnj8RNfWk7M7K4RvZG-rBdNJsuFseFVQWuP5s/edit#gid=266099631
Software
Data transfer
New Allocations Website
Launching on Tuesday, January 9, 2024.
Slow roll-out (will be announced via newsletters/announcements later in January)
Submission Window is Now Open for March 2024 AARC Meeting
Proposals accepted until January 31, 2024. Review meeting 2nd week of March. Awarded proposals start/renew April 1. More information.
MATCH Shelley Knuth
CONECT Tim Boerner
Representatives from all teams met last week to share efforts to date/perspectives on a resource selector tool/filter. See notes from that meeting here. The group settled on the following next steps based on similarities in requirements:
Reps from Allocations and Operations will meet to converge on a single solution for resource listings/filtering.
Reps from Support, Operations, and Metrics will meet to talk about ways the two selector tool options might potentially be merged or at least ensure continuity in results if they remain two separate tools (https://access-ara.ccs.uky.edu:8080/ and content available in the Operations chatbot
Metrics will be consulted throughout to determine where information they can provide can be made available via these various options.
MMS Tom Furlani
OpenCI John Towns
Great experience at NeurIPS last week. CB&E and Comms should consider presence in the future.
Reminder that the RP forum bylaws v1.0 were circulated for EC input. Eva could not attend today, but we will have her for discussion at our next meeting.
Misc Topics:
EC agrees to cancel meeting on 2nd January
Parking Lot
RP forum bylaws
NAIRR pilot update
Risk Management progress = change in likelihood due to mitigation efforts?
Horizontal Leadership progress = compromises?
Next EC Meeting: 16th January 2024
Action Tracker:
Use Action Item Macro to track assigned To Do Items - check the box when it is complete
Format:
Reference:
Risk Register: https://access-ci.atlassian.net/jira/core/projects/RR/board
Project Change Request: https://access-ci.atlassian.net/jira/core/projects/PCR/board