This challenge is closed to submissions.
CommanDING Tech Challenge
Command Dashboard Integrating Next-Gen Technology Challenge for Public Safety
Submission period:
Closed to submissionsTotal cash prizes:
$1,000,000Overview
The National Institute of Standards and Technology's Public Safety Communications Research (PSCR) Division is hosting the Command Dashboard Integrating Next-Gen Technology (CommanDING Tech) Challenge, a four-phase competition looking for the best next-generation incident command dashboards. Through improved user interfaces and user experience (UI/UX) and the ability to work with video, sensor, and map data in multi-story buildings, PSCR aims to improve the quality of incident command dashboards and, in turn, improve the effectiveness of emergency response. Contestants will bring new technology to the arena or improve their existing technology throughout the Challenge. The finalists will showcase their dashboards by completing a public safety emergency scenario in real time. Contestants' dashboards can use a variety of technologies for the Challenge, including but not limited to virtual reality (VR), augmented reality (AR), web-based, or hand-held devices (phone or tablet). All submissions must be able to integrate and respond to multiple data feeds and have a mobile, intuitive user interface that makes it more efficient and effective for public safety officers to respond to emergency situations. PSCR and its Challenge partners, of whom are listed on Challenge.gov and the Freelancer.com Challenge website, will award prizes valued at up to $1,000,000 to Contestants that meet the eligibility requirements.
Learn about and participate in Phase 1 by watching the Phase 1 kickoff video, attending the Phase 1 webinar, and registering at www.freelancer.com/nist/first-responder-dashboard.
Background
Emergency situations are complicated, time-sensitive, and demanding events. An effective public safety response requires naming a commander, allocating resources, mapping the area of impact, tracking individuals and objects, identifying areas of concern, and more. Through the CommanDING Tech Challenge, PSCR is hoping to improve the quality and usability of incident command dashboards. The challenge is looking to improve existing dashboards and also provides an opportunity for new entries into the field. PSCR is looking for dashboards that improve public safety officials’ ability to respond to emergencies through effective user interfaces and user experiences, the ability to work with data input from sensors and video streams, and the ability to locate both stationary and mobile sensors in 3-D space. This challenge will bring together first responders, video analytics professionals, public safety experts, and contestants to advance the quality and availability of Incident Command Dashboards for public safety.
Challenge Goals and Objectives
The goal of this Challenge is to leverage existing technology both within and beyond the incident command space and incentivize improving the quality, usability, and functionality of incident command dashboards for first responders. Existing dashboards are often limited by the quality of their user interface, ability to access data, or the cost to the public safety organization. As a result, public safety responders still rely on manual methods of staging and responding to an emergency situation. This Challenge aims to bring forward dashboards using multiple technologies, including VR, AR, mobile, and web-based solutions. All submissions for the Challenge must demonstrate an improvement to their prototype as demonstrated through the Prototype Capabilities Matrix (see Appendix A) updated throughout the Challenge. Public safety experts and video and data analytics professionals will support the Challenge, helping Contestants advance and enhance the state of the art of incident command dashboards.
PSCR's mission is to advance public safety communications technologies and their adoption in order to support the public safety community in protecting lives and property at all times. The CommanDING Tech Challenge, following other PSCR UI/UX Challenges, such as the 2020 CHARIoT Challenge, will further develop emergency response technology to improve the effectiveness of incident command response during a crisis.
Total cash prizes
Non-monetary prizes
Prize description
See Official Rules for the complete prize breakdowns.
A summary of the prizes to be award per phase follows:
Phase 1 Concept Papers (up to 15): $5,000 cash prize; Up to 8 $2,500 best-in-class awards; up to $95,000
Phase 2a Public Safety Collaboration (up to 15): $5,000 awards to support collaboration with public safety partner; up to $75,000
Phase 2b Video Demonstrations (up to 8): $15,000 cash prize; $5,000 to defray cost of travel to Phase 3; $5,000 to support collaboration with public safety partner; sensor package valued at $3,000; up to $224,000.
Phase 3 Lab Assessment (up to 4): up to $310,000
Phase 4 Technology Demonstration (up to 4): up to $313,500
Eligibility requirements
A Contestant who registers or submits an entry (whether an individual, private entity, or team or anyone acting on behalf of a private entity or team) to participate in this Challenge represents that they have read, understood, and agree to all terms and conditions of the Official Rules. Please review the Eligibility Section of the Official Rules document.
Rules
Please see the Official Rules document (.pdf) for details on the rules and all aspects of the challenge.
Concept papers will be evaluated based on the following criteria:
Criterion #0: Compliance Check (pass/fail)
This criterion will be evaluated on Completeness according to the ‘How to Enter’ section in the Official Prize Rules .pdf.
Criterion #1: Overview of existing or planned dashboard (20/100)
This criterion involves consideration of the following factors:
- Existing or planned features of the dashboard
- Explanation and visuals of existing or planned features and current usage
Criterion #2: Plans to improve the dashboard's UI/UX (35/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the requirements of the dashboard's UI/UX:
- Easy to use and intuitive user interface/user interface
- Mobile (e.g., field-deployable)
- Addressing public safety/incident command needs
- Ability for a public safety incident commander to use the dashboard to complete the test scenarios
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology and the team's ability to adapt their prototype/dashboard/hardware to address the UI/UX goals of the challenge.
Criterion #3: Plans for or ability to access and display data streams (35/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the data requirements of an incident command dashboard:
- Ingesting, displaying, overlaying, and otherwise working with LiDAR scans
- Ingesting and displaying data from stationary and mobile sensor data in 3-D space
- Ingesting, displaying, and responding to video streams and video analytics
- Responding to conditions as indicated by data from sensors or video data
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology and the team's ability to adapt their prototype/dashboard/hardware to address the goals of the challenge.
Criterion #4: Quality and completeness of the submission (10/100)
This criterion involves consideration of the following factors:
- Quality of the submission
- Clearly describes the current state of the technology
- Clearly describes work to be done
- Clearly describes the team's skills and ability to update the technology
- Completeness of the submission
- All information needed to evaluate the submission is provided
After the Judging Panel has reviewed each Contestant using the above evaluation criteria, the Judging Panel has up to 8 Best-in-Class awards to recognize contestants for their innovative proposed concept in alignment with the challenge goals. All Contestants who pass Criterion 1-4 are eligible for these awards. The Judging Panel will vote on all eligible Contestants and use a simple majority to select a Winner for each of the $2,500 Best-in-Class awards.
Scoring Criteria: Best-in-Class Technology
The highest ranked dashboard(s) in the following categories
- VR application
- AR application
- Phone or tablet application
- Web-based dashboard
- New technology interface other than those listed above
- Adaptation of existing technology for public safety use (2 awards)
Scoring Criteria: Best-in-Class Innovative Public Safety Feature
The dashboard that displays a feature that demonstrates a strong alignment to and knowledge of the public safety use case.
Phase 2a: Public Safety Collaboration
Section #0: Compliance Check (pass/fail)
A letter, including a description of agreed work and signatures from Contestant’s Official Representative and Public Safety Partner, will be evaluated for completeness according to the ‘How to Enter’ section in the Official Prize Rules .pdf.
Phase 2b: Video Demonstration
Video demonstrations will be evaluated based on the following criteria:
Criterion #0: Compliance Check (pass/fail)
This criterion will be evaluated on Completeness according to the ‘How to Enter’ section in the Official Prize Rules .pdf.
Criterion #1: Capabilities assessment (30/100)
This criterion involves consideration of the following factors:
- Demonstration of current dashboard features, which may include:
- Ingesting and displaying LiDAR scans
- Ingesting, displaying, and reacting to stationary and mobile sensors
- Ingesting, displaying, and reacting to video streams and analytics
- Status of the UI/UX
Criterion #2: Demonstrated progress made to date (30/100)
This criterion involves consideration of the following factors:
- Explanation and demonstration of new or improved features, which may include:
- Updated Capabilities Matrix
- New and updated features
Criterion #3: Potential to complete the challenge (20/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology and the team's ability to adapt their prototype/dashboard/hardware to address the goals of the challenge.
Criterion #4: Demonstrated inclusion and awareness of public safety needs (20/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the requirements and needs of public safety officials in emergency response.
- Implementation and description of features that directly help public safety for emergency response.
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology to address public safety needs and the team's ability to adapt their prototype/dashboard/hardware to address any outstanding issues.
Video demonstrations will be evaluated based on the following criteria:
Criterion #0: Compliance Check (pass/fail)
This criterion will be evaluated on Completeness according to the ‘How to Enter’ section in the Official Prize Rules .pdf.
Criterion #1: Capabilities assessment (30/100)
This criterion involves consideration of the following factors:
- Demonstration of current dashboard features, which may include:
- Ingesting and displaying LiDAR scans
- Ingesting, displaying, and reacting to stationary and mobile sensors
- Ingesting, displaying, and reacting to video streams and analytics
- Status of the UI/UX
Criterion #2: Demonstrated progress made to date (30/100)
This criterion involves consideration of the following factors:
- Explanation and demonstration of new or improved features, which may include:
- Updated Capabilities Matrix
- New and updated features
Criterion #3: Potential to complete the challenge (20/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology and the team's ability to adapt their prototype/dashboard/hardware to address the goals of the challenge.
Criterion #4: Demonstrated inclusion and awareness of public safety needs (20/100)
This criterion involves consideration of the following factors:
- Demonstrated understanding of the requirements and needs of public safety officials in emergency response.
- Implementation and description of features that directly help public safety for emergency response.
- Demonstrated understanding of the strengths, shortcomings, and changes to be made to their technology to address public safety needs and the team's ability to adapt their prototype/dashboard/hardware to address any outstanding issues.
The technology demonstration will be evaluated based on the following criteria:
Criterion #0: Compliance Check (pass/fail)
This criterion will be evaluated on Completeness according to the ‘How to Enter’ section in the Official Prize Rules .pdf.
Criterion #1: Ability to complete the scenario (10 tasks) (40/100)
- For each task (5 points max/task):
- Completed, showing extra ease of use or speed to complete (5 points)
- Completed, as expected, with no assistance or malfunctions (4 points)
- Completed, with only minor issues (2-3 points)
- Completed, with major issues (1 point)
- Unable to complete the task (0 points)
Criterion #2: Quantitative and qualitative assessment of dashboard (UI/UX) (60/100)
- Overall impression by the judging panel as reported through questionnaire and observation:
- Intuitive
- Overall performance
- Easy to navigate
- Ease of decision making
- Time spent fixing errors
- Time spent accessing necessary information
- Frustration, confusion, dissatisfaction/satisfaction
- Requests for clarification
- Interruptions or disruptions while performing tasks
- Performance
- Quality of instructions and documentation provided
- Alignment to public safety needs and requirements
After the Judging Panel has reviewed each Contestant using the above evaluation criteria, the Judging Panel has at least 12 Best-in-Class awards to recognize contestants for outstanding achievement or contribution to advancing the challenge goals. All Contestants in Phase 4 who pass Criterion 1 and 2 are eligible for these awards. The Judging Panel will vote on all eligible Contestants and use a simple majority to select a Winner for each of the $10,000 Best-in-Class awards. Please note, there may be more than one award per category (e.g., UI/UX for each platform).
Scoring Criteria: Best-in-Class Technology
- The highest ranked dashboard(s) in the following categories:
- VR application
- AR application
- Phone or tablet application
- Web-based dashboard
- UI/UX
- Data Handling
Scoring Criteria: Best-in-Class Innovative Public Safety Feature
The dashboard that displays a feature that demonstrates a strong alignment to and knowledge of the public safety use case.
Scoring Criteria: Commercial Viability
The Contestant with the highest likelihood of commercial success based on the Judging Panel’s use of the dashboard
Review the phases and the Official Rules. By the July 31, 2022 deadline, submit all requirements for Phase 1 through the Challenge website.
- Review the information on the video and data streams included on the Challenge website.
- Register as a contestant and complete the submission requirements via the Challenge website by the required date.
- Follow the instructions on the Challenge website to submit your concept paper, images or video of your prototype, and the Prototype Capabilities Matrix.
- Additional information on how to complete a contestant entry is on the Challenge website.
See the Official Rules.
See the Official Rules.
See the Official Rules.
For a current list of questions and answers, see the FAQ document linked on the Challenge website. Additional questions can be posted on the challenge’s Public Clarification Board on the Challenge website.
Concept Paper
The CommanDING Tech Challenge is excited to announce the winners of Phase 1: Concept Paper! Congrats to the winners advancing to Phases 2a and 2b as they partner with public safety to advance their prototypes. Thank you to all who submitted their ideas and concepts to advance incident command dashboards for public safety- we were so impressed with the caliber, energy and solutions we received!
a. Public Safety Collaboration & b. Video Demonstration
Stage 2b Winners
Each of the Phase 2b winners received: an invitation to Phase 3; $15,000 for technology development; $5,000 to defray the cost for team members to travel to the Department of Commerce laboratory facility in Boulder, Colorado, for the Phase 3 Technical Demonstration; $5,000 to support their collaboration with the public safety partner in Phase 3; and a sensor package valued at $3,000 for testing and developing their prototype.
BadVR
Cloud Responder
Engineering Dynamics
Headwall VR
Red Volta, LLC
Televerse Robot, LLC
TurnRock Labs
VALOARUS
Stage 2a Winners
Each of the Phase 2a winners received $5,000 to support their collaboration with a public safety partner as they developed their prototype for Phase 2b.
BadVR
Cloud Responder
Emergency Ventures
Engineering Dynamics
Headwall VR
JANUS Research Group
Red Volta, LLC
Smart Firefighting
Smart Response Technologies, Inc (SRT)
Three Firefighters
Televerse Robot, LLC
TurnRock Labs
Laboratory Assessment
The CommanDING Tech Challenge would like to congratulate the winners of Phase 3: Laboratory Assessment, and celebrate the accomplishment of all the eight contestants that contributed their solutions for next generation incident command dashboards. Thank you for your efforts to advance public safety communications, and good luck to the top four teams as they advance to Phase 4!
Turn Rock Labs
- First Place: $110,000
Engineering Dynamics
- Second Place: $85,000
BadVR
- Third Place: $60,000
Headwall VR
- Fourth Place: $35,000
Red Volta
- Fifth Place: $10,000
Cloud Responder
- Sixth Place: $10,000
Technology Demonstration
The CommanDING Tech Challenge would like to congratulate the final winners of the CommanDING Tech Challenge! Stay tuned to this website for more information about their next generation incident command dashboards.
Below, the ranked prizes from Phase 4: Technology Demonstration:
HeadwallVR- First Place: $76,750
BadVR- Second Place: $52,625
Turn Rock Labs- Third Place: $29,375
ENGR Dynamics- Fourth Place: $21,250
All four teams received $3,375 to defray the cost of travel to demo their innovative incident command dashboard technology at the 5X5: The 2023 Public Safety Innovation Summit.
The Judging Panel also awarded the following Best-in-Class Award ($10,000 each):
Best AR application: BadVR
Best VR application: HeadwallVR
Best UI/UX for AR: BadVR
Best UI/UX for VR: HeadwallVR
Best Data Handling in AR: BadVR
Best Data Handling in VR: HeadwallVR
Best Data Handling for a category not listed: Turn Rock Labs
Best-in-Class Innovative Public Safety Feature- wrist activated clipboard – embodied haptic feedback for easy information access: BadVR
Best-in-Class Innovative Public Safety Feature- ability to track a first responder cleanly by individual floor: ENGR Dynamics
Best in Class Innovative Public Safety Feature- Room Clearing Function: HeadwallVR
Best in Class Innovative Public Safety Feature - The Virtual Commander: AI generated recommendations for incident command action response: Turn Rock Labs
Commercial Viability: HeadwallVR
Total Amount of Phase 4 Awards Received Per Contestant
Headwall VR: $130,125
BadVR: $96,000
Turn Rock Labs: $52,750
ENGR Dynamics: $34,625
