In this phase you'll determine the challenge structure and implementation timeline. During this critical step, you'll work with internal groups to establish eligibility and submission requirements, terms and conditions, and judging criteria. You'll connect with your communications team to outline your announcement and ongoing outreach strategy to engage potential solvers.
Identify Goal and Outcome Metrics
At this point you should have defined your desired outcomes and goals. Now, you must determine how to measure performance throughout the challenge.
Goals may include soliciting specific types of solutions, reaching new audiences, saving lives or creating more effective products. Using your desired goals as a basis, design an agency-focused set of metrics to capture your outcomes. For example, you may want to measure the speed of a solution or the number of students reached. Whatever it may be, identify specific data to collect throughout the challenge that will inform your metrics.
This can be a difficult step. It may help to enlist subject matter experts, academia, foundations and refer to case studies of previous challenges.
Outcome measures come vary widely depending on the specific challenge and goal. Brainstorm with colleagues, the community and subject matter experts. Make the goals relevant to your agency activities and strategic goals without restricting yourself unnecessarily.
Outcomes can be qualitative or quantitative, but you have to be able to measure them. Outcomes that can be counted are simpler, but qualitative measures may better capture the depth and value of an outcome.
As always, make sure your outcomes include all of the information required for the biennial progress reports to Congress.
Consider developing user surveys or public access data to provide a more complete understanding of your challenge's impact at the individual and community levels. Your agency leadership may have specific criteria for success that require a unique form of measurement.
Your challenge website actually may provide the most efficient way to measure outcomes. The website easily can capture quantitative data. For qualitative data, consider using the website to collect user feedback.
This toolkit didn't write itself, and these tips didn't appear out of thin air. This material comes from those who have pioneered the use of challenges in the federal government.
After you collect and analyze your outcome data, it will be your turn to share what you learned.
When establishing metrics, keep in mind that down the road others may come to you asking about the goals you achieved or the processes and procedures you employed for your challenge.
When all is said and done, there are a variety of ways to share what you learned. You can report information using standard agency communication channels or in conjunction with the Challenge.gov program in the form of case studies, blog posts or even new content for this toolkit.
2.7 Identify Goal & Outcome Metrics (current page)