U.S. flag An official website of the United States government
Dot gov

The .gov means it's official.
Federal government websites always use a .gov or .mil domain. Before sharing sensitive information online, make sure you're on a .gov or .mil site by inspecting your browser's address (or "location") bar.

SSL

This site is also protected by an SSL (Secure Sockets Layer) certificate that's been signed by the U.S. government. The https:// means all transmitted data is encrypted - in other words, any information or browsing history that you provide is transmitted securely.

Identify Goal & Outcome Metrics

Identify Goal & Outcome Metrics

develop pencil and ruler icon

DEVELOP

In this phase you'll determine the challenge structure and implementation timeline. During this critical step, you'll work with internal groups to establish eligibility and submission requirements, terms and conditions, and judging criteria. You'll connect with your communications team to outline your announcement and ongoing outreach strategy to engage potential solvers.

Other Phases

prepare books phase icondevelop pencil and ruler iconconduct wheel iconaward star medal icontransition hand and star icon

Identify Goal and Outcome Metrics

At this point you should have defined your desired outcomes and goals. Now, you must determine how to measure performance throughout the challenge.

Goals may include soliciting specific types of solutions, reaching new audiences, saving lives or creating more effective products. Using your desired goals as a basis, design an agency-focused set of metrics to capture your outcomes. For example, you may want to measure the speed of a solution or the number of students reached. Whatever it may be, identify specific data to collect throughout the challenge that will inform your metrics.

This can be a difficult step. It may help to enlist subject matter experts, academia, foundations and refer to case studies of previous challenges.

Key Takeaways

1. Develop relevant goals.

Outcome measures come vary widely depending on the specific challenge and goal. Brainstorm with colleagues, the community and subject matter experts. Make the goals relevant to your agency activities and strategic goals without restricting yourself unnecessarily.

2. Measure your outcomes.

Outcomes can be qualitative or quantitative, but you have to be able to measure them. Outcomes that can be counted are simpler, but qualitative measures may better capture the depth and value of an outcome.

As always, make sure your outcomes include all of the information required for the biennial progress reports to Congress.

3. Be creative in your measurement.

Consider developing user surveys or public access data to provide a more complete understanding of your challenge's impact at the individual and community levels. Your agency leadership may have specific criteria for success that require a unique form of measurement.

4. Use your website to help with measurement.

Your challenge website actually may provide the most efficient way to measure outcomes. The website easily can capture quantitative data. For qualitative data, consider using the website to collect user feedback.

5. Remember that your knowledge will be added to the public domain.

This toolkit didn't write itself, and these tips didn't appear out of thin air. This material comes from those who have pioneered the use of challenges in the federal government.

After you collect and analyze your outcome data, it will be your turn to share what you learned.

When establishing metrics, keep in mind that down the road others may come to you asking about the goals you achieved or the processes and procedures you employed for your challenge.

When all is said and done, there are a variety of ways to share what you learned. You can report information using standard agency communication channels or in conjunction with the Challenge.gov program in the form of case studies, blog posts or even new content for this toolkit.

Still have questions?

Contact the Team

Case Studies