Measure AI impact

You can leverage the Eng Intelligence features in Cortex to measure the impact of AI.

Copilot Dashboard

The Copilot Dashboard provides insights into the adoption and impact of AI coding tools (starting with GitHub Copilot) across your engineering teams. It allows you to:

• View AI adoption rates by team: See how many developers are actively using Copilot and how adoption trends over time.

• Correlate AI usage with engineering performance: Compare key metrics (cycle time, deployment frequency, incident frequency, merged PRs, PR size, time to resolution, and work items completed) between teams or users who use AI tools and those who do not.

• Track AI adoption over time: Monitor how Copilot usage changes and how it affects delivery and reliability metrics.

• Filter and analyze: Use filters for time range, team, user, and more to drill into the data that matters most to you.

These insights help you identify whether AI tools are improving efficiency, accelerating delivery, or introducing new risks, and allow you to take targeted action based on real data.

Metrics Explorer

Metrics Explorer includes AI-specific metrics such as:

• AI adoption rate: Percentage of licensed seats that are active users of AI coding tools.

• Active AI users: Number of users who used AI tools in a given period.

You can group any Eng Intelligence metric by the Cortex-generated "AI Usage" user label to compare performance between AI users and non-AI users.

Drive continuous Improvement

You can use insights from the Copilot Dashboard and Metrics Explorer to understand what your teams are doing well and areas where they could improve. Use this data to inform your next steps and promote continuous improvement.

For example, if you notice a spike in incidents among AI users, you could create an Initiative to improve test coverage or code review practices.