AI Maturity in action

You've prepared your Cortex workspace for AI Maturity — what can you do now to ensure your team is consistently using AI tools and encourage continuous improvement?

Learn more below on how you can prioritize AI-related tasks and gain insights to improve your practices.

Review, prioritize, and complete tasks

Prioritize and complete work from the homepage

Engineers use the Engineering homepage as their personalized daily starting point. It provides a centralized view of key signals and tasks related to your AI projects, including:

• Active work: See your open PRs, PRs assigned for review, active Jira tickets, and action items from Scorecards and Initiatives, ensuring you are aware of your responsibilities and can quickly address gaps that impact AI Maturity.

• Scorecards and Initiatives: See real-time progress toward AI standards and goals.

Review failing Scorecard rules

When a Scorecard rule is failing, this information is surfaced to you in multiple ways:

• Scorecard rules that require your attention appear on the Engineering homepage.

• You can receive notifications via Slack, Microsoft Teams, or email when a Scorecard rule is failing.

  • Learn more about configuring notifications in the docs.

• You can review a Scorecard's progress in reports or by viewing the Scorecard in Cortex.

Remediate failing rules

When a service falls short of standards, there are different ways you can approach remediation:

• Use Cortex MCP to get suggestions for remediations. Ask a question such as What are some quick wins for my AI Maturity Scorecard? and the MCP will respond with a prioritized list for you to focus on during remediation efforts.

• Set up an Initiative to assign and track remediation tasks. For example, you might create an Initiative that asks teams to meet standards on all rules in the Silver level of your AI Maturity Scorecard within the next month.

  • You can also automatically create issues in Jira, ClickUp, Azure DevOps, and GitHub based on Initiatives. Learn more in Creating issues based on Initiatives.

• Identify and troubleshoot trends in Scorecards, and consider scalable remediation efforts. Learn more in Review and evaluate Scorecards.

Gain visibility with Eng Intelligence

Eng Intelligence allows you to view organization-wide and historical data, making it easy for leaders to validate the impact of AI tools and programs and for teams to see their progress toward goals.

View Eng Intelligence metrics to see how your services, teams, and Scorecards are doing with AI Maturity goals, then take action to promote continuous improvement.

• See impact: Launch a Scorecard and watch as metrics like MTTR, cycle time, or deployment frequency shift in real time alongside increased usage of AI tools.

  • For example, after you launch an AI Maturity Scorecard, you see cycle time improving as the team adopts AI tools. The engineering team is running more efficiently, and leadership gains confidence that AI tools are helping engineering teams drive business impact.

  • If you applied user labels to identify teams or users with AI tools, you can compare metrics of AI users vs. non-AI users.

• Drive action: When you identify a bottleneck that affects your benchmarks or a gap in AI adoption efforts, create a targeted Initiative to fix it or add Scorecard rules to your AI Maturity Scorecard to set productivity benchmarks alongside AI adoption efforts.

  • Initiatives send notifications to users asking them to complete tasks by the deadline you configured. Learn more in Initiatives and Action items.

  • For example, you might notice that change failure rate initially becomes more of an issue after adding AI-assisted coding tools. After identifying this issue and discussing it with your teams, you find out that some team members haven't been reviewing PRs as closely after the automated AI-assisted review. You ask them to start reviewing more closely, and you determine a path forward to motivate success:

    • You add Scorecard rules to your AI Maturity Scorecard to set benchmarks for "Change failure rate" alongside the increasing adoption of AI tools.

    • If these rules aren't passing when you check back in on the Scorecard, you plan to create an Initiative with a name like "Improve quality of PR reviews" and a due date in 30 days. In other words, you set a 30-day goal to improve the team's thoroughness with reviewing PRs, with Cortex sending automated reminders about Initiative due dates to members of the team.