All Metrics (Legacy View)

In the All Metrics page, view metrics pulled in from the Cortex deploys API, version control integrations (Azure DevOps, Bitbucket, GitHub, and GitLab), Jira, and PagerDuty.

​

Accessing All Metrics

To view, click Eng Intelligence > All Metrics in the main nav:

​

Using All Metrics

The All Metrics view aggregates data from your connected entities to calculate critical metrics based on your organization’s priorities. The data is presented by team, group, or individual, and can be filtered by time range. Cortex provides a set of default metrics, but you can also create custom metrics to track here. These values are recalculated every hour. For count metrics (e.g., PRs opened) , 0 is displayed if no data is available. For average metrics (e.g., average PR open to close time), N/A is displayed if no data is available to calculate averages.

​

Apply time range and team filters

By default, All Metrics displays data from the last 7 days. To filter by time range:
In the upper right corner of Eng Intelligence, click Last 7 days, then select a new time range for your metrics display:
To filter by team, group, or owner:

1. Click Filter in the upper right corner.
2. Click into Group, Owner, or Team, and select filter options.
3. Click Apply.

​

Group by team hierarchy

By default, each Team entity in Cortex is displayed in its own dedicated row. To group by the team hierarchies you’ve created, click View as hierarchy.

​

Group by entity type

By default, All Metrics displays Team data. In the upper left corner, click the Team dropdown to select a different entity type:

​

Group by user label

After you have set up user labels, you can group by labels. Click the Group by dropdown and select a label you want to group by. The grouping will be added as a row to the metrics table, along with separate rows for each member of the grouping.

​

View more details for an entity

To better understand the data behind a trend you see, click an entity to open a side panel with more information:

• Under the Related activity tab, see available metrics and recent activity.
• Under the Trends tab, see a historical performance graph for each metric.

In the upper right corner of the panel, you can adjust the time range for the graphs to be anywhere between the last 7 days and 6 months. This will update the graph view and maps to the table, so all metrics will reflect the new timeframe.

​

Show Scorecard view

In the upper right corner, click Display. In this drop-down, you can choose whether to display entities in their associated hierarchies and you can select a Scorecard. When you select a Scorecard, Scorecard performance is overlayed in Eng Intelligence when grouped by team or service. This view is not available when grouping by group, user, or owner. The icon representing the Scorecard level achieved by each entity will appear next to the entity name:

​

Metrics

Users with the Configure custom metrics permission can create custom metrics for All Metrics, or you can use the built-in metrics listed below. These metrics are pulled from the Cortex deploys API, version control integrations (Azure DevOps, Bitbucket, GitHub, and GitLab), Jira, and PagerDuty.

​

Deploy metrics

​

Version control metrics

​

Jira metrics

​

PagerDuty metrics

​

All Metrics settings

​

Change All Metrics appearance

From the All Metrics appearance settings, users with the Configure Eng Intelligence permission can also choose which columns to display and adjust the order of columns in the All Metrics view.

​

Set filtering for metric calculation

From the All Metrics filters settings, users with the Configure Eng Intelligence permission can set filters for some pre-defined metrics:

• Under Deploys, select the deploy environments you want to include in the calculation of deploy frequency and deploy failure rate. - If none are selected, all deploys will be included.
• Under Pull requests, select the authors you want to exclude from the calculation of PR-related metrics.
  • If none are selected, PRs from all authors will be included.
  • By default, Cortex filters out pull requests opened by bots in GitHub but does not do this automatically for GitLab.

​

Configuring Groupings for Jira Metrics

You can add custom groupings to Jira Issues based on labels, issue types, and components. The number of tickets completed for each grouping will be calculated in All Metrics using the custom name you configure for the grouping.

1. Navigate to the All Metrics settings page and click the Issue tracking tab.
2. On the right side of the page, click Add issue grouping.
3. In the modal, configure the issue grouping:
   • Name: Enter a name for the grouping.
   • Type: In the dropdown, select at least one issue type you want to track.
   • Component: Enter the name of the Jira component you want to track.
   • Label: Enter the name of the Jira label you want to track.
4. Click Add issue grouping.

​

Create and manage user labels for grouping

User labels in Eng Intelligence allow you to group users into cohorts to analyze metrics based on different factors. This can be useful for benchmarking one engineer’s metrics against the average within a cohort, comparing metrics between engineers who use different tools to complete their work, and understanding metrics by different variables: location (e.g., in office or remote), engineer level (staff vs. lead engineer), tech stack (frontend vs. backend), and more. Users who have the Configure user labels permission can create and apply labels. The instructions below describe how to use this feature in the Cortex UI. See the Cortex API documentation for instructions on creating and managing user labels programmatically. Create a user label

1. In Cortex, navigate to the User labeling settings.
   1. Click your avatar in the lower left then click Settings.
   2. Under Eng Intelligence, click User labeling.
2. In the upper right corner, click Create label.
3. Fill out the “Create label” form:
   • Name: Enter a descriptive name, e.g., Location.
   • Description: Optionally enter a description, such as “This label helps us understand metrics by location.”
   • Values: Enter possible values for the label, e.g., New York, California, Remote.
4. Click Create label.

After saving, the label will appear under the Label management tab in the Eng Intelligence settings page. View applied user labels In the User labeling settings, you can view a list of users and their applied labels. Note that these labels are only displayed in Eng Intelligence, and not in other pages within Cortex. Assign a user label to a user

1. In Cortex, navigate to the User labeling settings.
2. In the list, locate the user you want to add a label to. Under the “Labels” column for that user, click the pencil icon.
3. In the side panel, click into the dropdown to select a pre-existing label. To create a new label, type in a name then click +Create in the dropdown.
4. At the bottom of the side panel, click Set labels.

Assign user labels in bulk

1. In Cortex, navigate to the User labeling settings.
2. Check the boxes next to the users you want to edit. As you check names, a banner will appear at the bottom of the page showing how many users are selected. In that banner, click Edit labels.
3. In the bulk edit modal, enter the labels you want to add to the users, then click Set labels.

After applying labels to users, you can group by user label while viewing Eng Intelligence metrics.