GenAI metrics - Tech Preview

Overview

Disclaimer:

This release contains access to the GenAI metrics feature in HCL DevOps Velocity (Velocity) as a Tech Preview. The Tech Preview is intended for you to view the capabilities of GenAI metrics offered by Velocity, and to provide your feedback to the product team. You are permitted to use the information only for evaluation purposes and not for use in a production environment. HCL® provides the information without obligation of support and "as is" without warranty of any kind.

The GenAI metrics provides you the insights about GitHub Copilot usage within an organization. This feature retrieves user activity, engagement levels, language-specific completions, and other Copilot adoption metrics directly from the GitHub API and syncs them into Velocity

The Gen AI metrics helps organizations track how developers are using AI-assisted coding and measure productivity impact through structured metrics.

The following GenAI metrics can be added and displayed within the Velocity insights section.

  • GenAI Line Acceptance
  • GenAI User Adoption
  • GenAI Chat Events
  • GenAI Code Acceptance
  • GenAI PR Events

Prerequisites

You must integrate or upgrade your Github integration with plugin version 1.5.4 or later with Copilot metrics collection enabled during integration. For more information, refer to Github plugin documentation.

Display of the GenAI metrics in Velocity

In Velocity, the Flow Efficiency metric is displayed on the Dashboards page under GenAI categoty:

Adding the GenAI metric chart to the Dashboard

Perform the following steps to add the GenAI metric charts on Dashboards:
  1. Click Insights > All Dashboards.
  2. Perform any of the following steps:
    • Click any existing dashboard to open the dashboard.
    • Click Add new dashboard, provide the name and description for the dashboard, and then click Add.

    The Dashboard is opened.

  3. Click Add charts and in the GenAI category, click Add for the available GenAI metrics collected from GitHub Copilot.

    The chart is displayed on the dashboard.