Viewing per-user activity

You can configure Kiro to collect per-user activity telemetry for the Kiro subscribers in your organization and deliver it as a daily CSV report. Use this report to audit usage, optimize license allocation, track credit and overage consumption, and understand how individual users interact with Kiro across clients.

Each day at 2:00 AM (02:00) Coordinated Universal Time (UTC), Kiro generates a CSV report per Kiro client type (IDE, CLI, and Plugin) and writes it to your S3 bucket.

s3://bucketName/prefix/AWSLogs/accountId/KiroLogs/user_report/region/year/month/day/00/clientType_accountId_user_report_timestamp.csv

Create an Amazon S3 bucket to hold the user activity report CSV file. The bucket must:

• Be in the AWS Region where the Kiro profile was installed. This profile was installed when you subscribed IAM Identity Center workforce users to Kiro Pro for the first time. For more information about this profile and the Regions where it's supported, see Kiro profile and Supported Regions.

• Be in the AWS account where users are subscribed. If users are subscribed in multiple AWS accounts, then you must create buckets in each of those accounts. Cross-account buckets are not supported.

• (Optional but recommended) Be different from the bucket you might be using for logging users' prompts.

• Include a prefix, also known as a subfolder, where Kiro will save the CSV file. The CSV file cannot be saved in the root of the bucket.

• Have a bucket policy like the one that follows. Replace bucketName, prefix, region, and accountId with your own information. The region and accountId in the policy's Condition block must match the Region where your Kiro profile was installed and the AWS account where users are subscribed.

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "KiroLogsWrite",
      "Effect": "Allow",
      "Principal": {
        "Service": "q.amazonaws.com"
      },
      "Action": [
        "s3:PutObject"
      ],
      "Resource": [
        "arn:aws:s3:::bucketName/prefix/*"
      ],
      "Condition": {
        "StringEquals": {
          "aws:SourceAccount": "accountId"
        },
        "ArnLike": {
          "aws:SourceArn": "arn:aws:codewhisperer:region:accountId:*"
        }
      }
    }
  ]
}

To learn about protecting the data in your Amazon S3 bucket, see Protecting data with encryption in the Amazon Simple Storage Service User Guide.

1. Sign in to the AWS console.

2. Switch to the Kiro console. To use the Kiro console, you must have the permissions defined in Policy: Allow administrators to configure Kiro and subscribe users.

3. Choose Settings.

4. Under Kiro user activity reports, choose Edit.

5. Toggle Collect granular metrics per user.

6. Under S3 location, enter the Amazon S3 URI that you will use to hold the CSV reports. Example: s3://amzn-s3-demo-bucket/user-activity-reports/

The first CSV report is generated at the next 2:00 AM UTC after you enable reporting, and new files are written every day afterwards. Once reports are in your bucket you can query them with Amazon Athena, visualize trends in Amazon QuickSight, or pull them into your existing analytics pipeline.

For a higher-level view of Kiro usage without per-user detail, see Viewing Kiro usage on the dashboard. To also capture the content of user prompts, see Prompt logging.

The following table describes the metrics that are included in the user activity reports generated by Kiro.

1. Report contains static (all fields except model messages) and dynamic columns (model messages).
2. The number of model message columns will depend on the number of models used during the report date.
3. Model message column names are the model names in lower case in alphabetical order, starting with Auto.
4. Model message column values are the number of messages processed by that model during the report day for a user. If a user did not use a model, the column will show a value of 0.

The legacy user activity report continues to run alongside the new per-client report. This report contains data for CLI and plugin usage only. Its daily CSV files are published to the same S3 bucket, at the following path:

s3://bucketName/prefix/AWSLogs/accountId/KiroLogs/by_user_analytic/Region/year/month/day/00/accountId_by_user_analytic_timestamp.csv

Each column shows a metric, as described in Old user activity report metrics.

The CSV file is laid out as follows:

• One CSV per clientType, containing every user who interacted with that client during the day.
• Each row shows a user who interacted with Kiro that day.
• Each column shows a metric, as described in User activity report metrics. Metrics are calculated based on the user telemetry collected over the course of the day.
• If more than 1,000 users interact with Kiro during the day, Kiro splits the data into several CSV files containing 1,000 users each. Files are suffixed with part_1, part_2, and so on.

Reports are saved at the following path. The 00 segment is a fixed hour partition that reflects the 2:00 AM UTC write time.

The following table describes the legacy metrics that are included in the user activity reports generated by Kiro.