Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Capture more detailed usage metrics #223

Open
sdolgin opened this issue Jun 24, 2022 · 1 comment
Open

Capture more detailed usage metrics #223

sdolgin opened this issue Jun 24, 2022 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@sdolgin
Copy link
Collaborator

sdolgin commented Jun 24, 2022

To better understand how often the review checklists are being used, we should track the download of JSON files in detail. These metrics can be used to detect trends in usage, which is valuable feedback.

We'd like to know:

  • How many times did each JSON file get imported into the worksheet per month?
  • Are there any increases month over month in requests for landing zone, security, avd, etc?
  • Are there any anomalies in JSON file requests or increases in static XLSX file requests that indicate a problem with the macros?

A few ways we might do this...

  1. Update the GH actions workflow to publish new release versions of the JSON files with every merge to main. The release tracking / insights in GH would provide tracking. This is not ideal because it would require a new release to be published (automating multiple steps) with EVERY merge to main.

  2. On merge, publish the JSON files to blob storage with metrics logged. We could then build monitoring workbooks on the data.

  3. Build custom telemetry calls into the VBA code to call a logging API when a JSON file is being imported.

My instinct is that option 2 is the right path forward. In all 3 cases, the macros would need to be updated in some way to account for tracking the download of JSON files.

@erjosito erjosito added the enhancement New feature or request label Jun 28, 2022
@erjosito
Copy link
Collaborator

Thanks for this @sdolgin ! If you create a Github action that copies the JSON files to a storage account, I can update the spreadsheet to support downloading from the storage account. Would you need any help with the Github action?

@sdolgin sdolgin self-assigned this Aug 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants