[GEN-1028] Generate failed annotations report dashboard

[rxu17]

Purpose: This is a draft PR. This PR will add a section to our dashboard that showcases the number of failed annotations per center and also let sites know where to find their failed annotations report

Testing:

• Created R unit tests for some of the dashboard functions
• Generated the relevant section of the dashboard R markdown file. See current look:

- Ran the `R/dashboard_markdown_generator.R` using the relevant dashboard code above in docker image

Depends on #545

[rxu17]

One outstanding question is the historical reason behind not running the dashboard code on the test pipeline? Currently it defaults to running on production:

Genie/bin/database_to_staging.py

Lines 289 to 294 in 446de5c

	if not test:
	logger.info("DASHBOARD UPDATE")
	dashboard_table_updater.run_dashboard(
	syn, databaseSynIdMappingDf, genie_version, staging=staging
	)
	generate_dashboard_html(genie_version, staging=staging)

[thomasyu888]

One outstanding question is the historical reason behind not running the dashboard code on the test pipeline? Currently it defaults to running on production:

Genie/bin/database_to_staging.py

Lines 289 to 294 in 446de5c

	if not test:
	logger.info("DASHBOARD UPDATE")
	dashboard_table_updater.run_dashboard(
	syn, databaseSynIdMappingDf, genie_version, staging=staging
	)
	generate_dashboard_html(genie_version, staging=staging)

There's not a good reason other than tech debt. If you notice in bin/database_to_staging.py we use test and staging parameters to choose which GENIE project to push data into, however, see this ticket; https://sagebionetworks.jira.com/browse/GEN-420.

[thomasyu888]

🦖 LGTM! This is great - have you had a chance to check out quarto at all? I recently created nice looking dashboards like this using purely Python code. It's a game changer.

Note: Not saying we should convert to quarto in this PR. ha

[thomasyu888]

Really appreciate the tests added here.

[rxu17]

🦖 LGTM! This is great - have you had a chance to check out quarto at all? I recently created nice looking dashboards like this using purely Python code. It's a game changer.

Note: Not saying we should convert to quarto in this PR. ha

Somehow I missed the notifications to the comments in this PR. I have not, this is my first time touching dashboard code here haha but I remember you used it for the hefty data guide PR. Quarto looks great, I am down to just convert to it (plus easier to integrate in tests when it's python and moving away from R dependencies is a plus).

[thomasyu888]

🦖 LGTM! This is great - have you had a chance to check out quarto at all? I recently created nice looking dashboards like this using purely Python code. It's a game changer.
Note: Not saying we should convert to quarto in this PR. ha

Somehow I missed the notifications to the comments in this PR. I have not, this is my first time touching dashboard code here haha but I remember you used it for the hefty data guide PR. Quarto looks great, I am down to just convert to it (plus easier to integrate in tests when it's python and moving away from R dependencies is a plus).

@rxu17 Lets create a separate ticket to export to quarto, but this is PR is good to go

[dpulls]

🎉 All dependencies have been resolved !

[sonarqubecloud]

Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud