Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NOT MERGE] add coverage option to collect line/toggle coverage #932

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

Clo91eaf
Copy link
Contributor

@Clo91eaf Clo91eaf commented Jan 8, 2025

This pr implements line/toggle or any other coverage type in the cover flow of t1. To achieve this, I added the vcs-emu-cover-full target in nix.

  • Compile time:

Use -cm line+cond+fsm+tgl+branch+assert to enable all possible coverage types. This change may greatly affect the ci running time, so this PR will NOT BE MERGE.

  • Runtime:
  1. Run the regression test in ci: At this time, only the coverage of line+tgl+assert is collected. This process is hard-coded and can be changed by modifying the nix script.
    After the ci operation is completed, you can obtain all the coverage through this command.
nix build .#t1.blastoise.t1rocketemu.run._vcsEmuResult --impure
urg -dir ./result/*/cm.vdb -format text -metric line+tgl+assert -show summary -parallel

This process can be accelerated by setting an environment variable:

AWS_EC2_METADATA_DISABLED=true 
  1. To run a single test case locally: you can specify the test type you want to run through the cover-type parameter of t1-helper, for example:
nix develop -c t1-helper run -i t1rocketemu -e vcs-emu-cover-full -c blastoise --cover-type line+tgl+assert codegen.vsra_vx

@Clo91eaf Clo91eaf changed the title Clo91eaf/other coverage option add coverage option to collect line/toggle coverage Jan 8, 2025
@Clo91eaf Clo91eaf force-pushed the Clo91eaf/other-coverage-option branch from 37cc516 to 531f345 Compare January 9, 2025 02:07
@Clo91eaf Clo91eaf changed the title add coverage option to collect line/toggle coverage [NOT MERGE] add coverage option to collect line/toggle coverage Jan 9, 2025
@Clo91eaf Clo91eaf assigned Clo91eaf and unassigned Clo91eaf Jan 9, 2025
@Clo91eaf Clo91eaf force-pushed the Clo91eaf/other-coverage-option branch 6 times, most recently from 7125ca5 to 7df9fef Compare January 9, 2025 10:48
@Clo91eaf Clo91eaf force-pushed the Clo91eaf/other-coverage-option branch 9 times, most recently from 3341291 to 8813d79 Compare January 9, 2025 15:12
Signed-off-by: Clo91eaf <[email protected]>

[ci] run urg parallelly

Signed-off-by: Clo91eaf <[email protected]>
@Clo91eaf Clo91eaf force-pushed the Clo91eaf/other-coverage-option branch from 4dd9c1c to 8813d79 Compare January 10, 2025 04:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant