ONC Certification (g)(10) Standardized API Test Kit v3.7.2

The ONC Certification (g)(10) Standardized API Test Kit v3.7.2 provides minor improvements based on community feedback. As a patch version release, this update includes no changes which should cause systems that passed v3.7.1 tests to fail.

This version includes the following test updates which should not cause systems which have previously passed to fail:

• Fix an error message which could indicate that there was invalid requested scope, when it was actually an invalid received scope (#435).

ONC Certification (g)(10) Standardized API Test Kit v3.7.1

The ONC Certification (g)(10) Standardized API Test Kit v3.7.1 provides minor improvements based on community feedback. As a patch version release, this update includes no changes which should cause systems that passed v3.7.0 tests to fail.

This version includes the following test updates which should not cause systems which have previously passed to fail:

• Fix a misleading skip message in the bulk data tests when the next polling time is past the maximum allowed time for polling (#426). This message now indicates that the next polling time is past the limit, rather than that the limit has already passed.

This version includes the following improvements which do not affect test behavior:

• Fix a misleading error message when validating resources against a base resource profile.

ONC Certification (g)(10) Standardized API Test Kit v3.7.0

The ONC Certification (g)(10) Standardized API Test Kit v3.7.0 provides several test and user experience improvements based on community feedback.

As a minor version release, this update incorporates the following test change that may cause systems that passed v3.6.0 tests to now fail:

• Relax MustSupport requirements for Patient's previous name and previous address (#416). The HL7® Cross-Group Projects workgroup, through the US Core 'Patch' Process ticket FHIR-40299, approved patching the US Core Patient Profile in US Core 3.1.1, US Core 4.0.0, and US Core 5.0.1. As a result:

  • For US Core v3.1.1
    • Remove attestation 9.10.12
    • Remove Patient.address.period from Patient's MustSupport test 4.2.09
    • Add these ONC USCDI requirements to Patient's MustSupport test 4.2.09
      • Patient.address.use or Patient.address.period.end
      • Patient.name.use or Patient.name.period.end
  • For US Core v4.0.0 and v5.0.0,
    • Remove Patient.address.period from Patient's MustSupport test 5.2.09 and 6.2.09
    • Remove these ONC USCDI requirements from Patient's MustSupport test 5.2.09 and 6.2.09
      • Patient.address.use
      • Patient.name.period.end
      • Patient.name.use
    • Add these ONC USCDI requirements to Patient's MustSupport test 5.2.09 and 6.2.09
      • Patient.address.use or Patient.address.period.end
      • Patient.name.use or Patient.name.period.end

  We consider this change as one which could cause a system which previously passed to fail because

  • A new test for ONC USCDI requirements is added for US Core v3.1.1
  • If server uses Patient.address.period for previous address, Inferno used to test MustSupport at Patient.address.period but now tests for Patient.address.period.end.

ONC Certification (g)(10) Standardized API Test Kit v3.6.0

The ONC Certification (g)(10) Standardized API Test Kit v3.6.0 provides several test and user experience improvements based on community feedback.

As a minor version release, this update incorporates the following test change that may cause systems that passed v3.5.0 tests to now fail:

• Validate that patient-level scopes are received from the Standalone Patient App launch, and user-level scopes are received from the EHR Practitioner App Launch (#333).
• Fix a bug affecting US Core 4 & 5 which prevented Inferno from attempting to resolve MedicationRequest.reportedReference. This allowed servers which populated that field to pass even if those references could not be resolved (#412).
• Add tests for the _since parameter in Bulk Data v2. As part of this addition, we reorganized the bulk data tests by moving the cancellation tests and tests for additional parameters into their own groups (#405).

This version also includes several other tests updates that should not cause systems which have previously passed to fail:

• Fix a bug which could prevent the ServiceRequest.catgeory:us-core slice from being identified in US Core 5 (#406).
• Remove the Device UDI-PI tests from US Core 4 and US Core 5 (#404).

This version includes the following improvements which do not affect test behavior:

• Fix a bug which could cause an unhandled exception when a non-FHIR response is received from a FHIR request.
• Updated test session routes to be in the form BASE_URL/TEST_SUITE_ID/TEST_SESSION_ID rather than BASE_URL/TEST_SESSIONS/TEST_SESSION_ID. Old session urls will continue to work and redirect to the new style urls.
• Updated newly created test sessions to have shorter ids.

ONC Certification (g)(10) Standardized API Test Kit v3.5.0

The ONC Certification (g)(10) Standardized API Test Kit v3.5.0 provides several test and user experience improvements based on community feedback.

As a minor version release, this update incorporates the following test change that may cause systems that passed v3.4.0 tests to now fail:

• Update the version of the FHIR Validator from 5.6.71 to 5.6.93.
• Add a new test for Bulk Data v2 which checks that polling for the status of a cancelled export returns a 404 (#387).
• Ensure that the server advertises support for all required resources in its CapabilityStatement (#400).

This version also includes several other tests updates that should not cause systems which have previously passed to fail:

• Suppress missing scope warnings for the Limited App Launch when using SMART App Launch STU 2(#393).
• Fix a bug which removed the refresh token during automatic refreshes if the token refresh response did not contain a new refresh token.

This version includes the following improvements which do not affect test behavior:

• Update the descriptions of the CapabilityStatement group to reflect the (g)(10) requirements rather than the base US Core requirements (#402).
• Update SMART App Launch IG links in EHR Launch with Patient Scopes to point to the correct IG versions (#391).
• Update reference server preset to support all IG versions (#395).
• Display front end errors in the UI rather than just logging them in the console.
• Prevent manually expanded groups from automatically closing when tests run.
• Display warning and error message indicators at the group level.
• Expand the clickable area for groups in the navigation tree.
• Update page titles.

ONC Certification (g)(10) Standardized API Test Kit v3.4.0

The ONC Certification (g)(10) Standardized API Test Kit v3.4.0 provides several test and user experience improvements based on community feedback.

As a minor version release, this update incorporates the following test change that may cause systems that passed v3.3.2 tests to now fail:

• A new attestation has been added which requires developers to attest that systems are capable of extending the length of time an access token can be refreshed when refreshing an access token (#386).

This version also includes several other tests updates that should not cause systems which have previously passed to fail:

• Make the patient id list input optional for bulk data. It was previously described as optional, but was actually required (#368).
• Update bulk data tests to allow resources to match against multiple resources. This is necessary for US Core 5 where a single resource may conform to multiple profiles (#378).
• Fix a bug which caused access tokens not to be refreshed when a the token refresh response does not contain a new refresh token (#377).
• Update the title and description for Must Support tests (#384).

This version includes the following improvements which do not affect test behavior:

• Improve the UI for mobile devices.

ONC Certification (g)(10) Standardized API Test Kit v3.3.2

The ONC Certification (g)(10) Standardized API Test Kit v3.3.2 provides several test and user experience improvements based on community feedback. As a patch version release, this update includes no changes which should cause systems that passed v3.3.1 tests to fail.

NOTE: The database schema has been updated with this release. Users upgrading from an earlier version will need to run the setup.sh script to update the database prior to running this release.

This version includes the following test updates which should not cause systems which have previously passed to fail:

• Fix a bug which causes mime-type codes with a charset to fail terminology validation (#370).
• Fix an incorrect error message in the token revocation attestation (#367).
• Fix an issue which prevented Provenance resources from being validated in US Core 5 (#366).
• Fix an issue where searches could return resources conforming to multiple profiles in US Core 5 (#356).
• Fix a bug which prevents health concern Conditions from being identified in Bulk Data responses for US Core 5 (#372).
• Allow Media scopes to be requested when using US Core 5 (#375).

This version includes the following improvements which do not affect test behavior:

• Update the UI to display in-progress icons for running/queued tests.
• Update the UI to automatically open groups with a skip result.
• Change the display for ingoing/outgoing requests in the UI.
• Remove the copy button and url truncation from print view.

ONC Certification (g)(10) Standardized API Test Kit v3.3.1

The ONC Certification (g)(10) Standardized API Test Kit v3.3.1 is a patch release which includes the following updates:

• Fixes a bug introduced in v3.3.0 relating to validating slices with required bindings which resulted in incorrect failures for US Core 5 Problems and Health Concerns Observations (#340).
• Updates terminology build to work with Ruby 3 (#342).

Systems that passed v3.3.0 tests should not fail v3.3.1 tests.

ONC Certification (g)(10) Standardized API Test Kit v3.3.0

The ONC Certification (g)(10) Standardized API Test Kit v3.3.0 provides several test and user experience improvements based on community feedback.

As a minor version release, this update incorporates the following test changes that may cause systems that passed v3.2.0 tests to now fail:

• Fixes a bug that has been present since v3.0.0 which prevented terminology from being validated (#320).
• Updates the FHIR validator service to a new version based on org.hl7.fhir.core version 5.6.71.
• EHR Launch with Patient Scopes tests now verifies that patient-level scopes are received rather than only ensuring that patient-level scopes are requested (#330).
• Removes custodian from the list of Must Support fields for DocumentReference in US Core 3 (#313). The (g)(10) Standardized API Test Kit tests systems' support for the Organization resource by reading references to US Core Organizations from other resources. If DocumentReference.custodian contained a reference to a US Core Organization needed to pass the Organization tests, Inferno will no longer resolve that reference so this change could cause systems to fail the Organization tests. See the Organization FAQ for a list of places where Inferno looks for US Core Organization references.

This version also includes several other tests updates that should not cause systems which have previously passed to fail:

• Removes permission-v1 from the list of required capabilities in SMART v2 tests (#305).
• Fixes a bug which caused tests to fail when search parameter values include commas (#314).
• Fixes a bug which prevented the Must Support MedicationRequest.category:us-core slice in US Core 5 from being recognized (#322).
• Fixes a bug which prevented Clinical Test Observations from being identified in Bulk Data tests with US Core 5 (#327).

This version includes the following improvements which do not affect test behavior:

• Fixes a UI bug which could cause rapid screen flickering on the suite selection page at certain screen sizes.
• Fixes a UI bug which caused a test's messages to be displayed instead of its requests when clicking on a requests icon.

ONC Certification (g)(10) Standardized API Test Kit v3.2.0

The ONC Certification (g)(10) Standardized API Test Kit v3.2.0 provides several test and user experience improvements based on community feedback.

Important: This release includes an update to the terminology build methodology to incorporate recent updates to relevant CodeSystems, while also substantially reducing terminology processing time. Users running local copies of the ONC Certification (g)(10) Standardized API Test Kit will need to regenerate terminology using the same set of steps described in the README. Previously, terminology included all codes that were valid in any of the 2019, 2020, or 2021 UMLS releases, while the new process only includes valid codes in the 2022 UMLS release. This substantially reduces terminology generation time, though it may also disallow recently deprecated or removed codes.

Important: TLS tests will now issue a warning for systems that accept TLS 1.0 or TLS 1.1 connections, instead of failing the system. As described in a recent ONC (g)(10) clarification, systems are encouraged to follow BCP 195 and deny TLS connections for these versions, but may also enforce other policies to prevent data from being sent over these connections. For systems that do not deny TLS 1.0 or 1.1 connections, testers will be required to describe how they enforce use of TLS 1.2 or above in test 9.10.15 TLS version 1.2 or above must be enforced.

As a minor version release, this update incorporates the following test changes that may cause systems that passed v3.1.0 tests to now fail:

• Updates terminology build process to only use the most recent UMLS release (#288). If a system is using codes which were removed from the most recent UMLS release, those codes will no longer be considered valid.
• Fixes MustSupport requirements for representing a Patient's previous name in US Core 4.0.0 and US Core v5.0.1 (#283). Specifically, the changes include:
  • US Core v4.0.0: change Patient's Previous Name MS test from "name.period.end or name.use" to "name.period.end"
  • US Core v5.0.1: change Patient's Previous Name MS test from "name.period.end or name.use" to "name.period.end" AND "name.use"

This version also includes several other tests updates that should not cause systems which have previously passed to fail:

• Updates TLS tests to allow systems to accept connections to prohibited TLS versions, which is acceptable if the system denies sending content over these established connections (#289). If a system accepts a connection using a prohibited TLS version, there is a new attestation where an explanation must be provided for how systems prevent data from being sent over prohibited TLS versions.
• Fixes date comparator searches to account for server time zones (#278).
• Fixes a bug which prevented handing the Imaging Result profile in the Bulk Data tests when using US Core 5 (#271).
• Updates the SMART App Launch tests to allow use of relative urls (#268).

This version includes the following improvements which do not affect test behavior:

• Fixes a bug which could cause unhandled exceptions when invalid JSON is received.
• Fixes the ordering of requests in the UI.
• Adds the ability to copy request urls from the Inferno UI.
• Adds a toggle to the report view to show/hide messages and requests.
• Reduces the size of report pdfs.
• Improves the Inferno UI for mobile devices.
• Locks test IDs for future releases, so test IDs will remain stable between versions regardless of new tests being added or tests being deprecated.
• Various minor UI improvements.