REAL WORLD TESTING PLAN 2025
GENERAL INFORMATION
Plan Report ID Number: 20241105emp
Developer Name
eMedPractice, LLC
Product Name(s)
eMedicalPractice
Version Number(s)
2.0
Certified Health IT
2015 Edition
Product List (CHPL) ID(s)
15.02.05.2898.EMED.01.01.1.220112
Developer Real World Testing Plan Page URL
JUSTIFICATION FOR THE REAL WORLD TESTING APPROACH
Structured interviews will be conducted with five ambulatory offices staff holding a range of clinical, administrative and managerial roles, and with differing levels of exposure to the certification criteria. Qualitative data will be analyzed thematically, and themes will be subsequently organized within the constructs of the PARIHS framework.
The PARIHS (Promoting Action on Research Implementation) framework proposes that successful implementation of measures in practice is a function of the relation between the nature of the evidence, the context in which the proposed changes are to be implemented and the mechanisms by which the change is facilitated. The framework is expressed as:
SI = f (E, C, F)
where SI=successful implementation, E=evidence, C=context, F=facilitation and f=function of
Each factor, evidence, context and facilitation consist of sub-elements that can be rated on a scale from low to high. High ratings on each factor are more likely to produce successful implementation results.
| Evidence | Context | Facilitation |
|---|---|---|
| Staff perceptions | Culture | Measure fit |
| External factors | Familiarity/exposure | |
| Burden | ||
| Engagement |
STANDARDS UPDATES (INCLUDING STANDARDS VERSION ADVANCEMENT PROCESS (SVAP) )
MEASURES USED IN OVERALL APPROACH
Description of Measurement/Metric
Test Plan:Â The test cases will include actions by varying user types to capture the required data and workflows. In some scenarios, real world patient data will be used to confirm compliance with the things such as successful transmission statuses for some certification criteria requirements. Compliance with Required standards will be tested via manual inspection and/or with ONC-recommended test tools.
Test Methods:Â The following test methods will be used to complete testing of conformance with the certification criteria requirements.
- Entry of simulation data
- Analysis of log data & log files
- Testing with ONC-approved testing tools
- Real time patient centric scenarios in production environment
| Standard (and version) |
For the c3 criterion: For the g10 criterion: |
|---|---|
| Updated certification criteria and associated products | 170.315(c)(3) and 170.315(g)(10) for eMedicalPractice |
| Health IT Module CHPL ID | 15.02.05.2898.EMED.01.01.1.220112 |
| Date of ONC ACB notification | 11/16/2022 |
| Date of customer notification (SVAP only) | 12/01/2022 |
| Conformance method and measurement/metric(s) |
measurement/metric from the RWT Plan associated with 170.315(c)(3) Clinical quality measures – report & 170.315(g)(10) Standardized API for patient and population services. |
| Measurement/Metric |
|---|
|
Certification criteria will be tested by successful demonstration of each measure. Final metric will be calculated by percentage of clients who successfully demonstrate the required certification criteria. The study is to explore staff perspectives on the feasibility and acceptance of a range of strategies to support implementation of complexity of workflows and use cases within care settings. |
Associated Certification Criteria
The following are the list of certification criteria associated with the measure and relied upon software.
| Measurement/Metric | Description | Justification | Relied Upon Software |
|---|---|---|---|
| 170.315(c)(1) Clinical quality measures - record and export |
Demonstration of the ability to export patient data recorded in the EHR for a given patient population and export that into the Cypress Test Tool for calculation of specified quality measures that will match the results obtained in the testing for 170.315(c)(2). |
This is to justify the calculation of quality measures after recording in EHR. An user can export a de-duplicated archive of patient documents which are at a minimum is in accordance with the standard specified in: § 170.205(h)(3)in the CMS QRDA Category I IG format of the clinical quality measure. | |
| 170.315(c)(2) Clinical quality measures - import and calculate |
Demonstration of the ability to calculate quality measures for the patient data and measures specified in the demonstration for 170.315(c)(1) and match to the quality measure results obtained from the Cypress Test tool. |
An user can import a de-duplicated archive of patient documents which are at a minimum is in accordance with the standard specified in: § 170.205(h)(3)in the CMS QRDA Category I IG format of the clinical quality measure. | |
| 170.315(c)(3) Clinical quality measures - report |
Demonstration of the ability to generate QRDA 1 and QRDA 3 files. |
This is to justify if a practice can generate QRDAI & III files that can be submitted to CMS quality measurements. The user can generate an aggregate report with calculated summary data for the patient population of the clinical quality measures calculated in the Execute test (§ 170.315(c)(2)), which at a minimum is in accordance with the standard specified in § 170.205(k)(3). | |
| 170.315(c)(4) Clinical quality measures – filter |
Demonstration of the ability to filter the measures . |
This is to justify if a practice can filter the quality measures by specialty or by weightage. | |
|
170.315(g)(10) Standardized API for patient and population services |
Healthcare data standard(FHIR) with an application programming interface (API) for representing and exchanging electronic health records. |
This is to justify that if a patient data can be exchanged between two health care providers using FHIR. |
Care Setting(s)
| Care Setting | Justification |
|---|---|
|
The test results are same for all specialties & facilities. |
|
|
Small & Rural health |
Will pick one small primary & rural care settings to collect the data calculate the measures. This type of primary care ambulatory setting represents more than 10% of our emedicalpractice customer base. Most of said Interoperability originated from these primary care facilities. |
|
Behavioral Health |
Will pick one behavioral health care setting to collect the measures data. This type of behavioral health care ambulatory settings represents at least 30% of our emedicalpractice customer base. |
|
Ambulatory specialty setting |
Will pick one for various specialty care setting to collect the patient data in real time. This specialist office can consume the referral in their system and complete the care. This type of care ambulatory settings represents at least 60% of our emedicalpractice customer base. |
Expected Outcomes
| Measurement/Metric | Expected Outcomes |
|---|---|
| 170.315(c)(1) Clinical quality measures - record and export |
Total number of measures selected by provider. Total number of defects identified and resolved. Total number of successful submissions to CMS or exported by provider. Data errors/accuracy will be tracked over the time and trended over the time. |
| 170.315(c)(2) Clinical quality measures - import and calculate |
Total number of measures selected by provider & imported. Total number of defects identified and resolved. Total number of successful submissions to CMS or exported by provider. Data errors/accuracy will be tracked over the time and trended over the time. |
| 170.315(c)(3) Clinical quality measures - report |
Total number of measures selected by provider. Total number of defects identified and resolved to calculate the population dashboard. Total number of successful submissions QRDA III files to CMS or exported by provider. Data errors/accuracy will be tracked over the time and trended over the time. |
| 170.315(c)(4) Clinical quality measures – filter |
Total number of measures available. Practice should be able filter by specialty. Error rates will be tracked and trended over time. |
| 170.315(g)(10) Standardized API for patient and population services |
Request a patient request using FHIR API from source provider office. Receive a complete patient clinical data and documents related to the specific patient. Error rates will be tracked and trended over time. |
SCHEDULE OF KEY MILESTONES
| Key Milestone | Care Setting | Date/Timeframe |
|---|---|---|
|
Identify 5 various ambulatory care settings and start capturing the feasibility study |
Small & Rural health Behavioral Health Ambulatory specialty setting |
3/30/2025 |
|
with final data collection, The datasets generated and analyzed during the current study. |
Small & Rural health Behavioral Health Ambulatory specialty setting |
10/30/2025 |
|
Report the final data to ACB |
Small & Rural health Behavioral Health Ambulatory specialty setting |
01/15/2026 |
Disclaimer
eMedicalPractice is committed to Real World Testing (RWT) plan as much as possible but execution of this plan is dependent on eMedicalPractice customer participation on the RWT activity throughout calendar year 2025, based on their availability, which is beyond eMedicalPractice’s control. eMedicalPractice strives to review the plan on an ongoing basis and may modify the RWT plan steps as and when necessary to fully meet the needs of RWT. There are a few criteria that need mentioning owing to less adoption by the industry or by customer base.
Use of the following certified criteria has low usage among the customer base. Testing the following transactions for RWT might be difficult and eMedicalPractice reserves the right to test transactions using a simulated environment.
- 170.315(g)(10) Standardized API for patient and population services
ATTESTATION
This Real World Testing plan is complete with all required elements, including measures that address all certification criteria and care settings. All information in this plan is up-to-date and fully addresses the health IT developer’s Real World Testing requirements.
Authorized Representative Name
Nandu Dhanekula
Authorized Representative Email
Nandu@emedpractice.com
Authorized Representative Phone
561-921-0978
Authorized Representative Signature
Date
10/06/2024
