githubEdit

Create a Coverage Matrix

A Coverage Matrix is the generated output of your Business Rules. Each row in the Coverage Matrix is a unique set of values as defined in your Business Rules. The Coverage Matrix is what drives your tests and your test data selection criteria.

You can also create a coverage matrix with auto-generated business rules, covered at the bottom of this document, for when you want full coverage.

circle-info

When you generate a coverage matrix for the first time, the coverage data view and other file data views will be generated for you. The other file data views will be linked via common field names between the coverage set determining attributes and source files.

Generating a Coverage Matrix from Business Rules

Once your business rules are created, you can generate your Coverage Matrix. In the upper right corner of the business rules page there is a small blue box with a white grid in it. Click on this box to generate the Coverage Matrix.

Business rules page with Coverage Matrix button

When you click on this button, you will get a message telling you what TDO is about to create. Here, TDO is letting you know that you have 8 determining attributes in your rules, and you will create 16 unique tests in your coverage matrix. Click 'OK' to create the coverage matrix.

Coverage Matrix cofirmation message

Once you click OK, the coverage matrix will be created. On the menu, select 'Coverage Matrix' from the 'Coverage Engine' section of the menu to view your coverage matrix.

Coverage Matrix

Each row is identified by the rule that it was generated to match. Note that TDO has created one row for each unique combination of data. The first rule (Corporate accounts) has two account currencies, two payment currencies, and two payment amounts - this has created 8 unique rows. Each row represents both a unique test case as well as a unique test data requirement.

When you create a coverage matrix, it builds a data block that contains the values shown on the coverage matrix screen. The data block has the same name as the coverage set, the source is shown as 'Coverage', and the coverage set that was used is shown under the 'Objects' column.

Data blocks list showing coverage matrices

If you set the 'Occurrences' to a value higher than '1', you will see the impact here. In the screen print below, the first rule has been set to an 'Occurences' value of 5. In the confirmation message, TDO is showing that 48 rows will be generated (versus 16 in the original rules with no multiple occurrences).

Confirmation message with higher volumes
Coverage matrix with additional tests added by setting multiple occurrences

A Coverage Matrix must be created before you can build Data Views and Work Sets.

Generating a Full Coverage Matrix

There may be times (performance testing, etc) where you need to create a large volume of tests. There are 3 icons in the most upper right section of the business rules page. The first icon will generate coverage from your existing set of business rules. The middle icon (a bolded grid) will generatev all possible rules, using your determining attribute filters to avoid invalid data combinations. The right icon will use both the filters you have set as well as the priorities you have set to only generate rules for the priorities you define.

Coverage matrix options

When you click the middle icon, you will see this message. If you click 'Yes', your existing rules will remain and the new rules will be added. If you click 'No', your existing rules will be replaced by the auto generated rules. Clicking 'Cancel' will cancel the process.

Auto generation message

When you click the right icon, you will see this message first, asking you to set which priorities you want to test. You must enter the priority(s) you want to test. Below, both 1 and 2 are selected (separate the priority numbers with a comma).

Selecting auto generation priority

After you click 'Generate', you will see the same message as above for full rules. Select your option to proceed.

In the screen below, 'No' was selected (do not keep existing rules) and prioritized coverage for priorities 1 and 2 were chosen. TDO displays a message showing how many rows will be in the coverage matrix. The new auto generated rules are now shown on the business rules page. Click 'Yes' to generate the coverage matrix or 'No' to skip that process.

Auto generated rules with message

Last updated

Was this helpful?