[Me]: - Time to put the thoughts in Excel for tracking and implementation.
Most of the headers are self explanatory. The Areas correspond to the functional areas that have been selected for automation. We added another level of traceablilty for each such areas
[Guruji]: - There are two visible and important things that you can track through this index.
The progress in pass % for every subsequent runsThe progress in Automation trend. Whether time is being spent on repairing/updating the existing scripts or newer cases are being automated.
The index also captures the failures and we can classify them for use.Automated test case with low Test Automation Health Index might be not reliable, not effective or having bad performance. From this index, we can easily tell if a test case has failed multiple times due to test issue. Analyzing and resolving test results as test issue is expensive and causes test automation to be not effective and impacts the successfulness of test automation. The further action that we can take is to put automated test cases with low Test Automation Health Index to a bucket and then fix the problem that these automated test cases encounter.Also it will help us to determine where we are in our test automation.
[Me]: - Yes, now instead of having abstract measurement, we have concrete index that we can use to measure the reliability, effectiveness and performance of our test automation. These will help us to plan further actions to improve this index over time to have healthy and successful test automation. Thanks Guruji