Applitools, as a visual validation tool, allows you to validate the appearance of the Application Under Test (AUT) by capturing screenshots of it in strategic points along the test and comparing them against predefined baseline images. The granular components of each test are its screenshots, that are also called steps.
The following article covers the different status of tests and steps in the Applitools dashboard.
Test Status:
Running- During the execution of the test, the test will be marked in the dashboard with a Running label.
New- The first time running a test, the test will be marked with a green New label to indicate that all of its steps are used to create a new baseline.
Unresolved- A test which has differences will appears as Unresolved to indicate that it contains one or more steps with differences that have not yet been reviewed.
Passed- There are two scenarios in which a test will be marked as Passed. The first scenario is of a test that all of its steps match their baseline images. In this case the test will be marked as passed as follows:
The second scenario is of a test that was found with differences, that were later resolved and updated to override the baseline. In this case the test will be marked as passed with an inequality sign, as follows:
Failed- A test that at least one of its steps did not match the baseline image and was rejected (not used to override the baseline), will be marked as failed, like this:
Aborted- Test that was not closed properly through the eyes.close() method, but rather through the eyes.abortIfNotClosed() method, will be marked as follows:
Step Status:
New- In tests that contain more screenshots in the current test than in the baseline, the additional steps will be marked with a '+' symbol, as follows:
Missing- In tests that contain less screenshots in the current test than in the current baseline set, the missing steps will be marked with a '-' symbol, as follows:
Unresolved - A step that has differences will appear as Unresolved. The step will appear with an inequality sign and the differences will be highlighted in pink. Steps with differences can be resolved by clicking on the "accept" or "reject" buttons. Accepting a step will update the baseline image and replace it with the current image and will be marked as passed. Rejecting a step will keep the existing baseline image and will mark the step as failed.
Failed- A step that contained mismatches (differences between the baseline and the current images) and was rejected will be marked as failed.
Passed -There are two scenarios where a step will be marked as Passed, The first scenario is when the step matched the baseline. In this case the step will appear with an equal symbol.
The second scenario is when the step did not match the baseline image, but was accepted as the new baseline.
Test Status:
Running- During the execution of the test, the test will be marked in the dashboard with a Running label.
New- The first time running a test, the test will be marked with a green New label to indicate that all of its steps are used to create a new baseline.
Unresolved- A test which has differences will appears as Unresolved to indicate that it contains one or more steps with differences that have not yet been reviewed.
Passed- There are two scenarios in which a test will be marked as Passed. The first scenario is of a test that all of its steps match their baseline images. In this case the test will be marked as passed as follows:
The second scenario is of a test that was found with differences, that were later resolved and updated to override the baseline. In this case the test will be marked as passed with an inequality sign, as follows:
Failed- A test that at least one of its steps did not match the baseline image and was rejected (not used to override the baseline), will be marked as failed, like this:
Aborted- Test that was not closed properly through the eyes.close() method, but rather through the eyes.abortIfNotClosed() method, will be marked as follows:
Step Status:
New- In tests that contain more screenshots in the current test than in the baseline, the additional steps will be marked with a '+' symbol, as follows:
Missing- In tests that contain less screenshots in the current test than in the current baseline set, the missing steps will be marked with a '-' symbol, as follows:
Unresolved - A step that has differences will appear as Unresolved. The step will appear with an inequality sign and the differences will be highlighted in pink. Steps with differences can be resolved by clicking on the "accept" or "reject" buttons. Accepting a step will update the baseline image and replace it with the current image and will be marked as passed. Rejecting a step will keep the existing baseline image and will mark the step as failed.
Failed- A step that contained mismatches (differences between the baseline and the current images) and was rejected will be marked as failed.
Passed -There are two scenarios where a step will be marked as Passed, The first scenario is when the step matched the baseline. In this case the step will appear with an equal symbol.
The second scenario is when the step did not match the baseline image, but was accepted as the new baseline.
Comments
0 comments
Article is closed for comments.