Test results from Cucumber and SpecFlow can be published from your CI/CD pipeline so feedback and progress can be shared with the whole team, not just the developers and testers. Test results are displayed in two main locations; on Jira issues and the requirements page.
As Behave Pro is designed for teams practising Continuous Delivery and DevOps, there will be frequent commits, builds and deployments so Behave Pro will always clearly indicate the commit that the result belongs to and if it is the latest commit from your repositories branch.
Test results on Jira issues
At the top of the Acceptance criteria panel, there is a summary of the test results for the Jira issue. This summary is made up of two sets of results:
Acceptance Tests - All the Pass, Fail, and Pending results from the scenarios linked to this individual Jira issue as acceptance tests
Regression tests - All the Pass, Fail, and Pending results from scenarios that are executed as part of the overall test suite but aren't acceptance tests for the Jira issue. Could simply be summed as "make sure we haven't broken anything"
While the summary gives you an overall picture of the results each scenario within the Acceptance criteria panel has its own results lozenge with an icon indicating the test result for that scenario. Clicking on the lozenge will reveal further details about the result.
Test results on the Requirements Page
The requirements page allows you to view all feature and scenarios for Jira issues that are "done". It acts as documentation about how your system or application is expected to behave and can be a useful reference. Because this documentation is updated from the team's git repository and overlaid with test results it is always correct, unlike most documentation, and becomes 'Living Documentation'.
To quickly see if the Cucumber or SpecFlow test results indicate that the overall system is functioning to specification or not, you just need to look at the Test results summary in the top right-hand corner of the page. The icon on the summary indicates the overall test results and clicking on the button opens a break of the results for each feature card.
Using the summary is not the only way to see results. Every feature card on the requirements pages has an icon showing the test results for its scenarios. Opening a feature card will allow you to view all its scenarios and quickly locate the scenario with the result that interests you.
