1

Topic: Difference between test plan and test run

It is not clear for me what is the real difference between test plan and test run. I would expect test plan to include multiple test runs - but I could not achieve it.

I will be grateful for clarifications.

2

Re: Difference between test plan and test run

Test plans are indeed basically a collection/group of related test runs. When you create a new test plan, you can select the test suites on the right sidebar to include (by clicking on the icon right to a test suite). So, for example, when you include three test suites in your test plan, this will effectively result in a test plan with three test runs.

When you view a test plan, you can see the individual test runs and the aggregated statistics of all test runs.

Test plans get especially interesting if you need support for so called configurations (for example, different operating systems, browser versions etc). You can specify multiple configurations for a suite in a plan and TestRail automatically creates a test run for each configuration combination.

I know that the documentation is currently not explaining any of this and we will have a more complete documentation when TestRail launches.

Regards,
Tobias

3

Re: Difference between test plan and test run

Thank you for explanations. It works. The only missing thing I see is that the report for the test plan displays only progress bar per run, without the textual data, e.g. 123 tests passed, 234 untested, etc.

4

Re: Difference between test plan and test run

Yes, the smaller overview (with the 32px icons instead of the large icons) used in a test plan  currently does not include this information. However, you can hover over the bar chart/progress bar to see this details. We will consider adding this to the textual description as well.

Kind regards,
Tobias