| Subject: | Test failures are reported as errors. |
| Date: | Mon, 13 Aug 2012 14:00:26 +0100 |
| To: | bug-TAP-Harness-JUnit [...] rt.cpan.org |
| From: | Malcolm Parsons <malcolm.parsons [...] gmail.com> |
In JUnit an error is something that prevented a test from being run
and a failure is a test that ran but gave an incorrect result.
http://stackoverflow.com/questions/3425995/whats-the-difference-between-failure-and-error-in-junit
http://www.devx.com/Java/Article/31983/1763/page/2
TAP:Harness:JUnit 0.36 reports failed tests as errors and tests that
were not run as failures.
e.g.
1..4
ok 1
not ok 2
not ok 3
# Looks like you planned 4 tests but ran 3.
# Looks like you failed 2 tests of 3 run.
produces JUnit xml saying:
<testsuite name="example" errors="3" failures="1" tests="4"
time="0.0337021350860596">
The attached patch fixes this:
<testsuite name="example" errors="1" failures="3" tests="4"
time="0.0274589061737061">
--
Malcolm Parsons
Message body is not shown because sender requested not to inline it.