bug#36616: 27.0.50; Say how many tests failed

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

bug#36616: 27.0.50; Say how many tests failed

Lars Ingebrigtsen

When saying "make test" you get this:

---

SUMMARY OF TEST RESULTS
-----------------------
Files examined: 240
Ran 3255 tests, 3210 results as expected, 45 skipped

---

After getting out my slide rule I see that that all adds up, but perhaps
this should say explicitly "0 failed"?  Since that's what we're
interested in.



--
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no




Reply | Threaded
Open this post in threaded view
|

bug#36616: 27.0.50; Say how many tests failed

Eli Zaretskii
> From: Lars Ingebrigtsen <[hidden email]>
> Date: Fri, 12 Jul 2019 16:11:32 +0200
>
> SUMMARY OF TEST RESULTS
> -----------------------
> Files examined: 240
> Ran 3255 tests, 3210 results as expected, 45 skipped
>
> ---
>
> After getting out my slide rule I see that that all adds up, but perhaps
> this should say explicitly "0 failed"?  Since that's what we're
> interested in.

I'm not sure, because there can be expected failures as well.
Maybe "0 unexpected results"?



Reply | Threaded
Open this post in threaded view
|

bug#36616: 27.0.50; Say how many tests failed

Lars Ingebrigtsen
Eli Zaretskii <[hidden email]> writes:

> I'm not sure, because there can be expected failures as well.
> Maybe "0 unexpected results"?

Hm...  But aren't expected failures successes?  :-)

--
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no



Reply | Threaded
Open this post in threaded view
|

bug#36616: 27.0.50; Say how many tests failed

Eli Zaretskii
> From: Lars Ingebrigtsen <[hidden email]>
> Cc: [hidden email]
> Date: Fri, 12 Jul 2019 16:58:04 +0200
>
> Eli Zaretskii <[hidden email]> writes:
>
> > I'm not sure, because there can be expected failures as well.
> > Maybe "0 unexpected results"?
>
> Hm...  But aren't expected failures successes?  :-)

No, they are failures.  But expected.



Reply | Threaded
Open this post in threaded view
|

bug#36616: 27.0.50; Say how many tests failed

Lars Ingebrigtsen
I've now made it output the data on unexpected results (and skipped)
unconditionally.

--
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no