Show expected vs. actual output on test failure
commita7a00d5108c36b8baaf54814aa1f42583dabc754
authorPekka Enberg <penberg@kernel.org>
Mon, 22 Aug 2011 13:57:27 +0000 (22 16:57 +0300)
committerChristopher Li <sparse@chrisli.org>
Thu, 25 Aug 2011 03:43:19 +0000 (24 20:43 -0700)
tree7b270e1a6cfb81efd16b73295f83e9006135fb9f
parent6afef22e1e3c2a7e6dab464706c80f4541f90a4b
Show expected vs. actual output on test failure

This patch changes 'make check' output to show sparse output compared to
expected results upon unexpected test failure. For example,
static-forward-decl.c output would look like this if it would not be tagged as
"known to fail":

       TEST     static forward declaration (static-forward-decl.c)
  error: actual error text does not match expected error text.
  --- static-forward-decl.c.error.expected 2011-08-22 06:29:40.000000000 +0000
  +++ static-forward-decl.c.error.got 2011-08-22 06:29:40.000000000 +0000
  @@ -0,0 +1 @@
  +static-forward-decl.c:3:5: warning: symbol 'f' was not declared. Should it be static?
  error: see static-forward-decl.c.error.* for further investigation.
  info: test 'static-forward-decl.c' is known to fail

This makes it easier to detect and analyze test breakage.

Cc: Christopher Li <sparse@chrisli.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Pekka Enberg <penberg@kernel.org>
Signed-off-by: Christopher Li <sparse@chrisli.org>
validation/test-suite