[Bug 27423] New: test infra: clear file-level test results on any test files being rerun prior to starting the rerun

Bug ID 27423
Summary test infra: clear file-level test results on any test files being rerun prior to starting the rerun
Product lldb
Version unspecified
Hardware PC
OS All
Status NEW
Severity normal
Priority P
Component All Bugs
Assignee lldb-dev@lists.llvm.org
Reporter todd.fiala@gmail.com
CC llvm-bugs@lists.llvm.org
Classification Unclassified

The test rerun logic will charge timeouts and exceptional exits to the file if
and only if the dotest.py inferior was not in the middle of running a test
method when the timeout or exceptional exit occurred.

In these cases, it is impossible for a *successful* rerun to clear that
file-level event since the successful rerun will simply overwrite test-method
test results, not file-level results.

The simple solution here is to take the set of files that are scheduled for
rerun, and clear any file-level test result for them.  If the file-level event
that was charged previously is deterministically repeating, it will occur again
and we will not lose it.  In the meantime, we allow the rerun to clear the
file-level event so that successful reruns come back clean.

Todd Fiala changed bug 27423

What | Removed | Added |

Comment # 1 on bug 27423 from Todd Fiala

Here was one such example:
[http://lab.llvm.org:8011/builders/lldb-x86_64-darwin-13.4/builds/9770](http://lab.llvm.org:8011/builders/lldb-x86_64-darwin-13.4/builds/9770)