Auto Bisect: Added some real-world examples to confidence score unit test.
commit3633d9d2cb5d87f07b0c3483c6e04ecb7abea237
authorqyearsley@chromium.org <qyearsley@chromium.org@0039d316-1c4b-4281-b951-d872f2087c98>
Fri, 22 Aug 2014 23:53:18 +0000 (22 23:53 +0000)
committerqyearsley@chromium.org <qyearsley@chromium.org@0039d316-1c4b-4281-b951-d872f2087c98>
Fri, 22 Aug 2014 23:55:08 +0000 (22 23:55 +0000)
tree7e2fa785b35f145bfa70e37ea28872e44fa424d6
parent1ca5ef521858f681f386fc254d70a1cc2a046d9f
Auto Bisect: Added some real-world examples to confidence score unit test.

These were collected by Jeff last week: https://docs.google.com/a/google.com/document/d/1erjepFVXplUFXCybBd8aojjEDgoDGfM4V-j_GewPWOg/edit

In the examples that he collected, I think that most of the confidence score numbers were from the old confidence function. Some of the actual results still don't fully line up with intuition, for example:

    [67, 68], [65, 65, 67] -> 80%
    [3, 3, 3], [2, 2, 2, 3] -> 90%

In general, the t-test is always giving either 0 or at least 80 (sort of like how it is for alerts the dashboard).

BUG=

Review URL: https://codereview.chromium.org/481063002

Cr-Commit-Position: refs/heads/master@{#291559}
git-svn-id: svn://svn.chromium.org/chrome/trunk/src@291559 0039d316-1c4b-4281-b951-d872f2087c98
tools/bisect-perf-regression_test.py