Bug
1821791 - Use kmeans filter in raptor extra-summary-methods. r=AlexandruIonescu,perftest-reviewers
This patch changes the filtering method from a gaussian filter to a k-means filter that should be more suitable to our needs. See this bug comment: https://bugzilla.mozilla.org/show_bug.cgi?id=
1821791#c0
With kmeans from scipy, we specify it to search for 2 groups. From there, we check to see if there is a group that comprises no more than 40% of the total size. If there is a group, then we check if the difference in the means are 200%. If they are, then we throw out the dataset that has the least amount of data in it.
This fixes an issue where datasets that had outliers that skewed the standard deviation, and the mean too much would prevent us from removing them.
Differential Revision: https://phabricator.services.mozilla.com/
D172320