SunSpider/ChangeLog

   1 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
   2
   3         Reviewed by Gavin Barraclough.
   4
   5         SunSpider/tests/string-base64.js does not compute a valid base64 encoded string
   6         https://bugs.webkit.org/show_bug.cgi?id=16806
   7
   8         Based on a patch by Eric Seidel.
   9
  10         Fix the base64 computation to actually compute correct results. The impact on runtime of
  11         the test is pretty small, but noticeable for some browsers. But at least it's not
  12         doing a wrong and meaningless computation any more.
  13
  14         * tests/sunspider-0.9.1/string-base64.js:
  15         ():
  16         (base64ToString):
  17
  18 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
  19
  20         Fixing commit error...
  21
  22         I accidentally committed my last patch in a form that broke Web-hosted SunSpider. Fixing.
  23
  24         * resources/driver-TEMPLATE.html:
  25
  26 2009-12-13  Maciej Stachowiak  <mjs@apple.com>
  27
  28         Reviewed by Sam Weinig.
  29
  30         Use JSON.parse instead of eval for Web-hosted SunSpider results processing
  31         https://bugs.webkit.org/show_bug.cgi?id=32490
  32
  33         * hosted/json2.js: Added. Incorporated from json.org
  34         * resources/driver-TEMPLATE.html: Fix an HTML validation bug I noticed.
  35         * resources/results-TEMPLATE.html: Use JSON.parse instead of eval to process
  36         results.
  37
  38 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
  39
  40         Reviewed by Oliver Hunt.
  41
  42         Enable Web-hosted version of SunSpider to handle multiple versions
  43         https://bugs.webkit.org/show_bug.cgi?id=32478
  44
  45         * make-hosted: Now generate the hosted version to be able to run both the
  46         0.9 and the 0.9.1 test suites.
  47         * hosted: Modified property svn:ignore.
  48         * hosted/sunspider-driver.html: Removed.
  49         * hosted/sunspider-results.html: Removed.
  50         * hosted/sunspider.html:
  51         * hosted/versions.html: Added.
  52         * resources/TEMPLATE.html:
  53         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-driver.html.
  54         * resources/driver-TEMPLATE.html: Copied from hosted/sunspider-results.html.
  55
  56 2009-12-12  Maciej Stachowiak  <mjs@apple.com>
  57
  58         Reviewed by Oliver Hunt.
  59
  60         Give command-line sunspider the ability to handle multiple suites and versions
  61         https://bugs.webkit.org/show_bug.cgi?id=32477
  62
  63         Each suite/version's set of tests are now in a separate subdirectory of tests/, with a file named LIST
  64         enumerating the tests. Current suites are:
  65
  66         sunspider-0.9 - riginal SunSpider content
  67         sunspider-0.9.1 - SunSpider suite with a few tests fixed (and a few more to come)
  68         ubench - "ubench" microbenchmark suite
  69         v8-v4 - version 4 of the v8 benchmark
  70         parse-only - some parser tests
  71
  72         Sunspider can now be run with the --suite= parameter to select a
  73         suite. The default is --suite=sunspider-0.9.
  74
  75         * .: Modified property svn:ignore to ignore new results directories.
  76         * make-hosted: Generate based on sunspider-0.9 suite.
  77         * resources/TEMPLATE.html: Fix an HTML compliance problem.
  78         * resources/sunspider-standalone-driver.js: Become aware of suite names.
  79         * sunspider: Modified to handle multiple suites as described above.
  80         * sunspider-compare-results: ditto
  81         * tests/LIST: Moved to tests/sunspider-0.9/ and tests/sunspider-0.9.1/
  82         * tests/LIST-PARSE-ONLY: Moved to parse-only/LIST
  83         * tests/LIST-UBENCH: Removed.
  84         * tests/LIST-V8: Removed.
  85         * tests/3d-cube.js: Moved to tests/sunspider-0.9 and tests/sunspider-0.9.1
  86         * tests/3d-morph.js: ditto
  87         * tests/3d-raytrace.js: ditto
  88         * tests/access-binary-trees.js: ditto
  89         * tests/access-fannkuch.js: ditto
  90         * tests/access-nbody.js: ditto
  91         * tests/access-nsieve.js: ditto
  92         * tests/bitops-3bit-bits-in-byte.js: ditto
  93         * tests/bitops-bits-in-byte.js: ditto
  94         * tests/bitops-bitwise-and.js: ditto
  95         * tests/bitops-nsieve-bits.js: ditto
  96         * tests/controlflow-recursive.js: ditto
  97         * tests/crypto-aes.js: ditto
  98         * tests/crypto-md5.js: ditto
  99         * tests/crypto-sha1.js: ditto
 100         * tests/date-format-tofte.js: ditto
 101         * tests/date-format-xparb.js: ditto
 102         * tests/math-cordic.js: ditto
 103         * tests/math-partial-sums.js: ditto
 104         * tests/math-spectral-norm.js: ditto
 105         * tests/regexp-dna.js: ditto
 106         * tests/string-base64.js: ditto
 107         * tests/string-fasta.js: ditto
 108         * tests/string-tagcloud.js: ditto
 109         * tests/string-unpack-code.js: ditto
 110         * tests/string-validate-input.js: ditto
 111         * tests/sunspider-0.9/: Added
 112         * tests/sunspider-0.9/*.js: Moved from one level up
 113         * tests/sunspider-0.9.1: Added.
 114         * tests/sunspider-0.9.1/*.js: Moved from one level up.
 115         * tests/v8-crypto.js: Moved to v8-v4/ directory.
 116         * tests/v8-deltablue.js: ditto
 117         * tests/v8-earley-boyer.js: ditto
 118         * tests/v8-raytrace.js: ditto
 119         * tests/v8-regexp.js: ditto
 120         * tests/v8-richards.js: ditto
 121         * tests/v8-splay.js: ditto
 122         * tests/v8-v4: Added.
 123
 124 2009-09-30  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 125
 126         Reviewed by Darin Adler.
 127
 128         Platform specific null device replaced with a platform independent.
 129         https://bugs.webkit.org/show_bug.cgi?id=29544
 130
 131         * sunspider: Using File::Spec->devnull() instead of /dev/null and NUL.
 132
 133 2009-09-21  Csaba Osztrogonac  <oszi@inf.u-szeged.hu>
 134
 135         Reviewed by Maciej Stachowiak.
 136
 137         [Qt] Make sunspider script work on Windows platform.
 138         https://bugs.webkit.org/show_bug.cgi?id=29544
 139
 140         * sunspider:
 141         Using platform specific null device instead of /dev/null.
 142
 143 2009-06-19  Adam Treat  <adam.treat@torchmobile.com>
 144
 145         Reviewed by Oliver Hunt.
 146
 147         https://bugs.webkit.org/show_bug.cgi?id=26540
 148         Currently the SunSpider test driver lacks an option to run a test suite that
 149         will test JavaScriptCore parsing performance only.  This patch adds just such
 150         a test suite and option to SunSpider as well as the jsc test shell.  I've included
 151         three large javascript source files found in the wild: jquery, mootools and prototype.
 152         Combined with the concatenation of all three, these form a new testsuite to measure
 153         and test pure JavaScriptCore parsing performance.
 154
 155         * resources/sunspider-standalone-driver.js:
 156           Load the js with parse-only flag if it is part of the parse-only suite.
 157         * sunspider:
 158           Add the parse-only suite to the list of options.
 159         * sunspider-compare-results:
 160           Add the parse-only suite to the list of options.
 161         * tests/LIST-PARSE-ONLY: Added.
 162         * tests/parse-only/concat-jquery-mootools-prototype.js: Added.
 163           A very large concatenation of the scripts found below.  This js takes ~30ms to parse on my machine.
 164         * tests/parse-only/jquery-1.3.2.js: Added.
 165           Latest version from jquery.com.
 166         * tests/parse-only/mootools-1.2.2-core-nc.js: Added.
 167           Latest version from mootools.net.
 168         * tests/parse-only/prototype-1.6.0.3.js: Added.
 169           Latest version from prototypejs.org.
 170
 171 2009-06-13  Steve Falkenburg  <sfalken@apple.com>
 172
 173         Update V8 benchmark to version 4.
 174
 175         Reviewed by Cameron Zwarich.
 176
 177         * tests/LIST-V8:
 178         * tests/v8-crypto.js:
 179         * tests/v8-deltablue.js:
 180         * tests/v8-earley-boyer.js:
 181         * tests/v8-raytrace.js:
 182         * tests/v8-regexp.js: Added.
 183         * tests/v8-richards.js:
 184         * tests/v8-splay.js: Added.
 185
 186 2009-05-26  Olivier DOLE  <odole@pleyo.com>
 187
 188         Reviewed by Maciej.
 189
 190         Store sunspider test suite results in a specific directory for each
 191         different type of benchmark (sunspider, V8 or ubench).
 192
 193         * sunspider:
 194         * sunspider-compare-results:
 195
 196 2009-05-12  Steve Falkenburg  <sfalken@apple.com>
 197
 198         Build fix.
 199
 200         * SunSpider.make:
 201
 202 2009-05-11  Steve Falkenburg  <sfalken@apple.com>
 203
 204         Include SunSpider tests in production builds.
 205
 206         Reviewed by Adam Roben.
 207
 208         * SunSpider.make: Added.
 209         * xcopy.excludes: Added.
 210
 211 2009-03-04  Oliver Hunt  <oliver@apple.com>
 212
 213         Added a few more tests to ubench
 214
 215         RS=Gavin Barraclough
 216
 217         Adding a couple of test to cover too few and too many arguments.  This
 218         is needed to prevent regressions in all call paths from my current refactoring.
 219
 220         * tests/LIST-UBENCH:
 221         * tests/ubench/function-correct-args.js: Added.
 222         (f):
 223         * tests/ubench/function-excess-args.js: Added.
 224         (f):
 225
 226 2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
 227
 228         Fix a bug where when V8's or UBENCH's test suite list file is missing
 229         the error message is suggesting that SunSpider's list file is missing.
 230
 231         Reviewed by Sam Weinig.
 232
 233         * sunspider:
 234         (loadTestsList): Fix the error message to use the right list name.
 235
 236 2008-10-07  David Hyatt  <hyatt@apple.com>
 237
 238         https://bugs.webkit.org/show_bug.cgi?id=18989
 239
 240         Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
 241         we want all browsers to be doing the same thing on the test.
 242
 243         Reviewed by Maciej
 244
 245         * tests/regexp-dna.js:
 246
 247 2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 248
 249         Rubber-stamped by Maciej Stachowiak.
 250
 251         The bleeding edge branch of V8 now supports passing fileanmes after
 252         '-f', so the SunSpider script should be changed to do this again.
 253         This allows all 3 major JavaScript engines to be used with the
 254         unmodified SunSpider script.
 255
 256         * sunspider:
 257
 258 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 259
 260         Reviewed by Maciej Stachowiak.
 261
 262         Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
 263         and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
 264         correct the punctuation in its documentation.
 265
 266         * sunspider:
 267
 268 2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 269
 270         Reviewed by Oliver Hunt.
 271
 272         Bug 20616: Incorporate V8 benchmarks in testing
 273         <https://bugs.webkit.org/show_bug.cgi?id=20616>
 274
 275         This is a first attempt at running the V8 benchmarks within SunSpider,
 276         with the --v8 option. The number of iterations is fixed for each
 277         benchmark, and was chosen to make each of the benchmarks run between
 278         500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
 279
 280         * sunspider:
 281         * tests/LIST-V8: Added.
 282         * tests/v8-crypto.js: Added.
 283         * tests/v8-deltablue.js: Added.
 284         * tests/v8-earley-boyer.js: Added.
 285         * tests/v8-raytrace.js: Added.
 286         * tests/v8-richards.js: Added.
 287
 288 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 289
 290         Not reviewed.
 291
 292         Remove a local change that was accidentally committed in r36034.
 293
 294         * resources/sunspider-standalone-driver.js:
 295
 296 2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 297
 298         Rubber-stamped by Oliver Hunt.
 299
 300         Make SunSpider work with JavaScript shells that don't take filenames
 301         after a '-f' argument.
 302
 303         * sunspider:
 304
 305 2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
 306
 307         Reviewed by Timothy.
 308
 309         Remove the --squirrelfish option from SunSpider, as it is no longer needed.
 310
 311         * sunspider:
 312         * tests/LIST-SQUIRRELFISH: Removed.
 313
 314 2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
 315
 316         Rubber-stamped by Mark Rowe.
 317
 318         Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
 319
 320         * sunspider:
 321
 322 2008-04-15  Maciej Stachowiak  <mjs@apple.com>
 323
 324         Rubber stamped by Oliver.
 325
 326         - add newly working tests to squirrelfish list
 327
 328         * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
 329
 330 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 331
 332         Rubber stamped by Oliver.
 333
 334         - move ubench tests properly.
 335
 336         * tests/ubench: Added.
 337         * tests/ubench/function-closure.js: Added.
 338         * tests/ubench/function-empty.js: Added.
 339         * tests/ubench/function-missing-args.js: Added.
 340         * tests/ubench/function-sum.js: Added.
 341         * tests/ubench/loop-empty-resolve.js: Added.
 342         * tests/ubench/loop-empty.js: Added.
 343         * tests/ubench/loop-sum.js: Added.
 344
 345 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 346
 347         Rubber stamped by Oliver.
 348
 349         * sunspider: Don't force --runs=1 in squirrelfish mode any more.
 350
 351 2008-04-14  Maciej Stachowiak  <mjs@apple.com>
 352
 353         Reviewed by Oliver.
 354
 355         - make --squirrelfish mode use the real harness, but a reduced set of tests
 356
 357         Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
 358
 359         * sunspider:
 360         * tests/LIST-SQUIRRELFISH:
 361         * tests/LIST-UBENCH: Added.
 362         * tests/squirrelfish: Moved to tests/ubench
 363
 364 2008-04-14  Geoffrey Garen  <ggaren@apple.com>
 365
 366         Reviewed by Maciej Stachowiak.
 367
 368         Removed an unused test.
 369
 370         * tests/squirrelfish/loop-resolve.js: Removed.
 371
 372 2008-04-10  Maciej Stachowiak  <mjs@apple.com>
 373
 374         Reviewed by Oliver.
 375
 376         Add newly runnable tests to --squirrelfish mode.
 377
 378         * tests/LIST-SQUIRRELFISH:
 379
 380 2008-04-06  Geoffrey Garen  <ggaren@apple.com>
 381
 382         Reviewed by Maciej Stachowiak.
 383
 384         A little more love for --squirrelfish mode:
 385
 386         Fixed a misplaced sort. Results properly sort now.
 387
 388         Added a test list just for squirrelfish, and updated it to include
 389         all currently passing SunSpider tests.
 390
 391         Fixed the pruning regexp to match 3d-morph.js.
 392
 393         * sunspider:
 394
 395 2008-03-26  Geoffrey Garen  <ggaren@apple.com>
 396
 397         Reviewed by Oliver Hunt.
 398
 399         --squirrelfish mode: pared down tests for squirrelfish to chew on.
 400
 401         * sunspider:
 402         * tests/LIST:
 403         * tests/squirrelfish: Added.
 404         * tests/squirrelfish/function-closure.js: Added.
 405         * tests/squirrelfish/function-empty.js: Added.
 406         * tests/squirrelfish/function-missing-args.js: Added.
 407         * tests/squirrelfish/function-sum.js: Added.
 408         * tests/squirrelfish/loop-empty-resolve.js: Added.
 409         * tests/squirrelfish/loop-empty.js: Added.
 410         * tests/squirrelfish/loop-resolve.js: Added.
 411         * tests/squirrelfish/loop-sum.js: Added.
 412
 413 2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
 414
 415         Reviewed by Geoff.
 416
 417         * sunspider: Pause update daemon on Darwin to make results reliable
 418         again (workaround for <rdar://problem/5811127>).
 419
 420 2008-02-07  Eric Seidel  <eric@webkit.org>
 421
 422         Reviewed by Sam.
 423
 424         * sunspider: add an error message when ./tests/LIST is not found
 425
 426 2007-12-29  Alp Toker  <alp@atoker.com>
 427
 428         Fix typo.
 429
 430         * hosted/sunspider.html:
 431
 432 2007-12-29  Alp Toker  <alp@atoker.com>
 433
 434         Reviewed by Maciej.
 435
 436         Provide the current URL in the SunSpider results page. Useful for
 437         copying benchmark results out of browsers without a location bar or
 438         where the location bar can't handle long URLs.
 439
 440         * hosted/sunspider-results.html:
 441
 442 2007-12-20  Eric Seidel  <eric@webkit.org>
 443
 444         Reviewed by mjs.
 445
 446         * sunspider: increase default number of runs for more accurate numbers
 447
 448 2007-12-18  Mark Rowe  <mrowe@apple.com>
 449
 450         Fix typo.
 451
 452         * hosted/sunspider.html:
 453
 454 2007-12-18  Maciej Stachowiak  <mjs@apple.com>
 455
 456         Reviewed by Eric.
 457
 458         - give an extra digit of precision for small differences.
 459
 460         * resources/sunspider-compare-results.js:
 461
 462 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 463
 464         Reviewed by Eric.
 465
 466         - work around IE layout bugs
 467
 468         * hosted/sunspider.css:
 469
 470 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 471
 472         Reviewed by Mark.
 473
 474         - fix compare feature
 475
 476         * hosted/sunspider-results.html:
 477
 478 2007-12-17  Maciej Stachowiak  <mjs@apple.com>
 479
 480         Reviewed by Mark.
 481
 482         - Change the format of the output URL to be shorter, to meet IE constraints
 483
 484         * hosted/sunspider-driver.html:
 485         * hosted/sunspider-results.html:
 486
 487 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 488
 489         Reviewed by Oliver.
 490
 491         - Add some explanatory test and a dumb logo to SunSpider web hosted version
 492
 493         * hosted/sunspider-driver.html:
 494         * hosted/sunspider-results.html:
 495         * hosted/sunspider.css:
 496         * hosted/sunspider.html:
 497
 498 2007-12-13  Maciej Stachowiak  <mjs@apple.com>
 499
 500         Reviewed by Oliver.
 501
 502         - Make the web-hosted version of SunSpider look a little bit less drab.
 503
 504         * hosted/sunspider-driver.html:
 505         * hosted/sunspider-results.html:
 506         * hosted/sunspider.css: Added.
 507         * hosted/sunspider.html:
 508         * resources/TEMPLATE.html:
 509
 510 2007-12-12  Maciej Stachowiak  <mjs@apple.com>
 511
 512         Reviewed by Sam.
 513
 514         - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
 515
 516         A sample of what new-style results would look like:
 517
 518         TEST                   COMPARISON            FROM                 TO             DETAILS
 519         ...
 520         ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
 521         ...
 522             3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
 523
 524         * resources/sunspider-compare-results.js:
 525
 526 2007-11-14  Eric Seidel  <eric@webkit.org>
 527
 528         Reviewed by Sam.
 529
 530         * sunspider: add --shark-cache for L2 Cache Miss profiling
 531
 532 2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
 533
 534         Reviewed by Darin Adler.
 535
 536         http://bugs.webkit.org/show_bug.cgi?id=15925
 537         SunSpider should check for Shark being installed
 538
 539         * sunspider: Explicitly test that shark command line tool is installed.
 540
 541 2007-11-04  Darin Adler  <darin@apple.com>
 542
 543         * hosted/sunspider.html: Tweaked formatting a bit.
 544
 545 2007-11-03  Maciej Stachowiak  <mjs@apple.com>
 546
 547         Reviewed by Darin Adler.
 548
 549         - Add compare mode and a description of the benchmark to the hosted version.
 550
 551         * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
 552         * hosted/sunspider.html: Added intro text.
 553         * make-hosted: Copy new file.
 554         * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
 555         a function.
 556         * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
 557         expects.
 558         * sunspider-compare-results: Use sunspider-standalone-compare.js.
 559
 560 2007-11-02  Darin Adler  <darin@apple.com>
 561
 562         * sunspider: Changed "--base" to "--set-baseline".
 563
 564 2007-11-02  Darin Adler  <darin@apple.com>
 565
 566         Reviewed by Maciej.
 567
 568         * sunspider: Added a "--base" option that records the current test as a baseline.
 569         Moved the code to find the newest .mshark file into a function (since I needed to use
 570         it in the other script and I prefer to copy/paste a function).
 571
 572         * sunspider-compare-results: Added logic to compare the baseline with the last
 573         run when you don't pass any parameters.
 574
 575 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 576
 577         Reviewed by Eric.
 578
 579         - Added list of ECMAScript3 features that SunSpider does not cover currently.
 580
 581         * UNCOVERED: Added.
 582
 583 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 584
 585         Reviewed by Oliver.
 586
 587         - Give better error messages when sunspider-compare-results fails
 588
 589         * sunspider-compare-results:
 590
 591 2007-10-29  Maciej Stachowiak  <mjs@apple.com>
 592
 593         Reviewed by Darin Adler.
 594
 595         - fix Date tests to work in command-line SpiderMonkey
 596
 597         * tests/date-format-tofte.js:
 598         * tests/date-format-xparb.js:
 599
 600 2007-10-29  Darin Adler  <darin@apple.com>
 601
 602         Reviewed by Maciej.
 603
 604         * sunspider: Added --shark20 option, to run Shark at its highest sample
 605         resolution instead of its default.
 606
 607 2007-10-28  Adam Roben  <aroben@apple.com>
 608
 609         Fix SunSpider on Windows
 610
 611         Reviewed by Eric.
 612
 613         * sunspider: Don't use colons in filenames.
 614
 615 2007-10-28  Darin Adler  <darin@apple.com>
 616
 617         Reviewed by Adam.
 618
 619         * resources/sunspider-analyze-results.js: Tweak the output format a little.
 620         Change so that when there's only one run we don't write out confidence
 621         intervals at all rather than writing "NaN" over and over again.
 622
 623         * sunspider: Use the time and date as a suffix on the results file, that way
 624         all the results are left behind in the tmp directory. This will make it easy
 625         for us to add features that compare past results in the future. Also rename
 626         the .mshark files using the same scheme.
 627
 628         * sunspider-compare-results: Relax the parsing rules so we can parse the
 629         results file exactly as it's emitted from sunspider.
 630
 631 2007-10-25  Adam Roben  <aroben@apple.com>
 632
 633         Strip carriage returns from results
 634
 635         Carriage returns were screwing up sunspider-compare-results on
 636         Windows.
 637
 638         Rubberstamped by Oliver.
 639
 640         * sunspider:
 641
 642 2007-10-24  Darin Adler  <darin@apple.com>
 643
 644         Reviewed by Eric.
 645
 646         * sunspider: Open the profile in shark after completing a run.
 647         * sunspider-compare-results: Tiny perl tweaks.
 648
 649 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 650
 651         Reviewed by Darin Adler.
 652
 653         - Don't hardcode my path to testkjs
 654
 655         * sunspider-compare-results:
 656
 657 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 658
 659         Reviewed by Darin Adler.
 660
 661         - Add a compare script to compare results, and improve formatting of standard results a bit.
 662
 663         * resources/sunspider-analyze-results.js:
 664         * resources/sunspider-compare-results.js: Added.
 665         * sunspider-compare-results: Added.
 666
 667 2007-10-23  Maciej Stachowiak  <mjs@apple.com>
 668
 669         Reviewed by Darin Adler.
 670
 671         * resources/sunspider-analyze-results.js: Do the error range
 672         properly, using the t-distribution instead of 1.96 (which was
 673         based on the normal distribution).
 674
 675         * sunspider: Print results in a way that will be friendlier to the
 676         soon-to-come compare mode.
 677
 678 2007-10-22  Maciej Stachowiak  <mjs@apple.com>
 679
 680         Reviewed by Review.
 681
 682         - add more tests (probably the final set for now)
 683
 684         Already balanced. Added date, regexp, control flow, and a few
 685         more string and object/array access tests.
 686
 687         * tests/LIST:
 688         * tests/access-fannkuch.js: Added.
 689         * tests/access-nbody.js: Added.
 690         * tests/controlflow-recursive.js: Added.
 691         * tests/date-format-tofte.js: Added.
 692         * tests/date-format-xparb.js: Added.
 693         * tests/regexp-dna.js: Added.
 694         * tests/string-validate-input.js: Added.
 695
 696 2007-10-21  Eric Seidel  <eric@webkit.org>
 697
 698         Reviewed by mjs.
 699
 700         * sunspider: make --shark only sample from testkjs
 701
 702 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 703
 704         Rubber stamped by Eric.
 705
 706         - added crypto tests (already balanced)
 707
 708         * tests/LIST:
 709         * tests/crypto-aes.js: Added.
 710         * tests/crypto-md5.js: Added.
 711         * tests/crypto-sha1.js: Added.
 712
 713 2007-10-21  Maciej Stachowiak  <mjs@apple.com>
 714
 715         Reviewed by Adam.
 716
 717         - rebalance new tests
 718
 719         Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
 720
 721         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 722
 723         This balances them with the existing tests.
 724
 725         * tests/access-binary-trees.js:
 726         * tests/access-nsieve.js:
 727         * tests/bitops-nsieve-bits.js:
 728         * tests/math-partial-sums.js:
 729         * tests/math-spectral-norm.js:
 730         * tests/string-fasta.js:
 731
 732 2007-10-20  Eric Seidel  <eric@webkit.org>
 733
 734         Reviewed by darin.
 735
 736         Add improved argument handling to sunspider, including
 737         --runs=<number>, --tests=<pattern, --shark, and --help
 738         Also re-factor code into subroutines
 739
 740         * sunspider: improved argument handling
 741
 742 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 743
 744         Reviewed by Mark.
 745
 746         - Add more new tests, mostly from the computer language shootout. Not normalized yet.
 747
 748         * TODO:
 749         * tests/LIST:
 750         * tests/access-binary-trees.js: Added.
 751         * tests/access-nsieve.js: Added.
 752         * tests/bitops-nsieve-bits.js: Added.
 753         * tests/math-partial-sums.js: Added.
 754         * tests/math-spectral-norm.js: Added.
 755         * tests/string-fasta.js: Added.
 756
 757 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 758
 759         Reviewed by Darin Adler.
 760
 761         * TODO: Updated to note areas that are now well-covered.
 762
 763         - Change the tests and the driver to avoid leaving large object
 764         graphs hanging around, since that throws off the subsequent tests.
 765
 766         * resources/sunspider-standalone-driver.js:
 767         * tests/3d-cube.js:
 768         * tests/3d-morph.js:
 769         * tests/3d-raytrace.js:
 770         * tests/bitops-bitwise-and.js:
 771         * tests/string-base64.js:
 772         * tests/string-tagcloud.js:
 773
 774 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 775
 776         Reviewed by Nikolas.
 777
 778         - Rebalance test complexity.
 779
 780         Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
 781
 782         Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
 783
 784         However, for some tests, IE7 was a huge outlier compared to other
 785         major browsers. For those tests, I used Firefox 2.0.0.8 on the
 786         same OS and hardware as a normalization basis.
 787
 788         * tests/3d-morph.js:
 789         * tests/3d-raytrace.js:
 790         * tests/bitops-3bit-bits-in-byte.js:
 791         * tests/bitops-bits-in-byte.js:
 792         * tests/bitops-bitwise-and.js:
 793         * tests/math-cordic.js:
 794         * tests/string-base64.js:
 795         * tests/string-tagcloud.js:
 796         * tests/string-unpack-code.js:
 797
 798 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 799
 800         Reviewed by Oliver.
 801
 802         - Fix the browser-hosted driver to be compatible with Safari 2
 803
 804         * hosted/sunspider-driver.html:
 805
 806 2007-10-20  Maciej Stachowiak  <mjs@apple.com>
 807
 808         Rubber stamped by Hyatt.
 809
 810         - Add BSD license notice to cordic test, the original author said to do so.
 811
 812         * tests/math-cordic.js:
 813
 814 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 815
 816         Reviewed by Eric.
 817
 818         - Support Windows and Windows browsers.
 819
 820         * hosted/sunspider-results.html: Display results correctly in IE.
 821         * sunspider: tweaks to work on Windows, and with spaces in the path.
 822
 823 2007-10-18  Maciej Stachowiak  <mjs@apple.com>
 824
 825         Rubber stamped by Oliver.
 826
 827         * tests/string-tagcloud.js: Remove stray print()
 828
 829 2007-10-17  Maciej Stachowiak  <mjs@apple.com>
 830
 831         Reviewed by Oliver.
 832
 833         Add some string test cases.
 834
 835         * tests/string-base64.js: Added. Does base64 encoding and decoding.
 836         * tests/string-tagcloud.js: Added. Parses a JSON string and
 837         generates tagcloud HTML markup based on the data.
 838         * tests/string-unpack-code.js: Added. Unpack compressed versions of
 839         four of the most popular JavaScript libraries.
 840         * tests/LIST: Added the new tests.
 841
 842 2007-10-16  Maciej Stachowiak  <mjs@apple.com>
 843
 844         Reviewed by Anders.
 845
 846         * TODO: Updated with info on how to do the stats properly.
 847
 848         * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
 849         avoid overly slowing down the benchmark.
 850
 851         Added some 3D-related test cases.
 852
 853         * tests/3d-cube.js: Added.
 854         * tests/3d-morph.js: Added.
 855         * tests/3d-raytrace.js: Added.
 856         * tests/LIST:
 857
 858 2007-10-14  Maciej Stachowiak  <mjs@apple.com>
 859
 860         Reviewed by Darin Adler.
 861
 862         - New JavaScript benchmark
 863         http://bugs.webkit.org/show_bug.cgi?id=15515
 864
 865         A start on a new JavaScript benchmark, with standalone and
 866         browser-hosted drivers.
 867
 868         The test content is still incomplete and the drivers could use
 869         some more features but there is enough here to make a good start.
 870
 871         The drivers compute a 95% confidence interval on the mean for the
 872         whole test, each category, and each individual test to make it
 873         easier to tell whether differences are statistically
 874         significant. The confidence interval can be narrowed by running
 875         the test more times.
 876
 877         * TODO: Added. Remaining things that need to be done.
 878         * sunspider: Added. Perl script that acts as the standalone test driver.
 879         * resources/sunspider-standalone-driver.js: Added. JavaScript part
 880         of standalone test driver.
 881         * resources/sunspider-analyze-results.js: Added. JavaScript statistical
 882         analysis code.
 883         * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
 884         * make-hosted: Added. Script to generate browser-hosted tests.
 885         * hosted/sunspider.html: Added. Start page for browser-hosted test.
 886         * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
 887         * hosted/sunspider-results.html: Added. Results page for browser-hosted
 888         tests.
 889         * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
 890         tests.
 891         * tests/LIST: Added. List of tests to use.
 892         * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
 893         * tests/bitops-bits-in-byte.js: Added. Ditto.
 894         * tests/bitops-bitwise-and.js: Added. Ditto.
 895         * tests/math-cordic.js: Added. Ditto.
 896