testing/perfdocs/generated/raptor.rst

   1 ######
   2 Raptor
   3 ######
   4
   5 Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.
   6
   7 - Contact: Dave Hunt [:davehunt]
   8 - Source code: https://searchfox.org/mozilla-central/source/testing/raptor
   9 - Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
  10
  11 Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).
  12
  13 Locally, Raptor can be invoked with the following command:
  14
  15 ::
  16
  17     ./mach raptor
  18
  19 **We're in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.**
  20
  21 .. toctree::
  22    :titlesonly:
  23
  24    browsertime
  25    webextension
  26    debugging
  27    contributing
  28    test-list
  29    metrics
  30
  31 .. contents::
  32    :depth: 2
  33    :local:
  34
  35 Raptor tests
  36 ************
  37
  38 The following documents all testing we have for Raptor.
  39
  40 Benchmarks
  41 ----------
  42 Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests <browsertime.html#updating-benchmark-tests>`_.
  43
  44
  45 .. dropdown:: ares6
  46    :class-container: anchor-id-ares6-b
  47
  48    **Owner**: :jandem and SpiderMonkey Team
  49
  50    * **alert threshold**: 2.0
  51    * **apps**: firefox, chrome, chromium, safari
  52    * **expected**: pass
  53    * **gecko profile entries**: 14000000
  54    * **gecko profile interval**: 1
  55    * **lower is better**: true
  56    * **page cycles**: 4
  57    * **page timeout**: 270000
  58    * **subtest lower is better**: true
  59    * **subtest unit**: ms
  60    * **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__
  61    * **type**: benchmark
  62    * **unit**: ms
  63    * **Test Task**:
  64
  65    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
  66       :widths: 30 15 15 15 15
  67       :header-rows: 1
  68
  69       * - **Test Name**
  70         - mozilla-central
  71         - autoland
  72         - mozilla-release
  73         - mozilla-beta
  74       * - **browsertime-benchmark-firefox-ares6**
  75         - ❌
  76         - ❌
  77         - ❌
  78         - ❌
  79
  80
  81    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
  82       :widths: 30 15 15 15 15
  83       :header-rows: 1
  84
  85       * - **Test Name**
  86         - mozilla-central
  87         - autoland
  88         - mozilla-release
  89         - mozilla-beta
  90       * - **browsertime-benchmark-firefox-ares6**
  91         - ❌
  92         - ❌
  93         - ❌
  94         - ❌
  95
  96
  97    .. list-table:: **test-linux1804-64-qr/opt**
  98       :widths: 30 15 15 15 15
  99       :header-rows: 1
 100
 101       * - **Test Name**
 102         - mozilla-central
 103         - autoland
 104         - mozilla-release
 105         - mozilla-beta
 106       * - **browsertime-benchmark-firefox-ares6**
 107         - ❌
 108         - ❌
 109         - ❌
 110         - ❌
 111
 112
 113    .. list-table:: **test-linux1804-64-shippable-qr/opt**
 114       :widths: 30 15 15 15 15
 115       :header-rows: 1
 116
 117       * - **Test Name**
 118         - mozilla-central
 119         - autoland
 120         - mozilla-release
 121         - mozilla-beta
 122       * - **browsertime-benchmark-chrome-ares6**
 123         - ❌
 124         - ❌
 125         - ❌
 126         - ❌
 127       * - **browsertime-benchmark-chromium-ares6**
 128         - ❌
 129         - ❌
 130         - ❌
 131         - ❌
 132       * - **browsertime-benchmark-firefox-ares6**
 133         - ✅
 134         - ✅
 135         - ❌
 136         - ❌
 137
 138
 139    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
 140       :widths: 30 15 15 15 15
 141       :header-rows: 1
 142
 143       * - **Test Name**
 144         - mozilla-central
 145         - autoland
 146         - mozilla-release
 147         - mozilla-beta
 148       * - **browsertime-benchmark-firefox-ares6**
 149         - ❌
 150         - ❌
 151         - ❌
 152         - ❌
 153
 154
 155    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
 156       :widths: 30 15 15 15 15
 157       :header-rows: 1
 158
 159       * - **Test Name**
 160         - mozilla-central
 161         - autoland
 162         - mozilla-release
 163         - mozilla-beta
 164       * - **browsertime-benchmark-chrome-ares6**
 165         - ❌
 166         - ❌
 167         - ❌
 168         - ❌
 169       * - **browsertime-benchmark-chromium-ares6**
 170         - ❌
 171         - ❌
 172         - ❌
 173         - ❌
 174       * - **browsertime-benchmark-firefox-ares6**
 175         - ✅
 176         - ✅
 177         - ❌
 178         - ❌
 179       * - **browsertime-benchmark-safari-ares6**
 180         - ❌
 181         - ❌
 182         - ❌
 183         - ❌
 184
 185
 186    .. list-table:: **test-windows10-32-qr/opt**
 187       :widths: 30 15 15 15 15
 188       :header-rows: 1
 189
 190       * - **Test Name**
 191         - mozilla-central
 192         - autoland
 193         - mozilla-release
 194         - mozilla-beta
 195       * - **browsertime-benchmark-firefox-ares6**
 196         - ❌
 197         - ❌
 198         - ❌
 199         - ❌
 200
 201
 202    .. list-table:: **test-windows10-32-shippable-qr/opt**
 203       :widths: 30 15 15 15 15
 204       :header-rows: 1
 205
 206       * - **Test Name**
 207         - mozilla-central
 208         - autoland
 209         - mozilla-release
 210         - mozilla-beta
 211       * - **browsertime-benchmark-chrome-ares6**
 212         - ❌
 213         - ❌
 214         - ❌
 215         - ❌
 216       * - **browsertime-benchmark-chromium-ares6**
 217         - ❌
 218         - ❌
 219         - ❌
 220         - ❌
 221       * - **browsertime-benchmark-firefox-ares6**
 222         - ❌
 223         - ❌
 224         - ❌
 225         - ❌
 226
 227
 228    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
 229       :widths: 30 15 15 15 15
 230       :header-rows: 1
 231
 232       * - **Test Name**
 233         - mozilla-central
 234         - autoland
 235         - mozilla-release
 236         - mozilla-beta
 237       * - **browsertime-benchmark-firefox-ares6**
 238         - ❌
 239         - ❌
 240         - ❌
 241         - ❌
 242
 243
 244    .. list-table:: **test-windows10-64-qr/opt**
 245       :widths: 30 15 15 15 15
 246       :header-rows: 1
 247
 248       * - **Test Name**
 249         - mozilla-central
 250         - autoland
 251         - mozilla-release
 252         - mozilla-beta
 253       * - **browsertime-benchmark-firefox-ares6**
 254         - ❌
 255         - ❌
 256         - ❌
 257         - ❌
 258
 259
 260    .. list-table:: **test-windows10-64-shippable-qr/opt**
 261       :widths: 30 15 15 15 15
 262       :header-rows: 1
 263
 264       * - **Test Name**
 265         - mozilla-central
 266         - autoland
 267         - mozilla-release
 268         - mozilla-beta
 269       * - **browsertime-benchmark-chrome-ares6**
 270         - ❌
 271         - ❌
 272         - ❌
 273         - ❌
 274       * - **browsertime-benchmark-chromium-ares6**
 275         - ❌
 276         - ❌
 277         - ❌
 278         - ❌
 279       * - **browsertime-benchmark-firefox-ares6**
 280         - ✅
 281         - ✅
 282         - ✅
 283         - ✅
 284
 285
 286
 287 .. dropdown:: assorted-dom
 288    :class-container: anchor-id-assorted-dom-b
 289
 290    **Owner**: PerfTest Team
 291
 292    * **alert threshold**: 2.0
 293    * **apps**: firefox, chrome, chromium, safari
 294    * **expected**: pass
 295    * **gecko profile entries**: 2000000
 296    * **gecko profile interval**: 1
 297    * **lower is better**: true
 298    * **page cycles**: 1
 299    * **page timeout**: 60000
 300    * **repository**: https://github.com/mozilla/perf-automation
 301    * **repository path**: benchmarks/assorted-dom
 302    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
 303    * **screen capture**: true
 304    * **test url**: `<http://\<host\>:\<port\>/assorted/driver.html?raptor>`__
 305    * **type**: benchmark
 306    * **unit**: ms
 307    * **Test Task**:
 308
 309    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
 310       :widths: 30 15 15 15 15
 311       :header-rows: 1
 312
 313       * - **Test Name**
 314         - mozilla-central
 315         - autoland
 316         - mozilla-release
 317         - mozilla-beta
 318       * - **browsertime-benchmark-firefox-assorted-dom**
 319         - ❌
 320         - ❌
 321         - ❌
 322         - ❌
 323
 324
 325    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
 326       :widths: 30 15 15 15 15
 327       :header-rows: 1
 328
 329       * - **Test Name**
 330         - mozilla-central
 331         - autoland
 332         - mozilla-release
 333         - mozilla-beta
 334       * - **browsertime-benchmark-firefox-assorted-dom**
 335         - ❌
 336         - ❌
 337         - ❌
 338         - ❌
 339
 340
 341    .. list-table:: **test-linux1804-64-qr/opt**
 342       :widths: 30 15 15 15 15
 343       :header-rows: 1
 344
 345       * - **Test Name**
 346         - mozilla-central
 347         - autoland
 348         - mozilla-release
 349         - mozilla-beta
 350       * - **browsertime-benchmark-firefox-assorted-dom**
 351         - ❌
 352         - ❌
 353         - ❌
 354         - ❌
 355
 356
 357    .. list-table:: **test-linux1804-64-shippable-qr/opt**
 358       :widths: 30 15 15 15 15
 359       :header-rows: 1
 360
 361       * - **Test Name**
 362         - mozilla-central
 363         - autoland
 364         - mozilla-release
 365         - mozilla-beta
 366       * - **browsertime-benchmark-chrome-assorted-dom**
 367         - ❌
 368         - ❌
 369         - ❌
 370         - ❌
 371       * - **browsertime-benchmark-chromium-assorted-dom**
 372         - ❌
 373         - ❌
 374         - ❌
 375         - ❌
 376       * - **browsertime-benchmark-firefox-assorted-dom**
 377         - ✅
 378         - ✅
 379         - ❌
 380         - ❌
 381
 382
 383    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
 384       :widths: 30 15 15 15 15
 385       :header-rows: 1
 386
 387       * - **Test Name**
 388         - mozilla-central
 389         - autoland
 390         - mozilla-release
 391         - mozilla-beta
 392       * - **browsertime-benchmark-firefox-assorted-dom**
 393         - ❌
 394         - ❌
 395         - ❌
 396         - ❌
 397
 398
 399    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
 400       :widths: 30 15 15 15 15
 401       :header-rows: 1
 402
 403       * - **Test Name**
 404         - mozilla-central
 405         - autoland
 406         - mozilla-release
 407         - mozilla-beta
 408       * - **browsertime-benchmark-chrome-assorted-dom**
 409         - ❌
 410         - ❌
 411         - ❌
 412         - ❌
 413       * - **browsertime-benchmark-chromium-assorted-dom**
 414         - ❌
 415         - ❌
 416         - ❌
 417         - ❌
 418       * - **browsertime-benchmark-firefox-assorted-dom**
 419         - ✅
 420         - ✅
 421         - ❌
 422         - ❌
 423       * - **browsertime-benchmark-safari-assorted-dom**
 424         - ❌
 425         - ❌
 426         - ❌
 427         - ❌
 428
 429
 430    .. list-table:: **test-windows10-32-qr/opt**
 431       :widths: 30 15 15 15 15
 432       :header-rows: 1
 433
 434       * - **Test Name**
 435         - mozilla-central
 436         - autoland
 437         - mozilla-release
 438         - mozilla-beta
 439       * - **browsertime-benchmark-firefox-assorted-dom**
 440         - ❌
 441         - ❌
 442         - ❌
 443         - ❌
 444
 445
 446    .. list-table:: **test-windows10-32-shippable-qr/opt**
 447       :widths: 30 15 15 15 15
 448       :header-rows: 1
 449
 450       * - **Test Name**
 451         - mozilla-central
 452         - autoland
 453         - mozilla-release
 454         - mozilla-beta
 455       * - **browsertime-benchmark-chrome-assorted-dom**
 456         - ❌
 457         - ❌
 458         - ❌
 459         - ❌
 460       * - **browsertime-benchmark-chromium-assorted-dom**
 461         - ❌
 462         - ❌
 463         - ❌
 464         - ❌
 465       * - **browsertime-benchmark-firefox-assorted-dom**
 466         - ❌
 467         - ❌
 468         - ❌
 469         - ❌
 470
 471
 472    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
 473       :widths: 30 15 15 15 15
 474       :header-rows: 1
 475
 476       * - **Test Name**
 477         - mozilla-central
 478         - autoland
 479         - mozilla-release
 480         - mozilla-beta
 481       * - **browsertime-benchmark-firefox-assorted-dom**
 482         - ❌
 483         - ❌
 484         - ❌
 485         - ❌
 486
 487
 488    .. list-table:: **test-windows10-64-qr/opt**
 489       :widths: 30 15 15 15 15
 490       :header-rows: 1
 491
 492       * - **Test Name**
 493         - mozilla-central
 494         - autoland
 495         - mozilla-release
 496         - mozilla-beta
 497       * - **browsertime-benchmark-firefox-assorted-dom**
 498         - ❌
 499         - ❌
 500         - ❌
 501         - ❌
 502
 503
 504    .. list-table:: **test-windows10-64-shippable-qr/opt**
 505       :widths: 30 15 15 15 15
 506       :header-rows: 1
 507
 508       * - **Test Name**
 509         - mozilla-central
 510         - autoland
 511         - mozilla-release
 512         - mozilla-beta
 513       * - **browsertime-benchmark-chrome-assorted-dom**
 514         - ❌
 515         - ❌
 516         - ❌
 517         - ❌
 518       * - **browsertime-benchmark-chromium-assorted-dom**
 519         - ❌
 520         - ❌
 521         - ❌
 522         - ❌
 523       * - **browsertime-benchmark-firefox-assorted-dom**
 524         - ✅
 525         - ✅
 526         - ✅
 527         - ✅
 528
 529
 530
 531 .. dropdown:: jetstream2
 532    :class-container: anchor-id-jetstream2-b
 533
 534    **Owner**: :jandem and SpiderMonkey Team
 535
 536    * **alert threshold**: 2.0
 537    * **apps**: firefox, chrome, chromium, safari
 538    * **expected**: pass
 539    * **gecko profile entries**: 14000000
 540    * **gecko profile interval**: 1
 541    * **lower is better**: false
 542    * **page cycles**: 4
 543    * **page timeout**: 2000000
 544    * **repository**: https://github.com/mozilla/perf-automation
 545    * **repository path**: benchmarks/JetStream2
 546    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
 547    * **subtest lower is better**: false
 548    * **subtest unit**: score
 549    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
 550    * **type**: benchmark
 551    * **unit**: score
 552    * **Test Task**:
 553
 554    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
 555       :widths: 30 15 15 15 15
 556       :header-rows: 1
 557
 558       * - **Test Name**
 559         - mozilla-central
 560         - autoland
 561         - mozilla-release
 562         - mozilla-beta
 563       * - **browsertime-benchmark-firefox-jetstream2**
 564         - ❌
 565         - ❌
 566         - ❌
 567         - ❌
 568
 569
 570    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
 571       :widths: 30 15 15 15 15
 572       :header-rows: 1
 573
 574       * - **Test Name**
 575         - mozilla-central
 576         - autoland
 577         - mozilla-release
 578         - mozilla-beta
 579       * - **browsertime-benchmark-firefox-jetstream2**
 580         - ❌
 581         - ❌
 582         - ❌
 583         - ❌
 584
 585
 586    .. list-table:: **test-linux1804-64-qr/opt**
 587       :widths: 30 15 15 15 15
 588       :header-rows: 1
 589
 590       * - **Test Name**
 591         - mozilla-central
 592         - autoland
 593         - mozilla-release
 594         - mozilla-beta
 595       * - **browsertime-benchmark-firefox-jetstream2**
 596         - ❌
 597         - ❌
 598         - ❌
 599         - ❌
 600
 601
 602    .. list-table:: **test-linux1804-64-shippable-qr/opt**
 603       :widths: 30 15 15 15 15
 604       :header-rows: 1
 605
 606       * - **Test Name**
 607         - mozilla-central
 608         - autoland
 609         - mozilla-release
 610         - mozilla-beta
 611       * - **browsertime-benchmark-chrome-jetstream2**
 612         - ❌
 613         - ❌
 614         - ❌
 615         - ❌
 616       * - **browsertime-benchmark-chromium-jetstream2**
 617         - ❌
 618         - ❌
 619         - ❌
 620         - ❌
 621       * - **browsertime-benchmark-firefox-jetstream2**
 622         - ✅
 623         - ✅
 624         - ❌
 625         - ❌
 626
 627
 628    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
 629       :widths: 30 15 15 15 15
 630       :header-rows: 1
 631
 632       * - **Test Name**
 633         - mozilla-central
 634         - autoland
 635         - mozilla-release
 636         - mozilla-beta
 637       * - **browsertime-benchmark-firefox-jetstream2**
 638         - ❌
 639         - ❌
 640         - ❌
 641         - ❌
 642
 643
 644    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
 645       :widths: 30 15 15 15 15
 646       :header-rows: 1
 647
 648       * - **Test Name**
 649         - mozilla-central
 650         - autoland
 651         - mozilla-release
 652         - mozilla-beta
 653       * - **browsertime-benchmark-chrome-jetstream2**
 654         - ❌
 655         - ❌
 656         - ❌
 657         - ❌
 658       * - **browsertime-benchmark-chromium-jetstream2**
 659         - ❌
 660         - ❌
 661         - ❌
 662         - ❌
 663       * - **browsertime-benchmark-firefox-jetstream2**
 664         - ✅
 665         - ✅
 666         - ❌
 667         - ❌
 668       * - **browsertime-benchmark-safari-jetstream2**
 669         - ❌
 670         - ❌
 671         - ❌
 672         - ❌
 673
 674
 675    .. list-table:: **test-windows10-32-qr/opt**
 676       :widths: 30 15 15 15 15
 677       :header-rows: 1
 678
 679       * - **Test Name**
 680         - mozilla-central
 681         - autoland
 682         - mozilla-release
 683         - mozilla-beta
 684       * - **browsertime-benchmark-firefox-jetstream2**
 685         - ❌
 686         - ❌
 687         - ❌
 688         - ❌
 689
 690
 691    .. list-table:: **test-windows10-32-shippable-qr/opt**
 692       :widths: 30 15 15 15 15
 693       :header-rows: 1
 694
 695       * - **Test Name**
 696         - mozilla-central
 697         - autoland
 698         - mozilla-release
 699         - mozilla-beta
 700       * - **browsertime-benchmark-chrome-jetstream2**
 701         - ❌
 702         - ❌
 703         - ❌
 704         - ❌
 705       * - **browsertime-benchmark-chromium-jetstream2**
 706         - ❌
 707         - ❌
 708         - ❌
 709         - ❌
 710       * - **browsertime-benchmark-firefox-jetstream2**
 711         - ❌
 712         - ❌
 713         - ❌
 714         - ❌
 715
 716
 717    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
 718       :widths: 30 15 15 15 15
 719       :header-rows: 1
 720
 721       * - **Test Name**
 722         - mozilla-central
 723         - autoland
 724         - mozilla-release
 725         - mozilla-beta
 726       * - **browsertime-benchmark-firefox-jetstream2**
 727         - ❌
 728         - ❌
 729         - ❌
 730         - ❌
 731
 732
 733    .. list-table:: **test-windows10-64-qr/opt**
 734       :widths: 30 15 15 15 15
 735       :header-rows: 1
 736
 737       * - **Test Name**
 738         - mozilla-central
 739         - autoland
 740         - mozilla-release
 741         - mozilla-beta
 742       * - **browsertime-benchmark-firefox-jetstream2**
 743         - ❌
 744         - ❌
 745         - ❌
 746         - ❌
 747
 748
 749    .. list-table:: **test-windows10-64-shippable-qr/opt**
 750       :widths: 30 15 15 15 15
 751       :header-rows: 1
 752
 753       * - **Test Name**
 754         - mozilla-central
 755         - autoland
 756         - mozilla-release
 757         - mozilla-beta
 758       * - **browsertime-benchmark-chrome-jetstream2**
 759         - ❌
 760         - ❌
 761         - ❌
 762         - ❌
 763       * - **browsertime-benchmark-chromium-jetstream2**
 764         - ❌
 765         - ❌
 766         - ❌
 767         - ❌
 768       * - **browsertime-benchmark-firefox-jetstream2**
 769         - ✅
 770         - ✅
 771         - ✅
 772         - ✅
 773
 774
 775
 776 .. dropdown:: matrix-react-bench
 777    :class-container: anchor-id-matrix-react-bench-b
 778
 779    **Owner**: :jandem and SpiderMonkey Team
 780
 781    * **alert threshold**: 2.0
 782    * **apps**: firefox, chrome, chromium
 783    * **expected**: pass
 784    * **gecko profile entries**: 14000000
 785    * **gecko profile interval**: 1
 786    * **lower is better**: true
 787    * **page cycles**: 30
 788    * **page timeout**: 2000000
 789    * **repository**: https://github.com/mozilla/perf-automation
 790    * **repository path**: benchmarks/matrix-react-bench
 791    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
 792    * **subtest lower is better**: true
 793    * **subtest unit**: ms
 794    * **test url**: `<http://\<host\>:\<port\>/matrix_demo.html>`__
 795    * **type**: benchmark
 796    * **unit**: ms
 797    * **Test Task**:
 798
 799    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
 800       :widths: 30 15 15 15 15
 801       :header-rows: 1
 802
 803       * - **Test Name**
 804         - mozilla-central
 805         - autoland
 806         - mozilla-release
 807         - mozilla-beta
 808       * - **browsertime-benchmark-firefox-matrix-react-bench**
 809         - ❌
 810         - ❌
 811         - ❌
 812         - ❌
 813
 814
 815    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
 816       :widths: 30 15 15 15 15
 817       :header-rows: 1
 818
 819       * - **Test Name**
 820         - mozilla-central
 821         - autoland
 822         - mozilla-release
 823         - mozilla-beta
 824       * - **browsertime-benchmark-firefox-matrix-react-bench**
 825         - ❌
 826         - ❌
 827         - ❌
 828         - ❌
 829
 830
 831    .. list-table:: **test-linux1804-64-qr/opt**
 832       :widths: 30 15 15 15 15
 833       :header-rows: 1
 834
 835       * - **Test Name**
 836         - mozilla-central
 837         - autoland
 838         - mozilla-release
 839         - mozilla-beta
 840       * - **browsertime-benchmark-firefox-matrix-react-bench**
 841         - ❌
 842         - ❌
 843         - ❌
 844         - ❌
 845
 846
 847    .. list-table:: **test-linux1804-64-shippable-qr/opt**
 848       :widths: 30 15 15 15 15
 849       :header-rows: 1
 850
 851       * - **Test Name**
 852         - mozilla-central
 853         - autoland
 854         - mozilla-release
 855         - mozilla-beta
 856       * - **browsertime-benchmark-chrome-matrix-react-bench**
 857         - ❌
 858         - ❌
 859         - ❌
 860         - ❌
 861       * - **browsertime-benchmark-chromium-matrix-react-bench**
 862         - ❌
 863         - ❌
 864         - ❌
 865         - ❌
 866       * - **browsertime-benchmark-firefox-matrix-react-bench**
 867         - ✅
 868         - ✅
 869         - ❌
 870         - ❌
 871
 872
 873    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
 874       :widths: 30 15 15 15 15
 875       :header-rows: 1
 876
 877       * - **Test Name**
 878         - mozilla-central
 879         - autoland
 880         - mozilla-release
 881         - mozilla-beta
 882       * - **browsertime-benchmark-firefox-matrix-react-bench**
 883         - ❌
 884         - ❌
 885         - ❌
 886         - ❌
 887
 888
 889    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
 890       :widths: 30 15 15 15 15
 891       :header-rows: 1
 892
 893       * - **Test Name**
 894         - mozilla-central
 895         - autoland
 896         - mozilla-release
 897         - mozilla-beta
 898       * - **browsertime-benchmark-chrome-matrix-react-bench**
 899         - ❌
 900         - ❌
 901         - ❌
 902         - ❌
 903       * - **browsertime-benchmark-chromium-matrix-react-bench**
 904         - ❌
 905         - ❌
 906         - ❌
 907         - ❌
 908       * - **browsertime-benchmark-firefox-matrix-react-bench**
 909         - ✅
 910         - ✅
 911         - ❌
 912         - ❌
 913
 914
 915    .. list-table:: **test-windows10-32-qr/opt**
 916       :widths: 30 15 15 15 15
 917       :header-rows: 1
 918
 919       * - **Test Name**
 920         - mozilla-central
 921         - autoland
 922         - mozilla-release
 923         - mozilla-beta
 924       * - **browsertime-benchmark-firefox-matrix-react-bench**
 925         - ❌
 926         - ❌
 927         - ❌
 928         - ❌
 929
 930
 931    .. list-table:: **test-windows10-32-shippable-qr/opt**
 932       :widths: 30 15 15 15 15
 933       :header-rows: 1
 934
 935       * - **Test Name**
 936         - mozilla-central
 937         - autoland
 938         - mozilla-release
 939         - mozilla-beta
 940       * - **browsertime-benchmark-chrome-matrix-react-bench**
 941         - ❌
 942         - ❌
 943         - ❌
 944         - ❌
 945       * - **browsertime-benchmark-chromium-matrix-react-bench**
 946         - ❌
 947         - ❌
 948         - ❌
 949         - ❌
 950       * - **browsertime-benchmark-firefox-matrix-react-bench**
 951         - ❌
 952         - ❌
 953         - ❌
 954         - ❌
 955
 956
 957    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
 958       :widths: 30 15 15 15 15
 959       :header-rows: 1
 960
 961       * - **Test Name**
 962         - mozilla-central
 963         - autoland
 964         - mozilla-release
 965         - mozilla-beta
 966       * - **browsertime-benchmark-firefox-matrix-react-bench**
 967         - ❌
 968         - ❌
 969         - ❌
 970         - ❌
 971
 972
 973    .. list-table:: **test-windows10-64-qr/opt**
 974       :widths: 30 15 15 15 15
 975       :header-rows: 1
 976
 977       * - **Test Name**
 978         - mozilla-central
 979         - autoland
 980         - mozilla-release
 981         - mozilla-beta
 982       * - **browsertime-benchmark-firefox-matrix-react-bench**
 983         - ❌
 984         - ❌
 985         - ❌
 986         - ❌
 987
 988
 989    .. list-table:: **test-windows10-64-shippable-qr/opt**
 990       :widths: 30 15 15 15 15
 991       :header-rows: 1
 992
 993       * - **Test Name**
 994         - mozilla-central
 995         - autoland
 996         - mozilla-release
 997         - mozilla-beta
 998       * - **browsertime-benchmark-chrome-matrix-react-bench**
 999         - ❌
1000         - ❌
1001         - ❌
1002         - ❌
1003       * - **browsertime-benchmark-chromium-matrix-react-bench**
1004         - ❌
1005         - ❌
1006         - ❌
1007         - ❌
1008       * - **browsertime-benchmark-firefox-matrix-react-bench**
1009         - ✅
1010         - ✅
1011         - ✅
1012         - ✅
1013
1014
1015
1016 .. dropdown:: motionmark-animometer
1017    :class-container: anchor-id-motionmark-animometer-b
1018
1019    **Owner**: :jgilbert and Graphics(gfx) Team
1020
1021    * **alert threshold**: 2.0
1022    * **apps**: firefox, chrome, chromium, safari
1023    * **expected**: pass
1024    * **gecko profile entries**: 8000000
1025    * **gecko profile interval**: 1
1026    * **lower is better**: false
1027    * **page cycles**: 1
1028    * **page timeout**: 600000
1029    * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}>`__
1030    * **type**: benchmark
1031    * **unit**: score
1032    * **Test Task**:
1033
1034    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1035       :widths: 30 15 15 15 15
1036       :header-rows: 1
1037
1038       * - **Test Name**
1039         - mozilla-central
1040         - autoland
1041         - mozilla-release
1042         - mozilla-beta
1043       * - **browsertime-benchmark-firefox-motionmark-animometer**
1044         - ❌
1045         - ❌
1046         - ❌
1047         - ❌
1048
1049
1050    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
1051       :widths: 30 15 15 15 15
1052       :header-rows: 1
1053
1054       * - **Test Name**
1055         - mozilla-central
1056         - autoland
1057         - mozilla-release
1058         - mozilla-beta
1059       * - **browsertime-benchmark-firefox-motionmark-animometer**
1060         - ❌
1061         - ❌
1062         - ❌
1063         - ❌
1064
1065
1066    .. list-table:: **test-linux1804-64-qr/opt**
1067       :widths: 30 15 15 15 15
1068       :header-rows: 1
1069
1070       * - **Test Name**
1071         - mozilla-central
1072         - autoland
1073         - mozilla-release
1074         - mozilla-beta
1075       * - **browsertime-benchmark-firefox-motionmark-animometer**
1076         - ❌
1077         - ❌
1078         - ❌
1079         - ❌
1080
1081
1082    .. list-table:: **test-linux1804-64-shippable-qr/opt**
1083       :widths: 30 15 15 15 15
1084       :header-rows: 1
1085
1086       * - **Test Name**
1087         - mozilla-central
1088         - autoland
1089         - mozilla-release
1090         - mozilla-beta
1091       * - **browsertime-benchmark-chrome-motionmark-animometer**
1092         - ❌
1093         - ❌
1094         - ❌
1095         - ❌
1096       * - **browsertime-benchmark-chromium-motionmark-animometer**
1097         - ❌
1098         - ❌
1099         - ❌
1100         - ❌
1101       * - **browsertime-benchmark-firefox-motionmark-animometer**
1102         - ✅
1103         - ✅
1104         - ❌
1105         - ❌
1106
1107
1108    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
1109       :widths: 30 15 15 15 15
1110       :header-rows: 1
1111
1112       * - **Test Name**
1113         - mozilla-central
1114         - autoland
1115         - mozilla-release
1116         - mozilla-beta
1117       * - **browsertime-benchmark-firefox-motionmark-animometer**
1118         - ❌
1119         - ❌
1120         - ❌
1121         - ❌
1122
1123
1124    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1125       :widths: 30 15 15 15 15
1126       :header-rows: 1
1127
1128       * - **Test Name**
1129         - mozilla-central
1130         - autoland
1131         - mozilla-release
1132         - mozilla-beta
1133       * - **browsertime-benchmark-chrome-motionmark-animometer**
1134         - ❌
1135         - ❌
1136         - ❌
1137         - ❌
1138       * - **browsertime-benchmark-chromium-motionmark-animometer**
1139         - ❌
1140         - ❌
1141         - ❌
1142         - ❌
1143       * - **browsertime-benchmark-firefox-motionmark-animometer**
1144         - ✅
1145         - ✅
1146         - ❌
1147         - ❌
1148       * - **browsertime-benchmark-safari-motionmark-animometer**
1149         - ❌
1150         - ❌
1151         - ❌
1152         - ❌
1153
1154
1155    .. list-table:: **test-windows10-32-qr/opt**
1156       :widths: 30 15 15 15 15
1157       :header-rows: 1
1158
1159       * - **Test Name**
1160         - mozilla-central
1161         - autoland
1162         - mozilla-release
1163         - mozilla-beta
1164       * - **browsertime-benchmark-firefox-motionmark-animometer**
1165         - ❌
1166         - ❌
1167         - ❌
1168         - ❌
1169
1170
1171    .. list-table:: **test-windows10-32-shippable-qr/opt**
1172       :widths: 30 15 15 15 15
1173       :header-rows: 1
1174
1175       * - **Test Name**
1176         - mozilla-central
1177         - autoland
1178         - mozilla-release
1179         - mozilla-beta
1180       * - **browsertime-benchmark-chrome-motionmark-animometer**
1181         - ❌
1182         - ❌
1183         - ❌
1184         - ❌
1185       * - **browsertime-benchmark-chromium-motionmark-animometer**
1186         - ❌
1187         - ❌
1188         - ❌
1189         - ❌
1190       * - **browsertime-benchmark-firefox-motionmark-animometer**
1191         - ❌
1192         - ❌
1193         - ❌
1194         - ❌
1195
1196
1197    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
1198       :widths: 30 15 15 15 15
1199       :header-rows: 1
1200
1201       * - **Test Name**
1202         - mozilla-central
1203         - autoland
1204         - mozilla-release
1205         - mozilla-beta
1206       * - **browsertime-benchmark-firefox-motionmark-animometer**
1207         - ❌
1208         - ❌
1209         - ❌
1210         - ❌
1211
1212
1213    .. list-table:: **test-windows10-64-qr/opt**
1214       :widths: 30 15 15 15 15
1215       :header-rows: 1
1216
1217       * - **Test Name**
1218         - mozilla-central
1219         - autoland
1220         - mozilla-release
1221         - mozilla-beta
1222       * - **browsertime-benchmark-firefox-motionmark-animometer**
1223         - ❌
1224         - ❌
1225         - ❌
1226         - ❌
1227
1228
1229    .. list-table:: **test-windows10-64-shippable-qr/opt**
1230       :widths: 30 15 15 15 15
1231       :header-rows: 1
1232
1233       * - **Test Name**
1234         - mozilla-central
1235         - autoland
1236         - mozilla-release
1237         - mozilla-beta
1238       * - **browsertime-benchmark-chrome-motionmark-animometer**
1239         - ❌
1240         - ❌
1241         - ❌
1242         - ❌
1243       * - **browsertime-benchmark-chromium-motionmark-animometer**
1244         - ❌
1245         - ❌
1246         - ❌
1247         - ❌
1248       * - **browsertime-benchmark-firefox-motionmark-animometer**
1249         - ✅
1250         - ✅
1251         - ✅
1252         - ✅
1253
1254
1255
1256 .. dropdown:: motionmark-htmlsuite
1257    :class-container: anchor-id-motionmark-htmlsuite-b
1258
1259    **Owner**: :jgilbert and Graphics(gfx) Team
1260
1261    * **alert threshold**: 2.0
1262    * **apps**: firefox, chrome, chromium, safari
1263    * **expected**: pass
1264    * **gecko profile entries**: 8000000
1265    * **gecko profile interval**: 1
1266    * **lower is better**: false
1267    * **page cycles**: 5
1268    * **page timeout**: 600000
1269    * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}>`__
1270    * **type**: benchmark
1271    * **unit**: score
1272    * **Test Task**:
1273
1274    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1275       :widths: 30 15 15 15 15
1276       :header-rows: 1
1277
1278       * - **Test Name**
1279         - mozilla-central
1280         - autoland
1281         - mozilla-release
1282         - mozilla-beta
1283       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1284         - ❌
1285         - ❌
1286         - ❌
1287         - ❌
1288
1289
1290    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
1291       :widths: 30 15 15 15 15
1292       :header-rows: 1
1293
1294       * - **Test Name**
1295         - mozilla-central
1296         - autoland
1297         - mozilla-release
1298         - mozilla-beta
1299       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1300         - ❌
1301         - ❌
1302         - ❌
1303         - ❌
1304
1305
1306    .. list-table:: **test-linux1804-64-qr/opt**
1307       :widths: 30 15 15 15 15
1308       :header-rows: 1
1309
1310       * - **Test Name**
1311         - mozilla-central
1312         - autoland
1313         - mozilla-release
1314         - mozilla-beta
1315       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1316         - ❌
1317         - ❌
1318         - ❌
1319         - ❌
1320
1321
1322    .. list-table:: **test-linux1804-64-shippable-qr/opt**
1323       :widths: 30 15 15 15 15
1324       :header-rows: 1
1325
1326       * - **Test Name**
1327         - mozilla-central
1328         - autoland
1329         - mozilla-release
1330         - mozilla-beta
1331       * - **browsertime-benchmark-chrome-motionmark-htmlsuite**
1332         - ❌
1333         - ❌
1334         - ❌
1335         - ❌
1336       * - **browsertime-benchmark-chromium-motionmark-htmlsuite**
1337         - ❌
1338         - ❌
1339         - ❌
1340         - ❌
1341       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1342         - ✅
1343         - ✅
1344         - ❌
1345         - ❌
1346
1347
1348    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
1349       :widths: 30 15 15 15 15
1350       :header-rows: 1
1351
1352       * - **Test Name**
1353         - mozilla-central
1354         - autoland
1355         - mozilla-release
1356         - mozilla-beta
1357       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1358         - ❌
1359         - ❌
1360         - ❌
1361         - ❌
1362
1363
1364    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1365       :widths: 30 15 15 15 15
1366       :header-rows: 1
1367
1368       * - **Test Name**
1369         - mozilla-central
1370         - autoland
1371         - mozilla-release
1372         - mozilla-beta
1373       * - **browsertime-benchmark-chrome-motionmark-htmlsuite**
1374         - ❌
1375         - ❌
1376         - ❌
1377         - ❌
1378       * - **browsertime-benchmark-chromium-motionmark-htmlsuite**
1379         - ❌
1380         - ❌
1381         - ❌
1382         - ❌
1383       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1384         - ✅
1385         - ✅
1386         - ❌
1387         - ❌
1388       * - **browsertime-benchmark-safari-motionmark-htmlsuite**
1389         - ❌
1390         - ❌
1391         - ❌
1392         - ❌
1393
1394
1395    .. list-table:: **test-windows10-32-qr/opt**
1396       :widths: 30 15 15 15 15
1397       :header-rows: 1
1398
1399       * - **Test Name**
1400         - mozilla-central
1401         - autoland
1402         - mozilla-release
1403         - mozilla-beta
1404       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1405         - ❌
1406         - ❌
1407         - ❌
1408         - ❌
1409
1410
1411    .. list-table:: **test-windows10-32-shippable-qr/opt**
1412       :widths: 30 15 15 15 15
1413       :header-rows: 1
1414
1415       * - **Test Name**
1416         - mozilla-central
1417         - autoland
1418         - mozilla-release
1419         - mozilla-beta
1420       * - **browsertime-benchmark-chrome-motionmark-htmlsuite**
1421         - ❌
1422         - ❌
1423         - ❌
1424         - ❌
1425       * - **browsertime-benchmark-chromium-motionmark-htmlsuite**
1426         - ❌
1427         - ❌
1428         - ❌
1429         - ❌
1430       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1431         - ❌
1432         - ❌
1433         - ❌
1434         - ❌
1435
1436
1437    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
1438       :widths: 30 15 15 15 15
1439       :header-rows: 1
1440
1441       * - **Test Name**
1442         - mozilla-central
1443         - autoland
1444         - mozilla-release
1445         - mozilla-beta
1446       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1447         - ❌
1448         - ❌
1449         - ❌
1450         - ❌
1451
1452
1453    .. list-table:: **test-windows10-64-qr/opt**
1454       :widths: 30 15 15 15 15
1455       :header-rows: 1
1456
1457       * - **Test Name**
1458         - mozilla-central
1459         - autoland
1460         - mozilla-release
1461         - mozilla-beta
1462       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1463         - ❌
1464         - ❌
1465         - ❌
1466         - ❌
1467
1468
1469    .. list-table:: **test-windows10-64-shippable-qr/opt**
1470       :widths: 30 15 15 15 15
1471       :header-rows: 1
1472
1473       * - **Test Name**
1474         - mozilla-central
1475         - autoland
1476         - mozilla-release
1477         - mozilla-beta
1478       * - **browsertime-benchmark-chrome-motionmark-htmlsuite**
1479         - ❌
1480         - ❌
1481         - ❌
1482         - ❌
1483       * - **browsertime-benchmark-chromium-motionmark-htmlsuite**
1484         - ❌
1485         - ❌
1486         - ❌
1487         - ❌
1488       * - **browsertime-benchmark-firefox-motionmark-htmlsuite**
1489         - ✅
1490         - ✅
1491         - ✅
1492         - ✅
1493
1494
1495
1496 .. dropdown:: speedometer
1497    :class-container: anchor-id-speedometer-b
1498
1499    **Owner**: SpiderMonkey Team
1500
1501    * **alert threshold**: 2.0
1502    * **apps**: firefox, chrome, chromium, safari, custom-car
1503    * **expected**: pass
1504    * **gecko profile entries**: 14000000
1505    * **gecko profile interval**: 1
1506    * **lower is better**: false
1507    * **page cycles**: 5
1508    * **page timeout**: 180000
1509    * **subtest lower is better**: true
1510    * **subtest unit**: ms
1511    * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
1512    * **type**: benchmark
1513    * **unit**: score
1514    * **Test Task**:
1515
1516    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
1517       :widths: 30 15 15 15 15
1518       :header-rows: 1
1519
1520       * - **Test Name**
1521         - mozilla-central
1522         - autoland
1523         - mozilla-release
1524         - mozilla-beta
1525       * - **browsertime-speedometer-mobile-fenix-nofis**
1526         - ❌
1527         - ❌
1528         - ❌
1529         - ❌
1530       * - **browsertime-speedometer-mobile-geckoview-nofis**
1531         - ❌
1532         - ❌
1533         - ❌
1534         - ❌
1535
1536
1537    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
1538       :widths: 30 15 15 15 15
1539       :header-rows: 1
1540
1541       * - **Test Name**
1542         - mozilla-central
1543         - autoland
1544         - mozilla-release
1545         - mozilla-beta
1546       * - **browsertime-speedometer-mobile-chrome-m-nofis**
1547         - ❌
1548         - ❌
1549         - ❌
1550         - ❌
1551       * - **browsertime-speedometer-mobile-fenix-nofis**
1552         - ❌
1553         - ❌
1554         - ❌
1555         - ❌
1556       * - **browsertime-speedometer-mobile-geckoview-nofis**
1557         - ✅
1558         - ✅
1559         - ❌
1560         - ❌
1561
1562
1563    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1564       :widths: 30 15 15 15 15
1565       :header-rows: 1
1566
1567       * - **Test Name**
1568         - mozilla-central
1569         - autoland
1570         - mozilla-release
1571         - mozilla-beta
1572       * - **browsertime-benchmark-firefox-speedometer**
1573         - ❌
1574         - ❌
1575         - ❌
1576         - ❌
1577
1578
1579    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
1580       :widths: 30 15 15 15 15
1581       :header-rows: 1
1582
1583       * - **Test Name**
1584         - mozilla-central
1585         - autoland
1586         - mozilla-release
1587         - mozilla-beta
1588       * - **browsertime-benchmark-firefox-speedometer**
1589         - ❌
1590         - ✅
1591         - ❌
1592         - ❌
1593
1594
1595    .. list-table:: **test-linux1804-64-qr/opt**
1596       :widths: 30 15 15 15 15
1597       :header-rows: 1
1598
1599       * - **Test Name**
1600         - mozilla-central
1601         - autoland
1602         - mozilla-release
1603         - mozilla-beta
1604       * - **browsertime-benchmark-firefox-speedometer**
1605         - ❌
1606         - ❌
1607         - ❌
1608         - ❌
1609
1610
1611    .. list-table:: **test-linux1804-64-shippable-qr/opt**
1612       :widths: 30 15 15 15 15
1613       :header-rows: 1
1614
1615       * - **Test Name**
1616         - mozilla-central
1617         - autoland
1618         - mozilla-release
1619         - mozilla-beta
1620       * - **browsertime-benchmark-chrome-speedometer**
1621         - ❌
1622         - ❌
1623         - ❌
1624         - ❌
1625       * - **browsertime-benchmark-chromium-speedometer**
1626         - ❌
1627         - ❌
1628         - ❌
1629         - ❌
1630       * - **browsertime-benchmark-custom-car-speedometer**
1631         - ❌
1632         - ❌
1633         - ❌
1634         - ❌
1635       * - **browsertime-benchmark-firefox-speedometer**
1636         - ✅
1637         - ✅
1638         - ❌
1639         - ❌
1640
1641
1642    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
1643       :widths: 30 15 15 15 15
1644       :header-rows: 1
1645
1646       * - **Test Name**
1647         - mozilla-central
1648         - autoland
1649         - mozilla-release
1650         - mozilla-beta
1651       * - **browsertime-benchmark-firefox-speedometer**
1652         - ❌
1653         - ✅
1654         - ❌
1655         - ❌
1656
1657
1658    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1659       :widths: 30 15 15 15 15
1660       :header-rows: 1
1661
1662       * - **Test Name**
1663         - mozilla-central
1664         - autoland
1665         - mozilla-release
1666         - mozilla-beta
1667       * - **browsertime-benchmark-chrome-speedometer**
1668         - ❌
1669         - ❌
1670         - ❌
1671         - ❌
1672       * - **browsertime-benchmark-chromium-speedometer**
1673         - ❌
1674         - ❌
1675         - ❌
1676         - ❌
1677       * - **browsertime-benchmark-firefox-speedometer**
1678         - ✅
1679         - ✅
1680         - ❌
1681         - ❌
1682       * - **browsertime-benchmark-safari-speedometer**
1683         - ❌
1684         - ❌
1685         - ❌
1686         - ❌
1687
1688
1689    .. list-table:: **test-windows10-32-qr/opt**
1690       :widths: 30 15 15 15 15
1691       :header-rows: 1
1692
1693       * - **Test Name**
1694         - mozilla-central
1695         - autoland
1696         - mozilla-release
1697         - mozilla-beta
1698       * - **browsertime-benchmark-firefox-speedometer**
1699         - ❌
1700         - ❌
1701         - ❌
1702         - ❌
1703
1704
1705    .. list-table:: **test-windows10-32-shippable-qr/opt**
1706       :widths: 30 15 15 15 15
1707       :header-rows: 1
1708
1709       * - **Test Name**
1710         - mozilla-central
1711         - autoland
1712         - mozilla-release
1713         - mozilla-beta
1714       * - **browsertime-benchmark-chrome-speedometer**
1715         - ❌
1716         - ❌
1717         - ❌
1718         - ❌
1719       * - **browsertime-benchmark-chromium-speedometer**
1720         - ❌
1721         - ❌
1722         - ❌
1723         - ❌
1724       * - **browsertime-benchmark-firefox-speedometer**
1725         - ❌
1726         - ❌
1727         - ❌
1728         - ❌
1729
1730
1731    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
1732       :widths: 30 15 15 15 15
1733       :header-rows: 1
1734
1735       * - **Test Name**
1736         - mozilla-central
1737         - autoland
1738         - mozilla-release
1739         - mozilla-beta
1740       * - **browsertime-benchmark-firefox-speedometer**
1741         - ❌
1742         - ✅
1743         - ❌
1744         - ❌
1745
1746
1747    .. list-table:: **test-windows10-64-qr/opt**
1748       :widths: 30 15 15 15 15
1749       :header-rows: 1
1750
1751       * - **Test Name**
1752         - mozilla-central
1753         - autoland
1754         - mozilla-release
1755         - mozilla-beta
1756       * - **browsertime-benchmark-firefox-speedometer**
1757         - ❌
1758         - ❌
1759         - ❌
1760         - ❌
1761
1762
1763    .. list-table:: **test-windows10-64-shippable-qr/opt**
1764       :widths: 30 15 15 15 15
1765       :header-rows: 1
1766
1767       * - **Test Name**
1768         - mozilla-central
1769         - autoland
1770         - mozilla-release
1771         - mozilla-beta
1772       * - **browsertime-benchmark-chrome-speedometer**
1773         - ❌
1774         - ❌
1775         - ❌
1776         - ❌
1777       * - **browsertime-benchmark-chromium-speedometer**
1778         - ❌
1779         - ❌
1780         - ❌
1781         - ❌
1782       * - **browsertime-benchmark-firefox-speedometer**
1783         - ✅
1784         - ✅
1785         - ✅
1786         - ✅
1787
1788
1789    **Owner**: SpiderMonkey Team
1790
1791    * **alert threshold**: 2.0
1792    * **apps**: fenix, geckoview, refbrow, chrome-m
1793    * **expected**: pass
1794    * **gecko profile entries**: 14000000
1795    * **gecko profile interval**: 1
1796    * **lower is better**: false
1797    * **page cycles**: 5
1798    * **page timeout**: 420000
1799    * **subtest lower is better**: true
1800    * **subtest unit**: ms
1801    * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
1802    * **type**: benchmark
1803    * **unit**: score
1804    * **Test Task**:
1805
1806    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
1807       :widths: 30 15 15 15 15
1808       :header-rows: 1
1809
1810       * - **Test Name**
1811         - mozilla-central
1812         - autoland
1813         - mozilla-release
1814         - mozilla-beta
1815       * - **browsertime-speedometer-mobile-fenix-nofis**
1816         - ❌
1817         - ❌
1818         - ❌
1819         - ❌
1820       * - **browsertime-speedometer-mobile-geckoview-nofis**
1821         - ❌
1822         - ❌
1823         - ❌
1824         - ❌
1825
1826
1827    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
1828       :widths: 30 15 15 15 15
1829       :header-rows: 1
1830
1831       * - **Test Name**
1832         - mozilla-central
1833         - autoland
1834         - mozilla-release
1835         - mozilla-beta
1836       * - **browsertime-speedometer-mobile-chrome-m-nofis**
1837         - ❌
1838         - ❌
1839         - ❌
1840         - ❌
1841       * - **browsertime-speedometer-mobile-fenix-nofis**
1842         - ❌
1843         - ❌
1844         - ❌
1845         - ❌
1846       * - **browsertime-speedometer-mobile-geckoview-nofis**
1847         - ✅
1848         - ✅
1849         - ❌
1850         - ❌
1851
1852
1853    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1854       :widths: 30 15 15 15 15
1855       :header-rows: 1
1856
1857       * - **Test Name**
1858         - mozilla-central
1859         - autoland
1860         - mozilla-release
1861         - mozilla-beta
1862       * - **browsertime-benchmark-firefox-speedometer**
1863         - ❌
1864         - ❌
1865         - ❌
1866         - ❌
1867
1868
1869    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
1870       :widths: 30 15 15 15 15
1871       :header-rows: 1
1872
1873       * - **Test Name**
1874         - mozilla-central
1875         - autoland
1876         - mozilla-release
1877         - mozilla-beta
1878       * - **browsertime-benchmark-firefox-speedometer**
1879         - ❌
1880         - ✅
1881         - ❌
1882         - ❌
1883
1884
1885    .. list-table:: **test-linux1804-64-qr/opt**
1886       :widths: 30 15 15 15 15
1887       :header-rows: 1
1888
1889       * - **Test Name**
1890         - mozilla-central
1891         - autoland
1892         - mozilla-release
1893         - mozilla-beta
1894       * - **browsertime-benchmark-firefox-speedometer**
1895         - ❌
1896         - ❌
1897         - ❌
1898         - ❌
1899
1900
1901    .. list-table:: **test-linux1804-64-shippable-qr/opt**
1902       :widths: 30 15 15 15 15
1903       :header-rows: 1
1904
1905       * - **Test Name**
1906         - mozilla-central
1907         - autoland
1908         - mozilla-release
1909         - mozilla-beta
1910       * - **browsertime-benchmark-chrome-speedometer**
1911         - ❌
1912         - ❌
1913         - ❌
1914         - ❌
1915       * - **browsertime-benchmark-chromium-speedometer**
1916         - ❌
1917         - ❌
1918         - ❌
1919         - ❌
1920       * - **browsertime-benchmark-custom-car-speedometer**
1921         - ❌
1922         - ❌
1923         - ❌
1924         - ❌
1925       * - **browsertime-benchmark-firefox-speedometer**
1926         - ✅
1927         - ✅
1928         - ❌
1929         - ❌
1930
1931
1932    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
1933       :widths: 30 15 15 15 15
1934       :header-rows: 1
1935
1936       * - **Test Name**
1937         - mozilla-central
1938         - autoland
1939         - mozilla-release
1940         - mozilla-beta
1941       * - **browsertime-benchmark-firefox-speedometer**
1942         - ❌
1943         - ✅
1944         - ❌
1945         - ❌
1946
1947
1948    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1949       :widths: 30 15 15 15 15
1950       :header-rows: 1
1951
1952       * - **Test Name**
1953         - mozilla-central
1954         - autoland
1955         - mozilla-release
1956         - mozilla-beta
1957       * - **browsertime-benchmark-chrome-speedometer**
1958         - ❌
1959         - ❌
1960         - ❌
1961         - ❌
1962       * - **browsertime-benchmark-chromium-speedometer**
1963         - ❌
1964         - ❌
1965         - ❌
1966         - ❌
1967       * - **browsertime-benchmark-firefox-speedometer**
1968         - ✅
1969         - ✅
1970         - ❌
1971         - ❌
1972       * - **browsertime-benchmark-safari-speedometer**
1973         - ❌
1974         - ❌
1975         - ❌
1976         - ❌
1977
1978
1979    .. list-table:: **test-windows10-32-qr/opt**
1980       :widths: 30 15 15 15 15
1981       :header-rows: 1
1982
1983       * - **Test Name**
1984         - mozilla-central
1985         - autoland
1986         - mozilla-release
1987         - mozilla-beta
1988       * - **browsertime-benchmark-firefox-speedometer**
1989         - ❌
1990         - ❌
1991         - ❌
1992         - ❌
1993
1994
1995    .. list-table:: **test-windows10-32-shippable-qr/opt**
1996       :widths: 30 15 15 15 15
1997       :header-rows: 1
1998
1999       * - **Test Name**
2000         - mozilla-central
2001         - autoland
2002         - mozilla-release
2003         - mozilla-beta
2004       * - **browsertime-benchmark-chrome-speedometer**
2005         - ❌
2006         - ❌
2007         - ❌
2008         - ❌
2009       * - **browsertime-benchmark-chromium-speedometer**
2010         - ❌
2011         - ❌
2012         - ❌
2013         - ❌
2014       * - **browsertime-benchmark-firefox-speedometer**
2015         - ❌
2016         - ❌
2017         - ❌
2018         - ❌
2019
2020
2021    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
2022       :widths: 30 15 15 15 15
2023       :header-rows: 1
2024
2025       * - **Test Name**
2026         - mozilla-central
2027         - autoland
2028         - mozilla-release
2029         - mozilla-beta
2030       * - **browsertime-benchmark-firefox-speedometer**
2031         - ❌
2032         - ✅
2033         - ❌
2034         - ❌
2035
2036
2037    .. list-table:: **test-windows10-64-qr/opt**
2038       :widths: 30 15 15 15 15
2039       :header-rows: 1
2040
2041       * - **Test Name**
2042         - mozilla-central
2043         - autoland
2044         - mozilla-release
2045         - mozilla-beta
2046       * - **browsertime-benchmark-firefox-speedometer**
2047         - ❌
2048         - ❌
2049         - ❌
2050         - ❌
2051
2052
2053    .. list-table:: **test-windows10-64-shippable-qr/opt**
2054       :widths: 30 15 15 15 15
2055       :header-rows: 1
2056
2057       * - **Test Name**
2058         - mozilla-central
2059         - autoland
2060         - mozilla-release
2061         - mozilla-beta
2062       * - **browsertime-benchmark-chrome-speedometer**
2063         - ❌
2064         - ❌
2065         - ❌
2066         - ❌
2067       * - **browsertime-benchmark-chromium-speedometer**
2068         - ❌
2069         - ❌
2070         - ❌
2071         - ❌
2072       * - **browsertime-benchmark-firefox-speedometer**
2073         - ✅
2074         - ✅
2075         - ✅
2076         - ✅
2077
2078
2079
2080 .. dropdown:: speedometer3
2081    :class-container: anchor-id-speedometer3-b
2082
2083    **Owner**: Performance Team
2084
2085    * **alert threshold**: 2.0
2086    * **apps**: firefox, chrome, chromium, safari, custom-car
2087    * **browsertime args**: --browsertime.speedometer_iterations=5
2088    * **custom data**: true
2089    * **expected**: pass
2090    * **gecko profile entries**: 14000000
2091    * **gecko profile interval**: 1
2092    * **host from parent**: false
2093    * **lower is better**: false
2094    * **page cycles**: 5
2095    * **page timeout**: 180000
2096    * **repository**: https://github.com/WebKit/Speedometer
2097    * **repository revision**: 75cddea7ce4a95c5738a0dd47a2dea7fa56d8db9
2098    * **submetric summary method**: median
2099    * **subtest lower is better**: true
2100    * **subtest name filters**: tests/,s3/
2101    * **subtest unit**: ms
2102    * **test script**: speedometer3.js
2103    * **test summary**: flatten
2104    * **test url**: `<http://\<host\>:\<port\>/InteractiveRunner.html>`__
2105    * **type**: benchmark
2106    * **unit**: score
2107    * **Test Task**:
2108
2109    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
2110       :widths: 30 15 15 15 15
2111       :header-rows: 1
2112
2113       * - **Test Name**
2114         - mozilla-central
2115         - autoland
2116         - mozilla-release
2117         - mozilla-beta
2118       * - **browsertime-speedometer3-mobile-fenix-nofis**
2119         - ❌
2120         - ❌
2121         - ❌
2122         - ❌
2123       * - **browsertime-speedometer3-mobile-geckoview-nofis**
2124         - ❌
2125         - ❌
2126         - ❌
2127         - ❌
2128
2129
2130    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
2131       :widths: 30 15 15 15 15
2132       :header-rows: 1
2133
2134       * - **Test Name**
2135         - mozilla-central
2136         - autoland
2137         - mozilla-release
2138         - mozilla-beta
2139       * - **browsertime-speedometer3-mobile-chrome-m-nofis**
2140         - ❌
2141         - ❌
2142         - ❌
2143         - ❌
2144       * - **browsertime-speedometer3-mobile-fenix-nofis**
2145         - ❌
2146         - ❌
2147         - ❌
2148         - ❌
2149       * - **browsertime-speedometer3-mobile-geckoview-nofis**
2150         - ✅
2151         - ✅
2152         - ❌
2153         - ❌
2154
2155
2156    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2157       :widths: 30 15 15 15 15
2158       :header-rows: 1
2159
2160       * - **Test Name**
2161         - mozilla-central
2162         - autoland
2163         - mozilla-release
2164         - mozilla-beta
2165       * - **browsertime-benchmark-firefox-speedometer3**
2166         - ❌
2167         - ❌
2168         - ❌
2169         - ❌
2170
2171
2172    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
2173       :widths: 30 15 15 15 15
2174       :header-rows: 1
2175
2176       * - **Test Name**
2177         - mozilla-central
2178         - autoland
2179         - mozilla-release
2180         - mozilla-beta
2181       * - **browsertime-benchmark-firefox-speedometer3**
2182         - ❌
2183         - ✅
2184         - ❌
2185         - ❌
2186
2187
2188    .. list-table:: **test-linux1804-64-qr/opt**
2189       :widths: 30 15 15 15 15
2190       :header-rows: 1
2191
2192       * - **Test Name**
2193         - mozilla-central
2194         - autoland
2195         - mozilla-release
2196         - mozilla-beta
2197       * - **browsertime-benchmark-firefox-speedometer3**
2198         - ❌
2199         - ❌
2200         - ❌
2201         - ❌
2202
2203
2204    .. list-table:: **test-linux1804-64-shippable-qr/opt**
2205       :widths: 30 15 15 15 15
2206       :header-rows: 1
2207
2208       * - **Test Name**
2209         - mozilla-central
2210         - autoland
2211         - mozilla-release
2212         - mozilla-beta
2213       * - **browsertime-benchmark-chrome-speedometer3**
2214         - ❌
2215         - ❌
2216         - ❌
2217         - ❌
2218       * - **browsertime-benchmark-chromium-speedometer3**
2219         - ❌
2220         - ❌
2221         - ❌
2222         - ❌
2223       * - **browsertime-benchmark-custom-car-speedometer3**
2224         - ❌
2225         - ❌
2226         - ❌
2227         - ❌
2228       * - **browsertime-benchmark-firefox-speedometer3**
2229         - ✅
2230         - ✅
2231         - ❌
2232         - ❌
2233
2234
2235    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
2236       :widths: 30 15 15 15 15
2237       :header-rows: 1
2238
2239       * - **Test Name**
2240         - mozilla-central
2241         - autoland
2242         - mozilla-release
2243         - mozilla-beta
2244       * - **browsertime-benchmark-firefox-speedometer3**
2245         - ❌
2246         - ✅
2247         - ❌
2248         - ❌
2249
2250
2251    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2252       :widths: 30 15 15 15 15
2253       :header-rows: 1
2254
2255       * - **Test Name**
2256         - mozilla-central
2257         - autoland
2258         - mozilla-release
2259         - mozilla-beta
2260       * - **browsertime-benchmark-chrome-speedometer3**
2261         - ❌
2262         - ❌
2263         - ❌
2264         - ❌
2265       * - **browsertime-benchmark-chromium-speedometer3**
2266         - ❌
2267         - ❌
2268         - ❌
2269         - ❌
2270       * - **browsertime-benchmark-firefox-speedometer3**
2271         - ✅
2272         - ✅
2273         - ❌
2274         - ❌
2275       * - **browsertime-benchmark-safari-speedometer3**
2276         - ❌
2277         - ❌
2278         - ❌
2279         - ❌
2280
2281
2282    .. list-table:: **test-windows10-32-qr/opt**
2283       :widths: 30 15 15 15 15
2284       :header-rows: 1
2285
2286       * - **Test Name**
2287         - mozilla-central
2288         - autoland
2289         - mozilla-release
2290         - mozilla-beta
2291       * - **browsertime-benchmark-firefox-speedometer3**
2292         - ❌
2293         - ❌
2294         - ❌
2295         - ❌
2296
2297
2298    .. list-table:: **test-windows10-32-shippable-qr/opt**
2299       :widths: 30 15 15 15 15
2300       :header-rows: 1
2301
2302       * - **Test Name**
2303         - mozilla-central
2304         - autoland
2305         - mozilla-release
2306         - mozilla-beta
2307       * - **browsertime-benchmark-chrome-speedometer3**
2308         - ❌
2309         - ❌
2310         - ❌
2311         - ❌
2312       * - **browsertime-benchmark-chromium-speedometer3**
2313         - ❌
2314         - ❌
2315         - ❌
2316         - ❌
2317       * - **browsertime-benchmark-firefox-speedometer3**
2318         - ❌
2319         - ❌
2320         - ❌
2321         - ❌
2322
2323
2324    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
2325       :widths: 30 15 15 15 15
2326       :header-rows: 1
2327
2328       * - **Test Name**
2329         - mozilla-central
2330         - autoland
2331         - mozilla-release
2332         - mozilla-beta
2333       * - **browsertime-benchmark-firefox-speedometer3**
2334         - ❌
2335         - ✅
2336         - ❌
2337         - ❌
2338
2339
2340    .. list-table:: **test-windows10-64-qr/opt**
2341       :widths: 30 15 15 15 15
2342       :header-rows: 1
2343
2344       * - **Test Name**
2345         - mozilla-central
2346         - autoland
2347         - mozilla-release
2348         - mozilla-beta
2349       * - **browsertime-benchmark-firefox-speedometer3**
2350         - ❌
2351         - ❌
2352         - ❌
2353         - ❌
2354
2355
2356    .. list-table:: **test-windows10-64-shippable-qr/opt**
2357       :widths: 30 15 15 15 15
2358       :header-rows: 1
2359
2360       * - **Test Name**
2361         - mozilla-central
2362         - autoland
2363         - mozilla-release
2364         - mozilla-beta
2365       * - **browsertime-benchmark-chrome-speedometer3**
2366         - ❌
2367         - ❌
2368         - ❌
2369         - ❌
2370       * - **browsertime-benchmark-chromium-speedometer3**
2371         - ❌
2372         - ❌
2373         - ❌
2374         - ❌
2375       * - **browsertime-benchmark-firefox-speedometer3**
2376         - ✅
2377         - ✅
2378         - ✅
2379         - ❌
2380
2381
2382    **Owner**: Performance Team
2383
2384    * **alert threshold**: 2.0
2385    * **apps**: fenix, geckoview, refbrow, chrome-m
2386    * **browsertime args**: --browsertime.speedometer_iterations=5
2387    * **custom data**: true
2388    * **expected**: pass
2389    * **gecko profile entries**: 14000000
2390    * **gecko profile interval**: 1
2391    * **host from parent**: false
2392    * **lower is better**: false
2393    * **page cycles**: 5
2394    * **page timeout**: 420000
2395    * **repository**: https://github.com/WebKit/Speedometer
2396    * **repository revision**: 75cddea7ce4a95c5738a0dd47a2dea7fa56d8db9
2397    * **submetric summary method**: median
2398    * **subtest lower is better**: true
2399    * **subtest name filters**: tests/,s3/
2400    * **subtest unit**: ms
2401    * **test script**: speedometer3.js
2402    * **test summary**: flatten
2403    * **test url**: `<http://\<host\>:\<port\>/InteractiveRunner.html>`__
2404    * **type**: benchmark
2405    * **unit**: score
2406    * **Test Task**:
2407
2408    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
2409       :widths: 30 15 15 15 15
2410       :header-rows: 1
2411
2412       * - **Test Name**
2413         - mozilla-central
2414         - autoland
2415         - mozilla-release
2416         - mozilla-beta
2417       * - **browsertime-speedometer3-mobile-fenix-nofis**
2418         - ❌
2419         - ❌
2420         - ❌
2421         - ❌
2422       * - **browsertime-speedometer3-mobile-geckoview-nofis**
2423         - ❌
2424         - ❌
2425         - ❌
2426         - ❌
2427
2428
2429    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
2430       :widths: 30 15 15 15 15
2431       :header-rows: 1
2432
2433       * - **Test Name**
2434         - mozilla-central
2435         - autoland
2436         - mozilla-release
2437         - mozilla-beta
2438       * - **browsertime-speedometer3-mobile-chrome-m-nofis**
2439         - ❌
2440         - ❌
2441         - ❌
2442         - ❌
2443       * - **browsertime-speedometer3-mobile-fenix-nofis**
2444         - ❌
2445         - ❌
2446         - ❌
2447         - ❌
2448       * - **browsertime-speedometer3-mobile-geckoview-nofis**
2449         - ✅
2450         - ✅
2451         - ❌
2452         - ❌
2453
2454
2455    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2456       :widths: 30 15 15 15 15
2457       :header-rows: 1
2458
2459       * - **Test Name**
2460         - mozilla-central
2461         - autoland
2462         - mozilla-release
2463         - mozilla-beta
2464       * - **browsertime-benchmark-firefox-speedometer3**
2465         - ❌
2466         - ❌
2467         - ❌
2468         - ❌
2469
2470
2471    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
2472       :widths: 30 15 15 15 15
2473       :header-rows: 1
2474
2475       * - **Test Name**
2476         - mozilla-central
2477         - autoland
2478         - mozilla-release
2479         - mozilla-beta
2480       * - **browsertime-benchmark-firefox-speedometer3**
2481         - ❌
2482         - ✅
2483         - ❌
2484         - ❌
2485
2486
2487    .. list-table:: **test-linux1804-64-qr/opt**
2488       :widths: 30 15 15 15 15
2489       :header-rows: 1
2490
2491       * - **Test Name**
2492         - mozilla-central
2493         - autoland
2494         - mozilla-release
2495         - mozilla-beta
2496       * - **browsertime-benchmark-firefox-speedometer3**
2497         - ❌
2498         - ❌
2499         - ❌
2500         - ❌
2501
2502
2503    .. list-table:: **test-linux1804-64-shippable-qr/opt**
2504       :widths: 30 15 15 15 15
2505       :header-rows: 1
2506
2507       * - **Test Name**
2508         - mozilla-central
2509         - autoland
2510         - mozilla-release
2511         - mozilla-beta
2512       * - **browsertime-benchmark-chrome-speedometer3**
2513         - ❌
2514         - ❌
2515         - ❌
2516         - ❌
2517       * - **browsertime-benchmark-chromium-speedometer3**
2518         - ❌
2519         - ❌
2520         - ❌
2521         - ❌
2522       * - **browsertime-benchmark-custom-car-speedometer3**
2523         - ❌
2524         - ❌
2525         - ❌
2526         - ❌
2527       * - **browsertime-benchmark-firefox-speedometer3**
2528         - ✅
2529         - ✅
2530         - ❌
2531         - ❌
2532
2533
2534    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
2535       :widths: 30 15 15 15 15
2536       :header-rows: 1
2537
2538       * - **Test Name**
2539         - mozilla-central
2540         - autoland
2541         - mozilla-release
2542         - mozilla-beta
2543       * - **browsertime-benchmark-firefox-speedometer3**
2544         - ❌
2545         - ✅
2546         - ❌
2547         - ❌
2548
2549
2550    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2551       :widths: 30 15 15 15 15
2552       :header-rows: 1
2553
2554       * - **Test Name**
2555         - mozilla-central
2556         - autoland
2557         - mozilla-release
2558         - mozilla-beta
2559       * - **browsertime-benchmark-chrome-speedometer3**
2560         - ❌
2561         - ❌
2562         - ❌
2563         - ❌
2564       * - **browsertime-benchmark-chromium-speedometer3**
2565         - ❌
2566         - ❌
2567         - ❌
2568         - ❌
2569       * - **browsertime-benchmark-firefox-speedometer3**
2570         - ✅
2571         - ✅
2572         - ❌
2573         - ❌
2574       * - **browsertime-benchmark-safari-speedometer3**
2575         - ❌
2576         - ❌
2577         - ❌
2578         - ❌
2579
2580
2581    .. list-table:: **test-windows10-32-qr/opt**
2582       :widths: 30 15 15 15 15
2583       :header-rows: 1
2584
2585       * - **Test Name**
2586         - mozilla-central
2587         - autoland
2588         - mozilla-release
2589         - mozilla-beta
2590       * - **browsertime-benchmark-firefox-speedometer3**
2591         - ❌
2592         - ❌
2593         - ❌
2594         - ❌
2595
2596
2597    .. list-table:: **test-windows10-32-shippable-qr/opt**
2598       :widths: 30 15 15 15 15
2599       :header-rows: 1
2600
2601       * - **Test Name**
2602         - mozilla-central
2603         - autoland
2604         - mozilla-release
2605         - mozilla-beta
2606       * - **browsertime-benchmark-chrome-speedometer3**
2607         - ❌
2608         - ❌
2609         - ❌
2610         - ❌
2611       * - **browsertime-benchmark-chromium-speedometer3**
2612         - ❌
2613         - ❌
2614         - ❌
2615         - ❌
2616       * - **browsertime-benchmark-firefox-speedometer3**
2617         - ❌
2618         - ❌
2619         - ❌
2620         - ❌
2621
2622
2623    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
2624       :widths: 30 15 15 15 15
2625       :header-rows: 1
2626
2627       * - **Test Name**
2628         - mozilla-central
2629         - autoland
2630         - mozilla-release
2631         - mozilla-beta
2632       * - **browsertime-benchmark-firefox-speedometer3**
2633         - ❌
2634         - ✅
2635         - ❌
2636         - ❌
2637
2638
2639    .. list-table:: **test-windows10-64-qr/opt**
2640       :widths: 30 15 15 15 15
2641       :header-rows: 1
2642
2643       * - **Test Name**
2644         - mozilla-central
2645         - autoland
2646         - mozilla-release
2647         - mozilla-beta
2648       * - **browsertime-benchmark-firefox-speedometer3**
2649         - ❌
2650         - ❌
2651         - ❌
2652         - ❌
2653
2654
2655    .. list-table:: **test-windows10-64-shippable-qr/opt**
2656       :widths: 30 15 15 15 15
2657       :header-rows: 1
2658
2659       * - **Test Name**
2660         - mozilla-central
2661         - autoland
2662         - mozilla-release
2663         - mozilla-beta
2664       * - **browsertime-benchmark-chrome-speedometer3**
2665         - ❌
2666         - ❌
2667         - ❌
2668         - ❌
2669       * - **browsertime-benchmark-chromium-speedometer3**
2670         - ❌
2671         - ❌
2672         - ❌
2673         - ❌
2674       * - **browsertime-benchmark-firefox-speedometer3**
2675         - ✅
2676         - ✅
2677         - ✅
2678         - ❌
2679
2680
2681
2682 .. dropdown:: stylebench
2683    :class-container: anchor-id-stylebench-b
2684
2685    **Owner**: :emelio and Layout Team
2686
2687    * **alert threshold**: 2.0
2688    * **apps**: firefox, chrome, chromium, safari
2689    * **expected**: pass
2690    * **gecko profile entries**: 8000000
2691    * **gecko profile interval**: 1
2692    * **lower is better**: false
2693    * **page cycles**: 5
2694    * **page timeout**: 120000
2695    * **subtest lower is better**: true
2696    * **subtest unit**: ms
2697    * **test url**: `<http://\<host\>:\<port\>/StyleBench/index.html?raptor>`__
2698    * **type**: benchmark
2699    * **unit**: score
2700    * **Test Task**:
2701
2702    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2703       :widths: 30 15 15 15 15
2704       :header-rows: 1
2705
2706       * - **Test Name**
2707         - mozilla-central
2708         - autoland
2709         - mozilla-release
2710         - mozilla-beta
2711       * - **browsertime-benchmark-firefox-stylebench**
2712         - ❌
2713         - ❌
2714         - ❌
2715         - ❌
2716
2717
2718    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
2719       :widths: 30 15 15 15 15
2720       :header-rows: 1
2721
2722       * - **Test Name**
2723         - mozilla-central
2724         - autoland
2725         - mozilla-release
2726         - mozilla-beta
2727       * - **browsertime-benchmark-firefox-stylebench**
2728         - ❌
2729         - ❌
2730         - ❌
2731         - ❌
2732
2733
2734    .. list-table:: **test-linux1804-64-qr/opt**
2735       :widths: 30 15 15 15 15
2736       :header-rows: 1
2737
2738       * - **Test Name**
2739         - mozilla-central
2740         - autoland
2741         - mozilla-release
2742         - mozilla-beta
2743       * - **browsertime-benchmark-firefox-stylebench**
2744         - ❌
2745         - ❌
2746         - ❌
2747         - ❌
2748
2749
2750    .. list-table:: **test-linux1804-64-shippable-qr/opt**
2751       :widths: 30 15 15 15 15
2752       :header-rows: 1
2753
2754       * - **Test Name**
2755         - mozilla-central
2756         - autoland
2757         - mozilla-release
2758         - mozilla-beta
2759       * - **browsertime-benchmark-chrome-stylebench**
2760         - ❌
2761         - ❌
2762         - ❌
2763         - ❌
2764       * - **browsertime-benchmark-chromium-stylebench**
2765         - ❌
2766         - ❌
2767         - ❌
2768         - ❌
2769       * - **browsertime-benchmark-firefox-stylebench**
2770         - ✅
2771         - ✅
2772         - ❌
2773         - ❌
2774
2775
2776    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
2777       :widths: 30 15 15 15 15
2778       :header-rows: 1
2779
2780       * - **Test Name**
2781         - mozilla-central
2782         - autoland
2783         - mozilla-release
2784         - mozilla-beta
2785       * - **browsertime-benchmark-firefox-stylebench**
2786         - ❌
2787         - ❌
2788         - ❌
2789         - ❌
2790
2791
2792    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2793       :widths: 30 15 15 15 15
2794       :header-rows: 1
2795
2796       * - **Test Name**
2797         - mozilla-central
2798         - autoland
2799         - mozilla-release
2800         - mozilla-beta
2801       * - **browsertime-benchmark-chrome-stylebench**
2802         - ❌
2803         - ❌
2804         - ❌
2805         - ❌
2806       * - **browsertime-benchmark-chromium-stylebench**
2807         - ❌
2808         - ❌
2809         - ❌
2810         - ❌
2811       * - **browsertime-benchmark-firefox-stylebench**
2812         - ✅
2813         - ✅
2814         - ❌
2815         - ❌
2816       * - **browsertime-benchmark-safari-stylebench**
2817         - ❌
2818         - ❌
2819         - ❌
2820         - ❌
2821
2822
2823    .. list-table:: **test-windows10-32-qr/opt**
2824       :widths: 30 15 15 15 15
2825       :header-rows: 1
2826
2827       * - **Test Name**
2828         - mozilla-central
2829         - autoland
2830         - mozilla-release
2831         - mozilla-beta
2832       * - **browsertime-benchmark-firefox-stylebench**
2833         - ❌
2834         - ❌
2835         - ❌
2836         - ❌
2837
2838
2839    .. list-table:: **test-windows10-32-shippable-qr/opt**
2840       :widths: 30 15 15 15 15
2841       :header-rows: 1
2842
2843       * - **Test Name**
2844         - mozilla-central
2845         - autoland
2846         - mozilla-release
2847         - mozilla-beta
2848       * - **browsertime-benchmark-chrome-stylebench**
2849         - ❌
2850         - ❌
2851         - ❌
2852         - ❌
2853       * - **browsertime-benchmark-chromium-stylebench**
2854         - ❌
2855         - ❌
2856         - ❌
2857         - ❌
2858       * - **browsertime-benchmark-firefox-stylebench**
2859         - ❌
2860         - ❌
2861         - ❌
2862         - ❌
2863
2864
2865    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
2866       :widths: 30 15 15 15 15
2867       :header-rows: 1
2868
2869       * - **Test Name**
2870         - mozilla-central
2871         - autoland
2872         - mozilla-release
2873         - mozilla-beta
2874       * - **browsertime-benchmark-firefox-stylebench**
2875         - ❌
2876         - ❌
2877         - ❌
2878         - ❌
2879
2880
2881    .. list-table:: **test-windows10-64-qr/opt**
2882       :widths: 30 15 15 15 15
2883       :header-rows: 1
2884
2885       * - **Test Name**
2886         - mozilla-central
2887         - autoland
2888         - mozilla-release
2889         - mozilla-beta
2890       * - **browsertime-benchmark-firefox-stylebench**
2891         - ❌
2892         - ❌
2893         - ❌
2894         - ❌
2895
2896
2897    .. list-table:: **test-windows10-64-shippable-qr/opt**
2898       :widths: 30 15 15 15 15
2899       :header-rows: 1
2900
2901       * - **Test Name**
2902         - mozilla-central
2903         - autoland
2904         - mozilla-release
2905         - mozilla-beta
2906       * - **browsertime-benchmark-chrome-stylebench**
2907         - ❌
2908         - ❌
2909         - ❌
2910         - ❌
2911       * - **browsertime-benchmark-chromium-stylebench**
2912         - ❌
2913         - ❌
2914         - ❌
2915         - ❌
2916       * - **browsertime-benchmark-firefox-stylebench**
2917         - ✅
2918         - ✅
2919         - ✅
2920         - ✅
2921
2922
2923
2924 .. dropdown:: sunspider
2925    :class-container: anchor-id-sunspider-b
2926
2927    **Owner**: :jandem and SpiderMonkey Team
2928
2929    * **alert threshold**: 2.0
2930    * **apps**: firefox, chrome, chromium, safari
2931    * **expected**: pass
2932    * **gecko profile entries**: 8000000
2933    * **gecko profile interval**: 1
2934    * **lower is better**: true
2935    * **page cycles**: 5
2936    * **page timeout**: 55000
2937    * **test url**: `<http://\<host\>:\<port\>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__
2938    * **type**: benchmark
2939    * **unit**: ms
2940    * **Test Task**:
2941
2942    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2943       :widths: 30 15 15 15 15
2944       :header-rows: 1
2945
2946       * - **Test Name**
2947         - mozilla-central
2948         - autoland
2949         - mozilla-release
2950         - mozilla-beta
2951       * - **browsertime-benchmark-firefox-sunspider**
2952         - ❌
2953         - ❌
2954         - ❌
2955         - ❌
2956
2957
2958    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
2959       :widths: 30 15 15 15 15
2960       :header-rows: 1
2961
2962       * - **Test Name**
2963         - mozilla-central
2964         - autoland
2965         - mozilla-release
2966         - mozilla-beta
2967       * - **browsertime-benchmark-firefox-sunspider**
2968         - ❌
2969         - ❌
2970         - ❌
2971         - ❌
2972
2973
2974    .. list-table:: **test-linux1804-64-qr/opt**
2975       :widths: 30 15 15 15 15
2976       :header-rows: 1
2977
2978       * - **Test Name**
2979         - mozilla-central
2980         - autoland
2981         - mozilla-release
2982         - mozilla-beta
2983       * - **browsertime-benchmark-firefox-sunspider**
2984         - ❌
2985         - ❌
2986         - ❌
2987         - ❌
2988
2989
2990    .. list-table:: **test-linux1804-64-shippable-qr/opt**
2991       :widths: 30 15 15 15 15
2992       :header-rows: 1
2993
2994       * - **Test Name**
2995         - mozilla-central
2996         - autoland
2997         - mozilla-release
2998         - mozilla-beta
2999       * - **browsertime-benchmark-chrome-sunspider**
3000         - ❌
3001         - ❌
3002         - ❌
3003         - ❌
3004       * - **browsertime-benchmark-chromium-sunspider**
3005         - ❌
3006         - ❌
3007         - ❌
3008         - ❌
3009       * - **browsertime-benchmark-firefox-sunspider**
3010         - ✅
3011         - ✅
3012         - ❌
3013         - ❌
3014
3015
3016    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
3017       :widths: 30 15 15 15 15
3018       :header-rows: 1
3019
3020       * - **Test Name**
3021         - mozilla-central
3022         - autoland
3023         - mozilla-release
3024         - mozilla-beta
3025       * - **browsertime-benchmark-firefox-sunspider**
3026         - ❌
3027         - ❌
3028         - ❌
3029         - ❌
3030
3031
3032    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3033       :widths: 30 15 15 15 15
3034       :header-rows: 1
3035
3036       * - **Test Name**
3037         - mozilla-central
3038         - autoland
3039         - mozilla-release
3040         - mozilla-beta
3041       * - **browsertime-benchmark-chrome-sunspider**
3042         - ❌
3043         - ❌
3044         - ❌
3045         - ❌
3046       * - **browsertime-benchmark-chromium-sunspider**
3047         - ❌
3048         - ❌
3049         - ❌
3050         - ❌
3051       * - **browsertime-benchmark-firefox-sunspider**
3052         - ✅
3053         - ✅
3054         - ❌
3055         - ❌
3056       * - **browsertime-benchmark-safari-sunspider**
3057         - ❌
3058         - ❌
3059         - ❌
3060         - ❌
3061
3062
3063    .. list-table:: **test-windows10-32-qr/opt**
3064       :widths: 30 15 15 15 15
3065       :header-rows: 1
3066
3067       * - **Test Name**
3068         - mozilla-central
3069         - autoland
3070         - mozilla-release
3071         - mozilla-beta
3072       * - **browsertime-benchmark-firefox-sunspider**
3073         - ❌
3074         - ❌
3075         - ❌
3076         - ❌
3077
3078
3079    .. list-table:: **test-windows10-32-shippable-qr/opt**
3080       :widths: 30 15 15 15 15
3081       :header-rows: 1
3082
3083       * - **Test Name**
3084         - mozilla-central
3085         - autoland
3086         - mozilla-release
3087         - mozilla-beta
3088       * - **browsertime-benchmark-chrome-sunspider**
3089         - ❌
3090         - ❌
3091         - ❌
3092         - ❌
3093       * - **browsertime-benchmark-chromium-sunspider**
3094         - ❌
3095         - ❌
3096         - ❌
3097         - ❌
3098       * - **browsertime-benchmark-firefox-sunspider**
3099         - ❌
3100         - ❌
3101         - ❌
3102         - ❌
3103
3104
3105    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
3106       :widths: 30 15 15 15 15
3107       :header-rows: 1
3108
3109       * - **Test Name**
3110         - mozilla-central
3111         - autoland
3112         - mozilla-release
3113         - mozilla-beta
3114       * - **browsertime-benchmark-firefox-sunspider**
3115         - ❌
3116         - ❌
3117         - ❌
3118         - ❌
3119
3120
3121    .. list-table:: **test-windows10-64-qr/opt**
3122       :widths: 30 15 15 15 15
3123       :header-rows: 1
3124
3125       * - **Test Name**
3126         - mozilla-central
3127         - autoland
3128         - mozilla-release
3129         - mozilla-beta
3130       * - **browsertime-benchmark-firefox-sunspider**
3131         - ❌
3132         - ❌
3133         - ❌
3134         - ❌
3135
3136
3137    .. list-table:: **test-windows10-64-shippable-qr/opt**
3138       :widths: 30 15 15 15 15
3139       :header-rows: 1
3140
3141       * - **Test Name**
3142         - mozilla-central
3143         - autoland
3144         - mozilla-release
3145         - mozilla-beta
3146       * - **browsertime-benchmark-chrome-sunspider**
3147         - ❌
3148         - ❌
3149         - ❌
3150         - ❌
3151       * - **browsertime-benchmark-chromium-sunspider**
3152         - ❌
3153         - ❌
3154         - ❌
3155         - ❌
3156       * - **browsertime-benchmark-firefox-sunspider**
3157         - ✅
3158         - ✅
3159         - ✅
3160         - ✅
3161
3162
3163
3164 .. dropdown:: twitch-animation
3165    :class-container: anchor-id-twitch-animation-b
3166
3167    **Owner**: :jrmuizel
3168
3169    * **alert threshold**: 2.0
3170    * **apps**: firefox
3171    * **expected**: pass
3172    * **gecko profile entries**: 14000000
3173    * **gecko profile interval**: 1
3174    * **lower is better**: true
3175    * **page cycles**: 1
3176    * **page timeout**: 2000000
3177    * **perfstats**: true
3178    * **repository**: https://github.com/mozilla/perf-automation
3179    * **repository path**: benchmarks/twitch-animation
3180    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
3181    * **subtest lower is better**: true
3182    * **subtest unit**: ms
3183    * **test url**: `<http://\<host\>:\<port\>/index.html>`__
3184    * **type**: benchmark
3185    * **unit**: ms
3186    * **Test Task**:
3187
3188    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3189       :widths: 30 15 15 15 15
3190       :header-rows: 1
3191
3192       * - **Test Name**
3193         - mozilla-central
3194         - autoland
3195         - mozilla-release
3196         - mozilla-beta
3197       * - **browsertime-benchmark-firefox-twitch-animation**
3198         - ❌
3199         - ❌
3200         - ❌
3201         - ❌
3202
3203
3204    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
3205       :widths: 30 15 15 15 15
3206       :header-rows: 1
3207
3208       * - **Test Name**
3209         - mozilla-central
3210         - autoland
3211         - mozilla-release
3212         - mozilla-beta
3213       * - **browsertime-benchmark-firefox-twitch-animation**
3214         - ❌
3215         - ❌
3216         - ❌
3217         - ❌
3218
3219
3220    .. list-table:: **test-linux1804-64-qr/opt**
3221       :widths: 30 15 15 15 15
3222       :header-rows: 1
3223
3224       * - **Test Name**
3225         - mozilla-central
3226         - autoland
3227         - mozilla-release
3228         - mozilla-beta
3229       * - **browsertime-benchmark-firefox-twitch-animation**
3230         - ❌
3231         - ❌
3232         - ❌
3233         - ❌
3234
3235
3236    .. list-table:: **test-linux1804-64-shippable-qr/opt**
3237       :widths: 30 15 15 15 15
3238       :header-rows: 1
3239
3240       * - **Test Name**
3241         - mozilla-central
3242         - autoland
3243         - mozilla-release
3244         - mozilla-beta
3245       * - **browsertime-benchmark-firefox-twitch-animation**
3246         - ✅
3247         - ✅
3248         - ❌
3249         - ❌
3250
3251
3252    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
3253       :widths: 30 15 15 15 15
3254       :header-rows: 1
3255
3256       * - **Test Name**
3257         - mozilla-central
3258         - autoland
3259         - mozilla-release
3260         - mozilla-beta
3261       * - **browsertime-benchmark-firefox-twitch-animation**
3262         - ❌
3263         - ❌
3264         - ❌
3265         - ❌
3266
3267
3268    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3269       :widths: 30 15 15 15 15
3270       :header-rows: 1
3271
3272       * - **Test Name**
3273         - mozilla-central
3274         - autoland
3275         - mozilla-release
3276         - mozilla-beta
3277       * - **browsertime-benchmark-firefox-twitch-animation**
3278         - ✅
3279         - ✅
3280         - ❌
3281         - ❌
3282
3283
3284    .. list-table:: **test-windows10-32-qr/opt**
3285       :widths: 30 15 15 15 15
3286       :header-rows: 1
3287
3288       * - **Test Name**
3289         - mozilla-central
3290         - autoland
3291         - mozilla-release
3292         - mozilla-beta
3293       * - **browsertime-benchmark-firefox-twitch-animation**
3294         - ❌
3295         - ❌
3296         - ❌
3297         - ❌
3298
3299
3300    .. list-table:: **test-windows10-32-shippable-qr/opt**
3301       :widths: 30 15 15 15 15
3302       :header-rows: 1
3303
3304       * - **Test Name**
3305         - mozilla-central
3306         - autoland
3307         - mozilla-release
3308         - mozilla-beta
3309       * - **browsertime-benchmark-firefox-twitch-animation**
3310         - ❌
3311         - ❌
3312         - ❌
3313         - ❌
3314
3315
3316    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
3317       :widths: 30 15 15 15 15
3318       :header-rows: 1
3319
3320       * - **Test Name**
3321         - mozilla-central
3322         - autoland
3323         - mozilla-release
3324         - mozilla-beta
3325       * - **browsertime-benchmark-firefox-twitch-animation**
3326         - ❌
3327         - ❌
3328         - ❌
3329         - ❌
3330
3331
3332    .. list-table:: **test-windows10-64-qr/opt**
3333       :widths: 30 15 15 15 15
3334       :header-rows: 1
3335
3336       * - **Test Name**
3337         - mozilla-central
3338         - autoland
3339         - mozilla-release
3340         - mozilla-beta
3341       * - **browsertime-benchmark-firefox-twitch-animation**
3342         - ❌
3343         - ❌
3344         - ❌
3345         - ❌
3346
3347
3348    .. list-table:: **test-windows10-64-shippable-qr/opt**
3349       :widths: 30 15 15 15 15
3350       :header-rows: 1
3351
3352       * - **Test Name**
3353         - mozilla-central
3354         - autoland
3355         - mozilla-release
3356         - mozilla-beta
3357       * - **browsertime-benchmark-firefox-twitch-animation**
3358         - ✅
3359         - ✅
3360         - ✅
3361         - ✅
3362
3363
3364
3365 .. dropdown:: unity-webgl
3366    :class-container: anchor-id-unity-webgl-b
3367
3368    **Owner**: :jgilbert and Graphics(gfx) Team
3369
3370    * **alert threshold**: 2.0
3371    * **apps**: geckoview, refbrow, fenix, chrome-m
3372    * **expected**: pass
3373    * **gecko profile entries**: 8000000
3374    * **gecko profile interval**: 1
3375    * **lower is better**: false
3376    * **page cycles**: 1
3377    * **page timeout**: 420000
3378    * **repository**: https://github.com/mozilla/perf-automation
3379    * **repository path**: benchmarks/unity-webgl
3380    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
3381    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
3382    * **type**: benchmark
3383    * **unit**: score
3384    * **Test Task**:
3385
3386    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
3387       :widths: 30 15 15 15 15
3388       :header-rows: 1
3389
3390       * - **Test Name**
3391         - mozilla-central
3392         - autoland
3393         - mozilla-release
3394         - mozilla-beta
3395       * - **browsertime-unity-webgl-mobile-fenix-nofis**
3396         - ❌
3397         - ❌
3398         - ❌
3399         - ❌
3400       * - **browsertime-unity-webgl-mobile-geckoview-nofis**
3401         - ❌
3402         - ❌
3403         - ❌
3404         - ❌
3405
3406
3407    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
3408       :widths: 30 15 15 15 15
3409       :header-rows: 1
3410
3411       * - **Test Name**
3412         - mozilla-central
3413         - autoland
3414         - mozilla-release
3415         - mozilla-beta
3416       * - **browsertime-unity-webgl-mobile-chrome-m-nofis**
3417         - ✅
3418         - ❌
3419         - ❌
3420         - ❌
3421       * - **browsertime-unity-webgl-mobile-fenix-nofis**
3422         - ✅
3423         - ❌
3424         - ❌
3425         - ❌
3426       * - **browsertime-unity-webgl-mobile-geckoview-nofis**
3427         - ✅
3428         - ✅
3429         - ❌
3430         - ❌
3431
3432
3433    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3434       :widths: 30 15 15 15 15
3435       :header-rows: 1
3436
3437       * - **Test Name**
3438         - mozilla-central
3439         - autoland
3440         - mozilla-release
3441         - mozilla-beta
3442       * - **browsertime-benchmark-firefox-unity-webgl**
3443         - ❌
3444         - ❌
3445         - ❌
3446         - ❌
3447
3448
3449    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
3450       :widths: 30 15 15 15 15
3451       :header-rows: 1
3452
3453       * - **Test Name**
3454         - mozilla-central
3455         - autoland
3456         - mozilla-release
3457         - mozilla-beta
3458       * - **browsertime-benchmark-firefox-unity-webgl**
3459         - ❌
3460         - ❌
3461         - ❌
3462         - ❌
3463
3464
3465    .. list-table:: **test-linux1804-64-qr/opt**
3466       :widths: 30 15 15 15 15
3467       :header-rows: 1
3468
3469       * - **Test Name**
3470         - mozilla-central
3471         - autoland
3472         - mozilla-release
3473         - mozilla-beta
3474       * - **browsertime-benchmark-firefox-unity-webgl**
3475         - ❌
3476         - ❌
3477         - ❌
3478         - ❌
3479
3480
3481    .. list-table:: **test-linux1804-64-shippable-qr/opt**
3482       :widths: 30 15 15 15 15
3483       :header-rows: 1
3484
3485       * - **Test Name**
3486         - mozilla-central
3487         - autoland
3488         - mozilla-release
3489         - mozilla-beta
3490       * - **browsertime-benchmark-chrome-unity-webgl**
3491         - ❌
3492         - ❌
3493         - ❌
3494         - ❌
3495       * - **browsertime-benchmark-chromium-unity-webgl**
3496         - ❌
3497         - ❌
3498         - ❌
3499         - ❌
3500       * - **browsertime-benchmark-firefox-unity-webgl**
3501         - ✅
3502         - ✅
3503         - ❌
3504         - ❌
3505
3506
3507    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
3508       :widths: 30 15 15 15 15
3509       :header-rows: 1
3510
3511       * - **Test Name**
3512         - mozilla-central
3513         - autoland
3514         - mozilla-release
3515         - mozilla-beta
3516       * - **browsertime-benchmark-firefox-unity-webgl**
3517         - ❌
3518         - ❌
3519         - ❌
3520         - ❌
3521
3522
3523    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3524       :widths: 30 15 15 15 15
3525       :header-rows: 1
3526
3527       * - **Test Name**
3528         - mozilla-central
3529         - autoland
3530         - mozilla-release
3531         - mozilla-beta
3532       * - **browsertime-benchmark-chrome-unity-webgl**
3533         - ❌
3534         - ❌
3535         - ❌
3536         - ❌
3537       * - **browsertime-benchmark-chromium-unity-webgl**
3538         - ❌
3539         - ❌
3540         - ❌
3541         - ❌
3542       * - **browsertime-benchmark-firefox-unity-webgl**
3543         - ✅
3544         - ✅
3545         - ❌
3546         - ❌
3547       * - **browsertime-benchmark-safari-unity-webgl**
3548         - ❌
3549         - ❌
3550         - ❌
3551         - ❌
3552
3553
3554    .. list-table:: **test-windows10-32-qr/opt**
3555       :widths: 30 15 15 15 15
3556       :header-rows: 1
3557
3558       * - **Test Name**
3559         - mozilla-central
3560         - autoland
3561         - mozilla-release
3562         - mozilla-beta
3563       * - **browsertime-benchmark-firefox-unity-webgl**
3564         - ❌
3565         - ❌
3566         - ❌
3567         - ❌
3568
3569
3570    .. list-table:: **test-windows10-32-shippable-qr/opt**
3571       :widths: 30 15 15 15 15
3572       :header-rows: 1
3573
3574       * - **Test Name**
3575         - mozilla-central
3576         - autoland
3577         - mozilla-release
3578         - mozilla-beta
3579       * - **browsertime-benchmark-chrome-unity-webgl**
3580         - ❌
3581         - ❌
3582         - ❌
3583         - ❌
3584       * - **browsertime-benchmark-chromium-unity-webgl**
3585         - ❌
3586         - ❌
3587         - ❌
3588         - ❌
3589       * - **browsertime-benchmark-firefox-unity-webgl**
3590         - ❌
3591         - ❌
3592         - ❌
3593         - ❌
3594
3595
3596    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
3597       :widths: 30 15 15 15 15
3598       :header-rows: 1
3599
3600       * - **Test Name**
3601         - mozilla-central
3602         - autoland
3603         - mozilla-release
3604         - mozilla-beta
3605       * - **browsertime-benchmark-firefox-unity-webgl**
3606         - ❌
3607         - ❌
3608         - ❌
3609         - ❌
3610
3611
3612    .. list-table:: **test-windows10-64-qr/opt**
3613       :widths: 30 15 15 15 15
3614       :header-rows: 1
3615
3616       * - **Test Name**
3617         - mozilla-central
3618         - autoland
3619         - mozilla-release
3620         - mozilla-beta
3621       * - **browsertime-benchmark-firefox-unity-webgl**
3622         - ❌
3623         - ❌
3624         - ❌
3625         - ❌
3626
3627
3628    .. list-table:: **test-windows10-64-shippable-qr/opt**
3629       :widths: 30 15 15 15 15
3630       :header-rows: 1
3631
3632       * - **Test Name**
3633         - mozilla-central
3634         - autoland
3635         - mozilla-release
3636         - mozilla-beta
3637       * - **browsertime-benchmark-chrome-unity-webgl**
3638         - ❌
3639         - ❌
3640         - ❌
3641         - ❌
3642       * - **browsertime-benchmark-chromium-unity-webgl**
3643         - ❌
3644         - ❌
3645         - ❌
3646         - ❌
3647       * - **browsertime-benchmark-firefox-unity-webgl**
3648         - ✅
3649         - ✅
3650         - ✅
3651         - ❌
3652
3653
3654    **Owner**: :jgilbert and Graphics(gfx) Team
3655
3656    * **alert threshold**: 2.0
3657    * **apps**: firefox, chrome, chromium, safari
3658    * **expected**: pass
3659    * **gecko profile entries**: 8000000
3660    * **gecko profile interval**: 1
3661    * **lower is better**: false
3662    * **page cycles**: 5
3663    * **page timeout**: 420000
3664    * **repository**: https://github.com/mozilla/perf-automation
3665    * **repository path**: benchmarks/unity-webgl
3666    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
3667    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
3668    * **type**: benchmark
3669    * **unit**: score
3670    * **Test Task**:
3671
3672    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
3673       :widths: 30 15 15 15 15
3674       :header-rows: 1
3675
3676       * - **Test Name**
3677         - mozilla-central
3678         - autoland
3679         - mozilla-release
3680         - mozilla-beta
3681       * - **browsertime-unity-webgl-mobile-fenix-nofis**
3682         - ❌
3683         - ❌
3684         - ❌
3685         - ❌
3686       * - **browsertime-unity-webgl-mobile-geckoview-nofis**
3687         - ❌
3688         - ❌
3689         - ❌
3690         - ❌
3691
3692
3693    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
3694       :widths: 30 15 15 15 15
3695       :header-rows: 1
3696
3697       * - **Test Name**
3698         - mozilla-central
3699         - autoland
3700         - mozilla-release
3701         - mozilla-beta
3702       * - **browsertime-unity-webgl-mobile-chrome-m-nofis**
3703         - ✅
3704         - ❌
3705         - ❌
3706         - ❌
3707       * - **browsertime-unity-webgl-mobile-fenix-nofis**
3708         - ✅
3709         - ❌
3710         - ❌
3711         - ❌
3712       * - **browsertime-unity-webgl-mobile-geckoview-nofis**
3713         - ✅
3714         - ✅
3715         - ❌
3716         - ❌
3717
3718
3719    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3720       :widths: 30 15 15 15 15
3721       :header-rows: 1
3722
3723       * - **Test Name**
3724         - mozilla-central
3725         - autoland
3726         - mozilla-release
3727         - mozilla-beta
3728       * - **browsertime-benchmark-firefox-unity-webgl**
3729         - ❌
3730         - ❌
3731         - ❌
3732         - ❌
3733
3734
3735    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
3736       :widths: 30 15 15 15 15
3737       :header-rows: 1
3738
3739       * - **Test Name**
3740         - mozilla-central
3741         - autoland
3742         - mozilla-release
3743         - mozilla-beta
3744       * - **browsertime-benchmark-firefox-unity-webgl**
3745         - ❌
3746         - ❌
3747         - ❌
3748         - ❌
3749
3750
3751    .. list-table:: **test-linux1804-64-qr/opt**
3752       :widths: 30 15 15 15 15
3753       :header-rows: 1
3754
3755       * - **Test Name**
3756         - mozilla-central
3757         - autoland
3758         - mozilla-release
3759         - mozilla-beta
3760       * - **browsertime-benchmark-firefox-unity-webgl**
3761         - ❌
3762         - ❌
3763         - ❌
3764         - ❌
3765
3766
3767    .. list-table:: **test-linux1804-64-shippable-qr/opt**
3768       :widths: 30 15 15 15 15
3769       :header-rows: 1
3770
3771       * - **Test Name**
3772         - mozilla-central
3773         - autoland
3774         - mozilla-release
3775         - mozilla-beta
3776       * - **browsertime-benchmark-chrome-unity-webgl**
3777         - ❌
3778         - ❌
3779         - ❌
3780         - ❌
3781       * - **browsertime-benchmark-chromium-unity-webgl**
3782         - ❌
3783         - ❌
3784         - ❌
3785         - ❌
3786       * - **browsertime-benchmark-firefox-unity-webgl**
3787         - ✅
3788         - ✅
3789         - ❌
3790         - ❌
3791
3792
3793    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
3794       :widths: 30 15 15 15 15
3795       :header-rows: 1
3796
3797       * - **Test Name**
3798         - mozilla-central
3799         - autoland
3800         - mozilla-release
3801         - mozilla-beta
3802       * - **browsertime-benchmark-firefox-unity-webgl**
3803         - ❌
3804         - ❌
3805         - ❌
3806         - ❌
3807
3808
3809    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3810       :widths: 30 15 15 15 15
3811       :header-rows: 1
3812
3813       * - **Test Name**
3814         - mozilla-central
3815         - autoland
3816         - mozilla-release
3817         - mozilla-beta
3818       * - **browsertime-benchmark-chrome-unity-webgl**
3819         - ❌
3820         - ❌
3821         - ❌
3822         - ❌
3823       * - **browsertime-benchmark-chromium-unity-webgl**
3824         - ❌
3825         - ❌
3826         - ❌
3827         - ❌
3828       * - **browsertime-benchmark-firefox-unity-webgl**
3829         - ✅
3830         - ✅
3831         - ❌
3832         - ❌
3833       * - **browsertime-benchmark-safari-unity-webgl**
3834         - ❌
3835         - ❌
3836         - ❌
3837         - ❌
3838
3839
3840    .. list-table:: **test-windows10-32-qr/opt**
3841       :widths: 30 15 15 15 15
3842       :header-rows: 1
3843
3844       * - **Test Name**
3845         - mozilla-central
3846         - autoland
3847         - mozilla-release
3848         - mozilla-beta
3849       * - **browsertime-benchmark-firefox-unity-webgl**
3850         - ❌
3851         - ❌
3852         - ❌
3853         - ❌
3854
3855
3856    .. list-table:: **test-windows10-32-shippable-qr/opt**
3857       :widths: 30 15 15 15 15
3858       :header-rows: 1
3859
3860       * - **Test Name**
3861         - mozilla-central
3862         - autoland
3863         - mozilla-release
3864         - mozilla-beta
3865       * - **browsertime-benchmark-chrome-unity-webgl**
3866         - ❌
3867         - ❌
3868         - ❌
3869         - ❌
3870       * - **browsertime-benchmark-chromium-unity-webgl**
3871         - ❌
3872         - ❌
3873         - ❌
3874         - ❌
3875       * - **browsertime-benchmark-firefox-unity-webgl**
3876         - ❌
3877         - ❌
3878         - ❌
3879         - ❌
3880
3881
3882    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
3883       :widths: 30 15 15 15 15
3884       :header-rows: 1
3885
3886       * - **Test Name**
3887         - mozilla-central
3888         - autoland
3889         - mozilla-release
3890         - mozilla-beta
3891       * - **browsertime-benchmark-firefox-unity-webgl**
3892         - ❌
3893         - ❌
3894         - ❌
3895         - ❌
3896
3897
3898    .. list-table:: **test-windows10-64-qr/opt**
3899       :widths: 30 15 15 15 15
3900       :header-rows: 1
3901
3902       * - **Test Name**
3903         - mozilla-central
3904         - autoland
3905         - mozilla-release
3906         - mozilla-beta
3907       * - **browsertime-benchmark-firefox-unity-webgl**
3908         - ❌
3909         - ❌
3910         - ❌
3911         - ❌
3912
3913
3914    .. list-table:: **test-windows10-64-shippable-qr/opt**
3915       :widths: 30 15 15 15 15
3916       :header-rows: 1
3917
3918       * - **Test Name**
3919         - mozilla-central
3920         - autoland
3921         - mozilla-release
3922         - mozilla-beta
3923       * - **browsertime-benchmark-chrome-unity-webgl**
3924         - ❌
3925         - ❌
3926         - ❌
3927         - ❌
3928       * - **browsertime-benchmark-chromium-unity-webgl**
3929         - ❌
3930         - ❌
3931         - ❌
3932         - ❌
3933       * - **browsertime-benchmark-firefox-unity-webgl**
3934         - ✅
3935         - ✅
3936         - ✅
3937         - ❌
3938
3939
3940
3941 .. dropdown:: wasm-godot
3942    :class-container: anchor-id-wasm-godot-b
3943
3944    **Owner**: :lth and SpiderMonkey Team
3945
3946    * **alert threshold**: 2.0
3947    * **apps**: firefox, chrome, chromium
3948    * **expected**: pass
3949    * **gecko profile entries**: 8000000
3950    * **gecko profile interval**: 1
3951    * **lower is better**: true
3952    * **newtab per cycle**: true
3953    * **page cycles**: 5
3954    * **page timeout**: 120000
3955    * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
3956    * **type**: benchmark
3957    * **unit**: ms
3958    * **Test Task**:
3959
3960    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3961       :widths: 30 15 15 15 15
3962       :header-rows: 1
3963
3964       * - **Test Name**
3965         - mozilla-central
3966         - autoland
3967         - mozilla-release
3968         - mozilla-beta
3969       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
3970         - ❌
3971         - ❌
3972         - ❌
3973         - ❌
3974
3975
3976    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
3977       :widths: 30 15 15 15 15
3978       :header-rows: 1
3979
3980       * - **Test Name**
3981         - mozilla-central
3982         - autoland
3983         - mozilla-release
3984         - mozilla-beta
3985       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
3986         - ❌
3987         - ❌
3988         - ❌
3989         - ❌
3990
3991
3992    .. list-table:: **test-linux1804-64-qr/opt**
3993       :widths: 30 15 15 15 15
3994       :header-rows: 1
3995
3996       * - **Test Name**
3997         - mozilla-central
3998         - autoland
3999         - mozilla-release
4000         - mozilla-beta
4001       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4002         - ❌
4003         - ❌
4004         - ❌
4005         - ❌
4006
4007
4008    .. list-table:: **test-linux1804-64-shippable-qr/opt**
4009       :widths: 30 15 15 15 15
4010       :header-rows: 1
4011
4012       * - **Test Name**
4013         - mozilla-central
4014         - autoland
4015         - mozilla-release
4016         - mozilla-beta
4017       * - **browsertime-benchmark-wasm-chrome-wasm-godot**
4018         - ❌
4019         - ❌
4020         - ❌
4021         - ❌
4022       * - **browsertime-benchmark-wasm-chromium-wasm-godot**
4023         - ❌
4024         - ❌
4025         - ❌
4026         - ❌
4027       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4028         - ✅
4029         - ❌
4030         - ✅
4031         - ❌
4032
4033
4034    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
4035       :widths: 30 15 15 15 15
4036       :header-rows: 1
4037
4038       * - **Test Name**
4039         - mozilla-central
4040         - autoland
4041         - mozilla-release
4042         - mozilla-beta
4043       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4044         - ❌
4045         - ❌
4046         - ❌
4047         - ❌
4048
4049
4050    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4051       :widths: 30 15 15 15 15
4052       :header-rows: 1
4053
4054       * - **Test Name**
4055         - mozilla-central
4056         - autoland
4057         - mozilla-release
4058         - mozilla-beta
4059       * - **browsertime-benchmark-wasm-chrome-wasm-godot**
4060         - ❌
4061         - ❌
4062         - ❌
4063         - ❌
4064       * - **browsertime-benchmark-wasm-chromium-wasm-godot**
4065         - ❌
4066         - ❌
4067         - ❌
4068         - ❌
4069       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4070         - ✅
4071         - ❌
4072         - ✅
4073         - ❌
4074
4075
4076    .. list-table:: **test-windows10-32-qr/opt**
4077       :widths: 30 15 15 15 15
4078       :header-rows: 1
4079
4080       * - **Test Name**
4081         - mozilla-central
4082         - autoland
4083         - mozilla-release
4084         - mozilla-beta
4085       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4086         - ❌
4087         - ❌
4088         - ❌
4089         - ❌
4090
4091
4092    .. list-table:: **test-windows10-32-shippable-qr/opt**
4093       :widths: 30 15 15 15 15
4094       :header-rows: 1
4095
4096       * - **Test Name**
4097         - mozilla-central
4098         - autoland
4099         - mozilla-release
4100         - mozilla-beta
4101       * - **browsertime-benchmark-wasm-chrome-wasm-godot**
4102         - ❌
4103         - ❌
4104         - ❌
4105         - ❌
4106       * - **browsertime-benchmark-wasm-chromium-wasm-godot**
4107         - ❌
4108         - ❌
4109         - ❌
4110         - ❌
4111       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4112         - ❌
4113         - ❌
4114         - ❌
4115         - ❌
4116
4117
4118    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
4119       :widths: 30 15 15 15 15
4120       :header-rows: 1
4121
4122       * - **Test Name**
4123         - mozilla-central
4124         - autoland
4125         - mozilla-release
4126         - mozilla-beta
4127       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4128         - ❌
4129         - ❌
4130         - ❌
4131         - ❌
4132
4133
4134    .. list-table:: **test-windows10-64-qr/opt**
4135       :widths: 30 15 15 15 15
4136       :header-rows: 1
4137
4138       * - **Test Name**
4139         - mozilla-central
4140         - autoland
4141         - mozilla-release
4142         - mozilla-beta
4143       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4144         - ❌
4145         - ❌
4146         - ❌
4147         - ❌
4148
4149
4150    .. list-table:: **test-windows10-64-shippable-qr/opt**
4151       :widths: 30 15 15 15 15
4152       :header-rows: 1
4153
4154       * - **Test Name**
4155         - mozilla-central
4156         - autoland
4157         - mozilla-release
4158         - mozilla-beta
4159       * - **browsertime-benchmark-wasm-chrome-wasm-godot**
4160         - ❌
4161         - ❌
4162         - ❌
4163         - ❌
4164       * - **browsertime-benchmark-wasm-chromium-wasm-godot**
4165         - ❌
4166         - ❌
4167         - ❌
4168         - ❌
4169       * - **browsertime-benchmark-wasm-firefox-wasm-godot**
4170         - ✅
4171         - ❌
4172         - ✅
4173         - ❌
4174
4175
4176
4177 .. dropdown:: wasm-godot-baseline
4178    :class-container: anchor-id-wasm-godot-baseline-b
4179
4180    **Owner**: :lth and SpiderMonkey Team
4181
4182    * **alert threshold**: 2.0
4183    * **apps**: firefox
4184    * **expected**: pass
4185    * **gecko profile entries**: 8000000
4186    * **gecko profile interval**: 1
4187    * **lower is better**: true
4188    * **newtab per cycle**: true
4189    * **page cycles**: 5
4190    * **page timeout**: 120000
4191    * **preferences**: {"javascript.options.wasm_baselinejit": true, "javascript.options.wasm_optimizingjit": false}
4192    * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
4193    * **type**: benchmark
4194    * **unit**: ms
4195    * **Test Task**:
4196
4197    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4198       :widths: 30 15 15 15 15
4199       :header-rows: 1
4200
4201       * - **Test Name**
4202         - mozilla-central
4203         - autoland
4204         - mozilla-release
4205         - mozilla-beta
4206       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4207         - ❌
4208         - ❌
4209         - ❌
4210         - ❌
4211
4212
4213    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
4214       :widths: 30 15 15 15 15
4215       :header-rows: 1
4216
4217       * - **Test Name**
4218         - mozilla-central
4219         - autoland
4220         - mozilla-release
4221         - mozilla-beta
4222       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4223         - ❌
4224         - ❌
4225         - ❌
4226         - ❌
4227
4228
4229    .. list-table:: **test-linux1804-64-qr/opt**
4230       :widths: 30 15 15 15 15
4231       :header-rows: 1
4232
4233       * - **Test Name**
4234         - mozilla-central
4235         - autoland
4236         - mozilla-release
4237         - mozilla-beta
4238       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4239         - ❌
4240         - ❌
4241         - ❌
4242         - ❌
4243
4244
4245    .. list-table:: **test-linux1804-64-shippable-qr/opt**
4246       :widths: 30 15 15 15 15
4247       :header-rows: 1
4248
4249       * - **Test Name**
4250         - mozilla-central
4251         - autoland
4252         - mozilla-release
4253         - mozilla-beta
4254       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4255         - ✅
4256         - ❌
4257         - ✅
4258         - ❌
4259
4260
4261    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
4262       :widths: 30 15 15 15 15
4263       :header-rows: 1
4264
4265       * - **Test Name**
4266         - mozilla-central
4267         - autoland
4268         - mozilla-release
4269         - mozilla-beta
4270       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4271         - ❌
4272         - ❌
4273         - ❌
4274         - ❌
4275
4276
4277    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4278       :widths: 30 15 15 15 15
4279       :header-rows: 1
4280
4281       * - **Test Name**
4282         - mozilla-central
4283         - autoland
4284         - mozilla-release
4285         - mozilla-beta
4286       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4287         - ✅
4288         - ❌
4289         - ✅
4290         - ❌
4291
4292
4293    .. list-table:: **test-windows10-32-qr/opt**
4294       :widths: 30 15 15 15 15
4295       :header-rows: 1
4296
4297       * - **Test Name**
4298         - mozilla-central
4299         - autoland
4300         - mozilla-release
4301         - mozilla-beta
4302       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4303         - ❌
4304         - ❌
4305         - ❌
4306         - ❌
4307
4308
4309    .. list-table:: **test-windows10-32-shippable-qr/opt**
4310       :widths: 30 15 15 15 15
4311       :header-rows: 1
4312
4313       * - **Test Name**
4314         - mozilla-central
4315         - autoland
4316         - mozilla-release
4317         - mozilla-beta
4318       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4319         - ❌
4320         - ❌
4321         - ❌
4322         - ❌
4323
4324
4325    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
4326       :widths: 30 15 15 15 15
4327       :header-rows: 1
4328
4329       * - **Test Name**
4330         - mozilla-central
4331         - autoland
4332         - mozilla-release
4333         - mozilla-beta
4334       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4335         - ❌
4336         - ❌
4337         - ❌
4338         - ❌
4339
4340
4341    .. list-table:: **test-windows10-64-qr/opt**
4342       :widths: 30 15 15 15 15
4343       :header-rows: 1
4344
4345       * - **Test Name**
4346         - mozilla-central
4347         - autoland
4348         - mozilla-release
4349         - mozilla-beta
4350       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4351         - ❌
4352         - ❌
4353         - ❌
4354         - ❌
4355
4356
4357    .. list-table:: **test-windows10-64-shippable-qr/opt**
4358       :widths: 30 15 15 15 15
4359       :header-rows: 1
4360
4361       * - **Test Name**
4362         - mozilla-central
4363         - autoland
4364         - mozilla-release
4365         - mozilla-beta
4366       * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
4367         - ✅
4368         - ❌
4369         - ✅
4370         - ❌
4371
4372
4373
4374 .. dropdown:: wasm-godot-optimizing
4375    :class-container: anchor-id-wasm-godot-optimizing-b
4376
4377    **Owner**: :lth and SpiderMonkey Team
4378
4379    * **alert threshold**: 2.0
4380    * **apps**: firefox
4381    * **expected**: pass
4382    * **gecko profile entries**: 8000000
4383    * **gecko profile interval**: 1
4384    * **lower is better**: true
4385    * **newtab per cycle**: true
4386    * **page cycles**: 5
4387    * **page timeout**: 120000
4388    * **preferences**: {"javascript.options.wasm_baselinejit": false, "javascript.options.wasm_optimizingjit": true}
4389    * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
4390    * **type**: benchmark
4391    * **unit**: ms
4392    * **Test Task**:
4393
4394    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4395       :widths: 30 15 15 15 15
4396       :header-rows: 1
4397
4398       * - **Test Name**
4399         - mozilla-central
4400         - autoland
4401         - mozilla-release
4402         - mozilla-beta
4403       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4404         - ❌
4405         - ❌
4406         - ❌
4407         - ❌
4408
4409
4410    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
4411       :widths: 30 15 15 15 15
4412       :header-rows: 1
4413
4414       * - **Test Name**
4415         - mozilla-central
4416         - autoland
4417         - mozilla-release
4418         - mozilla-beta
4419       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4420         - ❌
4421         - ❌
4422         - ❌
4423         - ❌
4424
4425
4426    .. list-table:: **test-linux1804-64-qr/opt**
4427       :widths: 30 15 15 15 15
4428       :header-rows: 1
4429
4430       * - **Test Name**
4431         - mozilla-central
4432         - autoland
4433         - mozilla-release
4434         - mozilla-beta
4435       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4436         - ❌
4437         - ❌
4438         - ❌
4439         - ❌
4440
4441
4442    .. list-table:: **test-linux1804-64-shippable-qr/opt**
4443       :widths: 30 15 15 15 15
4444       :header-rows: 1
4445
4446       * - **Test Name**
4447         - mozilla-central
4448         - autoland
4449         - mozilla-release
4450         - mozilla-beta
4451       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4452         - ✅
4453         - ❌
4454         - ✅
4455         - ❌
4456
4457
4458    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
4459       :widths: 30 15 15 15 15
4460       :header-rows: 1
4461
4462       * - **Test Name**
4463         - mozilla-central
4464         - autoland
4465         - mozilla-release
4466         - mozilla-beta
4467       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4468         - ❌
4469         - ❌
4470         - ❌
4471         - ❌
4472
4473
4474    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4475       :widths: 30 15 15 15 15
4476       :header-rows: 1
4477
4478       * - **Test Name**
4479         - mozilla-central
4480         - autoland
4481         - mozilla-release
4482         - mozilla-beta
4483       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4484         - ✅
4485         - ❌
4486         - ✅
4487         - ❌
4488
4489
4490    .. list-table:: **test-windows10-32-qr/opt**
4491       :widths: 30 15 15 15 15
4492       :header-rows: 1
4493
4494       * - **Test Name**
4495         - mozilla-central
4496         - autoland
4497         - mozilla-release
4498         - mozilla-beta
4499       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4500         - ❌
4501         - ❌
4502         - ❌
4503         - ❌
4504
4505
4506    .. list-table:: **test-windows10-32-shippable-qr/opt**
4507       :widths: 30 15 15 15 15
4508       :header-rows: 1
4509
4510       * - **Test Name**
4511         - mozilla-central
4512         - autoland
4513         - mozilla-release
4514         - mozilla-beta
4515       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4516         - ❌
4517         - ❌
4518         - ❌
4519         - ❌
4520
4521
4522    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
4523       :widths: 30 15 15 15 15
4524       :header-rows: 1
4525
4526       * - **Test Name**
4527         - mozilla-central
4528         - autoland
4529         - mozilla-release
4530         - mozilla-beta
4531       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4532         - ❌
4533         - ❌
4534         - ❌
4535         - ❌
4536
4537
4538    .. list-table:: **test-windows10-64-qr/opt**
4539       :widths: 30 15 15 15 15
4540       :header-rows: 1
4541
4542       * - **Test Name**
4543         - mozilla-central
4544         - autoland
4545         - mozilla-release
4546         - mozilla-beta
4547       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4548         - ❌
4549         - ❌
4550         - ❌
4551         - ❌
4552
4553
4554    .. list-table:: **test-windows10-64-shippable-qr/opt**
4555       :widths: 30 15 15 15 15
4556       :header-rows: 1
4557
4558       * - **Test Name**
4559         - mozilla-central
4560         - autoland
4561         - mozilla-release
4562         - mozilla-beta
4563       * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
4564         - ✅
4565         - ❌
4566         - ✅
4567         - ❌
4568
4569
4570
4571 .. dropdown:: wasm-misc
4572    :class-container: anchor-id-wasm-misc-b
4573
4574    **Owner**: :lth and SpiderMonkey Team
4575
4576    * **alert threshold**: 2.0
4577    * **apps**: firefox, chrome, chromium
4578    * **expected**: pass
4579    * **gecko profile entries**: 4000000
4580    * **gecko profile interval**: 1
4581    * **lower is better**: true
4582    * **page cycles**: 5
4583    * **page timeout**: 1200000
4584    * **repository**: https://github.com/mozilla/perf-automation
4585    * **repository path**: benchmarks/wasm-misc
4586    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
4587    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
4588    * **type**: benchmark
4589    * **unit**: ms
4590    * **Test Task**:
4591
4592    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4593       :widths: 30 15 15 15 15
4594       :header-rows: 1
4595
4596       * - **Test Name**
4597         - mozilla-central
4598         - autoland
4599         - mozilla-release
4600         - mozilla-beta
4601       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4602         - ❌
4603         - ❌
4604         - ❌
4605         - ❌
4606
4607
4608    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
4609       :widths: 30 15 15 15 15
4610       :header-rows: 1
4611
4612       * - **Test Name**
4613         - mozilla-central
4614         - autoland
4615         - mozilla-release
4616         - mozilla-beta
4617       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4618         - ❌
4619         - ❌
4620         - ❌
4621         - ❌
4622
4623
4624    .. list-table:: **test-linux1804-64-qr/opt**
4625       :widths: 30 15 15 15 15
4626       :header-rows: 1
4627
4628       * - **Test Name**
4629         - mozilla-central
4630         - autoland
4631         - mozilla-release
4632         - mozilla-beta
4633       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4634         - ❌
4635         - ❌
4636         - ❌
4637         - ❌
4638
4639
4640    .. list-table:: **test-linux1804-64-shippable-qr/opt**
4641       :widths: 30 15 15 15 15
4642       :header-rows: 1
4643
4644       * - **Test Name**
4645         - mozilla-central
4646         - autoland
4647         - mozilla-release
4648         - mozilla-beta
4649       * - **browsertime-benchmark-wasm-chrome-wasm-misc**
4650         - ❌
4651         - ❌
4652         - ❌
4653         - ❌
4654       * - **browsertime-benchmark-wasm-chromium-wasm-misc**
4655         - ❌
4656         - ❌
4657         - ❌
4658         - ❌
4659       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4660         - ✅
4661         - ❌
4662         - ✅
4663         - ❌
4664
4665
4666    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
4667       :widths: 30 15 15 15 15
4668       :header-rows: 1
4669
4670       * - **Test Name**
4671         - mozilla-central
4672         - autoland
4673         - mozilla-release
4674         - mozilla-beta
4675       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4676         - ❌
4677         - ❌
4678         - ❌
4679         - ❌
4680
4681
4682    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4683       :widths: 30 15 15 15 15
4684       :header-rows: 1
4685
4686       * - **Test Name**
4687         - mozilla-central
4688         - autoland
4689         - mozilla-release
4690         - mozilla-beta
4691       * - **browsertime-benchmark-wasm-chrome-wasm-misc**
4692         - ❌
4693         - ❌
4694         - ❌
4695         - ❌
4696       * - **browsertime-benchmark-wasm-chromium-wasm-misc**
4697         - ❌
4698         - ❌
4699         - ❌
4700         - ❌
4701       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4702         - ✅
4703         - ❌
4704         - ✅
4705         - ❌
4706
4707
4708    .. list-table:: **test-windows10-32-qr/opt**
4709       :widths: 30 15 15 15 15
4710       :header-rows: 1
4711
4712       * - **Test Name**
4713         - mozilla-central
4714         - autoland
4715         - mozilla-release
4716         - mozilla-beta
4717       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4718         - ❌
4719         - ❌
4720         - ❌
4721         - ❌
4722
4723
4724    .. list-table:: **test-windows10-32-shippable-qr/opt**
4725       :widths: 30 15 15 15 15
4726       :header-rows: 1
4727
4728       * - **Test Name**
4729         - mozilla-central
4730         - autoland
4731         - mozilla-release
4732         - mozilla-beta
4733       * - **browsertime-benchmark-wasm-chrome-wasm-misc**
4734         - ❌
4735         - ❌
4736         - ❌
4737         - ❌
4738       * - **browsertime-benchmark-wasm-chromium-wasm-misc**
4739         - ❌
4740         - ❌
4741         - ❌
4742         - ❌
4743       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4744         - ❌
4745         - ❌
4746         - ❌
4747         - ❌
4748
4749
4750    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
4751       :widths: 30 15 15 15 15
4752       :header-rows: 1
4753
4754       * - **Test Name**
4755         - mozilla-central
4756         - autoland
4757         - mozilla-release
4758         - mozilla-beta
4759       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4760         - ❌
4761         - ❌
4762         - ❌
4763         - ❌
4764
4765
4766    .. list-table:: **test-windows10-64-qr/opt**
4767       :widths: 30 15 15 15 15
4768       :header-rows: 1
4769
4770       * - **Test Name**
4771         - mozilla-central
4772         - autoland
4773         - mozilla-release
4774         - mozilla-beta
4775       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4776         - ❌
4777         - ❌
4778         - ❌
4779         - ❌
4780
4781
4782    .. list-table:: **test-windows10-64-shippable-qr/opt**
4783       :widths: 30 15 15 15 15
4784       :header-rows: 1
4785
4786       * - **Test Name**
4787         - mozilla-central
4788         - autoland
4789         - mozilla-release
4790         - mozilla-beta
4791       * - **browsertime-benchmark-wasm-chrome-wasm-misc**
4792         - ❌
4793         - ❌
4794         - ❌
4795         - ❌
4796       * - **browsertime-benchmark-wasm-chromium-wasm-misc**
4797         - ❌
4798         - ❌
4799         - ❌
4800         - ❌
4801       * - **browsertime-benchmark-wasm-firefox-wasm-misc**
4802         - ✅
4803         - ❌
4804         - ✅
4805         - ❌
4806
4807
4808
4809 .. dropdown:: wasm-misc-baseline
4810    :class-container: anchor-id-wasm-misc-baseline-b
4811
4812    **Owner**: :lth and SpiderMonkey Team
4813
4814    * **alert threshold**: 2.0
4815    * **apps**: firefox
4816    * **expected**: pass
4817    * **gecko profile entries**: 4000000
4818    * **gecko profile interval**: 1
4819    * **lower is better**: true
4820    * **page cycles**: 5
4821    * **page timeout**: 1200000
4822    * **preferences**: {"javascript.options.wasm_baselinejit": true, "javascript.options.wasm_optimizingjit": false}
4823    * **repository**: https://github.com/mozilla/perf-automation
4824    * **repository path**: benchmarks/wasm-misc
4825    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
4826    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
4827    * **type**: benchmark
4828    * **unit**: ms
4829    * **Test Task**:
4830
4831    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4832       :widths: 30 15 15 15 15
4833       :header-rows: 1
4834
4835       * - **Test Name**
4836         - mozilla-central
4837         - autoland
4838         - mozilla-release
4839         - mozilla-beta
4840       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4841         - ❌
4842         - ❌
4843         - ❌
4844         - ❌
4845
4846
4847    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
4848       :widths: 30 15 15 15 15
4849       :header-rows: 1
4850
4851       * - **Test Name**
4852         - mozilla-central
4853         - autoland
4854         - mozilla-release
4855         - mozilla-beta
4856       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4857         - ❌
4858         - ❌
4859         - ❌
4860         - ❌
4861
4862
4863    .. list-table:: **test-linux1804-64-qr/opt**
4864       :widths: 30 15 15 15 15
4865       :header-rows: 1
4866
4867       * - **Test Name**
4868         - mozilla-central
4869         - autoland
4870         - mozilla-release
4871         - mozilla-beta
4872       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4873         - ❌
4874         - ❌
4875         - ❌
4876         - ❌
4877
4878
4879    .. list-table:: **test-linux1804-64-shippable-qr/opt**
4880       :widths: 30 15 15 15 15
4881       :header-rows: 1
4882
4883       * - **Test Name**
4884         - mozilla-central
4885         - autoland
4886         - mozilla-release
4887         - mozilla-beta
4888       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4889         - ✅
4890         - ❌
4891         - ✅
4892         - ❌
4893
4894
4895    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
4896       :widths: 30 15 15 15 15
4897       :header-rows: 1
4898
4899       * - **Test Name**
4900         - mozilla-central
4901         - autoland
4902         - mozilla-release
4903         - mozilla-beta
4904       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4905         - ❌
4906         - ❌
4907         - ❌
4908         - ❌
4909
4910
4911    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4912       :widths: 30 15 15 15 15
4913       :header-rows: 1
4914
4915       * - **Test Name**
4916         - mozilla-central
4917         - autoland
4918         - mozilla-release
4919         - mozilla-beta
4920       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4921         - ✅
4922         - ❌
4923         - ✅
4924         - ❌
4925
4926
4927    .. list-table:: **test-windows10-32-qr/opt**
4928       :widths: 30 15 15 15 15
4929       :header-rows: 1
4930
4931       * - **Test Name**
4932         - mozilla-central
4933         - autoland
4934         - mozilla-release
4935         - mozilla-beta
4936       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4937         - ❌
4938         - ❌
4939         - ❌
4940         - ❌
4941
4942
4943    .. list-table:: **test-windows10-32-shippable-qr/opt**
4944       :widths: 30 15 15 15 15
4945       :header-rows: 1
4946
4947       * - **Test Name**
4948         - mozilla-central
4949         - autoland
4950         - mozilla-release
4951         - mozilla-beta
4952       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4953         - ❌
4954         - ❌
4955         - ❌
4956         - ❌
4957
4958
4959    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
4960       :widths: 30 15 15 15 15
4961       :header-rows: 1
4962
4963       * - **Test Name**
4964         - mozilla-central
4965         - autoland
4966         - mozilla-release
4967         - mozilla-beta
4968       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4969         - ❌
4970         - ❌
4971         - ❌
4972         - ❌
4973
4974
4975    .. list-table:: **test-windows10-64-qr/opt**
4976       :widths: 30 15 15 15 15
4977       :header-rows: 1
4978
4979       * - **Test Name**
4980         - mozilla-central
4981         - autoland
4982         - mozilla-release
4983         - mozilla-beta
4984       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
4985         - ❌
4986         - ❌
4987         - ❌
4988         - ❌
4989
4990
4991    .. list-table:: **test-windows10-64-shippable-qr/opt**
4992       :widths: 30 15 15 15 15
4993       :header-rows: 1
4994
4995       * - **Test Name**
4996         - mozilla-central
4997         - autoland
4998         - mozilla-release
4999         - mozilla-beta
5000       * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
5001         - ✅
5002         - ❌
5003         - ✅
5004         - ❌
5005
5006
5007
5008 .. dropdown:: wasm-misc-optimizing
5009    :class-container: anchor-id-wasm-misc-optimizing-b
5010
5011    **Owner**: :lth and SpiderMonkey Team
5012
5013    * **alert threshold**: 2.0
5014    * **apps**: firefox
5015    * **expected**: pass
5016    * **gecko profile entries**: 4000000
5017    * **gecko profile interval**: 1
5018    * **lower is better**: true
5019    * **page cycles**: 5
5020    * **page timeout**: 1200000
5021    * **preferences**: {"javascript.options.wasm_baselinejit": false, "javascript.options.wasm_optimizingjit": true}
5022    * **repository**: https://github.com/mozilla/perf-automation
5023    * **repository path**: benchmarks/wasm-misc
5024    * **repository revision**: 61332db584026b73e37066d717a162825408c36b
5025    * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
5026    * **type**: benchmark
5027    * **unit**: ms
5028    * **Test Task**:
5029
5030    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
5031       :widths: 30 15 15 15 15
5032       :header-rows: 1
5033
5034       * - **Test Name**
5035         - mozilla-central
5036         - autoland
5037         - mozilla-release
5038         - mozilla-beta
5039       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5040         - ❌
5041         - ❌
5042         - ❌
5043         - ❌
5044
5045
5046    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
5047       :widths: 30 15 15 15 15
5048       :header-rows: 1
5049
5050       * - **Test Name**
5051         - mozilla-central
5052         - autoland
5053         - mozilla-release
5054         - mozilla-beta
5055       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5056         - ❌
5057         - ❌
5058         - ❌
5059         - ❌
5060
5061
5062    .. list-table:: **test-linux1804-64-qr/opt**
5063       :widths: 30 15 15 15 15
5064       :header-rows: 1
5065
5066       * - **Test Name**
5067         - mozilla-central
5068         - autoland
5069         - mozilla-release
5070         - mozilla-beta
5071       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5072         - ❌
5073         - ❌
5074         - ❌
5075         - ❌
5076
5077
5078    .. list-table:: **test-linux1804-64-shippable-qr/opt**
5079       :widths: 30 15 15 15 15
5080       :header-rows: 1
5081
5082       * - **Test Name**
5083         - mozilla-central
5084         - autoland
5085         - mozilla-release
5086         - mozilla-beta
5087       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5088         - ✅
5089         - ❌
5090         - ✅
5091         - ❌
5092
5093
5094    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
5095       :widths: 30 15 15 15 15
5096       :header-rows: 1
5097
5098       * - **Test Name**
5099         - mozilla-central
5100         - autoland
5101         - mozilla-release
5102         - mozilla-beta
5103       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5104         - ❌
5105         - ❌
5106         - ❌
5107         - ❌
5108
5109
5110    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5111       :widths: 30 15 15 15 15
5112       :header-rows: 1
5113
5114       * - **Test Name**
5115         - mozilla-central
5116         - autoland
5117         - mozilla-release
5118         - mozilla-beta
5119       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5120         - ✅
5121         - ❌
5122         - ✅
5123         - ❌
5124
5125
5126    .. list-table:: **test-windows10-32-qr/opt**
5127       :widths: 30 15 15 15 15
5128       :header-rows: 1
5129
5130       * - **Test Name**
5131         - mozilla-central
5132         - autoland
5133         - mozilla-release
5134         - mozilla-beta
5135       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5136         - ❌
5137         - ❌
5138         - ❌
5139         - ❌
5140
5141
5142    .. list-table:: **test-windows10-32-shippable-qr/opt**
5143       :widths: 30 15 15 15 15
5144       :header-rows: 1
5145
5146       * - **Test Name**
5147         - mozilla-central
5148         - autoland
5149         - mozilla-release
5150         - mozilla-beta
5151       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5152         - ❌
5153         - ❌
5154         - ❌
5155         - ❌
5156
5157
5158    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
5159       :widths: 30 15 15 15 15
5160       :header-rows: 1
5161
5162       * - **Test Name**
5163         - mozilla-central
5164         - autoland
5165         - mozilla-release
5166         - mozilla-beta
5167       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5168         - ❌
5169         - ❌
5170         - ❌
5171         - ❌
5172
5173
5174    .. list-table:: **test-windows10-64-qr/opt**
5175       :widths: 30 15 15 15 15
5176       :header-rows: 1
5177
5178       * - **Test Name**
5179         - mozilla-central
5180         - autoland
5181         - mozilla-release
5182         - mozilla-beta
5183       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5184         - ❌
5185         - ❌
5186         - ❌
5187         - ❌
5188
5189
5190    .. list-table:: **test-windows10-64-shippable-qr/opt**
5191       :widths: 30 15 15 15 15
5192       :header-rows: 1
5193
5194       * - **Test Name**
5195         - mozilla-central
5196         - autoland
5197         - mozilla-release
5198         - mozilla-beta
5199       * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
5200         - ✅
5201         - ❌
5202         - ✅
5203         - ❌
5204
5205
5206
5207 .. dropdown:: webaudio
5208    :class-container: anchor-id-webaudio-b
5209
5210    **Owner**: :padenot and Media Team
5211
5212    * **alert threshold**: 2.0
5213    * **apps**: firefox, chrome, chromium
5214    * **expected**: pass
5215    * **gecko profile entries**: 4000000
5216    * **gecko profile interval**: 1
5217    * **lower is better**: true
5218    * **page cycles**: 5
5219    * **page timeout**: 360000
5220    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5221    * **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__
5222    * **type**: benchmark
5223    * **unit**: score
5224    * **Test Task**:
5225
5226    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
5227       :widths: 30 15 15 15 15
5228       :header-rows: 1
5229
5230       * - **Test Name**
5231         - mozilla-central
5232         - autoland
5233         - mozilla-release
5234         - mozilla-beta
5235       * - **browsertime-benchmark-firefox-webaudio**
5236         - ❌
5237         - ❌
5238         - ❌
5239         - ❌
5240
5241
5242    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
5243       :widths: 30 15 15 15 15
5244       :header-rows: 1
5245
5246       * - **Test Name**
5247         - mozilla-central
5248         - autoland
5249         - mozilla-release
5250         - mozilla-beta
5251       * - **browsertime-benchmark-firefox-webaudio**
5252         - ❌
5253         - ❌
5254         - ❌
5255         - ❌
5256
5257
5258    .. list-table:: **test-linux1804-64-qr/opt**
5259       :widths: 30 15 15 15 15
5260       :header-rows: 1
5261
5262       * - **Test Name**
5263         - mozilla-central
5264         - autoland
5265         - mozilla-release
5266         - mozilla-beta
5267       * - **browsertime-benchmark-firefox-webaudio**
5268         - ❌
5269         - ❌
5270         - ❌
5271         - ❌
5272
5273
5274    .. list-table:: **test-linux1804-64-shippable-qr/opt**
5275       :widths: 30 15 15 15 15
5276       :header-rows: 1
5277
5278       * - **Test Name**
5279         - mozilla-central
5280         - autoland
5281         - mozilla-release
5282         - mozilla-beta
5283       * - **browsertime-benchmark-chrome-webaudio**
5284         - ❌
5285         - ❌
5286         - ❌
5287         - ❌
5288       * - **browsertime-benchmark-chromium-webaudio**
5289         - ❌
5290         - ❌
5291         - ❌
5292         - ❌
5293       * - **browsertime-benchmark-firefox-webaudio**
5294         - ✅
5295         - ✅
5296         - ❌
5297         - ❌
5298
5299
5300    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
5301       :widths: 30 15 15 15 15
5302       :header-rows: 1
5303
5304       * - **Test Name**
5305         - mozilla-central
5306         - autoland
5307         - mozilla-release
5308         - mozilla-beta
5309       * - **browsertime-benchmark-firefox-webaudio**
5310         - ❌
5311         - ❌
5312         - ❌
5313         - ❌
5314
5315
5316    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5317       :widths: 30 15 15 15 15
5318       :header-rows: 1
5319
5320       * - **Test Name**
5321         - mozilla-central
5322         - autoland
5323         - mozilla-release
5324         - mozilla-beta
5325       * - **browsertime-benchmark-chrome-webaudio**
5326         - ❌
5327         - ❌
5328         - ❌
5329         - ❌
5330       * - **browsertime-benchmark-chromium-webaudio**
5331         - ❌
5332         - ❌
5333         - ❌
5334         - ❌
5335       * - **browsertime-benchmark-firefox-webaudio**
5336         - ✅
5337         - ✅
5338         - ❌
5339         - ❌
5340
5341
5342    .. list-table:: **test-windows10-32-qr/opt**
5343       :widths: 30 15 15 15 15
5344       :header-rows: 1
5345
5346       * - **Test Name**
5347         - mozilla-central
5348         - autoland
5349         - mozilla-release
5350         - mozilla-beta
5351       * - **browsertime-benchmark-firefox-webaudio**
5352         - ❌
5353         - ❌
5354         - ❌
5355         - ❌
5356
5357
5358    .. list-table:: **test-windows10-32-shippable-qr/opt**
5359       :widths: 30 15 15 15 15
5360       :header-rows: 1
5361
5362       * - **Test Name**
5363         - mozilla-central
5364         - autoland
5365         - mozilla-release
5366         - mozilla-beta
5367       * - **browsertime-benchmark-chrome-webaudio**
5368         - ❌
5369         - ❌
5370         - ❌
5371         - ❌
5372       * - **browsertime-benchmark-chromium-webaudio**
5373         - ❌
5374         - ❌
5375         - ❌
5376         - ❌
5377       * - **browsertime-benchmark-firefox-webaudio**
5378         - ❌
5379         - ❌
5380         - ❌
5381         - ❌
5382
5383
5384    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
5385       :widths: 30 15 15 15 15
5386       :header-rows: 1
5387
5388       * - **Test Name**
5389         - mozilla-central
5390         - autoland
5391         - mozilla-release
5392         - mozilla-beta
5393       * - **browsertime-benchmark-firefox-webaudio**
5394         - ❌
5395         - ❌
5396         - ❌
5397         - ❌
5398
5399
5400    .. list-table:: **test-windows10-64-qr/opt**
5401       :widths: 30 15 15 15 15
5402       :header-rows: 1
5403
5404       * - **Test Name**
5405         - mozilla-central
5406         - autoland
5407         - mozilla-release
5408         - mozilla-beta
5409       * - **browsertime-benchmark-firefox-webaudio**
5410         - ❌
5411         - ❌
5412         - ❌
5413         - ❌
5414
5415
5416    .. list-table:: **test-windows10-64-shippable-qr/opt**
5417       :widths: 30 15 15 15 15
5418       :header-rows: 1
5419
5420       * - **Test Name**
5421         - mozilla-central
5422         - autoland
5423         - mozilla-release
5424         - mozilla-beta
5425       * - **browsertime-benchmark-chrome-webaudio**
5426         - ❌
5427         - ❌
5428         - ❌
5429         - ❌
5430       * - **browsertime-benchmark-chromium-webaudio**
5431         - ❌
5432         - ❌
5433         - ❌
5434         - ❌
5435       * - **browsertime-benchmark-firefox-webaudio**
5436         - ✅
5437         - ✅
5438         - ✅
5439         - ✅
5440
5441
5442
5443 .. dropdown:: youtube-playback
5444    :class-container: anchor-id-youtube-playback-b
5445
5446    **Owner**: PerfTest Team
5447
5448    * **alert on**: H264.1080p30@1X_dropped_frames, H264.1080p60@1X_dropped_frames, H264.1440p30@1X_dropped_frames, H264.144p15@1X_dropped_frames, H264.2160p30@1X_dropped_frames, H264.240p30@1X_dropped_frames, H264.360p30@1X_dropped_frames, H264.480p30@1X_dropped_frames, H264.720p30@1X_dropped_frames, H264.720p60@1X_dropped_frames, VP9.1080p30@1X_dropped_frames, VP9.1080p60@1X_dropped_frames, VP9.1440p30@1X_dropped_frames, VP9.1440p60@1X_dropped_frames, VP9.144p30@1X_dropped_frames, VP9.2160p30@1X_dropped_frames, VP9.2160p60@1X_dropped_frames, VP9.240p30@1X_dropped_frames, VP9.360p30@1X_dropped_frames, VP9.480p30@1X_dropped_frames, VP9.720p30@1X_dropped_frames, VP9.720p60@1X_dropped_frames
5449    * **alert threshold**: 2.0
5450    * **apps**: firefox, geckoview, fenix,refbrow, chrome
5451    * **expected**: pass
5452    * **gecko profile entries**: 50000000
5453    * **gecko profile interval**: 1000
5454    * **gecko profile threads**: MediaPlayback
5455    * **lower is better**: true
5456    * **page cycles**: 1
5457    * **page timeout**: 2700000
5458    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5459    * **subtest lower is better**: true
5460    * **subtest unit**: score
5461    * **test url**: `<http://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&exclude=1,2&muted=true>`__
5462    * **type**: benchmark
5463    * **unit**: score
5464    * **use live sites**: true
5465
5466 .. dropdown:: youtube-playback-av1-sfr
5467    :class-container: anchor-id-youtube-playback-av1-sfr-b
5468
5469    **Owner**: PerfTest Team
5470
5471    * **alert threshold**: 2.0
5472    * **apps**: firefox, geckoview, fenix, refbrow, chrome
5473    * **expected**: pass
5474    * **gecko profile entries**: 50000000
5475    * **gecko profile interval**: 1000
5476    * **gecko profile threads**: MediaPlayback
5477    * **lower is better**: true
5478    * **page cycles**: 1
5479    * **page timeout**: 2700000
5480    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5481    * **subtest lower is better**: true
5482    * **subtest unit**: score
5483    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__
5484    * **type**: benchmark
5485    * **unit**: score
5486    * **use live sites**: true
5487    * **Test Task**:
5488
5489    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5490       :widths: 30 15 15 15 15
5491       :header-rows: 1
5492
5493       * - **Test Name**
5494         - mozilla-central
5495         - autoland
5496         - mozilla-release
5497         - mozilla-beta
5498       * - **browsertime-firefox-youtube-playback-av1-sfr**
5499         - ✅
5500         - ❌
5501         - ✅
5502         - ❌
5503
5504
5505
5506 .. dropdown:: youtube-playback-h264-1080p30
5507    :class-container: anchor-id-youtube-playback-h264-1080p30-b
5508
5509    **Owner**: PerfTest Team
5510
5511    * **alert threshold**: 2.0
5512    * **apps**: firefox
5513    * **expected**: pass
5514    * **gather cpuTime**: true
5515    * **gecko profile entries**: 50000000
5516    * **gecko profile interval**: 1000
5517    * **gecko profile threads**: MediaPlayback
5518    * **lower is better**: true
5519    * **page cycles**: 20
5520    * **page timeout**: 2700000
5521    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5522    * **subtest lower is better**: true
5523    * **subtest unit**: score
5524    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
5525    * **type**: benchmark
5526    * **unit**: score
5527    * **use live sites**: true
5528    * **Test Task**:
5529
5530    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
5531       :widths: 30 15 15 15 15
5532       :header-rows: 1
5533
5534       * - **Test Name**
5535         - mozilla-central
5536         - autoland
5537         - mozilla-release
5538         - mozilla-beta
5539       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5540         - ❌
5541         - ❌
5542         - ❌
5543         - ❌
5544
5545
5546    .. list-table:: **test-linux1804-64-qr/opt**
5547       :widths: 30 15 15 15 15
5548       :header-rows: 1
5549
5550       * - **Test Name**
5551         - mozilla-central
5552         - autoland
5553         - mozilla-release
5554         - mozilla-beta
5555       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5556         - ❌
5557         - ❌
5558         - ❌
5559         - ❌
5560
5561
5562    .. list-table:: **test-linux1804-64-shippable-qr/opt**
5563       :widths: 30 15 15 15 15
5564       :header-rows: 1
5565
5566       * - **Test Name**
5567         - mozilla-central
5568         - autoland
5569         - mozilla-release
5570         - mozilla-beta
5571       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5572         - ❌
5573         - ❌
5574         - ❌
5575         - ❌
5576
5577
5578    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
5579       :widths: 30 15 15 15 15
5580       :header-rows: 1
5581
5582       * - **Test Name**
5583         - mozilla-central
5584         - autoland
5585         - mozilla-release
5586         - mozilla-beta
5587       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5588         - ❌
5589         - ❌
5590         - ❌
5591         - ❌
5592
5593
5594    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5595       :widths: 30 15 15 15 15
5596       :header-rows: 1
5597
5598       * - **Test Name**
5599         - mozilla-central
5600         - autoland
5601         - mozilla-release
5602         - mozilla-beta
5603       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5604         - ✅
5605         - ❌
5606         - ❌
5607         - ❌
5608
5609
5610    .. list-table:: **test-windows10-32-qr/opt**
5611       :widths: 30 15 15 15 15
5612       :header-rows: 1
5613
5614       * - **Test Name**
5615         - mozilla-central
5616         - autoland
5617         - mozilla-release
5618         - mozilla-beta
5619       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5620         - ❌
5621         - ❌
5622         - ❌
5623         - ❌
5624
5625
5626    .. list-table:: **test-windows10-32-shippable-qr/opt**
5627       :widths: 30 15 15 15 15
5628       :header-rows: 1
5629
5630       * - **Test Name**
5631         - mozilla-central
5632         - autoland
5633         - mozilla-release
5634         - mozilla-beta
5635       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5636         - ❌
5637         - ❌
5638         - ❌
5639         - ❌
5640
5641
5642    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
5643       :widths: 30 15 15 15 15
5644       :header-rows: 1
5645
5646       * - **Test Name**
5647         - mozilla-central
5648         - autoland
5649         - mozilla-release
5650         - mozilla-beta
5651       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5652         - ❌
5653         - ❌
5654         - ❌
5655         - ❌
5656
5657
5658    .. list-table:: **test-windows10-64-qr/opt**
5659       :widths: 30 15 15 15 15
5660       :header-rows: 1
5661
5662       * - **Test Name**
5663         - mozilla-central
5664         - autoland
5665         - mozilla-release
5666         - mozilla-beta
5667       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5668         - ❌
5669         - ❌
5670         - ❌
5671         - ❌
5672
5673
5674    .. list-table:: **test-windows10-64-shippable-qr/opt**
5675       :widths: 30 15 15 15 15
5676       :header-rows: 1
5677
5678       * - **Test Name**
5679         - mozilla-central
5680         - autoland
5681         - mozilla-release
5682         - mozilla-beta
5683       * - **browsertime-power-firefox-youtube-playback-h264-1080p30**
5684         - ❌
5685         - ❌
5686         - ❌
5687         - ❌
5688
5689
5690
5691 .. dropdown:: youtube-playback-h264-1080p60
5692    :class-container: anchor-id-youtube-playback-h264-1080p60-b
5693
5694    **Owner**: PerfTest Team
5695
5696    * **alert threshold**: 2.0
5697    * **apps**: firefox
5698    * **expected**: pass
5699    * **gather cpuTime**: true
5700    * **gecko profile entries**: 50000000
5701    * **gecko profile interval**: 1000
5702    * **gecko profile threads**: MediaPlayback
5703    * **lower is better**: true
5704    * **page cycles**: 20
5705    * **page timeout**: 2700000
5706    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5707    * **subtest lower is better**: true
5708    * **subtest unit**: score
5709    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
5710    * **type**: benchmark
5711    * **unit**: score
5712    * **use live sites**: true
5713    * **Test Task**:
5714
5715    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
5716       :widths: 30 15 15 15 15
5717       :header-rows: 1
5718
5719       * - **Test Name**
5720         - mozilla-central
5721         - autoland
5722         - mozilla-release
5723         - mozilla-beta
5724       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5725         - ❌
5726         - ❌
5727         - ❌
5728         - ❌
5729
5730
5731    .. list-table:: **test-linux1804-64-qr/opt**
5732       :widths: 30 15 15 15 15
5733       :header-rows: 1
5734
5735       * - **Test Name**
5736         - mozilla-central
5737         - autoland
5738         - mozilla-release
5739         - mozilla-beta
5740       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5741         - ❌
5742         - ❌
5743         - ❌
5744         - ❌
5745
5746
5747    .. list-table:: **test-linux1804-64-shippable-qr/opt**
5748       :widths: 30 15 15 15 15
5749       :header-rows: 1
5750
5751       * - **Test Name**
5752         - mozilla-central
5753         - autoland
5754         - mozilla-release
5755         - mozilla-beta
5756       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5757         - ❌
5758         - ❌
5759         - ❌
5760         - ❌
5761
5762
5763    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
5764       :widths: 30 15 15 15 15
5765       :header-rows: 1
5766
5767       * - **Test Name**
5768         - mozilla-central
5769         - autoland
5770         - mozilla-release
5771         - mozilla-beta
5772       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5773         - ❌
5774         - ❌
5775         - ❌
5776         - ❌
5777
5778
5779    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5780       :widths: 30 15 15 15 15
5781       :header-rows: 1
5782
5783       * - **Test Name**
5784         - mozilla-central
5785         - autoland
5786         - mozilla-release
5787         - mozilla-beta
5788       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5789         - ✅
5790         - ❌
5791         - ❌
5792         - ❌
5793
5794
5795    .. list-table:: **test-windows10-32-qr/opt**
5796       :widths: 30 15 15 15 15
5797       :header-rows: 1
5798
5799       * - **Test Name**
5800         - mozilla-central
5801         - autoland
5802         - mozilla-release
5803         - mozilla-beta
5804       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5805         - ❌
5806         - ❌
5807         - ❌
5808         - ❌
5809
5810
5811    .. list-table:: **test-windows10-32-shippable-qr/opt**
5812       :widths: 30 15 15 15 15
5813       :header-rows: 1
5814
5815       * - **Test Name**
5816         - mozilla-central
5817         - autoland
5818         - mozilla-release
5819         - mozilla-beta
5820       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5821         - ❌
5822         - ❌
5823         - ❌
5824         - ❌
5825
5826
5827    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
5828       :widths: 30 15 15 15 15
5829       :header-rows: 1
5830
5831       * - **Test Name**
5832         - mozilla-central
5833         - autoland
5834         - mozilla-release
5835         - mozilla-beta
5836       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5837         - ❌
5838         - ❌
5839         - ❌
5840         - ❌
5841
5842
5843    .. list-table:: **test-windows10-64-qr/opt**
5844       :widths: 30 15 15 15 15
5845       :header-rows: 1
5846
5847       * - **Test Name**
5848         - mozilla-central
5849         - autoland
5850         - mozilla-release
5851         - mozilla-beta
5852       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5853         - ❌
5854         - ❌
5855         - ❌
5856         - ❌
5857
5858
5859    .. list-table:: **test-windows10-64-shippable-qr/opt**
5860       :widths: 30 15 15 15 15
5861       :header-rows: 1
5862
5863       * - **Test Name**
5864         - mozilla-central
5865         - autoland
5866         - mozilla-release
5867         - mozilla-beta
5868       * - **browsertime-power-firefox-youtube-playback-h264-1080p60**
5869         - ❌
5870         - ❌
5871         - ❌
5872         - ❌
5873
5874
5875
5876 .. dropdown:: youtube-playback-h264-full-1080p30
5877    :class-container: anchor-id-youtube-playback-h264-full-1080p30-b
5878
5879    **Owner**: PerfTest Team
5880
5881    * **alert threshold**: 2.0
5882    * **apps**: firefox
5883    * **expected**: pass
5884    * **gather cpuTime**: true
5885    * **gecko profile entries**: 50000000
5886    * **gecko profile interval**: 1000
5887    * **gecko profile threads**: MediaPlayback
5888    * **lower is better**: true
5889    * **page cycles**: 20
5890    * **page timeout**: 2700000
5891    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
5892    * **subtest lower is better**: true
5893    * **subtest unit**: score
5894    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
5895    * **type**: benchmark
5896    * **unit**: score
5897    * **use live sites**: true
5898    * **Test Task**:
5899
5900    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
5901       :widths: 30 15 15 15 15
5902       :header-rows: 1
5903
5904       * - **Test Name**
5905         - mozilla-central
5906         - autoland
5907         - mozilla-release
5908         - mozilla-beta
5909       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5910         - ❌
5911         - ❌
5912         - ❌
5913         - ❌
5914
5915
5916    .. list-table:: **test-linux1804-64-qr/opt**
5917       :widths: 30 15 15 15 15
5918       :header-rows: 1
5919
5920       * - **Test Name**
5921         - mozilla-central
5922         - autoland
5923         - mozilla-release
5924         - mozilla-beta
5925       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5926         - ❌
5927         - ❌
5928         - ❌
5929         - ❌
5930
5931
5932    .. list-table:: **test-linux1804-64-shippable-qr/opt**
5933       :widths: 30 15 15 15 15
5934       :header-rows: 1
5935
5936       * - **Test Name**
5937         - mozilla-central
5938         - autoland
5939         - mozilla-release
5940         - mozilla-beta
5941       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5942         - ❌
5943         - ❌
5944         - ❌
5945         - ❌
5946
5947
5948    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
5949       :widths: 30 15 15 15 15
5950       :header-rows: 1
5951
5952       * - **Test Name**
5953         - mozilla-central
5954         - autoland
5955         - mozilla-release
5956         - mozilla-beta
5957       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5958         - ❌
5959         - ❌
5960         - ❌
5961         - ❌
5962
5963
5964    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5965       :widths: 30 15 15 15 15
5966       :header-rows: 1
5967
5968       * - **Test Name**
5969         - mozilla-central
5970         - autoland
5971         - mozilla-release
5972         - mozilla-beta
5973       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5974         - ✅
5975         - ❌
5976         - ❌
5977         - ❌
5978
5979
5980    .. list-table:: **test-windows10-32-qr/opt**
5981       :widths: 30 15 15 15 15
5982       :header-rows: 1
5983
5984       * - **Test Name**
5985         - mozilla-central
5986         - autoland
5987         - mozilla-release
5988         - mozilla-beta
5989       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
5990         - ❌
5991         - ❌
5992         - ❌
5993         - ❌
5994
5995
5996    .. list-table:: **test-windows10-32-shippable-qr/opt**
5997       :widths: 30 15 15 15 15
5998       :header-rows: 1
5999
6000       * - **Test Name**
6001         - mozilla-central
6002         - autoland
6003         - mozilla-release
6004         - mozilla-beta
6005       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
6006         - ❌
6007         - ❌
6008         - ❌
6009         - ❌
6010
6011
6012    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
6013       :widths: 30 15 15 15 15
6014       :header-rows: 1
6015
6016       * - **Test Name**
6017         - mozilla-central
6018         - autoland
6019         - mozilla-release
6020         - mozilla-beta
6021       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
6022         - ❌
6023         - ❌
6024         - ❌
6025         - ❌
6026
6027
6028    .. list-table:: **test-windows10-64-qr/opt**
6029       :widths: 30 15 15 15 15
6030       :header-rows: 1
6031
6032       * - **Test Name**
6033         - mozilla-central
6034         - autoland
6035         - mozilla-release
6036         - mozilla-beta
6037       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
6038         - ❌
6039         - ❌
6040         - ❌
6041         - ❌
6042
6043
6044    .. list-table:: **test-windows10-64-shippable-qr/opt**
6045       :widths: 30 15 15 15 15
6046       :header-rows: 1
6047
6048       * - **Test Name**
6049         - mozilla-central
6050         - autoland
6051         - mozilla-release
6052         - mozilla-beta
6053       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
6054         - ❌
6055         - ❌
6056         - ❌
6057         - ❌
6058
6059
6060
6061 .. dropdown:: youtube-playback-h264-full-1080p60
6062    :class-container: anchor-id-youtube-playback-h264-full-1080p60-b
6063
6064    **Owner**: PerfTest Team
6065
6066    * **alert threshold**: 2.0
6067    * **apps**: firefox
6068    * **expected**: pass
6069    * **gather cpuTime**: true
6070    * **gecko profile entries**: 50000000
6071    * **gecko profile interval**: 1000
6072    * **gecko profile threads**: MediaPlayback
6073    * **lower is better**: true
6074    * **page cycles**: 20
6075    * **page timeout**: 2700000
6076    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
6077    * **subtest lower is better**: true
6078    * **subtest unit**: score
6079    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
6080    * **type**: benchmark
6081    * **unit**: score
6082    * **use live sites**: true
6083    * **Test Task**:
6084
6085    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
6086       :widths: 30 15 15 15 15
6087       :header-rows: 1
6088
6089       * - **Test Name**
6090         - mozilla-central
6091         - autoland
6092         - mozilla-release
6093         - mozilla-beta
6094       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6095         - ❌
6096         - ❌
6097         - ❌
6098         - ❌
6099
6100
6101    .. list-table:: **test-linux1804-64-qr/opt**
6102       :widths: 30 15 15 15 15
6103       :header-rows: 1
6104
6105       * - **Test Name**
6106         - mozilla-central
6107         - autoland
6108         - mozilla-release
6109         - mozilla-beta
6110       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6111         - ❌
6112         - ❌
6113         - ❌
6114         - ❌
6115
6116
6117    .. list-table:: **test-linux1804-64-shippable-qr/opt**
6118       :widths: 30 15 15 15 15
6119       :header-rows: 1
6120
6121       * - **Test Name**
6122         - mozilla-central
6123         - autoland
6124         - mozilla-release
6125         - mozilla-beta
6126       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6127         - ❌
6128         - ❌
6129         - ❌
6130         - ❌
6131
6132
6133    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
6134       :widths: 30 15 15 15 15
6135       :header-rows: 1
6136
6137       * - **Test Name**
6138         - mozilla-central
6139         - autoland
6140         - mozilla-release
6141         - mozilla-beta
6142       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6143         - ❌
6144         - ❌
6145         - ❌
6146         - ❌
6147
6148
6149    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6150       :widths: 30 15 15 15 15
6151       :header-rows: 1
6152
6153       * - **Test Name**
6154         - mozilla-central
6155         - autoland
6156         - mozilla-release
6157         - mozilla-beta
6158       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6159         - ✅
6160         - ❌
6161         - ❌
6162         - ❌
6163
6164
6165    .. list-table:: **test-windows10-32-qr/opt**
6166       :widths: 30 15 15 15 15
6167       :header-rows: 1
6168
6169       * - **Test Name**
6170         - mozilla-central
6171         - autoland
6172         - mozilla-release
6173         - mozilla-beta
6174       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6175         - ❌
6176         - ❌
6177         - ❌
6178         - ❌
6179
6180
6181    .. list-table:: **test-windows10-32-shippable-qr/opt**
6182       :widths: 30 15 15 15 15
6183       :header-rows: 1
6184
6185       * - **Test Name**
6186         - mozilla-central
6187         - autoland
6188         - mozilla-release
6189         - mozilla-beta
6190       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6191         - ❌
6192         - ❌
6193         - ❌
6194         - ❌
6195
6196
6197    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
6198       :widths: 30 15 15 15 15
6199       :header-rows: 1
6200
6201       * - **Test Name**
6202         - mozilla-central
6203         - autoland
6204         - mozilla-release
6205         - mozilla-beta
6206       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6207         - ❌
6208         - ❌
6209         - ❌
6210         - ❌
6211
6212
6213    .. list-table:: **test-windows10-64-qr/opt**
6214       :widths: 30 15 15 15 15
6215       :header-rows: 1
6216
6217       * - **Test Name**
6218         - mozilla-central
6219         - autoland
6220         - mozilla-release
6221         - mozilla-beta
6222       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6223         - ❌
6224         - ❌
6225         - ❌
6226         - ❌
6227
6228
6229    .. list-table:: **test-windows10-64-shippable-qr/opt**
6230       :widths: 30 15 15 15 15
6231       :header-rows: 1
6232
6233       * - **Test Name**
6234         - mozilla-central
6235         - autoland
6236         - mozilla-release
6237         - mozilla-beta
6238       * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
6239         - ❌
6240         - ❌
6241         - ❌
6242         - ❌
6243
6244
6245
6246 .. dropdown:: youtube-playback-h264-sfr
6247    :class-container: anchor-id-youtube-playback-h264-sfr-b
6248
6249    **Owner**: PerfTest Team
6250
6251    * **alert threshold**: 2.0
6252    * **apps**: firefox, geckoview, fenix, refbrow, chrome
6253    * **expected**: pass
6254    * **gecko profile entries**: 50000000
6255    * **gecko profile interval**: 1000
6256    * **gecko profile threads**: MediaPlayback
6257    * **lower is better**: true
6258    * **page cycles**: 1
6259    * **page timeout**: 2700000
6260    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6261    * **subtest lower is better**: true
6262    * **subtest unit**: score
6263    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
6264    * **type**: benchmark
6265    * **unit**: score
6266    * **use live sites**: true
6267    * **Test Task**:
6268
6269    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
6270       :widths: 30 15 15 15 15
6271       :header-rows: 1
6272
6273       * - **Test Name**
6274         - mozilla-central
6275         - autoland
6276         - mozilla-release
6277         - mozilla-beta
6278       * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis**
6279         - ❌
6280         - ❌
6281         - ❌
6282         - ❌
6283       * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
6284         - ❌
6285         - ❌
6286         - ❌
6287         - ❌
6288
6289
6290    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
6291       :widths: 30 15 15 15 15
6292       :header-rows: 1
6293
6294       * - **Test Name**
6295         - mozilla-central
6296         - autoland
6297         - mozilla-release
6298         - mozilla-beta
6299       * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis**
6300         - ❌
6301         - ❌
6302         - ❌
6303         - ❌
6304       * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
6305         - ✅
6306         - ❌
6307         - ❌
6308         - ❌
6309
6310
6311    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6312       :widths: 30 15 15 15 15
6313       :header-rows: 1
6314
6315       * - **Test Name**
6316         - mozilla-central
6317         - autoland
6318         - mozilla-release
6319         - mozilla-beta
6320       * - **browsertime-firefox-youtube-playback-h264-sfr**
6321         - ❌
6322         - ❌
6323         - ❌
6324         - ❌
6325
6326
6327    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
6328       :widths: 30 15 15 15 15
6329       :header-rows: 1
6330
6331       * - **Test Name**
6332         - mozilla-central
6333         - autoland
6334         - mozilla-release
6335         - mozilla-beta
6336       * - **browsertime-firefox-youtube-playback-h264-sfr**
6337         - ❌
6338         - ❌
6339         - ❌
6340         - ❌
6341
6342
6343    .. list-table:: **test-linux1804-64-qr/opt**
6344       :widths: 30 15 15 15 15
6345       :header-rows: 1
6346
6347       * - **Test Name**
6348         - mozilla-central
6349         - autoland
6350         - mozilla-release
6351         - mozilla-beta
6352       * - **browsertime-firefox-youtube-playback-h264-sfr**
6353         - ❌
6354         - ❌
6355         - ❌
6356         - ❌
6357
6358
6359    .. list-table:: **test-linux1804-64-shippable-qr/opt**
6360       :widths: 30 15 15 15 15
6361       :header-rows: 1
6362
6363       * - **Test Name**
6364         - mozilla-central
6365         - autoland
6366         - mozilla-release
6367         - mozilla-beta
6368       * - **browsertime-firefox-youtube-playback-h264-sfr**
6369         - ✅
6370         - ❌
6371         - ✅
6372         - ❌
6373
6374
6375    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
6376       :widths: 30 15 15 15 15
6377       :header-rows: 1
6378
6379       * - **Test Name**
6380         - mozilla-central
6381         - autoland
6382         - mozilla-release
6383         - mozilla-beta
6384       * - **browsertime-firefox-youtube-playback-h264-sfr**
6385         - ❌
6386         - ❌
6387         - ❌
6388         - ❌
6389
6390
6391    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6392       :widths: 30 15 15 15 15
6393       :header-rows: 1
6394
6395       * - **Test Name**
6396         - mozilla-central
6397         - autoland
6398         - mozilla-release
6399         - mozilla-beta
6400       * - **browsertime-firefox-youtube-playback-h264-sfr**
6401         - ✅
6402         - ❌
6403         - ✅
6404         - ❌
6405
6406
6407    .. list-table:: **test-windows10-32-qr/opt**
6408       :widths: 30 15 15 15 15
6409       :header-rows: 1
6410
6411       * - **Test Name**
6412         - mozilla-central
6413         - autoland
6414         - mozilla-release
6415         - mozilla-beta
6416       * - **browsertime-firefox-youtube-playback-h264-sfr**
6417         - ❌
6418         - ❌
6419         - ❌
6420         - ❌
6421
6422
6423    .. list-table:: **test-windows10-32-shippable-qr/opt**
6424       :widths: 30 15 15 15 15
6425       :header-rows: 1
6426
6427       * - **Test Name**
6428         - mozilla-central
6429         - autoland
6430         - mozilla-release
6431         - mozilla-beta
6432       * - **browsertime-firefox-youtube-playback-h264-sfr**
6433         - ❌
6434         - ❌
6435         - ❌
6436         - ❌
6437
6438
6439    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
6440       :widths: 30 15 15 15 15
6441       :header-rows: 1
6442
6443       * - **Test Name**
6444         - mozilla-central
6445         - autoland
6446         - mozilla-release
6447         - mozilla-beta
6448       * - **browsertime-firefox-youtube-playback-h264-sfr**
6449         - ❌
6450         - ❌
6451         - ❌
6452         - ❌
6453
6454
6455    .. list-table:: **test-windows10-64-qr/opt**
6456       :widths: 30 15 15 15 15
6457       :header-rows: 1
6458
6459       * - **Test Name**
6460         - mozilla-central
6461         - autoland
6462         - mozilla-release
6463         - mozilla-beta
6464       * - **browsertime-firefox-youtube-playback-h264-sfr**
6465         - ❌
6466         - ❌
6467         - ❌
6468         - ❌
6469
6470
6471    .. list-table:: **test-windows10-64-shippable-qr/opt**
6472       :widths: 30 15 15 15 15
6473       :header-rows: 1
6474
6475       * - **Test Name**
6476         - mozilla-central
6477         - autoland
6478         - mozilla-release
6479         - mozilla-beta
6480       * - **browsertime-firefox-youtube-playback-h264-sfr**
6481         - ✅
6482         - ❌
6483         - ✅
6484         - ❌
6485
6486
6487
6488 .. dropdown:: youtube-playback-hfr
6489    :class-container: anchor-id-youtube-playback-hfr-b
6490
6491    **Owner**: PerfTest Team
6492
6493    * **alert on**: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
6494    * **alert threshold**: 2.0
6495    * **apps**: firefox, geckoview, fenix, refbrow, chrome
6496    * **expected**: pass
6497    * **gecko profile entries**: 50000000
6498    * **gecko profile interval**: 1000
6499    * **gecko profile threads**: MediaPlayback
6500    * **lower is better**: true
6501    * **page cycles**: 1
6502    * **page timeout**: 2700000
6503    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6504    * **subtest lower is better**: true
6505    * **subtest unit**: score
6506    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
6507    * **type**: benchmark
6508    * **unit**: score
6509    * **use live sites**: true
6510    * **Test Task**:
6511
6512    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
6513       :widths: 30 15 15 15 15
6514       :header-rows: 1
6515
6516       * - **Test Name**
6517         - mozilla-central
6518         - autoland
6519         - mozilla-release
6520         - mozilla-beta
6521       * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
6522         - ❌
6523         - ❌
6524         - ❌
6525         - ❌
6526       * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
6527         - ❌
6528         - ❌
6529         - ❌
6530         - ❌
6531
6532
6533    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
6534       :widths: 30 15 15 15 15
6535       :header-rows: 1
6536
6537       * - **Test Name**
6538         - mozilla-central
6539         - autoland
6540         - mozilla-release
6541         - mozilla-beta
6542       * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
6543         - ❌
6544         - ❌
6545         - ❌
6546         - ❌
6547       * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
6548         - ✅
6549         - ❌
6550         - ❌
6551         - ❌
6552
6553
6554    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6555       :widths: 30 15 15 15 15
6556       :header-rows: 1
6557
6558       * - **Test Name**
6559         - mozilla-central
6560         - autoland
6561         - mozilla-release
6562         - mozilla-beta
6563       * - **browsertime-firefox-youtube-playback-hfr**
6564         - ❌
6565         - ❌
6566         - ❌
6567         - ❌
6568
6569
6570    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
6571       :widths: 30 15 15 15 15
6572       :header-rows: 1
6573
6574       * - **Test Name**
6575         - mozilla-central
6576         - autoland
6577         - mozilla-release
6578         - mozilla-beta
6579       * - **browsertime-firefox-youtube-playback-hfr**
6580         - ❌
6581         - ❌
6582         - ❌
6583         - ❌
6584
6585
6586    .. list-table:: **test-linux1804-64-qr/opt**
6587       :widths: 30 15 15 15 15
6588       :header-rows: 1
6589
6590       * - **Test Name**
6591         - mozilla-central
6592         - autoland
6593         - mozilla-release
6594         - mozilla-beta
6595       * - **browsertime-firefox-youtube-playback-hfr**
6596         - ❌
6597         - ❌
6598         - ❌
6599         - ❌
6600
6601
6602    .. list-table:: **test-linux1804-64-shippable-qr/opt**
6603       :widths: 30 15 15 15 15
6604       :header-rows: 1
6605
6606       * - **Test Name**
6607         - mozilla-central
6608         - autoland
6609         - mozilla-release
6610         - mozilla-beta
6611       * - **browsertime-firefox-youtube-playback-hfr**
6612         - ✅
6613         - ❌
6614         - ✅
6615         - ❌
6616
6617
6618    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
6619       :widths: 30 15 15 15 15
6620       :header-rows: 1
6621
6622       * - **Test Name**
6623         - mozilla-central
6624         - autoland
6625         - mozilla-release
6626         - mozilla-beta
6627       * - **browsertime-firefox-youtube-playback-hfr**
6628         - ❌
6629         - ❌
6630         - ❌
6631         - ❌
6632
6633
6634    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6635       :widths: 30 15 15 15 15
6636       :header-rows: 1
6637
6638       * - **Test Name**
6639         - mozilla-central
6640         - autoland
6641         - mozilla-release
6642         - mozilla-beta
6643       * - **browsertime-firefox-youtube-playback-hfr**
6644         - ✅
6645         - ❌
6646         - ✅
6647         - ❌
6648
6649
6650    .. list-table:: **test-windows10-32-qr/opt**
6651       :widths: 30 15 15 15 15
6652       :header-rows: 1
6653
6654       * - **Test Name**
6655         - mozilla-central
6656         - autoland
6657         - mozilla-release
6658         - mozilla-beta
6659       * - **browsertime-firefox-youtube-playback-hfr**
6660         - ❌
6661         - ❌
6662         - ❌
6663         - ❌
6664
6665
6666    .. list-table:: **test-windows10-32-shippable-qr/opt**
6667       :widths: 30 15 15 15 15
6668       :header-rows: 1
6669
6670       * - **Test Name**
6671         - mozilla-central
6672         - autoland
6673         - mozilla-release
6674         - mozilla-beta
6675       * - **browsertime-firefox-youtube-playback-hfr**
6676         - ❌
6677         - ❌
6678         - ❌
6679         - ❌
6680
6681
6682    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
6683       :widths: 30 15 15 15 15
6684       :header-rows: 1
6685
6686       * - **Test Name**
6687         - mozilla-central
6688         - autoland
6689         - mozilla-release
6690         - mozilla-beta
6691       * - **browsertime-firefox-youtube-playback-hfr**
6692         - ❌
6693         - ❌
6694         - ❌
6695         - ❌
6696
6697
6698    .. list-table:: **test-windows10-64-qr/opt**
6699       :widths: 30 15 15 15 15
6700       :header-rows: 1
6701
6702       * - **Test Name**
6703         - mozilla-central
6704         - autoland
6705         - mozilla-release
6706         - mozilla-beta
6707       * - **browsertime-firefox-youtube-playback-hfr**
6708         - ❌
6709         - ❌
6710         - ❌
6711         - ❌
6712
6713
6714    .. list-table:: **test-windows10-64-shippable-qr/opt**
6715       :widths: 30 15 15 15 15
6716       :header-rows: 1
6717
6718       * - **Test Name**
6719         - mozilla-central
6720         - autoland
6721         - mozilla-release
6722         - mozilla-beta
6723       * - **browsertime-firefox-youtube-playback-hfr**
6724         - ✅
6725         - ❌
6726         - ✅
6727         - ❌
6728
6729
6730
6731 .. dropdown:: youtube-playback-v9-1080p30
6732    :class-container: anchor-id-youtube-playback-v9-1080p30-b
6733
6734    **Owner**: PerfTest Team
6735
6736    * **alert threshold**: 2.0
6737    * **apps**: firefox
6738    * **expected**: pass
6739    * **gather cpuTime**: true
6740    * **gecko profile entries**: 50000000
6741    * **gecko profile interval**: 1000
6742    * **gecko profile threads**: MediaPlayback
6743    * **lower is better**: true
6744    * **page cycles**: 20
6745    * **page timeout**: 2700000
6746    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6747    * **subtest lower is better**: true
6748    * **subtest unit**: score
6749    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
6750    * **type**: benchmark
6751    * **unit**: score
6752    * **use live sites**: true
6753    * **Test Task**:
6754
6755    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
6756       :widths: 30 15 15 15 15
6757       :header-rows: 1
6758
6759       * - **Test Name**
6760         - mozilla-central
6761         - autoland
6762         - mozilla-release
6763         - mozilla-beta
6764       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6765         - ❌
6766         - ❌
6767         - ❌
6768         - ❌
6769
6770
6771    .. list-table:: **test-linux1804-64-qr/opt**
6772       :widths: 30 15 15 15 15
6773       :header-rows: 1
6774
6775       * - **Test Name**
6776         - mozilla-central
6777         - autoland
6778         - mozilla-release
6779         - mozilla-beta
6780       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6781         - ❌
6782         - ❌
6783         - ❌
6784         - ❌
6785
6786
6787    .. list-table:: **test-linux1804-64-shippable-qr/opt**
6788       :widths: 30 15 15 15 15
6789       :header-rows: 1
6790
6791       * - **Test Name**
6792         - mozilla-central
6793         - autoland
6794         - mozilla-release
6795         - mozilla-beta
6796       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6797         - ❌
6798         - ❌
6799         - ❌
6800         - ❌
6801
6802
6803    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
6804       :widths: 30 15 15 15 15
6805       :header-rows: 1
6806
6807       * - **Test Name**
6808         - mozilla-central
6809         - autoland
6810         - mozilla-release
6811         - mozilla-beta
6812       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6813         - ❌
6814         - ❌
6815         - ❌
6816         - ❌
6817
6818
6819    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6820       :widths: 30 15 15 15 15
6821       :header-rows: 1
6822
6823       * - **Test Name**
6824         - mozilla-central
6825         - autoland
6826         - mozilla-release
6827         - mozilla-beta
6828       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6829         - ✅
6830         - ❌
6831         - ❌
6832         - ❌
6833
6834
6835    .. list-table:: **test-windows10-32-qr/opt**
6836       :widths: 30 15 15 15 15
6837       :header-rows: 1
6838
6839       * - **Test Name**
6840         - mozilla-central
6841         - autoland
6842         - mozilla-release
6843         - mozilla-beta
6844       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6845         - ❌
6846         - ❌
6847         - ❌
6848         - ❌
6849
6850
6851    .. list-table:: **test-windows10-32-shippable-qr/opt**
6852       :widths: 30 15 15 15 15
6853       :header-rows: 1
6854
6855       * - **Test Name**
6856         - mozilla-central
6857         - autoland
6858         - mozilla-release
6859         - mozilla-beta
6860       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6861         - ❌
6862         - ❌
6863         - ❌
6864         - ❌
6865
6866
6867    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
6868       :widths: 30 15 15 15 15
6869       :header-rows: 1
6870
6871       * - **Test Name**
6872         - mozilla-central
6873         - autoland
6874         - mozilla-release
6875         - mozilla-beta
6876       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6877         - ❌
6878         - ❌
6879         - ❌
6880         - ❌
6881
6882
6883    .. list-table:: **test-windows10-64-qr/opt**
6884       :widths: 30 15 15 15 15
6885       :header-rows: 1
6886
6887       * - **Test Name**
6888         - mozilla-central
6889         - autoland
6890         - mozilla-release
6891         - mozilla-beta
6892       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6893         - ❌
6894         - ❌
6895         - ❌
6896         - ❌
6897
6898
6899    .. list-table:: **test-windows10-64-shippable-qr/opt**
6900       :widths: 30 15 15 15 15
6901       :header-rows: 1
6902
6903       * - **Test Name**
6904         - mozilla-central
6905         - autoland
6906         - mozilla-release
6907         - mozilla-beta
6908       * - **browsertime-power-firefox-youtube-playback-v9-1080p30**
6909         - ❌
6910         - ❌
6911         - ❌
6912         - ❌
6913
6914
6915
6916 .. dropdown:: youtube-playback-v9-1080p60
6917    :class-container: anchor-id-youtube-playback-v9-1080p60-b
6918
6919    **Owner**: PerfTest Team
6920
6921    * **alert threshold**: 2.0
6922    * **apps**: firefox
6923    * **expected**: pass
6924    * **gather cpuTime**: true
6925    * **gecko profile entries**: 50000000
6926    * **gecko profile interval**: 1000
6927    * **gecko profile threads**: MediaPlayback
6928    * **lower is better**: true
6929    * **page cycles**: 20
6930    * **page timeout**: 2700000
6931    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6932    * **subtest lower is better**: true
6933    * **subtest unit**: score
6934    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
6935    * **type**: benchmark
6936    * **unit**: score
6937    * **use live sites**: true
6938    * **Test Task**:
6939
6940    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
6941       :widths: 30 15 15 15 15
6942       :header-rows: 1
6943
6944       * - **Test Name**
6945         - mozilla-central
6946         - autoland
6947         - mozilla-release
6948         - mozilla-beta
6949       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
6950         - ❌
6951         - ❌
6952         - ❌
6953         - ❌
6954
6955
6956    .. list-table:: **test-linux1804-64-qr/opt**
6957       :widths: 30 15 15 15 15
6958       :header-rows: 1
6959
6960       * - **Test Name**
6961         - mozilla-central
6962         - autoland
6963         - mozilla-release
6964         - mozilla-beta
6965       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
6966         - ❌
6967         - ❌
6968         - ❌
6969         - ❌
6970
6971
6972    .. list-table:: **test-linux1804-64-shippable-qr/opt**
6973       :widths: 30 15 15 15 15
6974       :header-rows: 1
6975
6976       * - **Test Name**
6977         - mozilla-central
6978         - autoland
6979         - mozilla-release
6980         - mozilla-beta
6981       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
6982         - ❌
6983         - ❌
6984         - ❌
6985         - ❌
6986
6987
6988    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
6989       :widths: 30 15 15 15 15
6990       :header-rows: 1
6991
6992       * - **Test Name**
6993         - mozilla-central
6994         - autoland
6995         - mozilla-release
6996         - mozilla-beta
6997       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
6998         - ❌
6999         - ❌
7000         - ❌
7001         - ❌
7002
7003
7004    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7005       :widths: 30 15 15 15 15
7006       :header-rows: 1
7007
7008       * - **Test Name**
7009         - mozilla-central
7010         - autoland
7011         - mozilla-release
7012         - mozilla-beta
7013       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7014         - ✅
7015         - ❌
7016         - ❌
7017         - ❌
7018
7019
7020    .. list-table:: **test-windows10-32-qr/opt**
7021       :widths: 30 15 15 15 15
7022       :header-rows: 1
7023
7024       * - **Test Name**
7025         - mozilla-central
7026         - autoland
7027         - mozilla-release
7028         - mozilla-beta
7029       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7030         - ❌
7031         - ❌
7032         - ❌
7033         - ❌
7034
7035
7036    .. list-table:: **test-windows10-32-shippable-qr/opt**
7037       :widths: 30 15 15 15 15
7038       :header-rows: 1
7039
7040       * - **Test Name**
7041         - mozilla-central
7042         - autoland
7043         - mozilla-release
7044         - mozilla-beta
7045       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7046         - ❌
7047         - ❌
7048         - ❌
7049         - ❌
7050
7051
7052    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
7053       :widths: 30 15 15 15 15
7054       :header-rows: 1
7055
7056       * - **Test Name**
7057         - mozilla-central
7058         - autoland
7059         - mozilla-release
7060         - mozilla-beta
7061       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7062         - ❌
7063         - ❌
7064         - ❌
7065         - ❌
7066
7067
7068    .. list-table:: **test-windows10-64-qr/opt**
7069       :widths: 30 15 15 15 15
7070       :header-rows: 1
7071
7072       * - **Test Name**
7073         - mozilla-central
7074         - autoland
7075         - mozilla-release
7076         - mozilla-beta
7077       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7078         - ❌
7079         - ❌
7080         - ❌
7081         - ❌
7082
7083
7084    .. list-table:: **test-windows10-64-shippable-qr/opt**
7085       :widths: 30 15 15 15 15
7086       :header-rows: 1
7087
7088       * - **Test Name**
7089         - mozilla-central
7090         - autoland
7091         - mozilla-release
7092         - mozilla-beta
7093       * - **browsertime-power-firefox-youtube-playback-v9-1080p60**
7094         - ❌
7095         - ❌
7096         - ❌
7097         - ❌
7098
7099
7100
7101 .. dropdown:: youtube-playback-v9-full-1080p30
7102    :class-container: anchor-id-youtube-playback-v9-full-1080p30-b
7103
7104    **Owner**: PerfTest Team
7105
7106    * **alert threshold**: 2.0
7107    * **apps**: firefox
7108    * **expected**: pass
7109    * **gather cpuTime**: true
7110    * **gecko profile entries**: 50000000
7111    * **gecko profile interval**: 1000
7112    * **gecko profile threads**: MediaPlayback
7113    * **lower is better**: true
7114    * **page cycles**: 20
7115    * **page timeout**: 2700000
7116    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
7117    * **subtest lower is better**: true
7118    * **subtest unit**: score
7119    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
7120    * **type**: benchmark
7121    * **unit**: score
7122    * **use live sites**: true
7123    * **Test Task**:
7124
7125    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
7126       :widths: 30 15 15 15 15
7127       :header-rows: 1
7128
7129       * - **Test Name**
7130         - mozilla-central
7131         - autoland
7132         - mozilla-release
7133         - mozilla-beta
7134       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7135         - ❌
7136         - ❌
7137         - ❌
7138         - ❌
7139
7140
7141    .. list-table:: **test-linux1804-64-qr/opt**
7142       :widths: 30 15 15 15 15
7143       :header-rows: 1
7144
7145       * - **Test Name**
7146         - mozilla-central
7147         - autoland
7148         - mozilla-release
7149         - mozilla-beta
7150       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7151         - ❌
7152         - ❌
7153         - ❌
7154         - ❌
7155
7156
7157    .. list-table:: **test-linux1804-64-shippable-qr/opt**
7158       :widths: 30 15 15 15 15
7159       :header-rows: 1
7160
7161       * - **Test Name**
7162         - mozilla-central
7163         - autoland
7164         - mozilla-release
7165         - mozilla-beta
7166       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7167         - ❌
7168         - ❌
7169         - ❌
7170         - ❌
7171
7172
7173    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
7174       :widths: 30 15 15 15 15
7175       :header-rows: 1
7176
7177       * - **Test Name**
7178         - mozilla-central
7179         - autoland
7180         - mozilla-release
7181         - mozilla-beta
7182       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7183         - ❌
7184         - ❌
7185         - ❌
7186         - ❌
7187
7188
7189    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7190       :widths: 30 15 15 15 15
7191       :header-rows: 1
7192
7193       * - **Test Name**
7194         - mozilla-central
7195         - autoland
7196         - mozilla-release
7197         - mozilla-beta
7198       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7199         - ✅
7200         - ❌
7201         - ❌
7202         - ❌
7203
7204
7205    .. list-table:: **test-windows10-32-qr/opt**
7206       :widths: 30 15 15 15 15
7207       :header-rows: 1
7208
7209       * - **Test Name**
7210         - mozilla-central
7211         - autoland
7212         - mozilla-release
7213         - mozilla-beta
7214       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7215         - ❌
7216         - ❌
7217         - ❌
7218         - ❌
7219
7220
7221    .. list-table:: **test-windows10-32-shippable-qr/opt**
7222       :widths: 30 15 15 15 15
7223       :header-rows: 1
7224
7225       * - **Test Name**
7226         - mozilla-central
7227         - autoland
7228         - mozilla-release
7229         - mozilla-beta
7230       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7231         - ❌
7232         - ❌
7233         - ❌
7234         - ❌
7235
7236
7237    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
7238       :widths: 30 15 15 15 15
7239       :header-rows: 1
7240
7241       * - **Test Name**
7242         - mozilla-central
7243         - autoland
7244         - mozilla-release
7245         - mozilla-beta
7246       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7247         - ❌
7248         - ❌
7249         - ❌
7250         - ❌
7251
7252
7253    .. list-table:: **test-windows10-64-qr/opt**
7254       :widths: 30 15 15 15 15
7255       :header-rows: 1
7256
7257       * - **Test Name**
7258         - mozilla-central
7259         - autoland
7260         - mozilla-release
7261         - mozilla-beta
7262       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7263         - ❌
7264         - ❌
7265         - ❌
7266         - ❌
7267
7268
7269    .. list-table:: **test-windows10-64-shippable-qr/opt**
7270       :widths: 30 15 15 15 15
7271       :header-rows: 1
7272
7273       * - **Test Name**
7274         - mozilla-central
7275         - autoland
7276         - mozilla-release
7277         - mozilla-beta
7278       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
7279         - ❌
7280         - ❌
7281         - ❌
7282         - ❌
7283
7284
7285
7286 .. dropdown:: youtube-playback-v9-full-1080p60
7287    :class-container: anchor-id-youtube-playback-v9-full-1080p60-b
7288
7289    **Owner**: PerfTest Team
7290
7291    * **alert threshold**: 2.0
7292    * **apps**: firefox
7293    * **expected**: pass
7294    * **gather cpuTime**: true
7295    * **gecko profile entries**: 50000000
7296    * **gecko profile interval**: 1000
7297    * **gecko profile threads**: MediaPlayback
7298    * **lower is better**: true
7299    * **page cycles**: 20
7300    * **page timeout**: 2700000
7301    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
7302    * **subtest lower is better**: true
7303    * **subtest unit**: score
7304    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
7305    * **type**: benchmark
7306    * **unit**: score
7307    * **use live sites**: true
7308    * **Test Task**:
7309
7310    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
7311       :widths: 30 15 15 15 15
7312       :header-rows: 1
7313
7314       * - **Test Name**
7315         - mozilla-central
7316         - autoland
7317         - mozilla-release
7318         - mozilla-beta
7319       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7320         - ❌
7321         - ❌
7322         - ❌
7323         - ❌
7324
7325
7326    .. list-table:: **test-linux1804-64-qr/opt**
7327       :widths: 30 15 15 15 15
7328       :header-rows: 1
7329
7330       * - **Test Name**
7331         - mozilla-central
7332         - autoland
7333         - mozilla-release
7334         - mozilla-beta
7335       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7336         - ❌
7337         - ❌
7338         - ❌
7339         - ❌
7340
7341
7342    .. list-table:: **test-linux1804-64-shippable-qr/opt**
7343       :widths: 30 15 15 15 15
7344       :header-rows: 1
7345
7346       * - **Test Name**
7347         - mozilla-central
7348         - autoland
7349         - mozilla-release
7350         - mozilla-beta
7351       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7352         - ❌
7353         - ❌
7354         - ❌
7355         - ❌
7356
7357
7358    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
7359       :widths: 30 15 15 15 15
7360       :header-rows: 1
7361
7362       * - **Test Name**
7363         - mozilla-central
7364         - autoland
7365         - mozilla-release
7366         - mozilla-beta
7367       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7368         - ❌
7369         - ❌
7370         - ❌
7371         - ❌
7372
7373
7374    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7375       :widths: 30 15 15 15 15
7376       :header-rows: 1
7377
7378       * - **Test Name**
7379         - mozilla-central
7380         - autoland
7381         - mozilla-release
7382         - mozilla-beta
7383       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7384         - ✅
7385         - ❌
7386         - ❌
7387         - ❌
7388
7389
7390    .. list-table:: **test-windows10-32-qr/opt**
7391       :widths: 30 15 15 15 15
7392       :header-rows: 1
7393
7394       * - **Test Name**
7395         - mozilla-central
7396         - autoland
7397         - mozilla-release
7398         - mozilla-beta
7399       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7400         - ❌
7401         - ❌
7402         - ❌
7403         - ❌
7404
7405
7406    .. list-table:: **test-windows10-32-shippable-qr/opt**
7407       :widths: 30 15 15 15 15
7408       :header-rows: 1
7409
7410       * - **Test Name**
7411         - mozilla-central
7412         - autoland
7413         - mozilla-release
7414         - mozilla-beta
7415       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7416         - ❌
7417         - ❌
7418         - ❌
7419         - ❌
7420
7421
7422    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
7423       :widths: 30 15 15 15 15
7424       :header-rows: 1
7425
7426       * - **Test Name**
7427         - mozilla-central
7428         - autoland
7429         - mozilla-release
7430         - mozilla-beta
7431       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7432         - ❌
7433         - ❌
7434         - ❌
7435         - ❌
7436
7437
7438    .. list-table:: **test-windows10-64-qr/opt**
7439       :widths: 30 15 15 15 15
7440       :header-rows: 1
7441
7442       * - **Test Name**
7443         - mozilla-central
7444         - autoland
7445         - mozilla-release
7446         - mozilla-beta
7447       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7448         - ❌
7449         - ❌
7450         - ❌
7451         - ❌
7452
7453
7454    .. list-table:: **test-windows10-64-shippable-qr/opt**
7455       :widths: 30 15 15 15 15
7456       :header-rows: 1
7457
7458       * - **Test Name**
7459         - mozilla-central
7460         - autoland
7461         - mozilla-release
7462         - mozilla-beta
7463       * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
7464         - ❌
7465         - ❌
7466         - ❌
7467         - ❌
7468
7469
7470
7471 .. dropdown:: youtube-playback-vp9-sfr
7472    :class-container: anchor-id-youtube-playback-vp9-sfr-b
7473
7474    **Owner**: PerfTest Team
7475
7476    * **alert threshold**: 2.0
7477    * **apps**: firefox, geckoview, fenix, refbrow, chrome
7478    * **expected**: pass
7479    * **gecko profile entries**: 50000000
7480    * **gecko profile interval**: 1000
7481    * **gecko profile threads**: MediaPlayback
7482    * **lower is better**: true
7483    * **page cycles**: 1
7484    * **page timeout**: 2700000
7485    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
7486    * **subtest lower is better**: true
7487    * **subtest unit**: score
7488    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
7489    * **type**: benchmark
7490    * **unit**: score
7491    * **use live sites**: true
7492    * **Test Task**:
7493
7494    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7495       :widths: 30 15 15 15 15
7496       :header-rows: 1
7497
7498       * - **Test Name**
7499         - mozilla-central
7500         - autoland
7501         - mozilla-release
7502         - mozilla-beta
7503       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7504         - ❌
7505         - ❌
7506         - ❌
7507         - ❌
7508
7509
7510    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
7511       :widths: 30 15 15 15 15
7512       :header-rows: 1
7513
7514       * - **Test Name**
7515         - mozilla-central
7516         - autoland
7517         - mozilla-release
7518         - mozilla-beta
7519       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7520         - ❌
7521         - ❌
7522         - ❌
7523         - ❌
7524
7525
7526    .. list-table:: **test-linux1804-64-qr/opt**
7527       :widths: 30 15 15 15 15
7528       :header-rows: 1
7529
7530       * - **Test Name**
7531         - mozilla-central
7532         - autoland
7533         - mozilla-release
7534         - mozilla-beta
7535       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7536         - ❌
7537         - ❌
7538         - ❌
7539         - ❌
7540
7541
7542    .. list-table:: **test-linux1804-64-shippable-qr/opt**
7543       :widths: 30 15 15 15 15
7544       :header-rows: 1
7545
7546       * - **Test Name**
7547         - mozilla-central
7548         - autoland
7549         - mozilla-release
7550         - mozilla-beta
7551       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7552         - ✅
7553         - ❌
7554         - ✅
7555         - ❌
7556
7557
7558    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
7559       :widths: 30 15 15 15 15
7560       :header-rows: 1
7561
7562       * - **Test Name**
7563         - mozilla-central
7564         - autoland
7565         - mozilla-release
7566         - mozilla-beta
7567       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7568         - ❌
7569         - ❌
7570         - ❌
7571         - ❌
7572
7573
7574    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7575       :widths: 30 15 15 15 15
7576       :header-rows: 1
7577
7578       * - **Test Name**
7579         - mozilla-central
7580         - autoland
7581         - mozilla-release
7582         - mozilla-beta
7583       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7584         - ✅
7585         - ❌
7586         - ✅
7587         - ❌
7588
7589
7590    .. list-table:: **test-windows10-32-qr/opt**
7591       :widths: 30 15 15 15 15
7592       :header-rows: 1
7593
7594       * - **Test Name**
7595         - mozilla-central
7596         - autoland
7597         - mozilla-release
7598         - mozilla-beta
7599       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7600         - ❌
7601         - ❌
7602         - ❌
7603         - ❌
7604
7605
7606    .. list-table:: **test-windows10-32-shippable-qr/opt**
7607       :widths: 30 15 15 15 15
7608       :header-rows: 1
7609
7610       * - **Test Name**
7611         - mozilla-central
7612         - autoland
7613         - mozilla-release
7614         - mozilla-beta
7615       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7616         - ❌
7617         - ❌
7618         - ❌
7619         - ❌
7620
7621
7622    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
7623       :widths: 30 15 15 15 15
7624       :header-rows: 1
7625
7626       * - **Test Name**
7627         - mozilla-central
7628         - autoland
7629         - mozilla-release
7630         - mozilla-beta
7631       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7632         - ❌
7633         - ❌
7634         - ❌
7635         - ❌
7636
7637
7638    .. list-table:: **test-windows10-64-qr/opt**
7639       :widths: 30 15 15 15 15
7640       :header-rows: 1
7641
7642       * - **Test Name**
7643         - mozilla-central
7644         - autoland
7645         - mozilla-release
7646         - mozilla-beta
7647       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7648         - ❌
7649         - ❌
7650         - ❌
7651         - ❌
7652
7653
7654    .. list-table:: **test-windows10-64-shippable-qr/opt**
7655       :widths: 30 15 15 15 15
7656       :header-rows: 1
7657
7658       * - **Test Name**
7659         - mozilla-central
7660         - autoland
7661         - mozilla-release
7662         - mozilla-beta
7663       * - **browsertime-firefox-youtube-playback-vp9-sfr**
7664         - ✅
7665         - ❌
7666         - ✅
7667         - ❌
7668
7669
7670
7671 .. dropdown:: youtube-playback-widevine-h264-sfr
7672    :class-container: anchor-id-youtube-playback-widevine-h264-sfr-b
7673
7674    **Owner**: PerfTest Team
7675
7676    * **alert threshold**: 2.0
7677    * **apps**: firefox, geckoview, fenix, refbrow, chrome
7678    * **expected**: pass
7679    * **gecko profile entries**: 50000000
7680    * **gecko profile interval**: 1000
7681    * **gecko profile threads**: MediaPlayback
7682    * **lower is better**: true
7683    * **page cycles**: 1
7684    * **page timeout**: 2700000
7685    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
7686    * **subtest lower is better**: true
7687    * **subtest unit**: score
7688    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
7689    * **type**: benchmark
7690    * **unit**: score
7691    * **use live sites**: true
7692    * **Test Task**:
7693
7694    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7695       :widths: 30 15 15 15 15
7696       :header-rows: 1
7697
7698       * - **Test Name**
7699         - mozilla-central
7700         - autoland
7701         - mozilla-release
7702         - mozilla-beta
7703       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7704         - ❌
7705         - ❌
7706         - ❌
7707         - ❌
7708
7709
7710    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
7711       :widths: 30 15 15 15 15
7712       :header-rows: 1
7713
7714       * - **Test Name**
7715         - mozilla-central
7716         - autoland
7717         - mozilla-release
7718         - mozilla-beta
7719       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7720         - ❌
7721         - ❌
7722         - ❌
7723         - ❌
7724
7725
7726    .. list-table:: **test-linux1804-64-qr/opt**
7727       :widths: 30 15 15 15 15
7728       :header-rows: 1
7729
7730       * - **Test Name**
7731         - mozilla-central
7732         - autoland
7733         - mozilla-release
7734         - mozilla-beta
7735       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7736         - ❌
7737         - ❌
7738         - ❌
7739         - ❌
7740
7741
7742    .. list-table:: **test-linux1804-64-shippable-qr/opt**
7743       :widths: 30 15 15 15 15
7744       :header-rows: 1
7745
7746       * - **Test Name**
7747         - mozilla-central
7748         - autoland
7749         - mozilla-release
7750         - mozilla-beta
7751       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7752         - ✅
7753         - ❌
7754         - ✅
7755         - ❌
7756
7757
7758    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
7759       :widths: 30 15 15 15 15
7760       :header-rows: 1
7761
7762       * - **Test Name**
7763         - mozilla-central
7764         - autoland
7765         - mozilla-release
7766         - mozilla-beta
7767       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7768         - ❌
7769         - ❌
7770         - ❌
7771         - ❌
7772
7773
7774    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7775       :widths: 30 15 15 15 15
7776       :header-rows: 1
7777
7778       * - **Test Name**
7779         - mozilla-central
7780         - autoland
7781         - mozilla-release
7782         - mozilla-beta
7783       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7784         - ✅
7785         - ❌
7786         - ✅
7787         - ❌
7788
7789
7790    .. list-table:: **test-windows10-32-qr/opt**
7791       :widths: 30 15 15 15 15
7792       :header-rows: 1
7793
7794       * - **Test Name**
7795         - mozilla-central
7796         - autoland
7797         - mozilla-release
7798         - mozilla-beta
7799       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7800         - ❌
7801         - ❌
7802         - ❌
7803         - ❌
7804
7805
7806    .. list-table:: **test-windows10-32-shippable-qr/opt**
7807       :widths: 30 15 15 15 15
7808       :header-rows: 1
7809
7810       * - **Test Name**
7811         - mozilla-central
7812         - autoland
7813         - mozilla-release
7814         - mozilla-beta
7815       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7816         - ❌
7817         - ❌
7818         - ❌
7819         - ❌
7820
7821
7822    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
7823       :widths: 30 15 15 15 15
7824       :header-rows: 1
7825
7826       * - **Test Name**
7827         - mozilla-central
7828         - autoland
7829         - mozilla-release
7830         - mozilla-beta
7831       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7832         - ❌
7833         - ❌
7834         - ❌
7835         - ❌
7836
7837
7838    .. list-table:: **test-windows10-64-qr/opt**
7839       :widths: 30 15 15 15 15
7840       :header-rows: 1
7841
7842       * - **Test Name**
7843         - mozilla-central
7844         - autoland
7845         - mozilla-release
7846         - mozilla-beta
7847       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7848         - ❌
7849         - ❌
7850         - ❌
7851         - ❌
7852
7853
7854    .. list-table:: **test-windows10-64-shippable-qr/opt**
7855       :widths: 30 15 15 15 15
7856       :header-rows: 1
7857
7858       * - **Test Name**
7859         - mozilla-central
7860         - autoland
7861         - mozilla-release
7862         - mozilla-beta
7863       * - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
7864         - ✅
7865         - ❌
7866         - ✅
7867         - ❌
7868
7869
7870
7871 .. dropdown:: youtube-playback-widevine-hfr
7872    :class-container: anchor-id-youtube-playback-widevine-hfr-b
7873
7874    **Owner**: PerfTest Team
7875
7876    * **alert threshold**: 2.0
7877    * **apps**: firefox, geckoview, fenix, refbrow, chrome
7878    * **expected**: pass
7879    * **gecko profile entries**: 50000000
7880    * **gecko profile interval**: 1000
7881    * **gecko profile threads**: MediaPlayback
7882    * **lower is better**: true
7883    * **page cycles**: 1
7884    * **page timeout**: 2700000
7885    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
7886    * **subtest lower is better**: true
7887    * **subtest unit**: score
7888    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
7889    * **type**: benchmark
7890    * **unit**: score
7891    * **use live sites**: true
7892    * **Test Task**:
7893
7894    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7895       :widths: 30 15 15 15 15
7896       :header-rows: 1
7897
7898       * - **Test Name**
7899         - mozilla-central
7900         - autoland
7901         - mozilla-release
7902         - mozilla-beta
7903       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7904         - ❌
7905         - ❌
7906         - ❌
7907         - ❌
7908
7909
7910    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
7911       :widths: 30 15 15 15 15
7912       :header-rows: 1
7913
7914       * - **Test Name**
7915         - mozilla-central
7916         - autoland
7917         - mozilla-release
7918         - mozilla-beta
7919       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7920         - ❌
7921         - ❌
7922         - ❌
7923         - ❌
7924
7925
7926    .. list-table:: **test-linux1804-64-qr/opt**
7927       :widths: 30 15 15 15 15
7928       :header-rows: 1
7929
7930       * - **Test Name**
7931         - mozilla-central
7932         - autoland
7933         - mozilla-release
7934         - mozilla-beta
7935       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7936         - ❌
7937         - ❌
7938         - ❌
7939         - ❌
7940
7941
7942    .. list-table:: **test-linux1804-64-shippable-qr/opt**
7943       :widths: 30 15 15 15 15
7944       :header-rows: 1
7945
7946       * - **Test Name**
7947         - mozilla-central
7948         - autoland
7949         - mozilla-release
7950         - mozilla-beta
7951       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7952         - ✅
7953         - ❌
7954         - ✅
7955         - ❌
7956
7957
7958    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
7959       :widths: 30 15 15 15 15
7960       :header-rows: 1
7961
7962       * - **Test Name**
7963         - mozilla-central
7964         - autoland
7965         - mozilla-release
7966         - mozilla-beta
7967       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7968         - ❌
7969         - ❌
7970         - ❌
7971         - ❌
7972
7973
7974    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7975       :widths: 30 15 15 15 15
7976       :header-rows: 1
7977
7978       * - **Test Name**
7979         - mozilla-central
7980         - autoland
7981         - mozilla-release
7982         - mozilla-beta
7983       * - **browsertime-firefox-youtube-playback-widevine-hfr**
7984         - ✅
7985         - ❌
7986         - ✅
7987         - ❌
7988
7989
7990    .. list-table:: **test-windows10-32-qr/opt**
7991       :widths: 30 15 15 15 15
7992       :header-rows: 1
7993
7994       * - **Test Name**
7995         - mozilla-central
7996         - autoland
7997         - mozilla-release
7998         - mozilla-beta
7999       * - **browsertime-firefox-youtube-playback-widevine-hfr**
8000         - ❌
8001         - ❌
8002         - ❌
8003         - ❌
8004
8005
8006    .. list-table:: **test-windows10-32-shippable-qr/opt**
8007       :widths: 30 15 15 15 15
8008       :header-rows: 1
8009
8010       * - **Test Name**
8011         - mozilla-central
8012         - autoland
8013         - mozilla-release
8014         - mozilla-beta
8015       * - **browsertime-firefox-youtube-playback-widevine-hfr**
8016         - ❌
8017         - ❌
8018         - ❌
8019         - ❌
8020
8021
8022    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
8023       :widths: 30 15 15 15 15
8024       :header-rows: 1
8025
8026       * - **Test Name**
8027         - mozilla-central
8028         - autoland
8029         - mozilla-release
8030         - mozilla-beta
8031       * - **browsertime-firefox-youtube-playback-widevine-hfr**
8032         - ❌
8033         - ❌
8034         - ❌
8035         - ❌
8036
8037
8038    .. list-table:: **test-windows10-64-qr/opt**
8039       :widths: 30 15 15 15 15
8040       :header-rows: 1
8041
8042       * - **Test Name**
8043         - mozilla-central
8044         - autoland
8045         - mozilla-release
8046         - mozilla-beta
8047       * - **browsertime-firefox-youtube-playback-widevine-hfr**
8048         - ❌
8049         - ❌
8050         - ❌
8051         - ❌
8052
8053
8054    .. list-table:: **test-windows10-64-shippable-qr/opt**
8055       :widths: 30 15 15 15 15
8056       :header-rows: 1
8057
8058       * - **Test Name**
8059         - mozilla-central
8060         - autoland
8061         - mozilla-release
8062         - mozilla-beta
8063       * - **browsertime-firefox-youtube-playback-widevine-hfr**
8064         - ✅
8065         - ❌
8066         - ✅
8067         - ❌
8068
8069
8070
8071 .. dropdown:: youtube-playback-widevine-vp9-sfr
8072    :class-container: anchor-id-youtube-playback-widevine-vp9-sfr-b
8073
8074    **Owner**: PerfTest Team
8075
8076    * **alert threshold**: 2.0
8077    * **apps**: firefox, geckoview, fenix, refbrow, chrome
8078    * **expected**: pass
8079    * **gecko profile entries**: 50000000
8080    * **gecko profile interval**: 1000
8081    * **gecko profile threads**: MediaPlayback
8082    * **lower is better**: true
8083    * **page cycles**: 1
8084    * **page timeout**: 2700000
8085    * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
8086    * **subtest lower is better**: true
8087    * **subtest unit**: score
8088    * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
8089    * **type**: benchmark
8090    * **unit**: score
8091    * **use live sites**: true
8092    * **Test Task**:
8093
8094    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
8095       :widths: 30 15 15 15 15
8096       :header-rows: 1
8097
8098       * - **Test Name**
8099         - mozilla-central
8100         - autoland
8101         - mozilla-release
8102         - mozilla-beta
8103       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8104         - ❌
8105         - ❌
8106         - ❌
8107         - ❌
8108
8109
8110    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
8111       :widths: 30 15 15 15 15
8112       :header-rows: 1
8113
8114       * - **Test Name**
8115         - mozilla-central
8116         - autoland
8117         - mozilla-release
8118         - mozilla-beta
8119       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8120         - ❌
8121         - ❌
8122         - ❌
8123         - ❌
8124
8125
8126    .. list-table:: **test-linux1804-64-qr/opt**
8127       :widths: 30 15 15 15 15
8128       :header-rows: 1
8129
8130       * - **Test Name**
8131         - mozilla-central
8132         - autoland
8133         - mozilla-release
8134         - mozilla-beta
8135       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8136         - ❌
8137         - ❌
8138         - ❌
8139         - ❌
8140
8141
8142    .. list-table:: **test-linux1804-64-shippable-qr/opt**
8143       :widths: 30 15 15 15 15
8144       :header-rows: 1
8145
8146       * - **Test Name**
8147         - mozilla-central
8148         - autoland
8149         - mozilla-release
8150         - mozilla-beta
8151       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8152         - ✅
8153         - ❌
8154         - ✅
8155         - ❌
8156
8157
8158    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
8159       :widths: 30 15 15 15 15
8160       :header-rows: 1
8161
8162       * - **Test Name**
8163         - mozilla-central
8164         - autoland
8165         - mozilla-release
8166         - mozilla-beta
8167       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8168         - ❌
8169         - ❌
8170         - ❌
8171         - ❌
8172
8173
8174    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8175       :widths: 30 15 15 15 15
8176       :header-rows: 1
8177
8178       * - **Test Name**
8179         - mozilla-central
8180         - autoland
8181         - mozilla-release
8182         - mozilla-beta
8183       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8184         - ✅
8185         - ❌
8186         - ✅
8187         - ❌
8188
8189
8190    .. list-table:: **test-windows10-32-qr/opt**
8191       :widths: 30 15 15 15 15
8192       :header-rows: 1
8193
8194       * - **Test Name**
8195         - mozilla-central
8196         - autoland
8197         - mozilla-release
8198         - mozilla-beta
8199       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8200         - ❌
8201         - ❌
8202         - ❌
8203         - ❌
8204
8205
8206    .. list-table:: **test-windows10-32-shippable-qr/opt**
8207       :widths: 30 15 15 15 15
8208       :header-rows: 1
8209
8210       * - **Test Name**
8211         - mozilla-central
8212         - autoland
8213         - mozilla-release
8214         - mozilla-beta
8215       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8216         - ❌
8217         - ❌
8218         - ❌
8219         - ❌
8220
8221
8222    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
8223       :widths: 30 15 15 15 15
8224       :header-rows: 1
8225
8226       * - **Test Name**
8227         - mozilla-central
8228         - autoland
8229         - mozilla-release
8230         - mozilla-beta
8231       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8232         - ❌
8233         - ❌
8234         - ❌
8235         - ❌
8236
8237
8238    .. list-table:: **test-windows10-64-qr/opt**
8239       :widths: 30 15 15 15 15
8240       :header-rows: 1
8241
8242       * - **Test Name**
8243         - mozilla-central
8244         - autoland
8245         - mozilla-release
8246         - mozilla-beta
8247       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8248         - ❌
8249         - ❌
8250         - ❌
8251         - ❌
8252
8253
8254    .. list-table:: **test-windows10-64-shippable-qr/opt**
8255       :widths: 30 15 15 15 15
8256       :header-rows: 1
8257
8258       * - **Test Name**
8259         - mozilla-central
8260         - autoland
8261         - mozilla-release
8262         - mozilla-beta
8263       * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
8264         - ✅
8265         - ❌
8266         - ✅
8267         - ❌
8268
8269
8270
8271
8272 Custom
8273 ------
8274 Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.
8275
8276 .. dropdown:: browsertime
8277    :class-container: anchor-id-browsertime-c
8278
8279    **Owner**: PerfTest Team
8280
8281    * **alert on**: fcp, loadtime
8282    * **alert threshold**: 2.0
8283    * **apps**: firefox
8284    * **browser cycles**: 1
8285    * **expected**: pass
8286    * **gecko profile entries**: 14000000
8287    * **gecko profile interval**: 1
8288    * **lower is better**: true
8289    * **measure**: fnbpaint, fcp, dcf, loadtime
8290    * **page cycles**: 1
8291    * **page timeout**: 60000
8292    * **playback**: mitmproxy
8293    * **playback pageset manifest**: null.manifest
8294    * **playback version**: 8.1.1
8295    * **test script**: None
8296    * **test url**: `<None>`__
8297    * **type**: pageload
8298    * **unit**: ms
8299    * **use live sites**: true
8300
8301 .. dropdown:: constant-regression
8302    :class-container: anchor-id-constant-regression-c
8303
8304    **Owner**: PerfTest Team
8305
8306    * **alert threshold**: 2.0
8307    * **apps**: firefox, chrome, chromium, safari, geckoview, fenix
8308    * **browser cycles**: 1
8309    * **browsertime args**: --browsertime.constant_value=1500
8310    * **custom data**: true
8311    * **expected**: pass
8312    * **fore window**: 1
8313    * **gecko profile entries**: 14000000
8314    * **gecko profile interval**: 1
8315    * **lower is better**: true
8316    * **max back window**: 3
8317    * **min back window**: 2
8318    * **output timeout**: 2000000
8319    * **page cycles**: 1
8320    * **page timeout**: 1800000
8321    * **subtest unit**: ms
8322    * **test script**: constant_regression_test.js
8323    * **test summary**: flatten
8324    * **test url**: `<None>`__
8325    * **type**: pageload
8326    * **unit**: score
8327    * **use live sites**: true
8328    * **Test Task**:
8329
8330    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
8331       :widths: 30 15 15 15 15
8332       :header-rows: 1
8333
8334       * - **Test Name**
8335         - mozilla-central
8336         - autoland
8337         - mozilla-release
8338         - mozilla-beta
8339       * - **browsertime-regression-tests-firefox-constant-regression**
8340         - ❌
8341         - ✅
8342         - ❌
8343         - ❌
8344
8345
8346    .. list-table:: **test-linux1804-64-qr/opt**
8347       :widths: 30 15 15 15 15
8348       :header-rows: 1
8349
8350       * - **Test Name**
8351         - mozilla-central
8352         - autoland
8353         - mozilla-release
8354         - mozilla-beta
8355       * - **browsertime-regression-tests-firefox-constant-regression**
8356         - ❌
8357         - ✅
8358         - ❌
8359         - ❌
8360
8361
8362
8363 .. dropdown:: grandprix
8364    :class-container: anchor-id-grandprix-c
8365
8366    **Owner**: PerfTest Team
8367
8368    * **alert threshold**: 2.0
8369    * **apps**: firefox, chrome, chromium, safari
8370    * **browser cycles**: 1
8371    * **browsertime args**: --browsertime.grandprix_iterations=25
8372    * **custom data**: true
8373    * **expected**: pass
8374    * **gecko profile entries**: 14000000
8375    * **gecko profile interval**: 1
8376    * **lower is better**: true
8377    * **output timeout**: 2000000
8378    * **page cycles**: 1
8379    * **page timeout**: 1800000
8380    * **subtest name filters**: tests/,iterations/
8381    * **subtest unit**: ms
8382    * **test script**: grandprix.js
8383    * **test summary**: flatten
8384    * **test url**: `<None>`__
8385    * **type**: pageload
8386    * **unit**: score
8387    * **use live sites**: true
8388
8389 .. dropdown:: process-switch
8390    :class-container: anchor-id-process-switch-c
8391
8392    **Owner**: PerfTest Team
8393
8394    * **accept zero vismet**: true
8395    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
8396    * **alert threshold**: 2.0
8397    * **apps**: firefox, chrome, chromium
8398    * **browser cycles**: 25
8399    * **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true
8400    * **expected**: pass
8401    * **gecko profile entries**: 14000000
8402    * **gecko profile interval**: 1
8403    * **lower is better**: true
8404    * **page cycles**: 25
8405    * **page timeout**: 60000
8406    * **playback**: mitmproxy
8407    * **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest
8408    * **playback version**: 5.1.1
8409    * **test script**: process_switch.js
8410    * **test url**: `<https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html>`__
8411    * **type**: pageload
8412    * **unit**: ms
8413    * **use live sites**: false
8414    * **Test Task**:
8415
8416    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
8417       :widths: 30 15 15 15 15
8418       :header-rows: 1
8419
8420       * - **Test Name**
8421         - mozilla-central
8422         - autoland
8423         - mozilla-release
8424         - mozilla-beta
8425       * - **browsertime-custom-firefox-process-switch**
8426         - ❌
8427         - ❌
8428         - ❌
8429         - ❌
8430
8431
8432    .. list-table:: **test-linux1804-64-qr/opt**
8433       :widths: 30 15 15 15 15
8434       :header-rows: 1
8435
8436       * - **Test Name**
8437         - mozilla-central
8438         - autoland
8439         - mozilla-release
8440         - mozilla-beta
8441       * - **browsertime-custom-firefox-process-switch**
8442         - ❌
8443         - ❌
8444         - ❌
8445         - ❌
8446
8447
8448    .. list-table:: **test-linux1804-64-shippable-qr/opt**
8449       :widths: 30 15 15 15 15
8450       :header-rows: 1
8451
8452       * - **Test Name**
8453         - mozilla-central
8454         - autoland
8455         - mozilla-release
8456         - mozilla-beta
8457       * - **browsertime-custom-firefox-process-switch**
8458         - ✅
8459         - ❌
8460         - ❌
8461         - ❌
8462
8463
8464    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
8465       :widths: 30 15 15 15 15
8466       :header-rows: 1
8467
8468       * - **Test Name**
8469         - mozilla-central
8470         - autoland
8471         - mozilla-release
8472         - mozilla-beta
8473       * - **browsertime-custom-firefox-process-switch**
8474         - ❌
8475         - ❌
8476         - ❌
8477         - ❌
8478
8479
8480    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8481       :widths: 30 15 15 15 15
8482       :header-rows: 1
8483
8484       * - **Test Name**
8485         - mozilla-central
8486         - autoland
8487         - mozilla-release
8488         - mozilla-beta
8489       * - **browsertime-custom-firefox-process-switch**
8490         - ✅
8491         - ❌
8492         - ❌
8493         - ❌
8494
8495
8496    .. list-table:: **test-windows10-32-qr/opt**
8497       :widths: 30 15 15 15 15
8498       :header-rows: 1
8499
8500       * - **Test Name**
8501         - mozilla-central
8502         - autoland
8503         - mozilla-release
8504         - mozilla-beta
8505       * - **browsertime-custom-firefox-process-switch**
8506         - ❌
8507         - ❌
8508         - ❌
8509         - ❌
8510
8511
8512    .. list-table:: **test-windows10-32-shippable-qr/opt**
8513       :widths: 30 15 15 15 15
8514       :header-rows: 1
8515
8516       * - **Test Name**
8517         - mozilla-central
8518         - autoland
8519         - mozilla-release
8520         - mozilla-beta
8521       * - **browsertime-custom-firefox-process-switch**
8522         - ❌
8523         - ❌
8524         - ❌
8525         - ❌
8526
8527
8528    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
8529       :widths: 30 15 15 15 15
8530       :header-rows: 1
8531
8532       * - **Test Name**
8533         - mozilla-central
8534         - autoland
8535         - mozilla-release
8536         - mozilla-beta
8537       * - **browsertime-custom-firefox-process-switch**
8538         - ❌
8539         - ❌
8540         - ❌
8541         - ❌
8542
8543
8544    .. list-table:: **test-windows10-64-qr/opt**
8545       :widths: 30 15 15 15 15
8546       :header-rows: 1
8547
8548       * - **Test Name**
8549         - mozilla-central
8550         - autoland
8551         - mozilla-release
8552         - mozilla-beta
8553       * - **browsertime-custom-firefox-process-switch**
8554         - ❌
8555         - ❌
8556         - ❌
8557         - ❌
8558
8559
8560    .. list-table:: **test-windows10-64-shippable-qr/opt**
8561       :widths: 30 15 15 15 15
8562       :header-rows: 1
8563
8564       * - **Test Name**
8565         - mozilla-central
8566         - autoland
8567         - mozilla-release
8568         - mozilla-beta
8569       * - **browsertime-custom-firefox-process-switch**
8570         - ✅
8571         - ❌
8572         - ❌
8573         - ❌
8574
8575
8576
8577 .. dropdown:: sample-python-support
8578    :class-container: anchor-id-sample-python-support-c
8579
8580    **Owner**: PerfTest Team
8581
8582    * **alert threshold**: 2.0
8583    * **apps**: firefox
8584    * **browser cycles**: 1
8585    * **browsertime args**: --browsertime.constant_value={replace-with-constant-value}
8586    * **custom data**: true
8587    * **expected**: pass
8588    * **fore window**: 1
8589    * **gecko profile entries**: 14000000
8590    * **gecko profile interval**: 1
8591    * **lower is better**: true
8592    * **max back window**: 3
8593    * **min back window**: 2
8594    * **output timeout**: 2000000
8595    * **page cycles**: 1
8596    * **page timeout**: 1800000
8597    * **subtest unit**: ms
8598    * **support class**: sample_python_support.py
8599    * **test script**: constant_regression_test.js
8600    * **test summary**: flatten
8601    * **test url**: `<None>`__
8602    * **type**: pageload
8603    * **unit**: score
8604    * **use live sites**: true
8605
8606 .. dropdown:: upload
8607    :class-container: anchor-id-upload-c
8608
8609    **Owner**: Network Team
8610
8611    * **alert threshold**: 2.0
8612    * **apps**: firefox, chrome, chromium, safari
8613    * **browser cycles**: 1
8614    * **browsertime args**: --browsertime.upload_iterations=10 --firefox.preference=network.http.http3.enable:false --chrome.args disable-quic
8615    * **custom data**: true
8616    * **expected**: pass
8617    * **gecko profile entries**: 14000000
8618    * **gecko profile interval**: 1
8619    * **lower is better**: false
8620    * **output timeout**: 2000000
8621    * **page cycles**: 1
8622    * **page timeout**: 1800000
8623    * **subtest lower is better**: false
8624    * **subtest name filters**: tests/,iterations/
8625    * **subtest unit**: mbps
8626    * **test script**: upload.js
8627    * **test url**: `<None>`__
8628    * **type**: pageload
8629    * **unit**: mbps
8630    * **use live sites**: true
8631    * **Test Task**:
8632
8633    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
8634       :widths: 30 15 15 15 15
8635       :header-rows: 1
8636
8637       * - **Test Name**
8638         - mozilla-central
8639         - autoland
8640         - mozilla-release
8641         - mozilla-beta
8642       * - **browsertime-upload-firefox-upload**
8643         - ❌
8644         - ❌
8645         - ❌
8646         - ❌
8647
8648
8649    .. list-table:: **test-linux1804-64-qr/opt**
8650       :widths: 30 15 15 15 15
8651       :header-rows: 1
8652
8653       * - **Test Name**
8654         - mozilla-central
8655         - autoland
8656         - mozilla-release
8657         - mozilla-beta
8658       * - **browsertime-upload-firefox-upload**
8659         - ❌
8660         - ❌
8661         - ❌
8662         - ❌
8663
8664
8665    .. list-table:: **test-linux1804-64-shippable-qr/opt**
8666       :widths: 30 15 15 15 15
8667       :header-rows: 1
8668
8669       * - **Test Name**
8670         - mozilla-central
8671         - autoland
8672         - mozilla-release
8673         - mozilla-beta
8674       * - **browsertime-upload-chrome-upload**
8675         - ❌
8676         - ❌
8677         - ❌
8678         - ❌
8679       * - **browsertime-upload-chromium-upload**
8680         - ❌
8681         - ❌
8682         - ❌
8683         - ❌
8684       * - **browsertime-upload-firefox-upload**
8685         - ✅
8686         - ✅
8687         - ❌
8688         - ❌
8689
8690
8691    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
8692       :widths: 30 15 15 15 15
8693       :header-rows: 1
8694
8695       * - **Test Name**
8696         - mozilla-central
8697         - autoland
8698         - mozilla-release
8699         - mozilla-beta
8700       * - **browsertime-upload-firefox-upload**
8701         - ❌
8702         - ❌
8703         - ❌
8704         - ❌
8705
8706
8707    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8708       :widths: 30 15 15 15 15
8709       :header-rows: 1
8710
8711       * - **Test Name**
8712         - mozilla-central
8713         - autoland
8714         - mozilla-release
8715         - mozilla-beta
8716       * - **browsertime-upload-chrome-upload**
8717         - ❌
8718         - ❌
8719         - ❌
8720         - ❌
8721       * - **browsertime-upload-chromium-upload**
8722         - ❌
8723         - ❌
8724         - ❌
8725         - ❌
8726       * - **browsertime-upload-firefox-upload**
8727         - ✅
8728         - ✅
8729         - ❌
8730         - ❌
8731       * - **browsertime-upload-safari-upload**
8732         - ❌
8733         - ❌
8734         - ❌
8735         - ❌
8736
8737
8738    .. list-table:: **test-windows10-32-qr/opt**
8739       :widths: 30 15 15 15 15
8740       :header-rows: 1
8741
8742       * - **Test Name**
8743         - mozilla-central
8744         - autoland
8745         - mozilla-release
8746         - mozilla-beta
8747       * - **browsertime-upload-firefox-upload**
8748         - ❌
8749         - ❌
8750         - ❌
8751         - ❌
8752
8753
8754    .. list-table:: **test-windows10-32-shippable-qr/opt**
8755       :widths: 30 15 15 15 15
8756       :header-rows: 1
8757
8758       * - **Test Name**
8759         - mozilla-central
8760         - autoland
8761         - mozilla-release
8762         - mozilla-beta
8763       * - **browsertime-upload-chrome-upload**
8764         - ❌
8765         - ❌
8766         - ❌
8767         - ❌
8768       * - **browsertime-upload-chromium-upload**
8769         - ❌
8770         - ❌
8771         - ❌
8772         - ❌
8773       * - **browsertime-upload-firefox-upload**
8774         - ❌
8775         - ❌
8776         - ❌
8777         - ❌
8778
8779
8780    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
8781       :widths: 30 15 15 15 15
8782       :header-rows: 1
8783
8784       * - **Test Name**
8785         - mozilla-central
8786         - autoland
8787         - mozilla-release
8788         - mozilla-beta
8789       * - **browsertime-upload-firefox-upload**
8790         - ❌
8791         - ❌
8792         - ❌
8793         - ❌
8794
8795
8796    .. list-table:: **test-windows10-64-qr/opt**
8797       :widths: 30 15 15 15 15
8798       :header-rows: 1
8799
8800       * - **Test Name**
8801         - mozilla-central
8802         - autoland
8803         - mozilla-release
8804         - mozilla-beta
8805       * - **browsertime-upload-firefox-upload**
8806         - ❌
8807         - ❌
8808         - ❌
8809         - ❌
8810
8811
8812    .. list-table:: **test-windows10-64-shippable-qr/opt**
8813       :widths: 30 15 15 15 15
8814       :header-rows: 1
8815
8816       * - **Test Name**
8817         - mozilla-central
8818         - autoland
8819         - mozilla-release
8820         - mozilla-beta
8821       * - **browsertime-upload-chrome-upload**
8822         - ❌
8823         - ❌
8824         - ❌
8825         - ❌
8826       * - **browsertime-upload-chromium-upload**
8827         - ❌
8828         - ❌
8829         - ❌
8830         - ❌
8831       * - **browsertime-upload-firefox-upload**
8832         - ✅
8833         - ✅
8834         - ❌
8835         - ❌
8836
8837
8838
8839 .. dropdown:: welcome
8840    :class-container: anchor-id-welcome-c
8841
8842    **Owner**: PerfTest Team
8843
8844    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
8845    * **alert threshold**: 2.0
8846    * **apps**: firefox
8847    * **browser cycles**: 25
8848    * **expected**: pass
8849    * **gecko profile entries**: 14000000
8850    * **gecko profile interval**: 1
8851    * **lower is better**: true
8852    * **page cycles**: 25
8853    * **page timeout**: 60000
8854    * **playback**: mitmproxy
8855    * **playback pageset manifest**: mitm5-linux-firefox-welcome.manifest
8856    * **playback version**: 8.1.1
8857    * **test script**: welcome.js
8858    * **test url**: `<about:welcome>`__
8859    * **type**: pageload
8860    * **unit**: ms
8861    * **use live sites**: false
8862    * **Test Task**:
8863
8864    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
8865       :widths: 30 15 15 15 15
8866       :header-rows: 1
8867
8868       * - **Test Name**
8869         - mozilla-central
8870         - autoland
8871         - mozilla-release
8872         - mozilla-beta
8873       * - **browsertime-first-install-firefox-welcome**
8874         - ❌
8875         - ❌
8876         - ❌
8877         - ❌
8878
8879
8880    .. list-table:: **test-linux1804-64-qr/opt**
8881       :widths: 30 15 15 15 15
8882       :header-rows: 1
8883
8884       * - **Test Name**
8885         - mozilla-central
8886         - autoland
8887         - mozilla-release
8888         - mozilla-beta
8889       * - **browsertime-first-install-firefox-welcome**
8890         - ❌
8891         - ❌
8892         - ❌
8893         - ❌
8894
8895
8896    .. list-table:: **test-linux1804-64-shippable-qr/opt**
8897       :widths: 30 15 15 15 15
8898       :header-rows: 1
8899
8900       * - **Test Name**
8901         - mozilla-central
8902         - autoland
8903         - mozilla-release
8904         - mozilla-beta
8905       * - **browsertime-first-install-firefox-welcome**
8906         - ✅
8907         - ✅
8908         - ❌
8909         - ❌
8910
8911
8912    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
8913       :widths: 30 15 15 15 15
8914       :header-rows: 1
8915
8916       * - **Test Name**
8917         - mozilla-central
8918         - autoland
8919         - mozilla-release
8920         - mozilla-beta
8921       * - **browsertime-first-install-firefox-welcome**
8922         - ❌
8923         - ❌
8924         - ❌
8925         - ❌
8926
8927
8928    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8929       :widths: 30 15 15 15 15
8930       :header-rows: 1
8931
8932       * - **Test Name**
8933         - mozilla-central
8934         - autoland
8935         - mozilla-release
8936         - mozilla-beta
8937       * - **browsertime-first-install-firefox-welcome**
8938         - ✅
8939         - ✅
8940         - ❌
8941         - ❌
8942
8943
8944    .. list-table:: **test-windows10-32-qr/opt**
8945       :widths: 30 15 15 15 15
8946       :header-rows: 1
8947
8948       * - **Test Name**
8949         - mozilla-central
8950         - autoland
8951         - mozilla-release
8952         - mozilla-beta
8953       * - **browsertime-first-install-firefox-welcome**
8954         - ❌
8955         - ❌
8956         - ❌
8957         - ❌
8958
8959
8960    .. list-table:: **test-windows10-32-shippable-qr/opt**
8961       :widths: 30 15 15 15 15
8962       :header-rows: 1
8963
8964       * - **Test Name**
8965         - mozilla-central
8966         - autoland
8967         - mozilla-release
8968         - mozilla-beta
8969       * - **browsertime-first-install-firefox-welcome**
8970         - ❌
8971         - ❌
8972         - ❌
8973         - ❌
8974
8975
8976    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
8977       :widths: 30 15 15 15 15
8978       :header-rows: 1
8979
8980       * - **Test Name**
8981         - mozilla-central
8982         - autoland
8983         - mozilla-release
8984         - mozilla-beta
8985       * - **browsertime-first-install-firefox-welcome**
8986         - ❌
8987         - ❌
8988         - ❌
8989         - ❌
8990
8991
8992    .. list-table:: **test-windows10-64-qr/opt**
8993       :widths: 30 15 15 15 15
8994       :header-rows: 1
8995
8996       * - **Test Name**
8997         - mozilla-central
8998         - autoland
8999         - mozilla-release
9000         - mozilla-beta
9001       * - **browsertime-first-install-firefox-welcome**
9002         - ❌
9003         - ❌
9004         - ❌
9005         - ❌
9006
9007
9008    .. list-table:: **test-windows10-64-shippable-qr/opt**
9009       :widths: 30 15 15 15 15
9010       :header-rows: 1
9011
9012       * - **Test Name**
9013         - mozilla-central
9014         - autoland
9015         - mozilla-release
9016         - mozilla-beta
9017       * - **browsertime-first-install-firefox-welcome**
9018         - ✅
9019         - ✅
9020         - ❌
9021         - ❌
9022
9023
9024
9025
9026 Desktop
9027 -------
9028 Tests for page-load performance. The links direct to the actual websites that are being tested.
9029
9030 .. dropdown:: amazon
9031    :class-container: anchor-id-amazon-d
9032
9033    **Owner**: PerfTest Team
9034
9035    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
9036    * **alert threshold**: 2.0
9037    * **apps**: firefox, chrome, chromium, safari, custom-car
9038    * **browser cycles**: 25
9039    * **expected**: pass
9040    * **gecko profile entries**: 14000000
9041    * **gecko profile interval**: 1
9042    * **lower is better**: true
9043    * **page cycles**: 25
9044    * **page timeout**: 60000
9045    * **playback**: mitmproxy
9046    * **playback pageset manifest**: mitm7-linux-firefox-amazon.manifest
9047    * **playback version**: 8.1.1
9048    * **secondary url**: `<https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3>`__
9049    * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
9050    * **type**: pageload
9051    * **unit**: ms
9052    * **use live sites**: false
9053    * **Test Task**:
9054
9055    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
9056       :widths: 30 15 15 15 15
9057       :header-rows: 1
9058
9059       * - **Test Name**
9060         - mozilla-central
9061         - autoland
9062         - mozilla-release
9063         - mozilla-beta
9064       * - **browsertime-tp6m-fenix-amazon**
9065         - ❌
9066         - ❌
9067         - ❌
9068         - ❌
9069       * - **browsertime-tp6m-fenix-amazon-nofis**
9070         - ❌
9071         - ❌
9072         - ❌
9073         - ❌
9074       * - **browsertime-tp6m-geckoview-amazon**
9075         - ❌
9076         - ❌
9077         - ❌
9078         - ❌
9079       * - **browsertime-tp6m-geckoview-amazon-nofis**
9080         - ❌
9081         - ❌
9082         - ❌
9083         - ❌
9084       * - **browsertime-tp6m-live-fenix-amazon-nofis**
9085         - ❌
9086         - ❌
9087         - ❌
9088         - ❌
9089       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
9090         - ❌
9091         - ❌
9092         - ❌
9093         - ❌
9094       * - **browsertime-tp6m-refbrow-amazon**
9095         - ❌
9096         - ❌
9097         - ❌
9098         - ❌
9099
9100
9101    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
9102       :widths: 30 15 15 15 15
9103       :header-rows: 1
9104
9105       * - **Test Name**
9106         - mozilla-central
9107         - autoland
9108         - mozilla-release
9109         - mozilla-beta
9110       * - **browsertime-tp6m-chrome-m-amazon**
9111         - ❌
9112         - ❌
9113         - ❌
9114         - ❌
9115       * - **browsertime-tp6m-chrome-m-amazon-nofis**
9116         - ❌
9117         - ❌
9118         - ❌
9119         - ❌
9120       * - **browsertime-tp6m-fenix-amazon**
9121         - ❌
9122         - ❌
9123         - ❌
9124         - ❌
9125       * - **browsertime-tp6m-fenix-amazon-nofis**
9126         - ❌
9127         - ❌
9128         - ❌
9129         - ❌
9130       * - **browsertime-tp6m-geckoview-amazon**
9131         - ❌
9132         - ❌
9133         - ❌
9134         - ❌
9135       * - **browsertime-tp6m-geckoview-amazon-nofis**
9136         - ✅
9137         - ✅
9138         - ❌
9139         - ❌
9140       * - **browsertime-tp6m-live-chrome-m-amazon-nofis**
9141         - ❌
9142         - ❌
9143         - ❌
9144         - ❌
9145       * - **browsertime-tp6m-live-fenix-amazon-nofis**
9146         - ❌
9147         - ❌
9148         - ❌
9149         - ❌
9150       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
9151         - ❌
9152         - ❌
9153         - ❌
9154         - ❌
9155       * - **browsertime-tp6m-refbrow-amazon**
9156         - ❌
9157         - ❌
9158         - ❌
9159         - ❌
9160
9161
9162    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
9163       :widths: 30 15 15 15 15
9164       :header-rows: 1
9165
9166       * - **Test Name**
9167         - mozilla-central
9168         - autoland
9169         - mozilla-release
9170         - mozilla-beta
9171       * - **browsertime-tp6-bytecode-firefox-amazon**
9172         - ❌
9173         - ❌
9174         - ❌
9175         - ❌
9176       * - **browsertime-tp6-essential-custom-car-amazon**
9177         - ❌
9178         - ❌
9179         - ❌
9180         - ❌
9181       * - **browsertime-tp6-essential-firefox-amazon**
9182         - ❌
9183         - ❌
9184         - ❌
9185         - ❌
9186       * - **browsertime-tp6-live-firefox-amazon**
9187         - ❌
9188         - ❌
9189         - ❌
9190         - ❌
9191
9192
9193    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
9194       :widths: 30 15 15 15 15
9195       :header-rows: 1
9196
9197       * - **Test Name**
9198         - mozilla-central
9199         - autoland
9200         - mozilla-release
9201         - mozilla-beta
9202       * - **browsertime-tp6-bytecode-firefox-amazon**
9203         - ❌
9204         - ❌
9205         - ❌
9206         - ❌
9207       * - **browsertime-tp6-essential-custom-car-amazon**
9208         - ❌
9209         - ❌
9210         - ❌
9211         - ❌
9212       * - **browsertime-tp6-essential-firefox-amazon**
9213         - ❌
9214         - ❌
9215         - ❌
9216         - ❌
9217       * - **browsertime-tp6-live-firefox-amazon**
9218         - ❌
9219         - ❌
9220         - ❌
9221         - ❌
9222
9223
9224    .. list-table:: **test-linux1804-64-qr/opt**
9225       :widths: 30 15 15 15 15
9226       :header-rows: 1
9227
9228       * - **Test Name**
9229         - mozilla-central
9230         - autoland
9231         - mozilla-release
9232         - mozilla-beta
9233       * - **browsertime-tp6-bytecode-firefox-amazon**
9234         - ❌
9235         - ❌
9236         - ❌
9237         - ❌
9238       * - **browsertime-tp6-essential-custom-car-amazon**
9239         - ❌
9240         - ❌
9241         - ❌
9242         - ❌
9243       * - **browsertime-tp6-essential-firefox-amazon**
9244         - ❌
9245         - ❌
9246         - ❌
9247         - ❌
9248       * - **browsertime-tp6-live-firefox-amazon**
9249         - ❌
9250         - ❌
9251         - ❌
9252         - ❌
9253
9254
9255    .. list-table:: **test-linux1804-64-shippable-qr/opt**
9256       :widths: 30 15 15 15 15
9257       :header-rows: 1
9258
9259       * - **Test Name**
9260         - mozilla-central
9261         - autoland
9262         - mozilla-release
9263         - mozilla-beta
9264       * - **browsertime-tp6-bytecode-firefox-amazon**
9265         - ✅
9266         - ✅
9267         - ✅
9268         - ✅
9269       * - **browsertime-tp6-essential-chrome-amazon**
9270         - ❌
9271         - ❌
9272         - ❌
9273         - ❌
9274       * - **browsertime-tp6-essential-chromium-amazon**
9275         - ❌
9276         - ❌
9277         - ❌
9278         - ❌
9279       * - **browsertime-tp6-essential-custom-car-amazon**
9280         - ❌
9281         - ❌
9282         - ❌
9283         - ❌
9284       * - **browsertime-tp6-essential-firefox-amazon**
9285         - ✅
9286         - ✅
9287         - ✅
9288         - ✅
9289       * - **browsertime-tp6-live-chrome-amazon**
9290         - ❌
9291         - ❌
9292         - ❌
9293         - ❌
9294       * - **browsertime-tp6-live-chromium-amazon**
9295         - ❌
9296         - ❌
9297         - ❌
9298         - ❌
9299       * - **browsertime-tp6-live-firefox-amazon**
9300         - ❌
9301         - ❌
9302         - ❌
9303         - ❌
9304       * - **browsertime-tp6-profiling-firefox-amazon**
9305         - ✅
9306         - ❌
9307         - ❌
9308         - ❌
9309
9310
9311    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
9312       :widths: 30 15 15 15 15
9313       :header-rows: 1
9314
9315       * - **Test Name**
9316         - mozilla-central
9317         - autoland
9318         - mozilla-release
9319         - mozilla-beta
9320       * - **browsertime-tp6-bytecode-firefox-amazon**
9321         - ❌
9322         - ❌
9323         - ❌
9324         - ❌
9325       * - **browsertime-tp6-essential-custom-car-amazon**
9326         - ❌
9327         - ❌
9328         - ❌
9329         - ❌
9330       * - **browsertime-tp6-essential-firefox-amazon**
9331         - ❌
9332         - ❌
9333         - ❌
9334         - ❌
9335       * - **browsertime-tp6-live-firefox-amazon**
9336         - ❌
9337         - ❌
9338         - ❌
9339         - ❌
9340
9341
9342    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
9343       :widths: 30 15 15 15 15
9344       :header-rows: 1
9345
9346       * - **Test Name**
9347         - mozilla-central
9348         - autoland
9349         - mozilla-release
9350         - mozilla-beta
9351       * - **browsertime-tp6-bytecode-firefox-amazon**
9352         - ✅
9353         - ✅
9354         - ✅
9355         - ✅
9356       * - **browsertime-tp6-essential-chrome-amazon**
9357         - ❌
9358         - ❌
9359         - ❌
9360         - ❌
9361       * - **browsertime-tp6-essential-chromium-amazon**
9362         - ❌
9363         - ❌
9364         - ❌
9365         - ❌
9366       * - **browsertime-tp6-essential-custom-car-amazon**
9367         - ❌
9368         - ❌
9369         - ❌
9370         - ❌
9371       * - **browsertime-tp6-essential-firefox-amazon**
9372         - ✅
9373         - ✅
9374         - ✅
9375         - ✅
9376       * - **browsertime-tp6-live-chrome-amazon**
9377         - ❌
9378         - ❌
9379         - ❌
9380         - ❌
9381       * - **browsertime-tp6-live-chromium-amazon**
9382         - ❌
9383         - ❌
9384         - ❌
9385         - ❌
9386       * - **browsertime-tp6-live-firefox-amazon**
9387         - ❌
9388         - ❌
9389         - ❌
9390         - ❌
9391       * - **browsertime-tp6-live-safari-amazon**
9392         - ❌
9393         - ❌
9394         - ❌
9395         - ❌
9396       * - **browsertime-tp6-profiling-firefox-amazon**
9397         - ✅
9398         - ❌
9399         - ❌
9400         - ❌
9401
9402
9403    .. list-table:: **test-windows10-32-qr/opt**
9404       :widths: 30 15 15 15 15
9405       :header-rows: 1
9406
9407       * - **Test Name**
9408         - mozilla-central
9409         - autoland
9410         - mozilla-release
9411         - mozilla-beta
9412       * - **browsertime-tp6-bytecode-firefox-amazon**
9413         - ❌
9414         - ❌
9415         - ❌
9416         - ❌
9417       * - **browsertime-tp6-essential-custom-car-amazon**
9418         - ❌
9419         - ❌
9420         - ❌
9421         - ❌
9422       * - **browsertime-tp6-essential-firefox-amazon**
9423         - ❌
9424         - ❌
9425         - ❌
9426         - ❌
9427       * - **browsertime-tp6-live-firefox-amazon**
9428         - ❌
9429         - ❌
9430         - ❌
9431         - ❌
9432
9433
9434    .. list-table:: **test-windows10-32-shippable-qr/opt**
9435       :widths: 30 15 15 15 15
9436       :header-rows: 1
9437
9438       * - **Test Name**
9439         - mozilla-central
9440         - autoland
9441         - mozilla-release
9442         - mozilla-beta
9443       * - **browsertime-tp6-bytecode-firefox-amazon**
9444         - ❌
9445         - ❌
9446         - ❌
9447         - ❌
9448       * - **browsertime-tp6-essential-chrome-amazon**
9449         - ❌
9450         - ❌
9451         - ❌
9452         - ❌
9453       * - **browsertime-tp6-essential-chromium-amazon**
9454         - ❌
9455         - ❌
9456         - ❌
9457         - ❌
9458       * - **browsertime-tp6-essential-custom-car-amazon**
9459         - ❌
9460         - ❌
9461         - ❌
9462         - ❌
9463       * - **browsertime-tp6-essential-firefox-amazon**
9464         - ❌
9465         - ❌
9466         - ❌
9467         - ❌
9468       * - **browsertime-tp6-live-chrome-amazon**
9469         - ❌
9470         - ❌
9471         - ❌
9472         - ❌
9473       * - **browsertime-tp6-live-chromium-amazon**
9474         - ❌
9475         - ❌
9476         - ❌
9477         - ❌
9478       * - **browsertime-tp6-live-firefox-amazon**
9479         - ❌
9480         - ❌
9481         - ❌
9482         - ❌
9483
9484
9485    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
9486       :widths: 30 15 15 15 15
9487       :header-rows: 1
9488
9489       * - **Test Name**
9490         - mozilla-central
9491         - autoland
9492         - mozilla-release
9493         - mozilla-beta
9494       * - **browsertime-tp6-bytecode-firefox-amazon**
9495         - ❌
9496         - ❌
9497         - ❌
9498         - ❌
9499       * - **browsertime-tp6-essential-custom-car-amazon**
9500         - ❌
9501         - ❌
9502         - ❌
9503         - ❌
9504       * - **browsertime-tp6-essential-firefox-amazon**
9505         - ❌
9506         - ❌
9507         - ❌
9508         - ❌
9509       * - **browsertime-tp6-live-firefox-amazon**
9510         - ❌
9511         - ❌
9512         - ❌
9513         - ❌
9514
9515
9516    .. list-table:: **test-windows10-64-qr/opt**
9517       :widths: 30 15 15 15 15
9518       :header-rows: 1
9519
9520       * - **Test Name**
9521         - mozilla-central
9522         - autoland
9523         - mozilla-release
9524         - mozilla-beta
9525       * - **browsertime-tp6-bytecode-firefox-amazon**
9526         - ❌
9527         - ❌
9528         - ❌
9529         - ❌
9530       * - **browsertime-tp6-essential-custom-car-amazon**
9531         - ❌
9532         - ❌
9533         - ❌
9534         - ❌
9535       * - **browsertime-tp6-essential-firefox-amazon**
9536         - ❌
9537         - ❌
9538         - ❌
9539         - ❌
9540       * - **browsertime-tp6-live-firefox-amazon**
9541         - ❌
9542         - ❌
9543         - ❌
9544         - ❌
9545
9546
9547    .. list-table:: **test-windows10-64-shippable-qr/opt**
9548       :widths: 30 15 15 15 15
9549       :header-rows: 1
9550
9551       * - **Test Name**
9552         - mozilla-central
9553         - autoland
9554         - mozilla-release
9555         - mozilla-beta
9556       * - **browsertime-tp6-bytecode-firefox-amazon**
9557         - ✅
9558         - ✅
9559         - ✅
9560         - ✅
9561       * - **browsertime-tp6-essential-chrome-amazon**
9562         - ❌
9563         - ❌
9564         - ❌
9565         - ❌
9566       * - **browsertime-tp6-essential-chromium-amazon**
9567         - ❌
9568         - ❌
9569         - ❌
9570         - ❌
9571       * - **browsertime-tp6-essential-custom-car-amazon**
9572         - ❌
9573         - ❌
9574         - ❌
9575         - ❌
9576       * - **browsertime-tp6-essential-firefox-amazon**
9577         - ✅
9578         - ✅
9579         - ✅
9580         - ✅
9581       * - **browsertime-tp6-live-chrome-amazon**
9582         - ❌
9583         - ❌
9584         - ❌
9585         - ❌
9586       * - **browsertime-tp6-live-chromium-amazon**
9587         - ❌
9588         - ❌
9589         - ❌
9590         - ❌
9591       * - **browsertime-tp6-live-firefox-amazon**
9592         - ❌
9593         - ❌
9594         - ❌
9595         - ❌
9596
9597
9598
9599 .. dropdown:: bing-search
9600    :class-container: anchor-id-bing-search-d
9601
9602    **Owner**: PerfTest Team
9603
9604    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
9605    * **alert threshold**: 2.0
9606    * **apps**: firefox, chrome, chromium, safari, custom-car
9607    * **browser cycles**: 25
9608    * **expected**: pass
9609    * **gecko profile entries**: 14000000
9610    * **gecko profile interval**: 1
9611    * **lower is better**: true
9612    * **page cycles**: 25
9613    * **page timeout**: 60000
9614    * **playback**: mitmproxy
9615    * **playback pageset manifest**: mitm5-linux-firefox-bing-search.manifest
9616    * **playback version**: 8.1.1
9617    * **test url**: `<https://www.bing.com/search?q=barack+obama>`__
9618    * **type**: pageload
9619    * **unit**: ms
9620    * **use live sites**: false
9621    * **Test Task**:
9622
9623    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
9624       :widths: 30 15 15 15 15
9625       :header-rows: 1
9626
9627       * - **Test Name**
9628         - mozilla-central
9629         - autoland
9630         - mozilla-release
9631         - mozilla-beta
9632       * - **browsertime-tp6-bytecode-firefox-bing-search**
9633         - ❌
9634         - ❌
9635         - ❌
9636         - ❌
9637       * - **browsertime-tp6-essential-custom-car-bing-search**
9638         - ❌
9639         - ❌
9640         - ❌
9641         - ❌
9642       * - **browsertime-tp6-essential-firefox-bing-search**
9643         - ❌
9644         - ❌
9645         - ❌
9646         - ❌
9647       * - **browsertime-tp6-live-firefox-bing-search**
9648         - ❌
9649         - ❌
9650         - ❌
9651         - ❌
9652
9653
9654    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
9655       :widths: 30 15 15 15 15
9656       :header-rows: 1
9657
9658       * - **Test Name**
9659         - mozilla-central
9660         - autoland
9661         - mozilla-release
9662         - mozilla-beta
9663       * - **browsertime-tp6-bytecode-firefox-bing-search**
9664         - ❌
9665         - ❌
9666         - ❌
9667         - ❌
9668       * - **browsertime-tp6-essential-custom-car-bing-search**
9669         - ❌
9670         - ❌
9671         - ❌
9672         - ❌
9673       * - **browsertime-tp6-essential-firefox-bing-search**
9674         - ❌
9675         - ❌
9676         - ❌
9677         - ❌
9678       * - **browsertime-tp6-live-firefox-bing-search**
9679         - ❌
9680         - ❌
9681         - ❌
9682         - ❌
9683
9684
9685    .. list-table:: **test-linux1804-64-qr/opt**
9686       :widths: 30 15 15 15 15
9687       :header-rows: 1
9688
9689       * - **Test Name**
9690         - mozilla-central
9691         - autoland
9692         - mozilla-release
9693         - mozilla-beta
9694       * - **browsertime-tp6-bytecode-firefox-bing-search**
9695         - ❌
9696         - ❌
9697         - ❌
9698         - ❌
9699       * - **browsertime-tp6-essential-custom-car-bing-search**
9700         - ❌
9701         - ❌
9702         - ❌
9703         - ❌
9704       * - **browsertime-tp6-essential-firefox-bing-search**
9705         - ❌
9706         - ❌
9707         - ❌
9708         - ❌
9709       * - **browsertime-tp6-live-firefox-bing-search**
9710         - ❌
9711         - ❌
9712         - ❌
9713         - ❌
9714
9715
9716    .. list-table:: **test-linux1804-64-shippable-qr/opt**
9717       :widths: 30 15 15 15 15
9718       :header-rows: 1
9719
9720       * - **Test Name**
9721         - mozilla-central
9722         - autoland
9723         - mozilla-release
9724         - mozilla-beta
9725       * - **browsertime-tp6-bytecode-firefox-bing-search**
9726         - ✅
9727         - ✅
9728         - ✅
9729         - ✅
9730       * - **browsertime-tp6-essential-chrome-bing-search**
9731         - ❌
9732         - ❌
9733         - ❌
9734         - ❌
9735       * - **browsertime-tp6-essential-chromium-bing-search**
9736         - ❌
9737         - ❌
9738         - ❌
9739         - ❌
9740       * - **browsertime-tp6-essential-custom-car-bing-search**
9741         - ❌
9742         - ❌
9743         - ❌
9744         - ❌
9745       * - **browsertime-tp6-essential-firefox-bing-search**
9746         - ✅
9747         - ✅
9748         - ✅
9749         - ✅
9750       * - **browsertime-tp6-live-chrome-bing-search**
9751         - ❌
9752         - ❌
9753         - ❌
9754         - ❌
9755       * - **browsertime-tp6-live-chromium-bing-search**
9756         - ❌
9757         - ❌
9758         - ❌
9759         - ❌
9760       * - **browsertime-tp6-live-firefox-bing-search**
9761         - ❌
9762         - ❌
9763         - ❌
9764         - ❌
9765
9766
9767    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
9768       :widths: 30 15 15 15 15
9769       :header-rows: 1
9770
9771       * - **Test Name**
9772         - mozilla-central
9773         - autoland
9774         - mozilla-release
9775         - mozilla-beta
9776       * - **browsertime-tp6-bytecode-firefox-bing-search**
9777         - ❌
9778         - ❌
9779         - ❌
9780         - ❌
9781       * - **browsertime-tp6-essential-custom-car-bing-search**
9782         - ❌
9783         - ❌
9784         - ❌
9785         - ❌
9786       * - **browsertime-tp6-essential-firefox-bing-search**
9787         - ❌
9788         - ❌
9789         - ❌
9790         - ❌
9791       * - **browsertime-tp6-live-firefox-bing-search**
9792         - ❌
9793         - ❌
9794         - ❌
9795         - ❌
9796
9797
9798    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
9799       :widths: 30 15 15 15 15
9800       :header-rows: 1
9801
9802       * - **Test Name**
9803         - mozilla-central
9804         - autoland
9805         - mozilla-release
9806         - mozilla-beta
9807       * - **browsertime-tp6-bytecode-firefox-bing-search**
9808         - ✅
9809         - ✅
9810         - ✅
9811         - ✅
9812       * - **browsertime-tp6-essential-chrome-bing-search**
9813         - ❌
9814         - ❌
9815         - ❌
9816         - ❌
9817       * - **browsertime-tp6-essential-chromium-bing-search**
9818         - ❌
9819         - ❌
9820         - ❌
9821         - ❌
9822       * - **browsertime-tp6-essential-custom-car-bing-search**
9823         - ❌
9824         - ❌
9825         - ❌
9826         - ❌
9827       * - **browsertime-tp6-essential-firefox-bing-search**
9828         - ✅
9829         - ✅
9830         - ✅
9831         - ✅
9832       * - **browsertime-tp6-live-chrome-bing-search**
9833         - ❌
9834         - ❌
9835         - ❌
9836         - ❌
9837       * - **browsertime-tp6-live-chromium-bing-search**
9838         - ❌
9839         - ❌
9840         - ❌
9841         - ❌
9842       * - **browsertime-tp6-live-firefox-bing-search**
9843         - ❌
9844         - ❌
9845         - ❌
9846         - ❌
9847       * - **browsertime-tp6-live-safari-bing-search**
9848         - ❌
9849         - ❌
9850         - ❌
9851         - ❌
9852
9853
9854    .. list-table:: **test-windows10-32-qr/opt**
9855       :widths: 30 15 15 15 15
9856       :header-rows: 1
9857
9858       * - **Test Name**
9859         - mozilla-central
9860         - autoland
9861         - mozilla-release
9862         - mozilla-beta
9863       * - **browsertime-tp6-bytecode-firefox-bing-search**
9864         - ❌
9865         - ❌
9866         - ❌
9867         - ❌
9868       * - **browsertime-tp6-essential-custom-car-bing-search**
9869         - ❌
9870         - ❌
9871         - ❌
9872         - ❌
9873       * - **browsertime-tp6-essential-firefox-bing-search**
9874         - ❌
9875         - ❌
9876         - ❌
9877         - ❌
9878       * - **browsertime-tp6-live-firefox-bing-search**
9879         - ❌
9880         - ❌
9881         - ❌
9882         - ❌
9883
9884
9885    .. list-table:: **test-windows10-32-shippable-qr/opt**
9886       :widths: 30 15 15 15 15
9887       :header-rows: 1
9888
9889       * - **Test Name**
9890         - mozilla-central
9891         - autoland
9892         - mozilla-release
9893         - mozilla-beta
9894       * - **browsertime-tp6-bytecode-firefox-bing-search**
9895         - ❌
9896         - ❌
9897         - ❌
9898         - ❌
9899       * - **browsertime-tp6-essential-chrome-bing-search**
9900         - ❌
9901         - ❌
9902         - ❌
9903         - ❌
9904       * - **browsertime-tp6-essential-chromium-bing-search**
9905         - ❌
9906         - ❌
9907         - ❌
9908         - ❌
9909       * - **browsertime-tp6-essential-custom-car-bing-search**
9910         - ❌
9911         - ❌
9912         - ❌
9913         - ❌
9914       * - **browsertime-tp6-essential-firefox-bing-search**
9915         - ❌
9916         - ❌
9917         - ❌
9918         - ❌
9919       * - **browsertime-tp6-live-chrome-bing-search**
9920         - ❌
9921         - ❌
9922         - ❌
9923         - ❌
9924       * - **browsertime-tp6-live-chromium-bing-search**
9925         - ❌
9926         - ❌
9927         - ❌
9928         - ❌
9929       * - **browsertime-tp6-live-firefox-bing-search**
9930         - ❌
9931         - ❌
9932         - ❌
9933         - ❌
9934
9935
9936    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
9937       :widths: 30 15 15 15 15
9938       :header-rows: 1
9939
9940       * - **Test Name**
9941         - mozilla-central
9942         - autoland
9943         - mozilla-release
9944         - mozilla-beta
9945       * - **browsertime-tp6-bytecode-firefox-bing-search**
9946         - ❌
9947         - ❌
9948         - ❌
9949         - ❌
9950       * - **browsertime-tp6-essential-custom-car-bing-search**
9951         - ❌
9952         - ❌
9953         - ❌
9954         - ❌
9955       * - **browsertime-tp6-essential-firefox-bing-search**
9956         - ❌
9957         - ❌
9958         - ❌
9959         - ❌
9960       * - **browsertime-tp6-live-firefox-bing-search**
9961         - ❌
9962         - ❌
9963         - ❌
9964         - ❌
9965
9966
9967    .. list-table:: **test-windows10-64-qr/opt**
9968       :widths: 30 15 15 15 15
9969       :header-rows: 1
9970
9971       * - **Test Name**
9972         - mozilla-central
9973         - autoland
9974         - mozilla-release
9975         - mozilla-beta
9976       * - **browsertime-tp6-bytecode-firefox-bing-search**
9977         - ❌
9978         - ❌
9979         - ❌
9980         - ❌
9981       * - **browsertime-tp6-essential-custom-car-bing-search**
9982         - ❌
9983         - ❌
9984         - ❌
9985         - ❌
9986       * - **browsertime-tp6-essential-firefox-bing-search**
9987         - ❌
9988         - ❌
9989         - ❌
9990         - ❌
9991       * - **browsertime-tp6-live-firefox-bing-search**
9992         - ❌
9993         - ❌
9994         - ❌
9995         - ❌
9996
9997
9998    .. list-table:: **test-windows10-64-shippable-qr/opt**
9999       :widths: 30 15 15 15 15
10000       :header-rows: 1
10001
10002       * - **Test Name**
10003         - mozilla-central
10004         - autoland
10005         - mozilla-release
10006         - mozilla-beta
10007       * - **browsertime-tp6-bytecode-firefox-bing-search**
10008         - ✅
10009         - ✅
10010         - ✅
10011         - ✅
10012       * - **browsertime-tp6-essential-chrome-bing-search**
10013         - ❌
10014         - ❌
10015         - ❌
10016         - ❌
10017       * - **browsertime-tp6-essential-chromium-bing-search**
10018         - ❌
10019         - ❌
10020         - ❌
10021         - ❌
10022       * - **browsertime-tp6-essential-custom-car-bing-search**
10023         - ❌
10024         - ❌
10025         - ❌
10026         - ❌
10027       * - **browsertime-tp6-essential-firefox-bing-search**
10028         - ✅
10029         - ✅
10030         - ✅
10031         - ✅
10032       * - **browsertime-tp6-live-chrome-bing-search**
10033         - ❌
10034         - ❌
10035         - ❌
10036         - ❌
10037       * - **browsertime-tp6-live-chromium-bing-search**
10038         - ❌
10039         - ❌
10040         - ❌
10041         - ❌
10042       * - **browsertime-tp6-live-firefox-bing-search**
10043         - ❌
10044         - ❌
10045         - ❌
10046         - ❌
10047
10048
10049
10050 .. dropdown:: buzzfeed
10051    :class-container: anchor-id-buzzfeed-d
10052
10053    **Owner**: PerfTest Team
10054
10055    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
10056    * **alert threshold**: 2.0
10057    * **apps**: firefox, chrome, chromium, safari, custom-car
10058    * **browser cycles**: 25
10059    * **expected**: pass
10060    * **gecko profile entries**: 14000000
10061    * **gecko profile interval**: 1
10062    * **lower is better**: true
10063    * **page cycles**: 25
10064    * **page timeout**: 60000
10065    * **playback**: mitmproxy
10066    * **playback pageset manifest**: mitm7-linux-firefox-buzzfeed.manifest
10067    * **playback version**: 8.1.1
10068    * **secondary url**: `<https://www.buzzfeed.com/quizzes>`__
10069    * **test url**: `<https://www.buzzfeed.com/>`__
10070    * **type**: pageload
10071    * **unit**: ms
10072    * **use live sites**: false
10073    * **Test Task**:
10074
10075    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
10076       :widths: 30 15 15 15 15
10077       :header-rows: 1
10078
10079       * - **Test Name**
10080         - mozilla-central
10081         - autoland
10082         - mozilla-release
10083         - mozilla-beta
10084       * - **browsertime-tp6-firefox-buzzfeed**
10085         - ❌
10086         - ❌
10087         - ❌
10088         - ❌
10089
10090
10091    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
10092       :widths: 30 15 15 15 15
10093       :header-rows: 1
10094
10095       * - **Test Name**
10096         - mozilla-central
10097         - autoland
10098         - mozilla-release
10099         - mozilla-beta
10100       * - **browsertime-tp6-firefox-buzzfeed**
10101         - ❌
10102         - ❌
10103         - ❌
10104         - ❌
10105
10106
10107    .. list-table:: **test-linux1804-64-qr/opt**
10108       :widths: 30 15 15 15 15
10109       :header-rows: 1
10110
10111       * - **Test Name**
10112         - mozilla-central
10113         - autoland
10114         - mozilla-release
10115         - mozilla-beta
10116       * - **browsertime-tp6-firefox-buzzfeed**
10117         - ❌
10118         - ❌
10119         - ❌
10120         - ❌
10121
10122
10123    .. list-table:: **test-linux1804-64-shippable-qr/opt**
10124       :widths: 30 15 15 15 15
10125       :header-rows: 1
10126
10127       * - **Test Name**
10128         - mozilla-central
10129         - autoland
10130         - mozilla-release
10131         - mozilla-beta
10132       * - **browsertime-tp6-chrome-buzzfeed**
10133         - ❌
10134         - ❌
10135         - ❌
10136         - ❌
10137       * - **browsertime-tp6-chromium-buzzfeed**
10138         - ❌
10139         - ❌
10140         - ❌
10141         - ❌
10142       * - **browsertime-tp6-firefox-buzzfeed**
10143         - ✅
10144         - ✅
10145         - ✅
10146         - ✅
10147
10148
10149    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
10150       :widths: 30 15 15 15 15
10151       :header-rows: 1
10152
10153       * - **Test Name**
10154         - mozilla-central
10155         - autoland
10156         - mozilla-release
10157         - mozilla-beta
10158       * - **browsertime-tp6-firefox-buzzfeed**
10159         - ❌
10160         - ❌
10161         - ❌
10162         - ❌
10163
10164
10165    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
10166       :widths: 30 15 15 15 15
10167       :header-rows: 1
10168
10169       * - **Test Name**
10170         - mozilla-central
10171         - autoland
10172         - mozilla-release
10173         - mozilla-beta
10174       * - **browsertime-tp6-chrome-buzzfeed**
10175         - ❌
10176         - ❌
10177         - ❌
10178         - ❌
10179       * - **browsertime-tp6-chromium-buzzfeed**
10180         - ❌
10181         - ❌
10182         - ❌
10183         - ❌
10184       * - **browsertime-tp6-firefox-buzzfeed**
10185         - ✅
10186         - ✅
10187         - ✅
10188         - ✅
10189
10190
10191    .. list-table:: **test-windows10-32-qr/opt**
10192       :widths: 30 15 15 15 15
10193       :header-rows: 1
10194
10195       * - **Test Name**
10196         - mozilla-central
10197         - autoland
10198         - mozilla-release
10199         - mozilla-beta
10200       * - **browsertime-tp6-firefox-buzzfeed**
10201         - ❌
10202         - ❌
10203         - ❌
10204         - ❌
10205
10206
10207    .. list-table:: **test-windows10-32-shippable-qr/opt**
10208       :widths: 30 15 15 15 15
10209       :header-rows: 1
10210
10211       * - **Test Name**
10212         - mozilla-central
10213         - autoland
10214         - mozilla-release
10215         - mozilla-beta
10216       * - **browsertime-tp6-chrome-buzzfeed**
10217         - ❌
10218         - ❌
10219         - ❌
10220         - ❌
10221       * - **browsertime-tp6-chromium-buzzfeed**
10222         - ❌
10223         - ❌
10224         - ❌
10225         - ❌
10226       * - **browsertime-tp6-firefox-buzzfeed**
10227         - ❌
10228         - ❌
10229         - ❌
10230         - ❌
10231
10232
10233    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
10234       :widths: 30 15 15 15 15
10235       :header-rows: 1
10236
10237       * - **Test Name**
10238         - mozilla-central
10239         - autoland
10240         - mozilla-release
10241         - mozilla-beta
10242       * - **browsertime-tp6-firefox-buzzfeed**
10243         - ❌
10244         - ❌
10245         - ❌
10246         - ❌
10247
10248
10249    .. list-table:: **test-windows10-64-qr/opt**
10250       :widths: 30 15 15 15 15
10251       :header-rows: 1
10252
10253       * - **Test Name**
10254         - mozilla-central
10255         - autoland
10256         - mozilla-release
10257         - mozilla-beta
10258       * - **browsertime-tp6-firefox-buzzfeed**
10259         - ❌
10260         - ❌
10261         - ❌
10262         - ❌
10263
10264
10265    .. list-table:: **test-windows10-64-shippable-qr/opt**
10266       :widths: 30 15 15 15 15
10267       :header-rows: 1
10268
10269       * - **Test Name**
10270         - mozilla-central
10271         - autoland
10272         - mozilla-release
10273         - mozilla-beta
10274       * - **browsertime-tp6-chrome-buzzfeed**
10275         - ❌
10276         - ❌
10277         - ❌
10278         - ❌
10279       * - **browsertime-tp6-chromium-buzzfeed**
10280         - ❌
10281         - ❌
10282         - ❌
10283         - ❌
10284       * - **browsertime-tp6-firefox-buzzfeed**
10285         - ✅
10286         - ✅
10287         - ✅
10288         - ✅
10289
10290
10291
10292 .. dropdown:: cnn
10293    :class-container: anchor-id-cnn-d
10294
10295    **Owner**: PerfTest Team
10296
10297    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
10298    * **alert threshold**: 2.0
10299    * **apps**: firefox, chrome, chromium, safari, custom-car
10300    * **browser cycles**: 25
10301    * **expected**: pass
10302    * **gecko profile entries**: 14000000
10303    * **gecko profile interval**: 1
10304    * **lower is better**: true
10305    * **page cycles**: 25
10306    * **page timeout**: 60000
10307    * **playback**: mitmproxy
10308    * **playback pageset manifest**: mitm7-linux-firefox-cnn.manifest
10309    * **playback version**: 8.1.1
10310    * **secondary url**: `<https://www.cnn.com/weather>`__
10311    * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
10312    * **type**: pageload
10313    * **unit**: ms
10314    * **use live sites**: false
10315    * **Test Task**:
10316
10317    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
10318       :widths: 30 15 15 15 15
10319       :header-rows: 1
10320
10321       * - **Test Name**
10322         - mozilla-central
10323         - autoland
10324         - mozilla-release
10325         - mozilla-beta
10326       * - **browsertime-tp6m-fenix-cnn**
10327         - ❌
10328         - ❌
10329         - ❌
10330         - ❌
10331       * - **browsertime-tp6m-fenix-cnn-nofis**
10332         - ❌
10333         - ❌
10334         - ❌
10335         - ❌
10336       * - **browsertime-tp6m-geckoview-cnn**
10337         - ❌
10338         - ❌
10339         - ❌
10340         - ❌
10341       * - **browsertime-tp6m-geckoview-cnn-nofis**
10342         - ❌
10343         - ❌
10344         - ❌
10345         - ❌
10346       * - **browsertime-tp6m-live-fenix-cnn-nofis**
10347         - ❌
10348         - ❌
10349         - ❌
10350         - ❌
10351       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
10352         - ❌
10353         - ❌
10354         - ❌
10355         - ❌
10356       * - **browsertime-tp6m-refbrow-cnn**
10357         - ❌
10358         - ❌
10359         - ❌
10360         - ❌
10361
10362
10363    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
10364       :widths: 30 15 15 15 15
10365       :header-rows: 1
10366
10367       * - **Test Name**
10368         - mozilla-central
10369         - autoland
10370         - mozilla-release
10371         - mozilla-beta
10372       * - **browsertime-tp6m-chrome-m-cnn**
10373         - ❌
10374         - ❌
10375         - ❌
10376         - ❌
10377       * - **browsertime-tp6m-chrome-m-cnn-nofis**
10378         - ❌
10379         - ❌
10380         - ❌
10381         - ❌
10382       * - **browsertime-tp6m-fenix-cnn**
10383         - ❌
10384         - ❌
10385         - ❌
10386         - ❌
10387       * - **browsertime-tp6m-fenix-cnn-nofis**
10388         - ❌
10389         - ❌
10390         - ❌
10391         - ❌
10392       * - **browsertime-tp6m-geckoview-cnn**
10393         - ❌
10394         - ❌
10395         - ❌
10396         - ❌
10397       * - **browsertime-tp6m-geckoview-cnn-nofis**
10398         - ✅
10399         - ✅
10400         - ❌
10401         - ❌
10402       * - **browsertime-tp6m-live-chrome-m-cnn-nofis**
10403         - ❌
10404         - ❌
10405         - ❌
10406         - ❌
10407       * - **browsertime-tp6m-live-fenix-cnn-nofis**
10408         - ❌
10409         - ❌
10410         - ❌
10411         - ❌
10412       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
10413         - ❌
10414         - ❌
10415         - ❌
10416         - ❌
10417       * - **browsertime-tp6m-refbrow-cnn**
10418         - ❌
10419         - ❌
10420         - ❌
10421         - ❌
10422
10423
10424    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
10425       :widths: 30 15 15 15 15
10426       :header-rows: 1
10427
10428       * - **Test Name**
10429         - mozilla-central
10430         - autoland
10431         - mozilla-release
10432         - mozilla-beta
10433       * - **browsertime-tp6-bytecode-firefox-cnn**
10434         - ❌
10435         - ❌
10436         - ❌
10437         - ❌
10438       * - **browsertime-tp6-essential-custom-car-cnn**
10439         - ❌
10440         - ❌
10441         - ❌
10442         - ❌
10443       * - **browsertime-tp6-essential-firefox-cnn**
10444         - ❌
10445         - ❌
10446         - ❌
10447         - ❌
10448       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10449         - ❌
10450         - ❌
10451         - ❌
10452         - ❌
10453
10454
10455    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
10456       :widths: 30 15 15 15 15
10457       :header-rows: 1
10458
10459       * - **Test Name**
10460         - mozilla-central
10461         - autoland
10462         - mozilla-release
10463         - mozilla-beta
10464       * - **browsertime-tp6-bytecode-firefox-cnn**
10465         - ❌
10466         - ❌
10467         - ❌
10468         - ❌
10469       * - **browsertime-tp6-essential-custom-car-cnn**
10470         - ❌
10471         - ❌
10472         - ❌
10473         - ❌
10474       * - **browsertime-tp6-essential-firefox-cnn**
10475         - ❌
10476         - ❌
10477         - ❌
10478         - ❌
10479       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10480         - ❌
10481         - ❌
10482         - ❌
10483         - ❌
10484
10485
10486    .. list-table:: **test-linux1804-64-qr/opt**
10487       :widths: 30 15 15 15 15
10488       :header-rows: 1
10489
10490       * - **Test Name**
10491         - mozilla-central
10492         - autoland
10493         - mozilla-release
10494         - mozilla-beta
10495       * - **browsertime-tp6-bytecode-firefox-cnn**
10496         - ❌
10497         - ❌
10498         - ❌
10499         - ❌
10500       * - **browsertime-tp6-essential-custom-car-cnn**
10501         - ❌
10502         - ❌
10503         - ❌
10504         - ❌
10505       * - **browsertime-tp6-essential-firefox-cnn**
10506         - ❌
10507         - ❌
10508         - ❌
10509         - ❌
10510       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10511         - ❌
10512         - ❌
10513         - ❌
10514         - ❌
10515
10516
10517    .. list-table:: **test-linux1804-64-shippable-qr/opt**
10518       :widths: 30 15 15 15 15
10519       :header-rows: 1
10520
10521       * - **Test Name**
10522         - mozilla-central
10523         - autoland
10524         - mozilla-release
10525         - mozilla-beta
10526       * - **browsertime-tp6-bytecode-firefox-cnn**
10527         - ✅
10528         - ✅
10529         - ✅
10530         - ✅
10531       * - **browsertime-tp6-essential-chrome-cnn**
10532         - ❌
10533         - ❌
10534         - ❌
10535         - ❌
10536       * - **browsertime-tp6-essential-chromium-cnn**
10537         - ❌
10538         - ❌
10539         - ❌
10540         - ❌
10541       * - **browsertime-tp6-essential-custom-car-cnn**
10542         - ❌
10543         - ❌
10544         - ❌
10545         - ❌
10546       * - **browsertime-tp6-essential-firefox-cnn**
10547         - ✅
10548         - ✅
10549         - ✅
10550         - ✅
10551       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10552         - ❌
10553         - ❌
10554         - ❌
10555         - ❌
10556
10557
10558    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
10559       :widths: 30 15 15 15 15
10560       :header-rows: 1
10561
10562       * - **Test Name**
10563         - mozilla-central
10564         - autoland
10565         - mozilla-release
10566         - mozilla-beta
10567       * - **browsertime-tp6-bytecode-firefox-cnn**
10568         - ❌
10569         - ❌
10570         - ❌
10571         - ❌
10572       * - **browsertime-tp6-essential-custom-car-cnn**
10573         - ❌
10574         - ❌
10575         - ❌
10576         - ❌
10577       * - **browsertime-tp6-essential-firefox-cnn**
10578         - ❌
10579         - ❌
10580         - ❌
10581         - ❌
10582       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10583         - ❌
10584         - ❌
10585         - ❌
10586         - ❌
10587
10588
10589    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
10590       :widths: 30 15 15 15 15
10591       :header-rows: 1
10592
10593       * - **Test Name**
10594         - mozilla-central
10595         - autoland
10596         - mozilla-release
10597         - mozilla-beta
10598       * - **browsertime-tp6-bytecode-firefox-cnn**
10599         - ✅
10600         - ✅
10601         - ✅
10602         - ✅
10603       * - **browsertime-tp6-essential-chrome-cnn**
10604         - ❌
10605         - ❌
10606         - ❌
10607         - ❌
10608       * - **browsertime-tp6-essential-chromium-cnn**
10609         - ❌
10610         - ❌
10611         - ❌
10612         - ❌
10613       * - **browsertime-tp6-essential-custom-car-cnn**
10614         - ❌
10615         - ❌
10616         - ❌
10617         - ❌
10618       * - **browsertime-tp6-essential-firefox-cnn**
10619         - ✅
10620         - ✅
10621         - ✅
10622         - ✅
10623       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10624         - ❌
10625         - ❌
10626         - ❌
10627         - ❌
10628
10629
10630    .. list-table:: **test-windows10-32-qr/opt**
10631       :widths: 30 15 15 15 15
10632       :header-rows: 1
10633
10634       * - **Test Name**
10635         - mozilla-central
10636         - autoland
10637         - mozilla-release
10638         - mozilla-beta
10639       * - **browsertime-tp6-bytecode-firefox-cnn**
10640         - ❌
10641         - ❌
10642         - ❌
10643         - ❌
10644       * - **browsertime-tp6-essential-custom-car-cnn**
10645         - ❌
10646         - ❌
10647         - ❌
10648         - ❌
10649       * - **browsertime-tp6-essential-firefox-cnn**
10650         - ❌
10651         - ❌
10652         - ❌
10653         - ❌
10654       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10655         - ❌
10656         - ❌
10657         - ❌
10658         - ❌
10659
10660
10661    .. list-table:: **test-windows10-32-shippable-qr/opt**
10662       :widths: 30 15 15 15 15
10663       :header-rows: 1
10664
10665       * - **Test Name**
10666         - mozilla-central
10667         - autoland
10668         - mozilla-release
10669         - mozilla-beta
10670       * - **browsertime-tp6-bytecode-firefox-cnn**
10671         - ❌
10672         - ❌
10673         - ❌
10674         - ❌
10675       * - **browsertime-tp6-essential-chrome-cnn**
10676         - ❌
10677         - ❌
10678         - ❌
10679         - ❌
10680       * - **browsertime-tp6-essential-chromium-cnn**
10681         - ❌
10682         - ❌
10683         - ❌
10684         - ❌
10685       * - **browsertime-tp6-essential-custom-car-cnn**
10686         - ❌
10687         - ❌
10688         - ❌
10689         - ❌
10690       * - **browsertime-tp6-essential-firefox-cnn**
10691         - ❌
10692         - ❌
10693         - ❌
10694         - ❌
10695       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10696         - ❌
10697         - ❌
10698         - ❌
10699         - ❌
10700
10701
10702    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
10703       :widths: 30 15 15 15 15
10704       :header-rows: 1
10705
10706       * - **Test Name**
10707         - mozilla-central
10708         - autoland
10709         - mozilla-release
10710         - mozilla-beta
10711       * - **browsertime-tp6-bytecode-firefox-cnn**
10712         - ❌
10713         - ❌
10714         - ❌
10715         - ❌
10716       * - **browsertime-tp6-essential-custom-car-cnn**
10717         - ❌
10718         - ❌
10719         - ❌
10720         - ❌
10721       * - **browsertime-tp6-essential-firefox-cnn**
10722         - ❌
10723         - ❌
10724         - ❌
10725         - ❌
10726       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10727         - ❌
10728         - ❌
10729         - ❌
10730         - ❌
10731
10732
10733    .. list-table:: **test-windows10-64-qr/opt**
10734       :widths: 30 15 15 15 15
10735       :header-rows: 1
10736
10737       * - **Test Name**
10738         - mozilla-central
10739         - autoland
10740         - mozilla-release
10741         - mozilla-beta
10742       * - **browsertime-tp6-bytecode-firefox-cnn**
10743         - ❌
10744         - ❌
10745         - ❌
10746         - ❌
10747       * - **browsertime-tp6-essential-custom-car-cnn**
10748         - ❌
10749         - ❌
10750         - ❌
10751         - ❌
10752       * - **browsertime-tp6-essential-firefox-cnn**
10753         - ❌
10754         - ❌
10755         - ❌
10756         - ❌
10757       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10758         - ❌
10759         - ❌
10760         - ❌
10761         - ❌
10762
10763
10764    .. list-table:: **test-windows10-64-shippable-qr/opt**
10765       :widths: 30 15 15 15 15
10766       :header-rows: 1
10767
10768       * - **Test Name**
10769         - mozilla-central
10770         - autoland
10771         - mozilla-release
10772         - mozilla-beta
10773       * - **browsertime-tp6-bytecode-firefox-cnn**
10774         - ✅
10775         - ✅
10776         - ✅
10777         - ✅
10778       * - **browsertime-tp6-essential-chrome-cnn**
10779         - ❌
10780         - ❌
10781         - ❌
10782         - ❌
10783       * - **browsertime-tp6-essential-chromium-cnn**
10784         - ❌
10785         - ❌
10786         - ❌
10787         - ❌
10788       * - **browsertime-tp6-essential-custom-car-cnn**
10789         - ❌
10790         - ❌
10791         - ❌
10792         - ❌
10793       * - **browsertime-tp6-essential-firefox-cnn**
10794         - ✅
10795         - ✅
10796         - ✅
10797         - ✅
10798       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
10799         - ❌
10800         - ❌
10801         - ❌
10802         - ❌
10803
10804
10805
10806 .. dropdown:: ebay
10807    :class-container: anchor-id-ebay-d
10808
10809    **Owner**: PerfTest Team
10810
10811    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
10812    * **alert threshold**: 2.0
10813    * **apps**: firefox, chrome, chromium, safari, custom-car
10814    * **browser cycles**: 25
10815    * **expected**: pass
10816    * **gecko profile entries**: 14000000
10817    * **gecko profile interval**: 1
10818    * **lower is better**: true
10819    * **page cycles**: 25
10820    * **page timeout**: 60000
10821    * **playback**: mitmproxy
10822    * **playback pageset manifest**: mitm7-linux-firefox-ebay.manifest
10823    * **playback version**: 8.1.1
10824    * **secondary url**: `<https://www.ebay.com/deals>`__
10825    * **test url**: `<https://www.ebay.com/>`__
10826    * **type**: pageload
10827    * **unit**: ms
10828    * **use live sites**: false
10829    * **Test Task**:
10830
10831    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
10832       :widths: 30 15 15 15 15
10833       :header-rows: 1
10834
10835       * - **Test Name**
10836         - mozilla-central
10837         - autoland
10838         - mozilla-release
10839         - mozilla-beta
10840       * - **browsertime-tp6-firefox-ebay**
10841         - ❌
10842         - ❌
10843         - ❌
10844         - ❌
10845       * - **browsertime-tp6-live-firefox-ebay**
10846         - ❌
10847         - ❌
10848         - ❌
10849         - ❌
10850
10851
10852    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
10853       :widths: 30 15 15 15 15
10854       :header-rows: 1
10855
10856       * - **Test Name**
10857         - mozilla-central
10858         - autoland
10859         - mozilla-release
10860         - mozilla-beta
10861       * - **browsertime-tp6-firefox-ebay**
10862         - ❌
10863         - ❌
10864         - ❌
10865         - ❌
10866       * - **browsertime-tp6-live-firefox-ebay**
10867         - ❌
10868         - ❌
10869         - ❌
10870         - ❌
10871
10872
10873    .. list-table:: **test-linux1804-64-qr/opt**
10874       :widths: 30 15 15 15 15
10875       :header-rows: 1
10876
10877       * - **Test Name**
10878         - mozilla-central
10879         - autoland
10880         - mozilla-release
10881         - mozilla-beta
10882       * - **browsertime-tp6-firefox-ebay**
10883         - ❌
10884         - ❌
10885         - ❌
10886         - ❌
10887       * - **browsertime-tp6-live-firefox-ebay**
10888         - ❌
10889         - ❌
10890         - ❌
10891         - ❌
10892
10893
10894    .. list-table:: **test-linux1804-64-shippable-qr/opt**
10895       :widths: 30 15 15 15 15
10896       :header-rows: 1
10897
10898       * - **Test Name**
10899         - mozilla-central
10900         - autoland
10901         - mozilla-release
10902         - mozilla-beta
10903       * - **browsertime-tp6-chrome-ebay**
10904         - ❌
10905         - ❌
10906         - ❌
10907         - ❌
10908       * - **browsertime-tp6-chromium-ebay**
10909         - ❌
10910         - ❌
10911         - ❌
10912         - ❌
10913       * - **browsertime-tp6-firefox-ebay**
10914         - ✅
10915         - ✅
10916         - ✅
10917         - ✅
10918       * - **browsertime-tp6-live-chrome-ebay**
10919         - ❌
10920         - ❌
10921         - ❌
10922         - ❌
10923       * - **browsertime-tp6-live-chromium-ebay**
10924         - ❌
10925         - ❌
10926         - ❌
10927         - ❌
10928       * - **browsertime-tp6-live-firefox-ebay**
10929         - ❌
10930         - ❌
10931         - ❌
10932         - ❌
10933
10934
10935    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
10936       :widths: 30 15 15 15 15
10937       :header-rows: 1
10938
10939       * - **Test Name**
10940         - mozilla-central
10941         - autoland
10942         - mozilla-release
10943         - mozilla-beta
10944       * - **browsertime-tp6-firefox-ebay**
10945         - ❌
10946         - ❌
10947         - ❌
10948         - ❌
10949       * - **browsertime-tp6-live-firefox-ebay**
10950         - ❌
10951         - ❌
10952         - ❌
10953         - ❌
10954
10955
10956    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
10957       :widths: 30 15 15 15 15
10958       :header-rows: 1
10959
10960       * - **Test Name**
10961         - mozilla-central
10962         - autoland
10963         - mozilla-release
10964         - mozilla-beta
10965       * - **browsertime-tp6-chrome-ebay**
10966         - ❌
10967         - ❌
10968         - ❌
10969         - ❌
10970       * - **browsertime-tp6-chromium-ebay**
10971         - ❌
10972         - ❌
10973         - ❌
10974         - ❌
10975       * - **browsertime-tp6-firefox-ebay**
10976         - ✅
10977         - ✅
10978         - ✅
10979         - ✅
10980       * - **browsertime-tp6-live-chrome-ebay**
10981         - ❌
10982         - ❌
10983         - ❌
10984         - ❌
10985       * - **browsertime-tp6-live-chromium-ebay**
10986         - ❌
10987         - ❌
10988         - ❌
10989         - ❌
10990       * - **browsertime-tp6-live-firefox-ebay**
10991         - ❌
10992         - ❌
10993         - ❌
10994         - ❌
10995       * - **browsertime-tp6-live-safari-ebay**
10996         - ❌
10997         - ❌
10998         - ❌
10999         - ❌
11000
11001
11002    .. list-table:: **test-windows10-32-qr/opt**
11003       :widths: 30 15 15 15 15
11004       :header-rows: 1
11005
11006       * - **Test Name**
11007         - mozilla-central
11008         - autoland
11009         - mozilla-release
11010         - mozilla-beta
11011       * - **browsertime-tp6-firefox-ebay**
11012         - ❌
11013         - ❌
11014         - ❌
11015         - ❌
11016       * - **browsertime-tp6-live-firefox-ebay**
11017         - ❌
11018         - ❌
11019         - ❌
11020         - ❌
11021
11022
11023    .. list-table:: **test-windows10-32-shippable-qr/opt**
11024       :widths: 30 15 15 15 15
11025       :header-rows: 1
11026
11027       * - **Test Name**
11028         - mozilla-central
11029         - autoland
11030         - mozilla-release
11031         - mozilla-beta
11032       * - **browsertime-tp6-chrome-ebay**
11033         - ❌
11034         - ❌
11035         - ❌
11036         - ❌
11037       * - **browsertime-tp6-chromium-ebay**
11038         - ❌
11039         - ❌
11040         - ❌
11041         - ❌
11042       * - **browsertime-tp6-firefox-ebay**
11043         - ❌
11044         - ❌
11045         - ❌
11046         - ❌
11047       * - **browsertime-tp6-live-chrome-ebay**
11048         - ❌
11049         - ❌
11050         - ❌
11051         - ❌
11052       * - **browsertime-tp6-live-chromium-ebay**
11053         - ❌
11054         - ❌
11055         - ❌
11056         - ❌
11057       * - **browsertime-tp6-live-firefox-ebay**
11058         - ❌
11059         - ❌
11060         - ❌
11061         - ❌
11062
11063
11064    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
11065       :widths: 30 15 15 15 15
11066       :header-rows: 1
11067
11068       * - **Test Name**
11069         - mozilla-central
11070         - autoland
11071         - mozilla-release
11072         - mozilla-beta
11073       * - **browsertime-tp6-firefox-ebay**
11074         - ❌
11075         - ❌
11076         - ❌
11077         - ❌
11078       * - **browsertime-tp6-live-firefox-ebay**
11079         - ❌
11080         - ❌
11081         - ❌
11082         - ❌
11083
11084
11085    .. list-table:: **test-windows10-64-qr/opt**
11086       :widths: 30 15 15 15 15
11087       :header-rows: 1
11088
11089       * - **Test Name**
11090         - mozilla-central
11091         - autoland
11092         - mozilla-release
11093         - mozilla-beta
11094       * - **browsertime-tp6-firefox-ebay**
11095         - ❌
11096         - ❌
11097         - ❌
11098         - ❌
11099       * - **browsertime-tp6-live-firefox-ebay**
11100         - ❌
11101         - ❌
11102         - ❌
11103         - ❌
11104
11105
11106    .. list-table:: **test-windows10-64-shippable-qr/opt**
11107       :widths: 30 15 15 15 15
11108       :header-rows: 1
11109
11110       * - **Test Name**
11111         - mozilla-central
11112         - autoland
11113         - mozilla-release
11114         - mozilla-beta
11115       * - **browsertime-tp6-chrome-ebay**
11116         - ❌
11117         - ❌
11118         - ❌
11119         - ❌
11120       * - **browsertime-tp6-chromium-ebay**
11121         - ❌
11122         - ❌
11123         - ❌
11124         - ❌
11125       * - **browsertime-tp6-firefox-ebay**
11126         - ✅
11127         - ✅
11128         - ✅
11129         - ✅
11130       * - **browsertime-tp6-live-chrome-ebay**
11131         - ❌
11132         - ❌
11133         - ❌
11134         - ❌
11135       * - **browsertime-tp6-live-chromium-ebay**
11136         - ❌
11137         - ❌
11138         - ❌
11139         - ❌
11140       * - **browsertime-tp6-live-firefox-ebay**
11141         - ❌
11142         - ❌
11143         - ❌
11144         - ❌
11145
11146
11147
11148 .. dropdown:: espn
11149    :class-container: anchor-id-espn-d
11150
11151    **Owner**: PerfTest Team
11152
11153    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
11154    * **alert threshold**: 2.0
11155    * **apps**: firefox, chrome, chromium, safari, custom-car
11156    * **browser cycles**: 25
11157    * **expected**: pass
11158    * **gecko profile entries**: 14000000
11159    * **gecko profile interval**: 1
11160    * **lower is better**: true
11161    * **page cycles**: 25
11162    * **page timeout**: 60000
11163    * **playback**: mitmproxy
11164    * **playback pageset manifest**: mitm7-linux-firefox-espn.manifest
11165    * **playback version**: 8.1.1
11166    * **secondary url**: `<https://www.espn.com/nba/draft/news>`__
11167    * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
11168    * **type**: pageload
11169    * **unit**: ms
11170    * **use live sites**: false
11171    * **Test Task**:
11172
11173    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
11174       :widths: 30 15 15 15 15
11175       :header-rows: 1
11176
11177       * - **Test Name**
11178         - mozilla-central
11179         - autoland
11180         - mozilla-release
11181         - mozilla-beta
11182       * - **browsertime-tp6m-essential-fenix-espn-nofis**
11183         - ❌
11184         - ❌
11185         - ❌
11186         - ❌
11187       * - **browsertime-tp6m-essential-geckoview-espn-nofis**
11188         - ❌
11189         - ❌
11190         - ❌
11191         - ❌
11192       * - **browsertime-tp6m-live-fenix-espn-nofis**
11193         - ❌
11194         - ❌
11195         - ❌
11196         - ❌
11197       * - **browsertime-tp6m-live-geckoview-espn-nofis**
11198         - ❌
11199         - ❌
11200         - ❌
11201         - ❌
11202
11203
11204    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
11205       :widths: 30 15 15 15 15
11206       :header-rows: 1
11207
11208       * - **Test Name**
11209         - mozilla-central
11210         - autoland
11211         - mozilla-release
11212         - mozilla-beta
11213       * - **browsertime-tp6m-essential-chrome-m-espn-nofis**
11214         - ❌
11215         - ❌
11216         - ❌
11217         - ❌
11218       * - **browsertime-tp6m-essential-fenix-espn-nofis**
11219         - ❌
11220         - ❌
11221         - ❌
11222         - ❌
11223       * - **browsertime-tp6m-essential-geckoview-espn-nofis**
11224         - ✅
11225         - ✅
11226         - ❌
11227         - ❌
11228       * - **browsertime-tp6m-live-chrome-m-espn-nofis**
11229         - ❌
11230         - ❌
11231         - ❌
11232         - ❌
11233       * - **browsertime-tp6m-live-fenix-espn-nofis**
11234         - ❌
11235         - ❌
11236         - ❌
11237         - ❌
11238       * - **browsertime-tp6m-live-geckoview-espn-nofis**
11239         - ❌
11240         - ❌
11241         - ❌
11242         - ❌
11243
11244
11245    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11246       :widths: 30 15 15 15 15
11247       :header-rows: 1
11248
11249       * - **Test Name**
11250         - mozilla-central
11251         - autoland
11252         - mozilla-release
11253         - mozilla-beta
11254       * - **browsertime-tp6-firefox-espn**
11255         - ❌
11256         - ❌
11257         - ❌
11258         - ❌
11259
11260
11261    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
11262       :widths: 30 15 15 15 15
11263       :header-rows: 1
11264
11265       * - **Test Name**
11266         - mozilla-central
11267         - autoland
11268         - mozilla-release
11269         - mozilla-beta
11270       * - **browsertime-tp6-firefox-espn**
11271         - ❌
11272         - ❌
11273         - ❌
11274         - ❌
11275
11276
11277    .. list-table:: **test-linux1804-64-qr/opt**
11278       :widths: 30 15 15 15 15
11279       :header-rows: 1
11280
11281       * - **Test Name**
11282         - mozilla-central
11283         - autoland
11284         - mozilla-release
11285         - mozilla-beta
11286       * - **browsertime-tp6-firefox-espn**
11287         - ❌
11288         - ❌
11289         - ❌
11290         - ❌
11291
11292
11293    .. list-table:: **test-linux1804-64-shippable-qr/opt**
11294       :widths: 30 15 15 15 15
11295       :header-rows: 1
11296
11297       * - **Test Name**
11298         - mozilla-central
11299         - autoland
11300         - mozilla-release
11301         - mozilla-beta
11302       * - **browsertime-tp6-chrome-espn**
11303         - ❌
11304         - ❌
11305         - ❌
11306         - ❌
11307       * - **browsertime-tp6-chromium-espn**
11308         - ❌
11309         - ❌
11310         - ❌
11311         - ❌
11312       * - **browsertime-tp6-firefox-espn**
11313         - ✅
11314         - ✅
11315         - ✅
11316         - ✅
11317
11318
11319    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
11320       :widths: 30 15 15 15 15
11321       :header-rows: 1
11322
11323       * - **Test Name**
11324         - mozilla-central
11325         - autoland
11326         - mozilla-release
11327         - mozilla-beta
11328       * - **browsertime-tp6-firefox-espn**
11329         - ❌
11330         - ❌
11331         - ❌
11332         - ❌
11333
11334
11335    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
11336       :widths: 30 15 15 15 15
11337       :header-rows: 1
11338
11339       * - **Test Name**
11340         - mozilla-central
11341         - autoland
11342         - mozilla-release
11343         - mozilla-beta
11344       * - **browsertime-tp6-chrome-espn**
11345         - ❌
11346         - ❌
11347         - ❌
11348         - ❌
11349       * - **browsertime-tp6-chromium-espn**
11350         - ❌
11351         - ❌
11352         - ❌
11353         - ❌
11354       * - **browsertime-tp6-firefox-espn**
11355         - ✅
11356         - ✅
11357         - ✅
11358         - ✅
11359
11360
11361    .. list-table:: **test-windows10-32-qr/opt**
11362       :widths: 30 15 15 15 15
11363       :header-rows: 1
11364
11365       * - **Test Name**
11366         - mozilla-central
11367         - autoland
11368         - mozilla-release
11369         - mozilla-beta
11370       * - **browsertime-tp6-firefox-espn**
11371         - ❌
11372         - ❌
11373         - ❌
11374         - ❌
11375
11376
11377    .. list-table:: **test-windows10-32-shippable-qr/opt**
11378       :widths: 30 15 15 15 15
11379       :header-rows: 1
11380
11381       * - **Test Name**
11382         - mozilla-central
11383         - autoland
11384         - mozilla-release
11385         - mozilla-beta
11386       * - **browsertime-tp6-chrome-espn**
11387         - ❌
11388         - ❌
11389         - ❌
11390         - ❌
11391       * - **browsertime-tp6-chromium-espn**
11392         - ❌
11393         - ❌
11394         - ❌
11395         - ❌
11396       * - **browsertime-tp6-firefox-espn**
11397         - ❌
11398         - ❌
11399         - ❌
11400         - ❌
11401
11402
11403    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
11404       :widths: 30 15 15 15 15
11405       :header-rows: 1
11406
11407       * - **Test Name**
11408         - mozilla-central
11409         - autoland
11410         - mozilla-release
11411         - mozilla-beta
11412       * - **browsertime-tp6-firefox-espn**
11413         - ❌
11414         - ❌
11415         - ❌
11416         - ❌
11417
11418
11419    .. list-table:: **test-windows10-64-qr/opt**
11420       :widths: 30 15 15 15 15
11421       :header-rows: 1
11422
11423       * - **Test Name**
11424         - mozilla-central
11425         - autoland
11426         - mozilla-release
11427         - mozilla-beta
11428       * - **browsertime-tp6-firefox-espn**
11429         - ❌
11430         - ❌
11431         - ❌
11432         - ❌
11433
11434
11435    .. list-table:: **test-windows10-64-shippable-qr/opt**
11436       :widths: 30 15 15 15 15
11437       :header-rows: 1
11438
11439       * - **Test Name**
11440         - mozilla-central
11441         - autoland
11442         - mozilla-release
11443         - mozilla-beta
11444       * - **browsertime-tp6-chrome-espn**
11445         - ❌
11446         - ❌
11447         - ❌
11448         - ❌
11449       * - **browsertime-tp6-chromium-espn**
11450         - ❌
11451         - ❌
11452         - ❌
11453         - ❌
11454       * - **browsertime-tp6-firefox-espn**
11455         - ✅
11456         - ✅
11457         - ✅
11458         - ✅
11459
11460
11461
11462 .. dropdown:: expedia
11463    :class-container: anchor-id-expedia-d
11464
11465    **Owner**: PerfTest Team
11466
11467    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
11468    * **alert threshold**: 2.0
11469    * **apps**: firefox, chrome, chromium, safari, custom-car
11470    * **browser cycles**: 25
11471    * **expected**: pass
11472    * **gecko profile entries**: 14000000
11473    * **gecko profile interval**: 1
11474    * **lower is better**: true
11475    * **page cycles**: 25
11476    * **page timeout**: 60000
11477    * **playback**: mitmproxy
11478    * **playback pageset manifest**: mitm7-linux-firefox-expedia.manifest
11479    * **playback version**: 8.1.1
11480    * **secondary url**: `<https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1>`__
11481    * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__
11482    * **type**: pageload
11483    * **unit**: ms
11484    * **use live sites**: false
11485    * **Test Task**:
11486
11487    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
11488       :widths: 30 15 15 15 15
11489       :header-rows: 1
11490
11491       * - **Test Name**
11492         - mozilla-central
11493         - autoland
11494         - mozilla-release
11495         - mozilla-beta
11496       * - **browsertime-tp6m-live-fenix-expedia-nofis**
11497         - ❌
11498         - ❌
11499         - ❌
11500         - ❌
11501       * - **browsertime-tp6m-live-geckoview-expedia-nofis**
11502         - ❌
11503         - ❌
11504         - ❌
11505         - ❌
11506
11507
11508    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
11509       :widths: 30 15 15 15 15
11510       :header-rows: 1
11511
11512       * - **Test Name**
11513         - mozilla-central
11514         - autoland
11515         - mozilla-release
11516         - mozilla-beta
11517       * - **browsertime-tp6m-live-chrome-m-expedia-nofis**
11518         - ❌
11519         - ❌
11520         - ❌
11521         - ❌
11522       * - **browsertime-tp6m-live-fenix-expedia-nofis**
11523         - ❌
11524         - ❌
11525         - ❌
11526         - ❌
11527       * - **browsertime-tp6m-live-geckoview-expedia-nofis**
11528         - ❌
11529         - ❌
11530         - ❌
11531         - ❌
11532
11533
11534    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11535       :widths: 30 15 15 15 15
11536       :header-rows: 1
11537
11538       * - **Test Name**
11539         - mozilla-central
11540         - autoland
11541         - mozilla-release
11542         - mozilla-beta
11543       * - **browsertime-tp6-firefox-expedia**
11544         - ❌
11545         - ❌
11546         - ❌
11547         - ❌
11548
11549
11550    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
11551       :widths: 30 15 15 15 15
11552       :header-rows: 1
11553
11554       * - **Test Name**
11555         - mozilla-central
11556         - autoland
11557         - mozilla-release
11558         - mozilla-beta
11559       * - **browsertime-tp6-firefox-expedia**
11560         - ❌
11561         - ❌
11562         - ❌
11563         - ❌
11564
11565
11566    .. list-table:: **test-linux1804-64-qr/opt**
11567       :widths: 30 15 15 15 15
11568       :header-rows: 1
11569
11570       * - **Test Name**
11571         - mozilla-central
11572         - autoland
11573         - mozilla-release
11574         - mozilla-beta
11575       * - **browsertime-tp6-firefox-expedia**
11576         - ❌
11577         - ❌
11578         - ❌
11579         - ❌
11580
11581
11582    .. list-table:: **test-linux1804-64-shippable-qr/opt**
11583       :widths: 30 15 15 15 15
11584       :header-rows: 1
11585
11586       * - **Test Name**
11587         - mozilla-central
11588         - autoland
11589         - mozilla-release
11590         - mozilla-beta
11591       * - **browsertime-tp6-chrome-expedia**
11592         - ❌
11593         - ❌
11594         - ❌
11595         - ❌
11596       * - **browsertime-tp6-chromium-expedia**
11597         - ❌
11598         - ❌
11599         - ❌
11600         - ❌
11601       * - **browsertime-tp6-firefox-expedia**
11602         - ✅
11603         - ✅
11604         - ✅
11605         - ✅
11606
11607
11608    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
11609       :widths: 30 15 15 15 15
11610       :header-rows: 1
11611
11612       * - **Test Name**
11613         - mozilla-central
11614         - autoland
11615         - mozilla-release
11616         - mozilla-beta
11617       * - **browsertime-tp6-firefox-expedia**
11618         - ❌
11619         - ❌
11620         - ❌
11621         - ❌
11622
11623
11624    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
11625       :widths: 30 15 15 15 15
11626       :header-rows: 1
11627
11628       * - **Test Name**
11629         - mozilla-central
11630         - autoland
11631         - mozilla-release
11632         - mozilla-beta
11633       * - **browsertime-tp6-chrome-expedia**
11634         - ❌
11635         - ❌
11636         - ❌
11637         - ❌
11638       * - **browsertime-tp6-chromium-expedia**
11639         - ❌
11640         - ❌
11641         - ❌
11642         - ❌
11643       * - **browsertime-tp6-firefox-expedia**
11644         - ✅
11645         - ✅
11646         - ✅
11647         - ✅
11648
11649
11650    .. list-table:: **test-windows10-32-qr/opt**
11651       :widths: 30 15 15 15 15
11652       :header-rows: 1
11653
11654       * - **Test Name**
11655         - mozilla-central
11656         - autoland
11657         - mozilla-release
11658         - mozilla-beta
11659       * - **browsertime-tp6-firefox-expedia**
11660         - ❌
11661         - ❌
11662         - ❌
11663         - ❌
11664
11665
11666    .. list-table:: **test-windows10-32-shippable-qr/opt**
11667       :widths: 30 15 15 15 15
11668       :header-rows: 1
11669
11670       * - **Test Name**
11671         - mozilla-central
11672         - autoland
11673         - mozilla-release
11674         - mozilla-beta
11675       * - **browsertime-tp6-chrome-expedia**
11676         - ❌
11677         - ❌
11678         - ❌
11679         - ❌
11680       * - **browsertime-tp6-chromium-expedia**
11681         - ❌
11682         - ❌
11683         - ❌
11684         - ❌
11685       * - **browsertime-tp6-firefox-expedia**
11686         - ❌
11687         - ❌
11688         - ❌
11689         - ❌
11690
11691
11692    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
11693       :widths: 30 15 15 15 15
11694       :header-rows: 1
11695
11696       * - **Test Name**
11697         - mozilla-central
11698         - autoland
11699         - mozilla-release
11700         - mozilla-beta
11701       * - **browsertime-tp6-firefox-expedia**
11702         - ❌
11703         - ❌
11704         - ❌
11705         - ❌
11706
11707
11708    .. list-table:: **test-windows10-64-qr/opt**
11709       :widths: 30 15 15 15 15
11710       :header-rows: 1
11711
11712       * - **Test Name**
11713         - mozilla-central
11714         - autoland
11715         - mozilla-release
11716         - mozilla-beta
11717       * - **browsertime-tp6-firefox-expedia**
11718         - ❌
11719         - ❌
11720         - ❌
11721         - ❌
11722
11723
11724    .. list-table:: **test-windows10-64-shippable-qr/opt**
11725       :widths: 30 15 15 15 15
11726       :header-rows: 1
11727
11728       * - **Test Name**
11729         - mozilla-central
11730         - autoland
11731         - mozilla-release
11732         - mozilla-beta
11733       * - **browsertime-tp6-chrome-expedia**
11734         - ❌
11735         - ❌
11736         - ❌
11737         - ❌
11738       * - **browsertime-tp6-chromium-expedia**
11739         - ❌
11740         - ❌
11741         - ❌
11742         - ❌
11743       * - **browsertime-tp6-firefox-expedia**
11744         - ✅
11745         - ✅
11746         - ✅
11747         - ✅
11748
11749
11750
11751 .. dropdown:: facebook
11752    :class-container: anchor-id-facebook-d
11753
11754    **Owner**: PerfTest Team
11755
11756    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
11757    * **alert threshold**: 2.0
11758    * **apps**: firefox, chrome, chromium, safari, custom-car
11759    * **browser cycles**: 25
11760    * **expected**: pass
11761    * **gecko profile entries**: 14000000
11762    * **gecko profile interval**: 1
11763    * **lower is better**: true
11764    * **page cycles**: 25
11765    * **page timeout**: 60000
11766    * **playback**: mitmproxy
11767    * **playback pageset manifest**: mitm6-linux-firefox-facebook.manifest
11768    * **playback version**: 8.1.1
11769    * **secondary url**: `<https://www.facebook.com/marketplace/?ref=bookmark>`__
11770    * **test url**: `<https://www.facebook.com>`__
11771    * **type**: pageload
11772    * **unit**: ms
11773    * **use live sites**: false
11774    * **Test Task**:
11775
11776    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
11777       :widths: 30 15 15 15 15
11778       :header-rows: 1
11779
11780       * - **Test Name**
11781         - mozilla-central
11782         - autoland
11783         - mozilla-release
11784         - mozilla-beta
11785       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
11786         - ❌
11787         - ❌
11788         - ❌
11789         - ❌
11790       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
11791         - ❌
11792         - ❌
11793         - ❌
11794         - ❌
11795       * - **browsertime-tp6m-live-fenix-facebook-nofis**
11796         - ❌
11797         - ❌
11798         - ❌
11799         - ❌
11800       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
11801         - ❌
11802         - ❌
11803         - ❌
11804         - ❌
11805
11806
11807    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
11808       :widths: 30 15 15 15 15
11809       :header-rows: 1
11810
11811       * - **Test Name**
11812         - mozilla-central
11813         - autoland
11814         - mozilla-release
11815         - mozilla-beta
11816       * - **browsertime-tp6m-essential-chrome-m-facebook-nofis**
11817         - ❌
11818         - ❌
11819         - ❌
11820         - ❌
11821       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
11822         - ❌
11823         - ❌
11824         - ❌
11825         - ❌
11826       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
11827         - ✅
11828         - ✅
11829         - ❌
11830         - ❌
11831       * - **browsertime-tp6m-live-chrome-m-facebook-nofis**
11832         - ❌
11833         - ❌
11834         - ❌
11835         - ❌
11836       * - **browsertime-tp6m-live-fenix-facebook-nofis**
11837         - ❌
11838         - ❌
11839         - ❌
11840         - ❌
11841       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
11842         - ❌
11843         - ❌
11844         - ❌
11845         - ❌
11846
11847
11848    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11849       :widths: 30 15 15 15 15
11850       :header-rows: 1
11851
11852       * - **Test Name**
11853         - mozilla-central
11854         - autoland
11855         - mozilla-release
11856         - mozilla-beta
11857       * - **browsertime-tp6-firefox-facebook**
11858         - ❌
11859         - ❌
11860         - ❌
11861         - ❌
11862       * - **browsertime-tp6-live-firefox-facebook**
11863         - ❌
11864         - ❌
11865         - ❌
11866         - ❌
11867
11868
11869    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
11870       :widths: 30 15 15 15 15
11871       :header-rows: 1
11872
11873       * - **Test Name**
11874         - mozilla-central
11875         - autoland
11876         - mozilla-release
11877         - mozilla-beta
11878       * - **browsertime-tp6-firefox-facebook**
11879         - ❌
11880         - ❌
11881         - ❌
11882         - ❌
11883       * - **browsertime-tp6-live-firefox-facebook**
11884         - ❌
11885         - ❌
11886         - ❌
11887         - ❌
11888
11889
11890    .. list-table:: **test-linux1804-64-qr/opt**
11891       :widths: 30 15 15 15 15
11892       :header-rows: 1
11893
11894       * - **Test Name**
11895         - mozilla-central
11896         - autoland
11897         - mozilla-release
11898         - mozilla-beta
11899       * - **browsertime-tp6-firefox-facebook**
11900         - ❌
11901         - ❌
11902         - ❌
11903         - ❌
11904       * - **browsertime-tp6-live-firefox-facebook**
11905         - ❌
11906         - ❌
11907         - ❌
11908         - ❌
11909
11910
11911    .. list-table:: **test-linux1804-64-shippable-qr/opt**
11912       :widths: 30 15 15 15 15
11913       :header-rows: 1
11914
11915       * - **Test Name**
11916         - mozilla-central
11917         - autoland
11918         - mozilla-release
11919         - mozilla-beta
11920       * - **browsertime-tp6-chrome-facebook**
11921         - ❌
11922         - ❌
11923         - ❌
11924         - ❌
11925       * - **browsertime-tp6-chromium-facebook**
11926         - ❌
11927         - ❌
11928         - ❌
11929         - ❌
11930       * - **browsertime-tp6-firefox-facebook**
11931         - ✅
11932         - ✅
11933         - ✅
11934         - ✅
11935       * - **browsertime-tp6-live-chrome-facebook**
11936         - ❌
11937         - ❌
11938         - ❌
11939         - ❌
11940       * - **browsertime-tp6-live-chromium-facebook**
11941         - ❌
11942         - ❌
11943         - ❌
11944         - ❌
11945       * - **browsertime-tp6-live-firefox-facebook**
11946         - ❌
11947         - ❌
11948         - ❌
11949         - ❌
11950
11951
11952    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
11953       :widths: 30 15 15 15 15
11954       :header-rows: 1
11955
11956       * - **Test Name**
11957         - mozilla-central
11958         - autoland
11959         - mozilla-release
11960         - mozilla-beta
11961       * - **browsertime-tp6-firefox-facebook**
11962         - ❌
11963         - ❌
11964         - ❌
11965         - ❌
11966       * - **browsertime-tp6-live-firefox-facebook**
11967         - ❌
11968         - ❌
11969         - ❌
11970         - ❌
11971
11972
11973    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
11974       :widths: 30 15 15 15 15
11975       :header-rows: 1
11976
11977       * - **Test Name**
11978         - mozilla-central
11979         - autoland
11980         - mozilla-release
11981         - mozilla-beta
11982       * - **browsertime-tp6-chrome-facebook**
11983         - ❌
11984         - ❌
11985         - ❌
11986         - ❌
11987       * - **browsertime-tp6-chromium-facebook**
11988         - ❌
11989         - ❌
11990         - ❌
11991         - ❌
11992       * - **browsertime-tp6-firefox-facebook**
11993         - ✅
11994         - ✅
11995         - ✅
11996         - ✅
11997       * - **browsertime-tp6-live-chrome-facebook**
11998         - ❌
11999         - ❌
12000         - ❌
12001         - ❌
12002       * - **browsertime-tp6-live-chromium-facebook**
12003         - ❌
12004         - ❌
12005         - ❌
12006         - ❌
12007       * - **browsertime-tp6-live-firefox-facebook**
12008         - ❌
12009         - ❌
12010         - ❌
12011         - ❌
12012       * - **browsertime-tp6-live-safari-facebook**
12013         - ❌
12014         - ❌
12015         - ❌
12016         - ❌
12017
12018
12019    .. list-table:: **test-windows10-32-qr/opt**
12020       :widths: 30 15 15 15 15
12021       :header-rows: 1
12022
12023       * - **Test Name**
12024         - mozilla-central
12025         - autoland
12026         - mozilla-release
12027         - mozilla-beta
12028       * - **browsertime-tp6-firefox-facebook**
12029         - ❌
12030         - ❌
12031         - ❌
12032         - ❌
12033       * - **browsertime-tp6-live-firefox-facebook**
12034         - ❌
12035         - ❌
12036         - ❌
12037         - ❌
12038
12039
12040    .. list-table:: **test-windows10-32-shippable-qr/opt**
12041       :widths: 30 15 15 15 15
12042       :header-rows: 1
12043
12044       * - **Test Name**
12045         - mozilla-central
12046         - autoland
12047         - mozilla-release
12048         - mozilla-beta
12049       * - **browsertime-tp6-chrome-facebook**
12050         - ❌
12051         - ❌
12052         - ❌
12053         - ❌
12054       * - **browsertime-tp6-chromium-facebook**
12055         - ❌
12056         - ❌
12057         - ❌
12058         - ❌
12059       * - **browsertime-tp6-firefox-facebook**
12060         - ❌
12061         - ❌
12062         - ❌
12063         - ❌
12064       * - **browsertime-tp6-live-chrome-facebook**
12065         - ❌
12066         - ❌
12067         - ❌
12068         - ❌
12069       * - **browsertime-tp6-live-chromium-facebook**
12070         - ❌
12071         - ❌
12072         - ❌
12073         - ❌
12074       * - **browsertime-tp6-live-firefox-facebook**
12075         - ❌
12076         - ❌
12077         - ❌
12078         - ❌
12079
12080
12081    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
12082       :widths: 30 15 15 15 15
12083       :header-rows: 1
12084
12085       * - **Test Name**
12086         - mozilla-central
12087         - autoland
12088         - mozilla-release
12089         - mozilla-beta
12090       * - **browsertime-tp6-firefox-facebook**
12091         - ❌
12092         - ❌
12093         - ❌
12094         - ❌
12095       * - **browsertime-tp6-live-firefox-facebook**
12096         - ❌
12097         - ❌
12098         - ❌
12099         - ❌
12100
12101
12102    .. list-table:: **test-windows10-64-qr/opt**
12103       :widths: 30 15 15 15 15
12104       :header-rows: 1
12105
12106       * - **Test Name**
12107         - mozilla-central
12108         - autoland
12109         - mozilla-release
12110         - mozilla-beta
12111       * - **browsertime-tp6-firefox-facebook**
12112         - ❌
12113         - ❌
12114         - ❌
12115         - ❌
12116       * - **browsertime-tp6-live-firefox-facebook**
12117         - ❌
12118         - ❌
12119         - ❌
12120         - ❌
12121
12122
12123    .. list-table:: **test-windows10-64-shippable-qr/opt**
12124       :widths: 30 15 15 15 15
12125       :header-rows: 1
12126
12127       * - **Test Name**
12128         - mozilla-central
12129         - autoland
12130         - mozilla-release
12131         - mozilla-beta
12132       * - **browsertime-tp6-chrome-facebook**
12133         - ❌
12134         - ❌
12135         - ❌
12136         - ❌
12137       * - **browsertime-tp6-chromium-facebook**
12138         - ❌
12139         - ❌
12140         - ❌
12141         - ❌
12142       * - **browsertime-tp6-firefox-facebook**
12143         - ✅
12144         - ✅
12145         - ✅
12146         - ✅
12147       * - **browsertime-tp6-live-chrome-facebook**
12148         - ❌
12149         - ❌
12150         - ❌
12151         - ❌
12152       * - **browsertime-tp6-live-chromium-facebook**
12153         - ❌
12154         - ❌
12155         - ❌
12156         - ❌
12157       * - **browsertime-tp6-live-firefox-facebook**
12158         - ❌
12159         - ❌
12160         - ❌
12161         - ❌
12162
12163
12164
12165 .. dropdown:: fandom
12166    :class-container: anchor-id-fandom-d
12167
12168    **Owner**: PerfTest Team
12169
12170    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
12171    * **alert threshold**: 2.0
12172    * **apps**: firefox, chrome, chromium, safari, custom-car
12173    * **browser cycles**: 25
12174    * **expected**: pass
12175    * **gecko profile entries**: 14000000
12176    * **gecko profile interval**: 1
12177    * **lower is better**: true
12178    * **page cycles**: 25
12179    * **page timeout**: 60000
12180    * **playback**: mitmproxy
12181    * **playback pageset manifest**: mitm5-linux-firefox-fandom.manifest
12182    * **playback version**: 8.1.1
12183    * **test url**: `<https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__
12184    * **type**: pageload
12185    * **unit**: ms
12186    * **use live sites**: false
12187    * **Test Task**:
12188
12189    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12190       :widths: 30 15 15 15 15
12191       :header-rows: 1
12192
12193       * - **Test Name**
12194         - mozilla-central
12195         - autoland
12196         - mozilla-release
12197         - mozilla-beta
12198       * - **browsertime-tp6-bytecode-firefox-fandom**
12199         - ❌
12200         - ❌
12201         - ❌
12202         - ❌
12203       * - **browsertime-tp6-essential-custom-car-fandom**
12204         - ❌
12205         - ❌
12206         - ❌
12207         - ❌
12208       * - **browsertime-tp6-essential-firefox-fandom**
12209         - ❌
12210         - ❌
12211         - ❌
12212         - ❌
12213       * - **browsertime-tp6-live-firefox-fandom**
12214         - ❌
12215         - ❌
12216         - ❌
12217         - ❌
12218
12219
12220    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
12221       :widths: 30 15 15 15 15
12222       :header-rows: 1
12223
12224       * - **Test Name**
12225         - mozilla-central
12226         - autoland
12227         - mozilla-release
12228         - mozilla-beta
12229       * - **browsertime-tp6-bytecode-firefox-fandom**
12230         - ❌
12231         - ❌
12232         - ❌
12233         - ❌
12234       * - **browsertime-tp6-essential-custom-car-fandom**
12235         - ❌
12236         - ❌
12237         - ❌
12238         - ❌
12239       * - **browsertime-tp6-essential-firefox-fandom**
12240         - ❌
12241         - ❌
12242         - ❌
12243         - ❌
12244       * - **browsertime-tp6-live-firefox-fandom**
12245         - ❌
12246         - ❌
12247         - ❌
12248         - ❌
12249
12250
12251    .. list-table:: **test-linux1804-64-qr/opt**
12252       :widths: 30 15 15 15 15
12253       :header-rows: 1
12254
12255       * - **Test Name**
12256         - mozilla-central
12257         - autoland
12258         - mozilla-release
12259         - mozilla-beta
12260       * - **browsertime-tp6-bytecode-firefox-fandom**
12261         - ❌
12262         - ❌
12263         - ❌
12264         - ❌
12265       * - **browsertime-tp6-essential-custom-car-fandom**
12266         - ❌
12267         - ❌
12268         - ❌
12269         - ❌
12270       * - **browsertime-tp6-essential-firefox-fandom**
12271         - ❌
12272         - ❌
12273         - ❌
12274         - ❌
12275       * - **browsertime-tp6-live-firefox-fandom**
12276         - ❌
12277         - ❌
12278         - ❌
12279         - ❌
12280
12281
12282    .. list-table:: **test-linux1804-64-shippable-qr/opt**
12283       :widths: 30 15 15 15 15
12284       :header-rows: 1
12285
12286       * - **Test Name**
12287         - mozilla-central
12288         - autoland
12289         - mozilla-release
12290         - mozilla-beta
12291       * - **browsertime-tp6-bytecode-firefox-fandom**
12292         - ✅
12293         - ✅
12294         - ✅
12295         - ✅
12296       * - **browsertime-tp6-essential-chrome-fandom**
12297         - ❌
12298         - ❌
12299         - ❌
12300         - ❌
12301       * - **browsertime-tp6-essential-chromium-fandom**
12302         - ❌
12303         - ❌
12304         - ❌
12305         - ❌
12306       * - **browsertime-tp6-essential-custom-car-fandom**
12307         - ❌
12308         - ❌
12309         - ❌
12310         - ❌
12311       * - **browsertime-tp6-essential-firefox-fandom**
12312         - ✅
12313         - ✅
12314         - ✅
12315         - ✅
12316       * - **browsertime-tp6-live-chrome-fandom**
12317         - ❌
12318         - ❌
12319         - ❌
12320         - ❌
12321       * - **browsertime-tp6-live-chromium-fandom**
12322         - ❌
12323         - ❌
12324         - ❌
12325         - ❌
12326       * - **browsertime-tp6-live-firefox-fandom**
12327         - ❌
12328         - ❌
12329         - ❌
12330         - ❌
12331
12332
12333    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
12334       :widths: 30 15 15 15 15
12335       :header-rows: 1
12336
12337       * - **Test Name**
12338         - mozilla-central
12339         - autoland
12340         - mozilla-release
12341         - mozilla-beta
12342       * - **browsertime-tp6-bytecode-firefox-fandom**
12343         - ❌
12344         - ❌
12345         - ❌
12346         - ❌
12347       * - **browsertime-tp6-essential-custom-car-fandom**
12348         - ❌
12349         - ❌
12350         - ❌
12351         - ❌
12352       * - **browsertime-tp6-essential-firefox-fandom**
12353         - ❌
12354         - ❌
12355         - ❌
12356         - ❌
12357       * - **browsertime-tp6-live-firefox-fandom**
12358         - ❌
12359         - ❌
12360         - ❌
12361         - ❌
12362
12363
12364    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
12365       :widths: 30 15 15 15 15
12366       :header-rows: 1
12367
12368       * - **Test Name**
12369         - mozilla-central
12370         - autoland
12371         - mozilla-release
12372         - mozilla-beta
12373       * - **browsertime-tp6-bytecode-firefox-fandom**
12374         - ✅
12375         - ✅
12376         - ✅
12377         - ✅
12378       * - **browsertime-tp6-essential-chrome-fandom**
12379         - ❌
12380         - ❌
12381         - ❌
12382         - ❌
12383       * - **browsertime-tp6-essential-chromium-fandom**
12384         - ❌
12385         - ❌
12386         - ❌
12387         - ❌
12388       * - **browsertime-tp6-essential-custom-car-fandom**
12389         - ❌
12390         - ❌
12391         - ❌
12392         - ❌
12393       * - **browsertime-tp6-essential-firefox-fandom**
12394         - ✅
12395         - ✅
12396         - ✅
12397         - ✅
12398       * - **browsertime-tp6-live-chrome-fandom**
12399         - ❌
12400         - ❌
12401         - ❌
12402         - ❌
12403       * - **browsertime-tp6-live-chromium-fandom**
12404         - ❌
12405         - ❌
12406         - ❌
12407         - ❌
12408       * - **browsertime-tp6-live-firefox-fandom**
12409         - ❌
12410         - ❌
12411         - ❌
12412         - ❌
12413
12414
12415    .. list-table:: **test-windows10-32-qr/opt**
12416       :widths: 30 15 15 15 15
12417       :header-rows: 1
12418
12419       * - **Test Name**
12420         - mozilla-central
12421         - autoland
12422         - mozilla-release
12423         - mozilla-beta
12424       * - **browsertime-tp6-bytecode-firefox-fandom**
12425         - ❌
12426         - ❌
12427         - ❌
12428         - ❌
12429       * - **browsertime-tp6-essential-custom-car-fandom**
12430         - ❌
12431         - ❌
12432         - ❌
12433         - ❌
12434       * - **browsertime-tp6-essential-firefox-fandom**
12435         - ❌
12436         - ❌
12437         - ❌
12438         - ❌
12439       * - **browsertime-tp6-live-firefox-fandom**
12440         - ❌
12441         - ❌
12442         - ❌
12443         - ❌
12444
12445
12446    .. list-table:: **test-windows10-32-shippable-qr/opt**
12447       :widths: 30 15 15 15 15
12448       :header-rows: 1
12449
12450       * - **Test Name**
12451         - mozilla-central
12452         - autoland
12453         - mozilla-release
12454         - mozilla-beta
12455       * - **browsertime-tp6-bytecode-firefox-fandom**
12456         - ❌
12457         - ❌
12458         - ❌
12459         - ❌
12460       * - **browsertime-tp6-essential-chrome-fandom**
12461         - ❌
12462         - ❌
12463         - ❌
12464         - ❌
12465       * - **browsertime-tp6-essential-chromium-fandom**
12466         - ❌
12467         - ❌
12468         - ❌
12469         - ❌
12470       * - **browsertime-tp6-essential-custom-car-fandom**
12471         - ❌
12472         - ❌
12473         - ❌
12474         - ❌
12475       * - **browsertime-tp6-essential-firefox-fandom**
12476         - ❌
12477         - ❌
12478         - ❌
12479         - ❌
12480       * - **browsertime-tp6-live-chrome-fandom**
12481         - ❌
12482         - ❌
12483         - ❌
12484         - ❌
12485       * - **browsertime-tp6-live-chromium-fandom**
12486         - ❌
12487         - ❌
12488         - ❌
12489         - ❌
12490       * - **browsertime-tp6-live-firefox-fandom**
12491         - ❌
12492         - ❌
12493         - ❌
12494         - ❌
12495
12496
12497    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
12498       :widths: 30 15 15 15 15
12499       :header-rows: 1
12500
12501       * - **Test Name**
12502         - mozilla-central
12503         - autoland
12504         - mozilla-release
12505         - mozilla-beta
12506       * - **browsertime-tp6-bytecode-firefox-fandom**
12507         - ❌
12508         - ❌
12509         - ❌
12510         - ❌
12511       * - **browsertime-tp6-essential-custom-car-fandom**
12512         - ❌
12513         - ❌
12514         - ❌
12515         - ❌
12516       * - **browsertime-tp6-essential-firefox-fandom**
12517         - ❌
12518         - ❌
12519         - ❌
12520         - ❌
12521       * - **browsertime-tp6-live-firefox-fandom**
12522         - ❌
12523         - ❌
12524         - ❌
12525         - ❌
12526
12527
12528    .. list-table:: **test-windows10-64-qr/opt**
12529       :widths: 30 15 15 15 15
12530       :header-rows: 1
12531
12532       * - **Test Name**
12533         - mozilla-central
12534         - autoland
12535         - mozilla-release
12536         - mozilla-beta
12537       * - **browsertime-tp6-bytecode-firefox-fandom**
12538         - ❌
12539         - ❌
12540         - ❌
12541         - ❌
12542       * - **browsertime-tp6-essential-custom-car-fandom**
12543         - ❌
12544         - ❌
12545         - ❌
12546         - ❌
12547       * - **browsertime-tp6-essential-firefox-fandom**
12548         - ❌
12549         - ❌
12550         - ❌
12551         - ❌
12552       * - **browsertime-tp6-live-firefox-fandom**
12553         - ❌
12554         - ❌
12555         - ❌
12556         - ❌
12557
12558
12559    .. list-table:: **test-windows10-64-shippable-qr/opt**
12560       :widths: 30 15 15 15 15
12561       :header-rows: 1
12562
12563       * - **Test Name**
12564         - mozilla-central
12565         - autoland
12566         - mozilla-release
12567         - mozilla-beta
12568       * - **browsertime-tp6-bytecode-firefox-fandom**
12569         - ✅
12570         - ✅
12571         - ✅
12572         - ✅
12573       * - **browsertime-tp6-essential-chrome-fandom**
12574         - ❌
12575         - ❌
12576         - ❌
12577         - ❌
12578       * - **browsertime-tp6-essential-chromium-fandom**
12579         - ❌
12580         - ❌
12581         - ❌
12582         - ❌
12583       * - **browsertime-tp6-essential-custom-car-fandom**
12584         - ❌
12585         - ❌
12586         - ❌
12587         - ❌
12588       * - **browsertime-tp6-essential-firefox-fandom**
12589         - ✅
12590         - ✅
12591         - ✅
12592         - ✅
12593       * - **browsertime-tp6-live-chrome-fandom**
12594         - ❌
12595         - ❌
12596         - ❌
12597         - ❌
12598       * - **browsertime-tp6-live-chromium-fandom**
12599         - ❌
12600         - ❌
12601         - ❌
12602         - ❌
12603       * - **browsertime-tp6-live-firefox-fandom**
12604         - ❌
12605         - ❌
12606         - ❌
12607         - ❌
12608
12609
12610
12611 .. dropdown:: google-docs
12612    :class-container: anchor-id-google-docs-d
12613
12614    **Owner**: PerfTest Team
12615
12616    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
12617    * **alert threshold**: 2.0
12618    * **apps**: firefox, chrome, chromium, safari, custom-car
12619    * **browser cycles**: 25
12620    * **expected**: pass
12621    * **gecko profile entries**: 14000000
12622    * **gecko profile interval**: 1
12623    * **lower is better**: true
12624    * **page complete wait time**: 8000
12625    * **page cycles**: 25
12626    * **page timeout**: 60000
12627    * **playback**: mitmproxy
12628    * **playback pageset manifest**: mitm7-linux-firefox-google-docs.manifest
12629    * **playback version**: 8.1.1
12630    * **secondary url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__
12631    * **test url**: `<https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing>`__
12632    * **type**: pageload
12633    * **unit**: ms
12634    * **use live sites**: false
12635    * **Test Task**:
12636
12637    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12638       :widths: 30 15 15 15 15
12639       :header-rows: 1
12640
12641       * - **Test Name**
12642         - mozilla-central
12643         - autoland
12644         - mozilla-release
12645         - mozilla-beta
12646       * - **browsertime-tp6-firefox-google-docs**
12647         - ❌
12648         - ❌
12649         - ❌
12650         - ❌
12651       * - **browsertime-tp6-live-firefox-google-docs**
12652         - ❌
12653         - ❌
12654         - ❌
12655         - ❌
12656
12657
12658    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
12659       :widths: 30 15 15 15 15
12660       :header-rows: 1
12661
12662       * - **Test Name**
12663         - mozilla-central
12664         - autoland
12665         - mozilla-release
12666         - mozilla-beta
12667       * - **browsertime-tp6-firefox-google-docs**
12668         - ❌
12669         - ❌
12670         - ❌
12671         - ❌
12672       * - **browsertime-tp6-live-firefox-google-docs**
12673         - ❌
12674         - ❌
12675         - ❌
12676         - ❌
12677
12678
12679    .. list-table:: **test-linux1804-64-qr/opt**
12680       :widths: 30 15 15 15 15
12681       :header-rows: 1
12682
12683       * - **Test Name**
12684         - mozilla-central
12685         - autoland
12686         - mozilla-release
12687         - mozilla-beta
12688       * - **browsertime-tp6-firefox-google-docs**
12689         - ❌
12690         - ❌
12691         - ❌
12692         - ❌
12693       * - **browsertime-tp6-live-firefox-google-docs**
12694         - ❌
12695         - ❌
12696         - ❌
12697         - ❌
12698
12699
12700    .. list-table:: **test-linux1804-64-shippable-qr/opt**
12701       :widths: 30 15 15 15 15
12702       :header-rows: 1
12703
12704       * - **Test Name**
12705         - mozilla-central
12706         - autoland
12707         - mozilla-release
12708         - mozilla-beta
12709       * - **browsertime-tp6-chrome-google-docs**
12710         - ❌
12711         - ❌
12712         - ❌
12713         - ❌
12714       * - **browsertime-tp6-chromium-google-docs**
12715         - ❌
12716         - ❌
12717         - ❌
12718         - ❌
12719       * - **browsertime-tp6-firefox-google-docs**
12720         - ✅
12721         - ✅
12722         - ✅
12723         - ✅
12724       * - **browsertime-tp6-live-chrome-google-docs**
12725         - ❌
12726         - ❌
12727         - ❌
12728         - ❌
12729       * - **browsertime-tp6-live-chromium-google-docs**
12730         - ❌
12731         - ❌
12732         - ❌
12733         - ❌
12734       * - **browsertime-tp6-live-firefox-google-docs**
12735         - ❌
12736         - ❌
12737         - ❌
12738         - ❌
12739
12740
12741    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
12742       :widths: 30 15 15 15 15
12743       :header-rows: 1
12744
12745       * - **Test Name**
12746         - mozilla-central
12747         - autoland
12748         - mozilla-release
12749         - mozilla-beta
12750       * - **browsertime-tp6-firefox-google-docs**
12751         - ❌
12752         - ❌
12753         - ❌
12754         - ❌
12755       * - **browsertime-tp6-live-firefox-google-docs**
12756         - ❌
12757         - ❌
12758         - ❌
12759         - ❌
12760
12761
12762    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
12763       :widths: 30 15 15 15 15
12764       :header-rows: 1
12765
12766       * - **Test Name**
12767         - mozilla-central
12768         - autoland
12769         - mozilla-release
12770         - mozilla-beta
12771       * - **browsertime-tp6-chrome-google-docs**
12772         - ❌
12773         - ❌
12774         - ❌
12775         - ❌
12776       * - **browsertime-tp6-chromium-google-docs**
12777         - ❌
12778         - ❌
12779         - ❌
12780         - ❌
12781       * - **browsertime-tp6-firefox-google-docs**
12782         - ✅
12783         - ✅
12784         - ✅
12785         - ✅
12786       * - **browsertime-tp6-live-chrome-google-docs**
12787         - ❌
12788         - ❌
12789         - ❌
12790         - ❌
12791       * - **browsertime-tp6-live-chromium-google-docs**
12792         - ❌
12793         - ❌
12794         - ❌
12795         - ❌
12796       * - **browsertime-tp6-live-firefox-google-docs**
12797         - ❌
12798         - ❌
12799         - ❌
12800         - ❌
12801       * - **browsertime-tp6-live-safari-google-docs**
12802         - ❌
12803         - ❌
12804         - ❌
12805         - ❌
12806
12807
12808    .. list-table:: **test-windows10-32-qr/opt**
12809       :widths: 30 15 15 15 15
12810       :header-rows: 1
12811
12812       * - **Test Name**
12813         - mozilla-central
12814         - autoland
12815         - mozilla-release
12816         - mozilla-beta
12817       * - **browsertime-tp6-firefox-google-docs**
12818         - ❌
12819         - ❌
12820         - ❌
12821         - ❌
12822       * - **browsertime-tp6-live-firefox-google-docs**
12823         - ❌
12824         - ❌
12825         - ❌
12826         - ❌
12827
12828
12829    .. list-table:: **test-windows10-32-shippable-qr/opt**
12830       :widths: 30 15 15 15 15
12831       :header-rows: 1
12832
12833       * - **Test Name**
12834         - mozilla-central
12835         - autoland
12836         - mozilla-release
12837         - mozilla-beta
12838       * - **browsertime-tp6-chrome-google-docs**
12839         - ❌
12840         - ❌
12841         - ❌
12842         - ❌
12843       * - **browsertime-tp6-chromium-google-docs**
12844         - ❌
12845         - ❌
12846         - ❌
12847         - ❌
12848       * - **browsertime-tp6-firefox-google-docs**
12849         - ❌
12850         - ❌
12851         - ❌
12852         - ❌
12853       * - **browsertime-tp6-live-chrome-google-docs**
12854         - ❌
12855         - ❌
12856         - ❌
12857         - ❌
12858       * - **browsertime-tp6-live-chromium-google-docs**
12859         - ❌
12860         - ❌
12861         - ❌
12862         - ❌
12863       * - **browsertime-tp6-live-firefox-google-docs**
12864         - ❌
12865         - ❌
12866         - ❌
12867         - ❌
12868
12869
12870    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
12871       :widths: 30 15 15 15 15
12872       :header-rows: 1
12873
12874       * - **Test Name**
12875         - mozilla-central
12876         - autoland
12877         - mozilla-release
12878         - mozilla-beta
12879       * - **browsertime-tp6-firefox-google-docs**
12880         - ❌
12881         - ❌
12882         - ❌
12883         - ❌
12884       * - **browsertime-tp6-live-firefox-google-docs**
12885         - ❌
12886         - ❌
12887         - ❌
12888         - ❌
12889
12890
12891    .. list-table:: **test-windows10-64-qr/opt**
12892       :widths: 30 15 15 15 15
12893       :header-rows: 1
12894
12895       * - **Test Name**
12896         - mozilla-central
12897         - autoland
12898         - mozilla-release
12899         - mozilla-beta
12900       * - **browsertime-tp6-firefox-google-docs**
12901         - ❌
12902         - ❌
12903         - ❌
12904         - ❌
12905       * - **browsertime-tp6-live-firefox-google-docs**
12906         - ❌
12907         - ❌
12908         - ❌
12909         - ❌
12910
12911
12912    .. list-table:: **test-windows10-64-shippable-qr/opt**
12913       :widths: 30 15 15 15 15
12914       :header-rows: 1
12915
12916       * - **Test Name**
12917         - mozilla-central
12918         - autoland
12919         - mozilla-release
12920         - mozilla-beta
12921       * - **browsertime-tp6-chrome-google-docs**
12922         - ❌
12923         - ❌
12924         - ❌
12925         - ❌
12926       * - **browsertime-tp6-chromium-google-docs**
12927         - ❌
12928         - ❌
12929         - ❌
12930         - ❌
12931       * - **browsertime-tp6-firefox-google-docs**
12932         - ✅
12933         - ✅
12934         - ✅
12935         - ✅
12936       * - **browsertime-tp6-live-chrome-google-docs**
12937         - ❌
12938         - ❌
12939         - ❌
12940         - ❌
12941       * - **browsertime-tp6-live-chromium-google-docs**
12942         - ❌
12943         - ❌
12944         - ❌
12945         - ❌
12946       * - **browsertime-tp6-live-firefox-google-docs**
12947         - ❌
12948         - ❌
12949         - ❌
12950         - ❌
12951
12952
12953
12954 .. dropdown:: google-mail
12955    :class-container: anchor-id-google-mail-d
12956
12957    **Owner**: PerfTest Team
12958
12959    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
12960    * **alert threshold**: 2.0
12961    * **apps**: firefox, chrome, chromium, safari, custom-car
12962    * **browser cycles**: 25
12963    * **expected**: pass
12964    * **gecko profile entries**: 14000000
12965    * **gecko profile interval**: 1
12966    * **lower is better**: true
12967    * **page cycles**: 25
12968    * **page timeout**: 60000
12969    * **playback**: mitmproxy
12970    * **playback pageset manifest**: mitm5-linux-firefox-google-mail.manifest
12971    * **playback version**: 8.1.1
12972    * **test url**: `<https://mail.google.com/>`__
12973    * **type**: pageload
12974    * **unit**: ms
12975    * **use live sites**: false
12976    * **Test Task**:
12977
12978    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12979       :widths: 30 15 15 15 15
12980       :header-rows: 1
12981
12982       * - **Test Name**
12983         - mozilla-central
12984         - autoland
12985         - mozilla-release
12986         - mozilla-beta
12987       * - **browsertime-tp6-firefox-google-mail**
12988         - ❌
12989         - ❌
12990         - ❌
12991         - ❌
12992       * - **browsertime-tp6-live-firefox-google-mail**
12993         - ❌
12994         - ❌
12995         - ❌
12996         - ❌
12997
12998
12999    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
13000       :widths: 30 15 15 15 15
13001       :header-rows: 1
13002
13003       * - **Test Name**
13004         - mozilla-central
13005         - autoland
13006         - mozilla-release
13007         - mozilla-beta
13008       * - **browsertime-tp6-firefox-google-mail**
13009         - ❌
13010         - ❌
13011         - ❌
13012         - ❌
13013       * - **browsertime-tp6-live-firefox-google-mail**
13014         - ❌
13015         - ❌
13016         - ❌
13017         - ❌
13018
13019
13020    .. list-table:: **test-linux1804-64-qr/opt**
13021       :widths: 30 15 15 15 15
13022       :header-rows: 1
13023
13024       * - **Test Name**
13025         - mozilla-central
13026         - autoland
13027         - mozilla-release
13028         - mozilla-beta
13029       * - **browsertime-tp6-firefox-google-mail**
13030         - ❌
13031         - ❌
13032         - ❌
13033         - ❌
13034       * - **browsertime-tp6-live-firefox-google-mail**
13035         - ❌
13036         - ❌
13037         - ❌
13038         - ❌
13039
13040
13041    .. list-table:: **test-linux1804-64-shippable-qr/opt**
13042       :widths: 30 15 15 15 15
13043       :header-rows: 1
13044
13045       * - **Test Name**
13046         - mozilla-central
13047         - autoland
13048         - mozilla-release
13049         - mozilla-beta
13050       * - **browsertime-tp6-chrome-google-mail**
13051         - ❌
13052         - ❌
13053         - ❌
13054         - ❌
13055       * - **browsertime-tp6-chromium-google-mail**
13056         - ❌
13057         - ❌
13058         - ❌
13059         - ❌
13060       * - **browsertime-tp6-firefox-google-mail**
13061         - ✅
13062         - ✅
13063         - ✅
13064         - ✅
13065       * - **browsertime-tp6-live-chrome-google-mail**
13066         - ❌
13067         - ❌
13068         - ❌
13069         - ❌
13070       * - **browsertime-tp6-live-chromium-google-mail**
13071         - ❌
13072         - ❌
13073         - ❌
13074         - ❌
13075       * - **browsertime-tp6-live-firefox-google-mail**
13076         - ❌
13077         - ❌
13078         - ❌
13079         - ❌
13080
13081
13082    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
13083       :widths: 30 15 15 15 15
13084       :header-rows: 1
13085
13086       * - **Test Name**
13087         - mozilla-central
13088         - autoland
13089         - mozilla-release
13090         - mozilla-beta
13091       * - **browsertime-tp6-firefox-google-mail**
13092         - ❌
13093         - ❌
13094         - ❌
13095         - ❌
13096       * - **browsertime-tp6-live-firefox-google-mail**
13097         - ❌
13098         - ❌
13099         - ❌
13100         - ❌
13101
13102
13103    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
13104       :widths: 30 15 15 15 15
13105       :header-rows: 1
13106
13107       * - **Test Name**
13108         - mozilla-central
13109         - autoland
13110         - mozilla-release
13111         - mozilla-beta
13112       * - **browsertime-tp6-chrome-google-mail**
13113         - ❌
13114         - ❌
13115         - ❌
13116         - ❌
13117       * - **browsertime-tp6-chromium-google-mail**
13118         - ❌
13119         - ❌
13120         - ❌
13121         - ❌
13122       * - **browsertime-tp6-firefox-google-mail**
13123         - ✅
13124         - ✅
13125         - ✅
13126         - ✅
13127       * - **browsertime-tp6-live-chrome-google-mail**
13128         - ❌
13129         - ❌
13130         - ❌
13131         - ❌
13132       * - **browsertime-tp6-live-chromium-google-mail**
13133         - ❌
13134         - ❌
13135         - ❌
13136         - ❌
13137       * - **browsertime-tp6-live-firefox-google-mail**
13138         - ❌
13139         - ❌
13140         - ❌
13141         - ❌
13142
13143
13144    .. list-table:: **test-windows10-32-qr/opt**
13145       :widths: 30 15 15 15 15
13146       :header-rows: 1
13147
13148       * - **Test Name**
13149         - mozilla-central
13150         - autoland
13151         - mozilla-release
13152         - mozilla-beta
13153       * - **browsertime-tp6-firefox-google-mail**
13154         - ❌
13155         - ❌
13156         - ❌
13157         - ❌
13158       * - **browsertime-tp6-live-firefox-google-mail**
13159         - ❌
13160         - ❌
13161         - ❌
13162         - ❌
13163
13164
13165    .. list-table:: **test-windows10-32-shippable-qr/opt**
13166       :widths: 30 15 15 15 15
13167       :header-rows: 1
13168
13169       * - **Test Name**
13170         - mozilla-central
13171         - autoland
13172         - mozilla-release
13173         - mozilla-beta
13174       * - **browsertime-tp6-chrome-google-mail**
13175         - ❌
13176         - ❌
13177         - ❌
13178         - ❌
13179       * - **browsertime-tp6-chromium-google-mail**
13180         - ❌
13181         - ❌
13182         - ❌
13183         - ❌
13184       * - **browsertime-tp6-firefox-google-mail**
13185         - ❌
13186         - ❌
13187         - ❌
13188         - ❌
13189       * - **browsertime-tp6-live-chrome-google-mail**
13190         - ❌
13191         - ❌
13192         - ❌
13193         - ❌
13194       * - **browsertime-tp6-live-chromium-google-mail**
13195         - ❌
13196         - ❌
13197         - ❌
13198         - ❌
13199       * - **browsertime-tp6-live-firefox-google-mail**
13200         - ❌
13201         - ❌
13202         - ❌
13203         - ❌
13204
13205
13206    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
13207       :widths: 30 15 15 15 15
13208       :header-rows: 1
13209
13210       * - **Test Name**
13211         - mozilla-central
13212         - autoland
13213         - mozilla-release
13214         - mozilla-beta
13215       * - **browsertime-tp6-firefox-google-mail**
13216         - ❌
13217         - ❌
13218         - ❌
13219         - ❌
13220       * - **browsertime-tp6-live-firefox-google-mail**
13221         - ❌
13222         - ❌
13223         - ❌
13224         - ❌
13225
13226
13227    .. list-table:: **test-windows10-64-qr/opt**
13228       :widths: 30 15 15 15 15
13229       :header-rows: 1
13230
13231       * - **Test Name**
13232         - mozilla-central
13233         - autoland
13234         - mozilla-release
13235         - mozilla-beta
13236       * - **browsertime-tp6-firefox-google-mail**
13237         - ❌
13238         - ❌
13239         - ❌
13240         - ❌
13241       * - **browsertime-tp6-live-firefox-google-mail**
13242         - ❌
13243         - ❌
13244         - ❌
13245         - ❌
13246
13247
13248    .. list-table:: **test-windows10-64-shippable-qr/opt**
13249       :widths: 30 15 15 15 15
13250       :header-rows: 1
13251
13252       * - **Test Name**
13253         - mozilla-central
13254         - autoland
13255         - mozilla-release
13256         - mozilla-beta
13257       * - **browsertime-tp6-chrome-google-mail**
13258         - ❌
13259         - ❌
13260         - ❌
13261         - ❌
13262       * - **browsertime-tp6-chromium-google-mail**
13263         - ❌
13264         - ❌
13265         - ❌
13266         - ❌
13267       * - **browsertime-tp6-firefox-google-mail**
13268         - ✅
13269         - ✅
13270         - ✅
13271         - ✅
13272       * - **browsertime-tp6-live-chrome-google-mail**
13273         - ❌
13274         - ❌
13275         - ❌
13276         - ❌
13277       * - **browsertime-tp6-live-chromium-google-mail**
13278         - ❌
13279         - ❌
13280         - ❌
13281         - ❌
13282       * - **browsertime-tp6-live-firefox-google-mail**
13283         - ❌
13284         - ❌
13285         - ❌
13286         - ❌
13287
13288
13289
13290 .. dropdown:: google-search
13291    :class-container: anchor-id-google-search-d
13292
13293    **Owner**: PerfTest Team
13294
13295    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
13296    * **alert threshold**: 2.0
13297    * **apps**: firefox, chrome, chromium, safari, custom-car
13298    * **browser cycles**: 25
13299    * **expected**: pass
13300    * **gecko profile entries**: 14000000
13301    * **gecko profile interval**: 1
13302    * **lower is better**: true
13303    * **page cycles**: 25
13304    * **page timeout**: 60000
13305    * **playback**: mitmproxy
13306    * **playback pageset manifest**: mitm5-linux-firefox-google-search.manifest
13307    * **playback version**: 8.1.1
13308    * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
13309    * **type**: pageload
13310    * **unit**: ms
13311    * **use live sites**: false
13312    * **Test Task**:
13313
13314    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
13315       :widths: 30 15 15 15 15
13316       :header-rows: 1
13317
13318       * - **Test Name**
13319         - mozilla-central
13320         - autoland
13321         - mozilla-release
13322         - mozilla-beta
13323       * - **browsertime-tp6-firefox-google-search**
13324         - ❌
13325         - ❌
13326         - ❌
13327         - ❌
13328       * - **browsertime-tp6-live-firefox-google-search**
13329         - ❌
13330         - ❌
13331         - ❌
13332         - ❌
13333
13334
13335    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
13336       :widths: 30 15 15 15 15
13337       :header-rows: 1
13338
13339       * - **Test Name**
13340         - mozilla-central
13341         - autoland
13342         - mozilla-release
13343         - mozilla-beta
13344       * - **browsertime-tp6-firefox-google-search**
13345         - ❌
13346         - ❌
13347         - ❌
13348         - ❌
13349       * - **browsertime-tp6-live-firefox-google-search**
13350         - ❌
13351         - ❌
13352         - ❌
13353         - ❌
13354
13355
13356    .. list-table:: **test-linux1804-64-qr/opt**
13357       :widths: 30 15 15 15 15
13358       :header-rows: 1
13359
13360       * - **Test Name**
13361         - mozilla-central
13362         - autoland
13363         - mozilla-release
13364         - mozilla-beta
13365       * - **browsertime-tp6-firefox-google-search**
13366         - ❌
13367         - ❌
13368         - ❌
13369         - ❌
13370       * - **browsertime-tp6-live-firefox-google-search**
13371         - ❌
13372         - ❌
13373         - ❌
13374         - ❌
13375
13376
13377    .. list-table:: **test-linux1804-64-shippable-qr/opt**
13378       :widths: 30 15 15 15 15
13379       :header-rows: 1
13380
13381       * - **Test Name**
13382         - mozilla-central
13383         - autoland
13384         - mozilla-release
13385         - mozilla-beta
13386       * - **browsertime-tp6-chrome-google-search**
13387         - ❌
13388         - ❌
13389         - ❌
13390         - ❌
13391       * - **browsertime-tp6-chromium-google-search**
13392         - ❌
13393         - ❌
13394         - ❌
13395         - ❌
13396       * - **browsertime-tp6-firefox-google-search**
13397         - ✅
13398         - ✅
13399         - ✅
13400         - ✅
13401       * - **browsertime-tp6-live-chrome-google-search**
13402         - ❌
13403         - ❌
13404         - ❌
13405         - ❌
13406       * - **browsertime-tp6-live-chromium-google-search**
13407         - ❌
13408         - ❌
13409         - ❌
13410         - ❌
13411       * - **browsertime-tp6-live-firefox-google-search**
13412         - ❌
13413         - ❌
13414         - ❌
13415         - ❌
13416
13417
13418    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
13419       :widths: 30 15 15 15 15
13420       :header-rows: 1
13421
13422       * - **Test Name**
13423         - mozilla-central
13424         - autoland
13425         - mozilla-release
13426         - mozilla-beta
13427       * - **browsertime-tp6-firefox-google-search**
13428         - ❌
13429         - ❌
13430         - ❌
13431         - ❌
13432       * - **browsertime-tp6-live-firefox-google-search**
13433         - ❌
13434         - ❌
13435         - ❌
13436         - ❌
13437
13438
13439    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
13440       :widths: 30 15 15 15 15
13441       :header-rows: 1
13442
13443       * - **Test Name**
13444         - mozilla-central
13445         - autoland
13446         - mozilla-release
13447         - mozilla-beta
13448       * - **browsertime-tp6-chrome-google-search**
13449         - ❌
13450         - ❌
13451         - ❌
13452         - ❌
13453       * - **browsertime-tp6-chromium-google-search**
13454         - ❌
13455         - ❌
13456         - ❌
13457         - ❌
13458       * - **browsertime-tp6-firefox-google-search**
13459         - ✅
13460         - ✅
13461         - ✅
13462         - ✅
13463       * - **browsertime-tp6-live-chrome-google-search**
13464         - ❌
13465         - ❌
13466         - ❌
13467         - ❌
13468       * - **browsertime-tp6-live-chromium-google-search**
13469         - ❌
13470         - ❌
13471         - ❌
13472         - ❌
13473       * - **browsertime-tp6-live-firefox-google-search**
13474         - ❌
13475         - ❌
13476         - ❌
13477         - ❌
13478       * - **browsertime-tp6-live-safari-google-search**
13479         - ❌
13480         - ❌
13481         - ❌
13482         - ❌
13483
13484
13485    .. list-table:: **test-windows10-32-qr/opt**
13486       :widths: 30 15 15 15 15
13487       :header-rows: 1
13488
13489       * - **Test Name**
13490         - mozilla-central
13491         - autoland
13492         - mozilla-release
13493         - mozilla-beta
13494       * - **browsertime-tp6-firefox-google-search**
13495         - ❌
13496         - ❌
13497         - ❌
13498         - ❌
13499       * - **browsertime-tp6-live-firefox-google-search**
13500         - ❌
13501         - ❌
13502         - ❌
13503         - ❌
13504
13505
13506    .. list-table:: **test-windows10-32-shippable-qr/opt**
13507       :widths: 30 15 15 15 15
13508       :header-rows: 1
13509
13510       * - **Test Name**
13511         - mozilla-central
13512         - autoland
13513         - mozilla-release
13514         - mozilla-beta
13515       * - **browsertime-tp6-chrome-google-search**
13516         - ❌
13517         - ❌
13518         - ❌
13519         - ❌
13520       * - **browsertime-tp6-chromium-google-search**
13521         - ❌
13522         - ❌
13523         - ❌
13524         - ❌
13525       * - **browsertime-tp6-firefox-google-search**
13526         - ❌
13527         - ❌
13528         - ❌
13529         - ❌
13530       * - **browsertime-tp6-live-chrome-google-search**
13531         - ❌
13532         - ❌
13533         - ❌
13534         - ❌
13535       * - **browsertime-tp6-live-chromium-google-search**
13536         - ❌
13537         - ❌
13538         - ❌
13539         - ❌
13540       * - **browsertime-tp6-live-firefox-google-search**
13541         - ❌
13542         - ❌
13543         - ❌
13544         - ❌
13545
13546
13547    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
13548       :widths: 30 15 15 15 15
13549       :header-rows: 1
13550
13551       * - **Test Name**
13552         - mozilla-central
13553         - autoland
13554         - mozilla-release
13555         - mozilla-beta
13556       * - **browsertime-tp6-firefox-google-search**
13557         - ❌
13558         - ❌
13559         - ❌
13560         - ❌
13561       * - **browsertime-tp6-live-firefox-google-search**
13562         - ❌
13563         - ❌
13564         - ❌
13565         - ❌
13566
13567
13568    .. list-table:: **test-windows10-64-qr/opt**
13569       :widths: 30 15 15 15 15
13570       :header-rows: 1
13571
13572       * - **Test Name**
13573         - mozilla-central
13574         - autoland
13575         - mozilla-release
13576         - mozilla-beta
13577       * - **browsertime-tp6-firefox-google-search**
13578         - ❌
13579         - ❌
13580         - ❌
13581         - ❌
13582       * - **browsertime-tp6-live-firefox-google-search**
13583         - ❌
13584         - ❌
13585         - ❌
13586         - ❌
13587
13588
13589    .. list-table:: **test-windows10-64-shippable-qr/opt**
13590       :widths: 30 15 15 15 15
13591       :header-rows: 1
13592
13593       * - **Test Name**
13594         - mozilla-central
13595         - autoland
13596         - mozilla-release
13597         - mozilla-beta
13598       * - **browsertime-tp6-chrome-google-search**
13599         - ❌
13600         - ❌
13601         - ❌
13602         - ❌
13603       * - **browsertime-tp6-chromium-google-search**
13604         - ❌
13605         - ❌
13606         - ❌
13607         - ❌
13608       * - **browsertime-tp6-firefox-google-search**
13609         - ✅
13610         - ✅
13611         - ✅
13612         - ✅
13613       * - **browsertime-tp6-live-chrome-google-search**
13614         - ❌
13615         - ❌
13616         - ❌
13617         - ❌
13618       * - **browsertime-tp6-live-chromium-google-search**
13619         - ❌
13620         - ❌
13621         - ❌
13622         - ❌
13623       * - **browsertime-tp6-live-firefox-google-search**
13624         - ❌
13625         - ❌
13626         - ❌
13627         - ❌
13628
13629
13630
13631 .. dropdown:: google-slides
13632    :class-container: anchor-id-google-slides-d
13633
13634    **Owner**: PerfTest Team
13635
13636    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
13637    * **alert threshold**: 2.0
13638    * **apps**: firefox, chrome, chromium, safari, custom-car
13639    * **browser cycles**: 25
13640    * **expected**: pass
13641    * **gecko profile entries**: 14000000
13642    * **gecko profile interval**: 1
13643    * **lower is better**: true
13644    * **page cycles**: 25
13645    * **page timeout**: 60000
13646    * **playback**: mitmproxy
13647    * **playback pageset manifest**: mitm6-linux-firefox-google-slides.manifest
13648    * **playback version**: 6.0.2
13649    * **secondary url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__
13650    * **test url**: `<https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing>`__
13651    * **type**: pageload
13652    * **unit**: ms
13653    * **use live sites**: false
13654    * **Test Task**:
13655
13656    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
13657       :widths: 30 15 15 15 15
13658       :header-rows: 1
13659
13660       * - **Test Name**
13661         - mozilla-central
13662         - autoland
13663         - mozilla-release
13664         - mozilla-beta
13665       * - **browsertime-tp6-bytecode-firefox-google-slides**
13666         - ❌
13667         - ❌
13668         - ❌
13669         - ❌
13670       * - **browsertime-tp6-essential-custom-car-google-slides**
13671         - ❌
13672         - ❌
13673         - ❌
13674         - ❌
13675       * - **browsertime-tp6-essential-firefox-google-slides**
13676         - ❌
13677         - ❌
13678         - ❌
13679         - ❌
13680       * - **browsertime-tp6-live-firefox-google-slides**
13681         - ❌
13682         - ❌
13683         - ❌
13684         - ❌
13685
13686
13687    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
13688       :widths: 30 15 15 15 15
13689       :header-rows: 1
13690
13691       * - **Test Name**
13692         - mozilla-central
13693         - autoland
13694         - mozilla-release
13695         - mozilla-beta
13696       * - **browsertime-tp6-bytecode-firefox-google-slides**
13697         - ❌
13698         - ❌
13699         - ❌
13700         - ❌
13701       * - **browsertime-tp6-essential-custom-car-google-slides**
13702         - ❌
13703         - ❌
13704         - ❌
13705         - ❌
13706       * - **browsertime-tp6-essential-firefox-google-slides**
13707         - ❌
13708         - ❌
13709         - ❌
13710         - ❌
13711       * - **browsertime-tp6-live-firefox-google-slides**
13712         - ❌
13713         - ❌
13714         - ❌
13715         - ❌
13716
13717
13718    .. list-table:: **test-linux1804-64-qr/opt**
13719       :widths: 30 15 15 15 15
13720       :header-rows: 1
13721
13722       * - **Test Name**
13723         - mozilla-central
13724         - autoland
13725         - mozilla-release
13726         - mozilla-beta
13727       * - **browsertime-tp6-bytecode-firefox-google-slides**
13728         - ❌
13729         - ❌
13730         - ❌
13731         - ❌
13732       * - **browsertime-tp6-essential-custom-car-google-slides**
13733         - ❌
13734         - ❌
13735         - ❌
13736         - ❌
13737       * - **browsertime-tp6-essential-firefox-google-slides**
13738         - ❌
13739         - ❌
13740         - ❌
13741         - ❌
13742       * - **browsertime-tp6-live-firefox-google-slides**
13743         - ❌
13744         - ❌
13745         - ❌
13746         - ❌
13747
13748
13749    .. list-table:: **test-linux1804-64-shippable-qr/opt**
13750       :widths: 30 15 15 15 15
13751       :header-rows: 1
13752
13753       * - **Test Name**
13754         - mozilla-central
13755         - autoland
13756         - mozilla-release
13757         - mozilla-beta
13758       * - **browsertime-tp6-bytecode-firefox-google-slides**
13759         - ✅
13760         - ✅
13761         - ✅
13762         - ✅
13763       * - **browsertime-tp6-essential-chrome-google-slides**
13764         - ❌
13765         - ❌
13766         - ❌
13767         - ❌
13768       * - **browsertime-tp6-essential-chromium-google-slides**
13769         - ❌
13770         - ❌
13771         - ❌
13772         - ❌
13773       * - **browsertime-tp6-essential-custom-car-google-slides**
13774         - ❌
13775         - ❌
13776         - ❌
13777         - ❌
13778       * - **browsertime-tp6-essential-firefox-google-slides**
13779         - ✅
13780         - ✅
13781         - ✅
13782         - ✅
13783       * - **browsertime-tp6-live-chrome-google-slides**
13784         - ❌
13785         - ❌
13786         - ❌
13787         - ❌
13788       * - **browsertime-tp6-live-chromium-google-slides**
13789         - ❌
13790         - ❌
13791         - ❌
13792         - ❌
13793       * - **browsertime-tp6-live-firefox-google-slides**
13794         - ❌
13795         - ❌
13796         - ❌
13797         - ❌
13798
13799
13800    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
13801       :widths: 30 15 15 15 15
13802       :header-rows: 1
13803
13804       * - **Test Name**
13805         - mozilla-central
13806         - autoland
13807         - mozilla-release
13808         - mozilla-beta
13809       * - **browsertime-tp6-bytecode-firefox-google-slides**
13810         - ❌
13811         - ❌
13812         - ❌
13813         - ❌
13814       * - **browsertime-tp6-essential-custom-car-google-slides**
13815         - ❌
13816         - ❌
13817         - ❌
13818         - ❌
13819       * - **browsertime-tp6-essential-firefox-google-slides**
13820         - ❌
13821         - ❌
13822         - ❌
13823         - ❌
13824       * - **browsertime-tp6-live-firefox-google-slides**
13825         - ❌
13826         - ❌
13827         - ❌
13828         - ❌
13829
13830
13831    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
13832       :widths: 30 15 15 15 15
13833       :header-rows: 1
13834
13835       * - **Test Name**
13836         - mozilla-central
13837         - autoland
13838         - mozilla-release
13839         - mozilla-beta
13840       * - **browsertime-tp6-bytecode-firefox-google-slides**
13841         - ✅
13842         - ✅
13843         - ✅
13844         - ✅
13845       * - **browsertime-tp6-essential-chrome-google-slides**
13846         - ❌
13847         - ❌
13848         - ❌
13849         - ❌
13850       * - **browsertime-tp6-essential-chromium-google-slides**
13851         - ❌
13852         - ❌
13853         - ❌
13854         - ❌
13855       * - **browsertime-tp6-essential-custom-car-google-slides**
13856         - ❌
13857         - ❌
13858         - ❌
13859         - ❌
13860       * - **browsertime-tp6-essential-firefox-google-slides**
13861         - ✅
13862         - ✅
13863         - ✅
13864         - ✅
13865       * - **browsertime-tp6-live-chrome-google-slides**
13866         - ❌
13867         - ❌
13868         - ❌
13869         - ❌
13870       * - **browsertime-tp6-live-chromium-google-slides**
13871         - ❌
13872         - ❌
13873         - ❌
13874         - ❌
13875       * - **browsertime-tp6-live-firefox-google-slides**
13876         - ❌
13877         - ❌
13878         - ❌
13879         - ❌
13880       * - **browsertime-tp6-live-safari-google-slides**
13881         - ❌
13882         - ❌
13883         - ❌
13884         - ❌
13885
13886
13887    .. list-table:: **test-windows10-32-qr/opt**
13888       :widths: 30 15 15 15 15
13889       :header-rows: 1
13890
13891       * - **Test Name**
13892         - mozilla-central
13893         - autoland
13894         - mozilla-release
13895         - mozilla-beta
13896       * - **browsertime-tp6-bytecode-firefox-google-slides**
13897         - ❌
13898         - ❌
13899         - ❌
13900         - ❌
13901       * - **browsertime-tp6-essential-custom-car-google-slides**
13902         - ❌
13903         - ❌
13904         - ❌
13905         - ❌
13906       * - **browsertime-tp6-essential-firefox-google-slides**
13907         - ❌
13908         - ❌
13909         - ❌
13910         - ❌
13911       * - **browsertime-tp6-live-firefox-google-slides**
13912         - ❌
13913         - ❌
13914         - ❌
13915         - ❌
13916
13917
13918    .. list-table:: **test-windows10-32-shippable-qr/opt**
13919       :widths: 30 15 15 15 15
13920       :header-rows: 1
13921
13922       * - **Test Name**
13923         - mozilla-central
13924         - autoland
13925         - mozilla-release
13926         - mozilla-beta
13927       * - **browsertime-tp6-bytecode-firefox-google-slides**
13928         - ❌
13929         - ❌
13930         - ❌
13931         - ❌
13932       * - **browsertime-tp6-essential-chrome-google-slides**
13933         - ❌
13934         - ❌
13935         - ❌
13936         - ❌
13937       * - **browsertime-tp6-essential-chromium-google-slides**
13938         - ❌
13939         - ❌
13940         - ❌
13941         - ❌
13942       * - **browsertime-tp6-essential-custom-car-google-slides**
13943         - ❌
13944         - ❌
13945         - ❌
13946         - ❌
13947       * - **browsertime-tp6-essential-firefox-google-slides**
13948         - ❌
13949         - ❌
13950         - ❌
13951         - ❌
13952       * - **browsertime-tp6-live-chrome-google-slides**
13953         - ❌
13954         - ❌
13955         - ❌
13956         - ❌
13957       * - **browsertime-tp6-live-chromium-google-slides**
13958         - ❌
13959         - ❌
13960         - ❌
13961         - ❌
13962       * - **browsertime-tp6-live-firefox-google-slides**
13963         - ❌
13964         - ❌
13965         - ❌
13966         - ❌
13967
13968
13969    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
13970       :widths: 30 15 15 15 15
13971       :header-rows: 1
13972
13973       * - **Test Name**
13974         - mozilla-central
13975         - autoland
13976         - mozilla-release
13977         - mozilla-beta
13978       * - **browsertime-tp6-bytecode-firefox-google-slides**
13979         - ❌
13980         - ❌
13981         - ❌
13982         - ❌
13983       * - **browsertime-tp6-essential-custom-car-google-slides**
13984         - ❌
13985         - ❌
13986         - ❌
13987         - ❌
13988       * - **browsertime-tp6-essential-firefox-google-slides**
13989         - ❌
13990         - ❌
13991         - ❌
13992         - ❌
13993       * - **browsertime-tp6-live-firefox-google-slides**
13994         - ❌
13995         - ❌
13996         - ❌
13997         - ❌
13998
13999
14000    .. list-table:: **test-windows10-64-qr/opt**
14001       :widths: 30 15 15 15 15
14002       :header-rows: 1
14003
14004       * - **Test Name**
14005         - mozilla-central
14006         - autoland
14007         - mozilla-release
14008         - mozilla-beta
14009       * - **browsertime-tp6-bytecode-firefox-google-slides**
14010         - ❌
14011         - ❌
14012         - ❌
14013         - ❌
14014       * - **browsertime-tp6-essential-custom-car-google-slides**
14015         - ❌
14016         - ❌
14017         - ❌
14018         - ❌
14019       * - **browsertime-tp6-essential-firefox-google-slides**
14020         - ❌
14021         - ❌
14022         - ❌
14023         - ❌
14024       * - **browsertime-tp6-live-firefox-google-slides**
14025         - ❌
14026         - ❌
14027         - ❌
14028         - ❌
14029
14030
14031    .. list-table:: **test-windows10-64-shippable-qr/opt**
14032       :widths: 30 15 15 15 15
14033       :header-rows: 1
14034
14035       * - **Test Name**
14036         - mozilla-central
14037         - autoland
14038         - mozilla-release
14039         - mozilla-beta
14040       * - **browsertime-tp6-bytecode-firefox-google-slides**
14041         - ✅
14042         - ✅
14043         - ✅
14044         - ✅
14045       * - **browsertime-tp6-essential-chrome-google-slides**
14046         - ❌
14047         - ❌
14048         - ❌
14049         - ❌
14050       * - **browsertime-tp6-essential-chromium-google-slides**
14051         - ❌
14052         - ❌
14053         - ❌
14054         - ❌
14055       * - **browsertime-tp6-essential-custom-car-google-slides**
14056         - ❌
14057         - ❌
14058         - ❌
14059         - ❌
14060       * - **browsertime-tp6-essential-firefox-google-slides**
14061         - ✅
14062         - ✅
14063         - ✅
14064         - ✅
14065       * - **browsertime-tp6-live-chrome-google-slides**
14066         - ❌
14067         - ❌
14068         - ❌
14069         - ❌
14070       * - **browsertime-tp6-live-chromium-google-slides**
14071         - ❌
14072         - ❌
14073         - ❌
14074         - ❌
14075       * - **browsertime-tp6-live-firefox-google-slides**
14076         - ❌
14077         - ❌
14078         - ❌
14079         - ❌
14080
14081
14082
14083 .. dropdown:: imdb
14084    :class-container: anchor-id-imdb-d
14085
14086    **Owner**: PerfTest Team
14087
14088    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
14089    * **alert threshold**: 2.0
14090    * **apps**: firefox, chrome, chromium, safari, custom-car
14091    * **browser cycles**: 25
14092    * **expected**: pass
14093    * **gecko profile entries**: 14000000
14094    * **gecko profile interval**: 1
14095    * **lower is better**: true
14096    * **page cycles**: 25
14097    * **page timeout**: 60000
14098    * **playback**: mitmproxy
14099    * **playback pageset manifest**: mitm7-linux-firefox-imdb.manifest
14100    * **playback version**: 8.1.1
14101    * **secondary url**: `<https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl>`__
14102    * **test url**: `<https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2>`__
14103    * **type**: pageload
14104    * **unit**: ms
14105    * **use live sites**: false
14106    * **Test Task**:
14107
14108    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
14109       :widths: 30 15 15 15 15
14110       :header-rows: 1
14111
14112       * - **Test Name**
14113         - mozilla-central
14114         - autoland
14115         - mozilla-release
14116         - mozilla-beta
14117       * - **browsertime-tp6m-fenix-imdb**
14118         - ❌
14119         - ❌
14120         - ❌
14121         - ❌
14122       * - **browsertime-tp6m-fenix-imdb-nofis**
14123         - ❌
14124         - ❌
14125         - ❌
14126         - ❌
14127       * - **browsertime-tp6m-geckoview-imdb**
14128         - ❌
14129         - ❌
14130         - ❌
14131         - ❌
14132       * - **browsertime-tp6m-geckoview-imdb-nofis**
14133         - ❌
14134         - ❌
14135         - ❌
14136         - ❌
14137       * - **browsertime-tp6m-live-fenix-imdb-nofis**
14138         - ❌
14139         - ❌
14140         - ❌
14141         - ❌
14142       * - **browsertime-tp6m-live-geckoview-imdb-nofis**
14143         - ❌
14144         - ❌
14145         - ❌
14146         - ❌
14147       * - **browsertime-tp6m-refbrow-imdb**
14148         - ❌
14149         - ❌
14150         - ❌
14151         - ❌
14152
14153
14154    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
14155       :widths: 30 15 15 15 15
14156       :header-rows: 1
14157
14158       * - **Test Name**
14159         - mozilla-central
14160         - autoland
14161         - mozilla-release
14162         - mozilla-beta
14163       * - **browsertime-tp6m-chrome-m-imdb**
14164         - ❌
14165         - ❌
14166         - ❌
14167         - ❌
14168       * - **browsertime-tp6m-chrome-m-imdb-nofis**
14169         - ❌
14170         - ❌
14171         - ❌
14172         - ❌
14173       * - **browsertime-tp6m-fenix-imdb**
14174         - ❌
14175         - ❌
14176         - ❌
14177         - ❌
14178       * - **browsertime-tp6m-fenix-imdb-nofis**
14179         - ❌
14180         - ❌
14181         - ❌
14182         - ❌
14183       * - **browsertime-tp6m-geckoview-imdb**
14184         - ❌
14185         - ❌
14186         - ❌
14187         - ❌
14188       * - **browsertime-tp6m-geckoview-imdb-nofis**
14189         - ✅
14190         - ✅
14191         - ❌
14192         - ❌
14193       * - **browsertime-tp6m-live-chrome-m-imdb-nofis**
14194         - ❌
14195         - ❌
14196         - ❌
14197         - ❌
14198       * - **browsertime-tp6m-live-fenix-imdb-nofis**
14199         - ❌
14200         - ❌
14201         - ❌
14202         - ❌
14203       * - **browsertime-tp6m-live-geckoview-imdb-nofis**
14204         - ❌
14205         - ❌
14206         - ❌
14207         - ❌
14208       * - **browsertime-tp6m-refbrow-imdb**
14209         - ❌
14210         - ❌
14211         - ❌
14212         - ❌
14213
14214
14215    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
14216       :widths: 30 15 15 15 15
14217       :header-rows: 1
14218
14219       * - **Test Name**
14220         - mozilla-central
14221         - autoland
14222         - mozilla-release
14223         - mozilla-beta
14224       * - **browsertime-tp6-firefox-imdb**
14225         - ❌
14226         - ❌
14227         - ❌
14228         - ❌
14229       * - **browsertime-tp6-live-firefox-imdb**
14230         - ❌
14231         - ❌
14232         - ❌
14233         - ❌
14234
14235
14236    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
14237       :widths: 30 15 15 15 15
14238       :header-rows: 1
14239
14240       * - **Test Name**
14241         - mozilla-central
14242         - autoland
14243         - mozilla-release
14244         - mozilla-beta
14245       * - **browsertime-tp6-firefox-imdb**
14246         - ❌
14247         - ❌
14248         - ❌
14249         - ❌
14250       * - **browsertime-tp6-live-firefox-imdb**
14251         - ❌
14252         - ❌
14253         - ❌
14254         - ❌
14255
14256
14257    .. list-table:: **test-linux1804-64-qr/opt**
14258       :widths: 30 15 15 15 15
14259       :header-rows: 1
14260
14261       * - **Test Name**
14262         - mozilla-central
14263         - autoland
14264         - mozilla-release
14265         - mozilla-beta
14266       * - **browsertime-tp6-firefox-imdb**
14267         - ❌
14268         - ❌
14269         - ❌
14270         - ❌
14271       * - **browsertime-tp6-live-firefox-imdb**
14272         - ❌
14273         - ❌
14274         - ❌
14275         - ❌
14276
14277
14278    .. list-table:: **test-linux1804-64-shippable-qr/opt**
14279       :widths: 30 15 15 15 15
14280       :header-rows: 1
14281
14282       * - **Test Name**
14283         - mozilla-central
14284         - autoland
14285         - mozilla-release
14286         - mozilla-beta
14287       * - **browsertime-tp6-chrome-imdb**
14288         - ❌
14289         - ❌
14290         - ❌
14291         - ❌
14292       * - **browsertime-tp6-chromium-imdb**
14293         - ❌
14294         - ❌
14295         - ❌
14296         - ❌
14297       * - **browsertime-tp6-firefox-imdb**
14298         - ✅
14299         - ✅
14300         - ✅
14301         - ✅
14302       * - **browsertime-tp6-live-chrome-imdb**
14303         - ❌
14304         - ❌
14305         - ❌
14306         - ❌
14307       * - **browsertime-tp6-live-chromium-imdb**
14308         - ❌
14309         - ❌
14310         - ❌
14311         - ❌
14312       * - **browsertime-tp6-live-firefox-imdb**
14313         - ❌
14314         - ❌
14315         - ❌
14316         - ❌
14317
14318
14319    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
14320       :widths: 30 15 15 15 15
14321       :header-rows: 1
14322
14323       * - **Test Name**
14324         - mozilla-central
14325         - autoland
14326         - mozilla-release
14327         - mozilla-beta
14328       * - **browsertime-tp6-firefox-imdb**
14329         - ❌
14330         - ❌
14331         - ❌
14332         - ❌
14333       * - **browsertime-tp6-live-firefox-imdb**
14334         - ❌
14335         - ❌
14336         - ❌
14337         - ❌
14338
14339
14340    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
14341       :widths: 30 15 15 15 15
14342       :header-rows: 1
14343
14344       * - **Test Name**
14345         - mozilla-central
14346         - autoland
14347         - mozilla-release
14348         - mozilla-beta
14349       * - **browsertime-tp6-chrome-imdb**
14350         - ❌
14351         - ❌
14352         - ❌
14353         - ❌
14354       * - **browsertime-tp6-chromium-imdb**
14355         - ❌
14356         - ❌
14357         - ❌
14358         - ❌
14359       * - **browsertime-tp6-firefox-imdb**
14360         - ✅
14361         - ✅
14362         - ✅
14363         - ✅
14364       * - **browsertime-tp6-live-chrome-imdb**
14365         - ❌
14366         - ❌
14367         - ❌
14368         - ❌
14369       * - **browsertime-tp6-live-chromium-imdb**
14370         - ❌
14371         - ❌
14372         - ❌
14373         - ❌
14374       * - **browsertime-tp6-live-firefox-imdb**
14375         - ❌
14376         - ❌
14377         - ❌
14378         - ❌
14379       * - **browsertime-tp6-live-safari-imdb**
14380         - ❌
14381         - ❌
14382         - ❌
14383         - ❌
14384
14385
14386    .. list-table:: **test-windows10-32-qr/opt**
14387       :widths: 30 15 15 15 15
14388       :header-rows: 1
14389
14390       * - **Test Name**
14391         - mozilla-central
14392         - autoland
14393         - mozilla-release
14394         - mozilla-beta
14395       * - **browsertime-tp6-firefox-imdb**
14396         - ❌
14397         - ❌
14398         - ❌
14399         - ❌
14400       * - **browsertime-tp6-live-firefox-imdb**
14401         - ❌
14402         - ❌
14403         - ❌
14404         - ❌
14405
14406
14407    .. list-table:: **test-windows10-32-shippable-qr/opt**
14408       :widths: 30 15 15 15 15
14409       :header-rows: 1
14410
14411       * - **Test Name**
14412         - mozilla-central
14413         - autoland
14414         - mozilla-release
14415         - mozilla-beta
14416       * - **browsertime-tp6-chrome-imdb**
14417         - ❌
14418         - ❌
14419         - ❌
14420         - ❌
14421       * - **browsertime-tp6-chromium-imdb**
14422         - ❌
14423         - ❌
14424         - ❌
14425         - ❌
14426       * - **browsertime-tp6-firefox-imdb**
14427         - ❌
14428         - ❌
14429         - ❌
14430         - ❌
14431       * - **browsertime-tp6-live-chrome-imdb**
14432         - ❌
14433         - ❌
14434         - ❌
14435         - ❌
14436       * - **browsertime-tp6-live-chromium-imdb**
14437         - ❌
14438         - ❌
14439         - ❌
14440         - ❌
14441       * - **browsertime-tp6-live-firefox-imdb**
14442         - ❌
14443         - ❌
14444         - ❌
14445         - ❌
14446
14447
14448    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
14449       :widths: 30 15 15 15 15
14450       :header-rows: 1
14451
14452       * - **Test Name**
14453         - mozilla-central
14454         - autoland
14455         - mozilla-release
14456         - mozilla-beta
14457       * - **browsertime-tp6-firefox-imdb**
14458         - ❌
14459         - ❌
14460         - ❌
14461         - ❌
14462       * - **browsertime-tp6-live-firefox-imdb**
14463         - ❌
14464         - ❌
14465         - ❌
14466         - ❌
14467
14468
14469    .. list-table:: **test-windows10-64-qr/opt**
14470       :widths: 30 15 15 15 15
14471       :header-rows: 1
14472
14473       * - **Test Name**
14474         - mozilla-central
14475         - autoland
14476         - mozilla-release
14477         - mozilla-beta
14478       * - **browsertime-tp6-firefox-imdb**
14479         - ❌
14480         - ❌
14481         - ❌
14482         - ❌
14483       * - **browsertime-tp6-live-firefox-imdb**
14484         - ❌
14485         - ❌
14486         - ❌
14487         - ❌
14488
14489
14490    .. list-table:: **test-windows10-64-shippable-qr/opt**
14491       :widths: 30 15 15 15 15
14492       :header-rows: 1
14493
14494       * - **Test Name**
14495         - mozilla-central
14496         - autoland
14497         - mozilla-release
14498         - mozilla-beta
14499       * - **browsertime-tp6-chrome-imdb**
14500         - ❌
14501         - ❌
14502         - ❌
14503         - ❌
14504       * - **browsertime-tp6-chromium-imdb**
14505         - ❌
14506         - ❌
14507         - ❌
14508         - ❌
14509       * - **browsertime-tp6-firefox-imdb**
14510         - ✅
14511         - ✅
14512         - ✅
14513         - ✅
14514       * - **browsertime-tp6-live-chrome-imdb**
14515         - ❌
14516         - ❌
14517         - ❌
14518         - ❌
14519       * - **browsertime-tp6-live-chromium-imdb**
14520         - ❌
14521         - ❌
14522         - ❌
14523         - ❌
14524       * - **browsertime-tp6-live-firefox-imdb**
14525         - ❌
14526         - ❌
14527         - ❌
14528         - ❌
14529
14530
14531
14532 .. dropdown:: imgur
14533    :class-container: anchor-id-imgur-d
14534
14535    **Owner**: PerfTest Team
14536
14537    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
14538    * **alert threshold**: 2.0
14539    * **apps**: firefox, chrome, chromium, safari, custom-car
14540    * **browser cycles**: 25
14541    * **expected**: pass
14542    * **gecko profile entries**: 14000000
14543    * **gecko profile interval**: 1
14544    * **lower is better**: true
14545    * **page cycles**: 25
14546    * **page timeout**: 60000
14547    * **playback**: mitmproxy
14548    * **playback pageset manifest**: mitm8-linux-firefox-imgur.manifest
14549    * **playback version**: 8.1.1
14550    * **preferences**: {"media.autoplay.default": 5, "media.autoplay.ask-permission": true, "media.autoplay.blocking_policy": 1, "media.autoplay.block-webaudio": true, "media.allowed-to-play.enabled": false, "media.block-autoplay-until-in-foreground": true}
14551    * **secondary url**: `<https://imgur.com/gallery/rCXZUil>`__
14552    * **test url**: `<https://imgur.com/gallery/m5tYJL6>`__
14553    * **type**: pageload
14554    * **unit**: ms
14555    * **use live sites**: false
14556    * **Test Task**:
14557
14558    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
14559       :widths: 30 15 15 15 15
14560       :header-rows: 1
14561
14562       * - **Test Name**
14563         - mozilla-central
14564         - autoland
14565         - mozilla-release
14566         - mozilla-beta
14567       * - **browsertime-tp6-firefox-imgur**
14568         - ❌
14569         - ❌
14570         - ❌
14571         - ❌
14572       * - **browsertime-tp6-live-firefox-imgur**
14573         - ❌
14574         - ❌
14575         - ❌
14576         - ❌
14577
14578
14579    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
14580       :widths: 30 15 15 15 15
14581       :header-rows: 1
14582
14583       * - **Test Name**
14584         - mozilla-central
14585         - autoland
14586         - mozilla-release
14587         - mozilla-beta
14588       * - **browsertime-tp6-firefox-imgur**
14589         - ❌
14590         - ❌
14591         - ❌
14592         - ❌
14593       * - **browsertime-tp6-live-firefox-imgur**
14594         - ❌
14595         - ❌
14596         - ❌
14597         - ❌
14598
14599
14600    .. list-table:: **test-linux1804-64-qr/opt**
14601       :widths: 30 15 15 15 15
14602       :header-rows: 1
14603
14604       * - **Test Name**
14605         - mozilla-central
14606         - autoland
14607         - mozilla-release
14608         - mozilla-beta
14609       * - **browsertime-tp6-firefox-imgur**
14610         - ❌
14611         - ❌
14612         - ❌
14613         - ❌
14614       * - **browsertime-tp6-live-firefox-imgur**
14615         - ❌
14616         - ❌
14617         - ❌
14618         - ❌
14619
14620
14621    .. list-table:: **test-linux1804-64-shippable-qr/opt**
14622       :widths: 30 15 15 15 15
14623       :header-rows: 1
14624
14625       * - **Test Name**
14626         - mozilla-central
14627         - autoland
14628         - mozilla-release
14629         - mozilla-beta
14630       * - **browsertime-tp6-chrome-imgur**
14631         - ❌
14632         - ❌
14633         - ❌
14634         - ❌
14635       * - **browsertime-tp6-chromium-imgur**
14636         - ❌
14637         - ❌
14638         - ❌
14639         - ❌
14640       * - **browsertime-tp6-firefox-imgur**
14641         - ✅
14642         - ✅
14643         - ✅
14644         - ✅
14645       * - **browsertime-tp6-live-chromium-imgur**
14646         - ❌
14647         - ❌
14648         - ❌
14649         - ❌
14650       * - **browsertime-tp6-live-firefox-imgur**
14651         - ❌
14652         - ❌
14653         - ❌
14654         - ❌
14655
14656
14657    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
14658       :widths: 30 15 15 15 15
14659       :header-rows: 1
14660
14661       * - **Test Name**
14662         - mozilla-central
14663         - autoland
14664         - mozilla-release
14665         - mozilla-beta
14666       * - **browsertime-tp6-firefox-imgur**
14667         - ❌
14668         - ❌
14669         - ❌
14670         - ❌
14671       * - **browsertime-tp6-live-firefox-imgur**
14672         - ❌
14673         - ❌
14674         - ❌
14675         - ❌
14676
14677
14678    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
14679       :widths: 30 15 15 15 15
14680       :header-rows: 1
14681
14682       * - **Test Name**
14683         - mozilla-central
14684         - autoland
14685         - mozilla-release
14686         - mozilla-beta
14687       * - **browsertime-tp6-chrome-imgur**
14688         - ❌
14689         - ❌
14690         - ❌
14691         - ❌
14692       * - **browsertime-tp6-chromium-imgur**
14693         - ❌
14694         - ❌
14695         - ❌
14696         - ❌
14697       * - **browsertime-tp6-firefox-imgur**
14698         - ✅
14699         - ✅
14700         - ✅
14701         - ✅
14702       * - **browsertime-tp6-live-chromium-imgur**
14703         - ❌
14704         - ❌
14705         - ❌
14706         - ❌
14707       * - **browsertime-tp6-live-firefox-imgur**
14708         - ❌
14709         - ❌
14710         - ❌
14711         - ❌
14712
14713
14714    .. list-table:: **test-windows10-32-qr/opt**
14715       :widths: 30 15 15 15 15
14716       :header-rows: 1
14717
14718       * - **Test Name**
14719         - mozilla-central
14720         - autoland
14721         - mozilla-release
14722         - mozilla-beta
14723       * - **browsertime-tp6-firefox-imgur**
14724         - ❌
14725         - ❌
14726         - ❌
14727         - ❌
14728       * - **browsertime-tp6-live-firefox-imgur**
14729         - ❌
14730         - ❌
14731         - ❌
14732         - ❌
14733
14734
14735    .. list-table:: **test-windows10-32-shippable-qr/opt**
14736       :widths: 30 15 15 15 15
14737       :header-rows: 1
14738
14739       * - **Test Name**
14740         - mozilla-central
14741         - autoland
14742         - mozilla-release
14743         - mozilla-beta
14744       * - **browsertime-tp6-chrome-imgur**
14745         - ❌
14746         - ❌
14747         - ❌
14748         - ❌
14749       * - **browsertime-tp6-chromium-imgur**
14750         - ❌
14751         - ❌
14752         - ❌
14753         - ❌
14754       * - **browsertime-tp6-firefox-imgur**
14755         - ❌
14756         - ❌
14757         - ❌
14758         - ❌
14759       * - **browsertime-tp6-live-chromium-imgur**
14760         - ❌
14761         - ❌
14762         - ❌
14763         - ❌
14764       * - **browsertime-tp6-live-firefox-imgur**
14765         - ❌
14766         - ❌
14767         - ❌
14768         - ❌
14769
14770
14771    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
14772       :widths: 30 15 15 15 15
14773       :header-rows: 1
14774
14775       * - **Test Name**
14776         - mozilla-central
14777         - autoland
14778         - mozilla-release
14779         - mozilla-beta
14780       * - **browsertime-tp6-firefox-imgur**
14781         - ❌
14782         - ❌
14783         - ❌
14784         - ❌
14785       * - **browsertime-tp6-live-firefox-imgur**
14786         - ❌
14787         - ❌
14788         - ❌
14789         - ❌
14790
14791
14792    .. list-table:: **test-windows10-64-qr/opt**
14793       :widths: 30 15 15 15 15
14794       :header-rows: 1
14795
14796       * - **Test Name**
14797         - mozilla-central
14798         - autoland
14799         - mozilla-release
14800         - mozilla-beta
14801       * - **browsertime-tp6-firefox-imgur**
14802         - ❌
14803         - ❌
14804         - ❌
14805         - ❌
14806       * - **browsertime-tp6-live-firefox-imgur**
14807         - ❌
14808         - ❌
14809         - ❌
14810         - ❌
14811
14812
14813    .. list-table:: **test-windows10-64-shippable-qr/opt**
14814       :widths: 30 15 15 15 15
14815       :header-rows: 1
14816
14817       * - **Test Name**
14818         - mozilla-central
14819         - autoland
14820         - mozilla-release
14821         - mozilla-beta
14822       * - **browsertime-tp6-chrome-imgur**
14823         - ❌
14824         - ❌
14825         - ❌
14826         - ❌
14827       * - **browsertime-tp6-chromium-imgur**
14828         - ❌
14829         - ❌
14830         - ❌
14831         - ❌
14832       * - **browsertime-tp6-firefox-imgur**
14833         - ✅
14834         - ✅
14835         - ✅
14836         - ✅
14837       * - **browsertime-tp6-live-chromium-imgur**
14838         - ❌
14839         - ❌
14840         - ❌
14841         - ❌
14842       * - **browsertime-tp6-live-firefox-imgur**
14843         - ❌
14844         - ❌
14845         - ❌
14846         - ❌
14847
14848
14849
14850 .. dropdown:: instagram
14851    :class-container: anchor-id-instagram-d
14852
14853    **Owner**: PerfTest Team
14854
14855    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
14856    * **alert threshold**: 2.0
14857    * **apps**: firefox, chrome, chromium, safari, custom-car
14858    * **browser cycles**: 25
14859    * **expected**: pass
14860    * **gecko profile entries**: 14000000
14861    * **gecko profile interval**: 1
14862    * **lower is better**: true
14863    * **page cycles**: 25
14864    * **page timeout**: 60000
14865    * **playback**: mitmproxy
14866    * **playback pageset manifest**: mitm6-linux-firefox-instagram.manifest
14867    * **playback version**: 8.1.1
14868    * **secondary url**: `<https://www.instagram.com/nobelprize_org/>`__
14869    * **test url**: `<https://www.instagram.com/>`__
14870    * **type**: pageload
14871    * **unit**: ms
14872    * **use live sites**: false
14873    * **Test Task**:
14874
14875    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
14876       :widths: 30 15 15 15 15
14877       :header-rows: 1
14878
14879       * - **Test Name**
14880         - mozilla-central
14881         - autoland
14882         - mozilla-release
14883         - mozilla-beta
14884       * - **browsertime-tp6m-fenix-instagram**
14885         - ❌
14886         - ❌
14887         - ❌
14888         - ❌
14889       * - **browsertime-tp6m-fenix-instagram-nofis**
14890         - ❌
14891         - ❌
14892         - ❌
14893         - ❌
14894       * - **browsertime-tp6m-geckoview-instagram**
14895         - ❌
14896         - ❌
14897         - ❌
14898         - ❌
14899       * - **browsertime-tp6m-geckoview-instagram-nofis**
14900         - ❌
14901         - ❌
14902         - ❌
14903         - ❌
14904       * - **browsertime-tp6m-live-fenix-instagram-nofis**
14905         - ❌
14906         - ❌
14907         - ❌
14908         - ❌
14909       * - **browsertime-tp6m-live-geckoview-instagram-nofis**
14910         - ❌
14911         - ❌
14912         - ❌
14913         - ❌
14914       * - **browsertime-tp6m-refbrow-instagram**
14915         - ❌
14916         - ❌
14917         - ❌
14918         - ❌
14919
14920
14921    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
14922       :widths: 30 15 15 15 15
14923       :header-rows: 1
14924
14925       * - **Test Name**
14926         - mozilla-central
14927         - autoland
14928         - mozilla-release
14929         - mozilla-beta
14930       * - **browsertime-tp6m-chrome-m-instagram**
14931         - ❌
14932         - ❌
14933         - ❌
14934         - ❌
14935       * - **browsertime-tp6m-chrome-m-instagram-nofis**
14936         - ❌
14937         - ❌
14938         - ❌
14939         - ❌
14940       * - **browsertime-tp6m-fenix-instagram**
14941         - ❌
14942         - ❌
14943         - ❌
14944         - ❌
14945       * - **browsertime-tp6m-fenix-instagram-nofis**
14946         - ❌
14947         - ❌
14948         - ❌
14949         - ❌
14950       * - **browsertime-tp6m-geckoview-instagram**
14951         - ❌
14952         - ❌
14953         - ❌
14954         - ❌
14955       * - **browsertime-tp6m-geckoview-instagram-nofis**
14956         - ✅
14957         - ✅
14958         - ❌
14959         - ❌
14960       * - **browsertime-tp6m-live-chrome-m-instagram-nofis**
14961         - ❌
14962         - ❌
14963         - ❌
14964         - ❌
14965       * - **browsertime-tp6m-live-fenix-instagram-nofis**
14966         - ❌
14967         - ❌
14968         - ❌
14969         - ❌
14970       * - **browsertime-tp6m-live-geckoview-instagram-nofis**
14971         - ❌
14972         - ❌
14973         - ❌
14974         - ❌
14975       * - **browsertime-tp6m-refbrow-instagram**
14976         - ❌
14977         - ❌
14978         - ❌
14979         - ❌
14980
14981
14982    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
14983       :widths: 30 15 15 15 15
14984       :header-rows: 1
14985
14986       * - **Test Name**
14987         - mozilla-central
14988         - autoland
14989         - mozilla-release
14990         - mozilla-beta
14991       * - **browsertime-tp6-bytecode-firefox-instagram**
14992         - ❌
14993         - ❌
14994         - ❌
14995         - ❌
14996       * - **browsertime-tp6-essential-custom-car-instagram**
14997         - ❌
14998         - ❌
14999         - ❌
15000         - ❌
15001       * - **browsertime-tp6-essential-firefox-instagram**
15002         - ❌
15003         - ❌
15004         - ❌
15005         - ❌
15006
15007
15008    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
15009       :widths: 30 15 15 15 15
15010       :header-rows: 1
15011
15012       * - **Test Name**
15013         - mozilla-central
15014         - autoland
15015         - mozilla-release
15016         - mozilla-beta
15017       * - **browsertime-tp6-bytecode-firefox-instagram**
15018         - ❌
15019         - ❌
15020         - ❌
15021         - ❌
15022       * - **browsertime-tp6-essential-custom-car-instagram**
15023         - ❌
15024         - ❌
15025         - ❌
15026         - ❌
15027       * - **browsertime-tp6-essential-firefox-instagram**
15028         - ❌
15029         - ❌
15030         - ❌
15031         - ❌
15032
15033
15034    .. list-table:: **test-linux1804-64-qr/opt**
15035       :widths: 30 15 15 15 15
15036       :header-rows: 1
15037
15038       * - **Test Name**
15039         - mozilla-central
15040         - autoland
15041         - mozilla-release
15042         - mozilla-beta
15043       * - **browsertime-tp6-bytecode-firefox-instagram**
15044         - ❌
15045         - ❌
15046         - ❌
15047         - ❌
15048       * - **browsertime-tp6-essential-custom-car-instagram**
15049         - ❌
15050         - ❌
15051         - ❌
15052         - ❌
15053       * - **browsertime-tp6-essential-firefox-instagram**
15054         - ❌
15055         - ❌
15056         - ❌
15057         - ❌
15058
15059
15060    .. list-table:: **test-linux1804-64-shippable-qr/opt**
15061       :widths: 30 15 15 15 15
15062       :header-rows: 1
15063
15064       * - **Test Name**
15065         - mozilla-central
15066         - autoland
15067         - mozilla-release
15068         - mozilla-beta
15069       * - **browsertime-tp6-bytecode-firefox-instagram**
15070         - ✅
15071         - ✅
15072         - ✅
15073         - ✅
15074       * - **browsertime-tp6-essential-chrome-instagram**
15075         - ❌
15076         - ❌
15077         - ❌
15078         - ❌
15079       * - **browsertime-tp6-essential-chromium-instagram**
15080         - ❌
15081         - ❌
15082         - ❌
15083         - ❌
15084       * - **browsertime-tp6-essential-custom-car-instagram**
15085         - ❌
15086         - ❌
15087         - ❌
15088         - ❌
15089       * - **browsertime-tp6-essential-firefox-instagram**
15090         - ✅
15091         - ✅
15092         - ✅
15093         - ✅
15094
15095
15096    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
15097       :widths: 30 15 15 15 15
15098       :header-rows: 1
15099
15100       * - **Test Name**
15101         - mozilla-central
15102         - autoland
15103         - mozilla-release
15104         - mozilla-beta
15105       * - **browsertime-tp6-bytecode-firefox-instagram**
15106         - ❌
15107         - ❌
15108         - ❌
15109         - ❌
15110       * - **browsertime-tp6-essential-custom-car-instagram**
15111         - ❌
15112         - ❌
15113         - ❌
15114         - ❌
15115       * - **browsertime-tp6-essential-firefox-instagram**
15116         - ❌
15117         - ❌
15118         - ❌
15119         - ❌
15120
15121
15122    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15123       :widths: 30 15 15 15 15
15124       :header-rows: 1
15125
15126       * - **Test Name**
15127         - mozilla-central
15128         - autoland
15129         - mozilla-release
15130         - mozilla-beta
15131       * - **browsertime-tp6-bytecode-firefox-instagram**
15132         - ✅
15133         - ✅
15134         - ✅
15135         - ✅
15136       * - **browsertime-tp6-essential-chrome-instagram**
15137         - ❌
15138         - ❌
15139         - ❌
15140         - ❌
15141       * - **browsertime-tp6-essential-chromium-instagram**
15142         - ❌
15143         - ❌
15144         - ❌
15145         - ❌
15146       * - **browsertime-tp6-essential-custom-car-instagram**
15147         - ❌
15148         - ❌
15149         - ❌
15150         - ❌
15151       * - **browsertime-tp6-essential-firefox-instagram**
15152         - ✅
15153         - ✅
15154         - ✅
15155         - ✅
15156
15157
15158    .. list-table:: **test-windows10-32-qr/opt**
15159       :widths: 30 15 15 15 15
15160       :header-rows: 1
15161
15162       * - **Test Name**
15163         - mozilla-central
15164         - autoland
15165         - mozilla-release
15166         - mozilla-beta
15167       * - **browsertime-tp6-bytecode-firefox-instagram**
15168         - ❌
15169         - ❌
15170         - ❌
15171         - ❌
15172       * - **browsertime-tp6-essential-custom-car-instagram**
15173         - ❌
15174         - ❌
15175         - ❌
15176         - ❌
15177       * - **browsertime-tp6-essential-firefox-instagram**
15178         - ❌
15179         - ❌
15180         - ❌
15181         - ❌
15182
15183
15184    .. list-table:: **test-windows10-32-shippable-qr/opt**
15185       :widths: 30 15 15 15 15
15186       :header-rows: 1
15187
15188       * - **Test Name**
15189         - mozilla-central
15190         - autoland
15191         - mozilla-release
15192         - mozilla-beta
15193       * - **browsertime-tp6-bytecode-firefox-instagram**
15194         - ❌
15195         - ❌
15196         - ❌
15197         - ❌
15198       * - **browsertime-tp6-essential-chrome-instagram**
15199         - ❌
15200         - ❌
15201         - ❌
15202         - ❌
15203       * - **browsertime-tp6-essential-chromium-instagram**
15204         - ❌
15205         - ❌
15206         - ❌
15207         - ❌
15208       * - **browsertime-tp6-essential-custom-car-instagram**
15209         - ❌
15210         - ❌
15211         - ❌
15212         - ❌
15213       * - **browsertime-tp6-essential-firefox-instagram**
15214         - ❌
15215         - ❌
15216         - ❌
15217         - ❌
15218
15219
15220    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
15221       :widths: 30 15 15 15 15
15222       :header-rows: 1
15223
15224       * - **Test Name**
15225         - mozilla-central
15226         - autoland
15227         - mozilla-release
15228         - mozilla-beta
15229       * - **browsertime-tp6-bytecode-firefox-instagram**
15230         - ❌
15231         - ❌
15232         - ❌
15233         - ❌
15234       * - **browsertime-tp6-essential-custom-car-instagram**
15235         - ❌
15236         - ❌
15237         - ❌
15238         - ❌
15239       * - **browsertime-tp6-essential-firefox-instagram**
15240         - ❌
15241         - ❌
15242         - ❌
15243         - ❌
15244
15245
15246    .. list-table:: **test-windows10-64-qr/opt**
15247       :widths: 30 15 15 15 15
15248       :header-rows: 1
15249
15250       * - **Test Name**
15251         - mozilla-central
15252         - autoland
15253         - mozilla-release
15254         - mozilla-beta
15255       * - **browsertime-tp6-bytecode-firefox-instagram**
15256         - ❌
15257         - ❌
15258         - ❌
15259         - ❌
15260       * - **browsertime-tp6-essential-custom-car-instagram**
15261         - ❌
15262         - ❌
15263         - ❌
15264         - ❌
15265       * - **browsertime-tp6-essential-firefox-instagram**
15266         - ❌
15267         - ❌
15268         - ❌
15269         - ❌
15270
15271
15272    .. list-table:: **test-windows10-64-shippable-qr/opt**
15273       :widths: 30 15 15 15 15
15274       :header-rows: 1
15275
15276       * - **Test Name**
15277         - mozilla-central
15278         - autoland
15279         - mozilla-release
15280         - mozilla-beta
15281       * - **browsertime-tp6-bytecode-firefox-instagram**
15282         - ✅
15283         - ✅
15284         - ✅
15285         - ✅
15286       * - **browsertime-tp6-essential-chrome-instagram**
15287         - ❌
15288         - ❌
15289         - ❌
15290         - ❌
15291       * - **browsertime-tp6-essential-chromium-instagram**
15292         - ❌
15293         - ❌
15294         - ❌
15295         - ❌
15296       * - **browsertime-tp6-essential-custom-car-instagram**
15297         - ❌
15298         - ❌
15299         - ❌
15300         - ❌
15301       * - **browsertime-tp6-essential-firefox-instagram**
15302         - ✅
15303         - ✅
15304         - ✅
15305         - ✅
15306
15307
15308
15309 .. dropdown:: linkedin
15310    :class-container: anchor-id-linkedin-d
15311
15312    **Owner**: PerfTest Team
15313
15314    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
15315    * **alert threshold**: 2.0
15316    * **apps**: firefox, chrome, chromium, safari, custom-car
15317    * **browser cycles**: 25
15318    * **expected**: pass
15319    * **gecko profile entries**: 14000000
15320    * **gecko profile interval**: 1
15321    * **lower is better**: true
15322    * **page cycles**: 25
15323    * **page timeout**: 60000
15324    * **playback**: mitmproxy
15325    * **playback pageset manifest**: mitm6-linux-firefox-linkedin.manifest
15326    * **playback version**: 8.1.1
15327    * **secondary url**: `<https://www.linkedin.com/in/thommy-harris-hk-385723106/>`__
15328    * **test url**: `<https://www.linkedin.com/feed/>`__
15329    * **type**: pageload
15330    * **unit**: ms
15331    * **use live sites**: false
15332    * **Test Task**:
15333
15334    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
15335       :widths: 30 15 15 15 15
15336       :header-rows: 1
15337
15338       * - **Test Name**
15339         - mozilla-central
15340         - autoland
15341         - mozilla-release
15342         - mozilla-beta
15343       * - **browsertime-tp6-firefox-linkedin**
15344         - ❌
15345         - ❌
15346         - ❌
15347         - ❌
15348       * - **browsertime-tp6-live-firefox-linkedin**
15349         - ❌
15350         - ❌
15351         - ❌
15352         - ❌
15353
15354
15355    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
15356       :widths: 30 15 15 15 15
15357       :header-rows: 1
15358
15359       * - **Test Name**
15360         - mozilla-central
15361         - autoland
15362         - mozilla-release
15363         - mozilla-beta
15364       * - **browsertime-tp6-firefox-linkedin**
15365         - ❌
15366         - ❌
15367         - ❌
15368         - ❌
15369       * - **browsertime-tp6-live-firefox-linkedin**
15370         - ❌
15371         - ❌
15372         - ❌
15373         - ❌
15374
15375
15376    .. list-table:: **test-linux1804-64-qr/opt**
15377       :widths: 30 15 15 15 15
15378       :header-rows: 1
15379
15380       * - **Test Name**
15381         - mozilla-central
15382         - autoland
15383         - mozilla-release
15384         - mozilla-beta
15385       * - **browsertime-tp6-firefox-linkedin**
15386         - ❌
15387         - ❌
15388         - ❌
15389         - ❌
15390       * - **browsertime-tp6-live-firefox-linkedin**
15391         - ❌
15392         - ❌
15393         - ❌
15394         - ❌
15395
15396
15397    .. list-table:: **test-linux1804-64-shippable-qr/opt**
15398       :widths: 30 15 15 15 15
15399       :header-rows: 1
15400
15401       * - **Test Name**
15402         - mozilla-central
15403         - autoland
15404         - mozilla-release
15405         - mozilla-beta
15406       * - **browsertime-tp6-chrome-linkedin**
15407         - ❌
15408         - ❌
15409         - ❌
15410         - ❌
15411       * - **browsertime-tp6-chromium-linkedin**
15412         - ❌
15413         - ❌
15414         - ❌
15415         - ❌
15416       * - **browsertime-tp6-firefox-linkedin**
15417         - ✅
15418         - ✅
15419         - ✅
15420         - ✅
15421       * - **browsertime-tp6-live-chrome-linkedin**
15422         - ❌
15423         - ❌
15424         - ❌
15425         - ❌
15426       * - **browsertime-tp6-live-chromium-linkedin**
15427         - ❌
15428         - ❌
15429         - ❌
15430         - ❌
15431       * - **browsertime-tp6-live-firefox-linkedin**
15432         - ❌
15433         - ❌
15434         - ❌
15435         - ❌
15436
15437
15438    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
15439       :widths: 30 15 15 15 15
15440       :header-rows: 1
15441
15442       * - **Test Name**
15443         - mozilla-central
15444         - autoland
15445         - mozilla-release
15446         - mozilla-beta
15447       * - **browsertime-tp6-firefox-linkedin**
15448         - ❌
15449         - ❌
15450         - ❌
15451         - ❌
15452       * - **browsertime-tp6-live-firefox-linkedin**
15453         - ❌
15454         - ❌
15455         - ❌
15456         - ❌
15457
15458
15459    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15460       :widths: 30 15 15 15 15
15461       :header-rows: 1
15462
15463       * - **Test Name**
15464         - mozilla-central
15465         - autoland
15466         - mozilla-release
15467         - mozilla-beta
15468       * - **browsertime-tp6-chrome-linkedin**
15469         - ❌
15470         - ❌
15471         - ❌
15472         - ❌
15473       * - **browsertime-tp6-chromium-linkedin**
15474         - ❌
15475         - ❌
15476         - ❌
15477         - ❌
15478       * - **browsertime-tp6-firefox-linkedin**
15479         - ✅
15480         - ✅
15481         - ✅
15482         - ✅
15483       * - **browsertime-tp6-live-chrome-linkedin**
15484         - ❌
15485         - ❌
15486         - ❌
15487         - ❌
15488       * - **browsertime-tp6-live-chromium-linkedin**
15489         - ❌
15490         - ❌
15491         - ❌
15492         - ❌
15493       * - **browsertime-tp6-live-firefox-linkedin**
15494         - ❌
15495         - ❌
15496         - ❌
15497         - ❌
15498       * - **browsertime-tp6-live-safari-linkedin**
15499         - ❌
15500         - ❌
15501         - ❌
15502         - ❌
15503
15504
15505    .. list-table:: **test-windows10-32-qr/opt**
15506       :widths: 30 15 15 15 15
15507       :header-rows: 1
15508
15509       * - **Test Name**
15510         - mozilla-central
15511         - autoland
15512         - mozilla-release
15513         - mozilla-beta
15514       * - **browsertime-tp6-firefox-linkedin**
15515         - ❌
15516         - ❌
15517         - ❌
15518         - ❌
15519       * - **browsertime-tp6-live-firefox-linkedin**
15520         - ❌
15521         - ❌
15522         - ❌
15523         - ❌
15524
15525
15526    .. list-table:: **test-windows10-32-shippable-qr/opt**
15527       :widths: 30 15 15 15 15
15528       :header-rows: 1
15529
15530       * - **Test Name**
15531         - mozilla-central
15532         - autoland
15533         - mozilla-release
15534         - mozilla-beta
15535       * - **browsertime-tp6-chrome-linkedin**
15536         - ❌
15537         - ❌
15538         - ❌
15539         - ❌
15540       * - **browsertime-tp6-chromium-linkedin**
15541         - ❌
15542         - ❌
15543         - ❌
15544         - ❌
15545       * - **browsertime-tp6-firefox-linkedin**
15546         - ❌
15547         - ❌
15548         - ❌
15549         - ❌
15550       * - **browsertime-tp6-live-chrome-linkedin**
15551         - ❌
15552         - ❌
15553         - ❌
15554         - ❌
15555       * - **browsertime-tp6-live-chromium-linkedin**
15556         - ❌
15557         - ❌
15558         - ❌
15559         - ❌
15560       * - **browsertime-tp6-live-firefox-linkedin**
15561         - ❌
15562         - ❌
15563         - ❌
15564         - ❌
15565
15566
15567    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
15568       :widths: 30 15 15 15 15
15569       :header-rows: 1
15570
15571       * - **Test Name**
15572         - mozilla-central
15573         - autoland
15574         - mozilla-release
15575         - mozilla-beta
15576       * - **browsertime-tp6-firefox-linkedin**
15577         - ❌
15578         - ❌
15579         - ❌
15580         - ❌
15581       * - **browsertime-tp6-live-firefox-linkedin**
15582         - ❌
15583         - ❌
15584         - ❌
15585         - ❌
15586
15587
15588    .. list-table:: **test-windows10-64-qr/opt**
15589       :widths: 30 15 15 15 15
15590       :header-rows: 1
15591
15592       * - **Test Name**
15593         - mozilla-central
15594         - autoland
15595         - mozilla-release
15596         - mozilla-beta
15597       * - **browsertime-tp6-firefox-linkedin**
15598         - ❌
15599         - ❌
15600         - ❌
15601         - ❌
15602       * - **browsertime-tp6-live-firefox-linkedin**
15603         - ❌
15604         - ❌
15605         - ❌
15606         - ❌
15607
15608
15609    .. list-table:: **test-windows10-64-shippable-qr/opt**
15610       :widths: 30 15 15 15 15
15611       :header-rows: 1
15612
15613       * - **Test Name**
15614         - mozilla-central
15615         - autoland
15616         - mozilla-release
15617         - mozilla-beta
15618       * - **browsertime-tp6-chrome-linkedin**
15619         - ❌
15620         - ❌
15621         - ❌
15622         - ❌
15623       * - **browsertime-tp6-chromium-linkedin**
15624         - ❌
15625         - ❌
15626         - ❌
15627         - ❌
15628       * - **browsertime-tp6-firefox-linkedin**
15629         - ✅
15630         - ✅
15631         - ✅
15632         - ✅
15633       * - **browsertime-tp6-live-chrome-linkedin**
15634         - ❌
15635         - ❌
15636         - ❌
15637         - ❌
15638       * - **browsertime-tp6-live-chromium-linkedin**
15639         - ❌
15640         - ❌
15641         - ❌
15642         - ❌
15643       * - **browsertime-tp6-live-firefox-linkedin**
15644         - ❌
15645         - ❌
15646         - ❌
15647         - ❌
15648
15649
15650
15651 .. dropdown:: microsoft
15652    :class-container: anchor-id-microsoft-d
15653
15654    **Owner**: PerfTest Team
15655
15656    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
15657    * **alert threshold**: 2.0
15658    * **apps**: firefox, chrome, chromium, safari, custom-car
15659    * **browser cycles**: 25
15660    * **expected**: pass
15661    * **gecko profile entries**: 14000000
15662    * **gecko profile interval**: 1
15663    * **lower is better**: true
15664    * **page cycles**: 25
15665    * **page timeout**: 60000
15666    * **playback**: mitmproxy
15667    * **playback pageset manifest**: mitm7-linux-firefox-microsoft.manifest
15668    * **playback version**: 8.1.1
15669    * **secondary url**: `<https://support.microsoft.com/en-us>`__
15670    * **test url**: `<https://www.microsoft.com/en-us/>`__
15671    * **type**: pageload
15672    * **unit**: ms
15673    * **use live sites**: false
15674    * **Test Task**:
15675
15676    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
15677       :widths: 30 15 15 15 15
15678       :header-rows: 1
15679
15680       * - **Test Name**
15681         - mozilla-central
15682         - autoland
15683         - mozilla-release
15684         - mozilla-beta
15685       * - **browsertime-tp6-firefox-microsoft**
15686         - ❌
15687         - ❌
15688         - ❌
15689         - ❌
15690       * - **browsertime-tp6-live-firefox-microsoft**
15691         - ❌
15692         - ❌
15693         - ❌
15694         - ❌
15695
15696
15697    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
15698       :widths: 30 15 15 15 15
15699       :header-rows: 1
15700
15701       * - **Test Name**
15702         - mozilla-central
15703         - autoland
15704         - mozilla-release
15705         - mozilla-beta
15706       * - **browsertime-tp6-firefox-microsoft**
15707         - ❌
15708         - ❌
15709         - ❌
15710         - ❌
15711       * - **browsertime-tp6-live-firefox-microsoft**
15712         - ❌
15713         - ❌
15714         - ❌
15715         - ❌
15716
15717
15718    .. list-table:: **test-linux1804-64-qr/opt**
15719       :widths: 30 15 15 15 15
15720       :header-rows: 1
15721
15722       * - **Test Name**
15723         - mozilla-central
15724         - autoland
15725         - mozilla-release
15726         - mozilla-beta
15727       * - **browsertime-tp6-firefox-microsoft**
15728         - ❌
15729         - ❌
15730         - ❌
15731         - ❌
15732       * - **browsertime-tp6-live-firefox-microsoft**
15733         - ❌
15734         - ❌
15735         - ❌
15736         - ❌
15737
15738
15739    .. list-table:: **test-linux1804-64-shippable-qr/opt**
15740       :widths: 30 15 15 15 15
15741       :header-rows: 1
15742
15743       * - **Test Name**
15744         - mozilla-central
15745         - autoland
15746         - mozilla-release
15747         - mozilla-beta
15748       * - **browsertime-tp6-chrome-microsoft**
15749         - ❌
15750         - ❌
15751         - ❌
15752         - ❌
15753       * - **browsertime-tp6-chromium-microsoft**
15754         - ❌
15755         - ❌
15756         - ❌
15757         - ❌
15758       * - **browsertime-tp6-firefox-microsoft**
15759         - ✅
15760         - ✅
15761         - ✅
15762         - ✅
15763       * - **browsertime-tp6-live-chrome-microsoft**
15764         - ❌
15765         - ❌
15766         - ❌
15767         - ❌
15768       * - **browsertime-tp6-live-chromium-microsoft**
15769         - ❌
15770         - ❌
15771         - ❌
15772         - ❌
15773       * - **browsertime-tp6-live-firefox-microsoft**
15774         - ❌
15775         - ❌
15776         - ❌
15777         - ❌
15778
15779
15780    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
15781       :widths: 30 15 15 15 15
15782       :header-rows: 1
15783
15784       * - **Test Name**
15785         - mozilla-central
15786         - autoland
15787         - mozilla-release
15788         - mozilla-beta
15789       * - **browsertime-tp6-firefox-microsoft**
15790         - ❌
15791         - ❌
15792         - ❌
15793         - ❌
15794       * - **browsertime-tp6-live-firefox-microsoft**
15795         - ❌
15796         - ❌
15797         - ❌
15798         - ❌
15799
15800
15801    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15802       :widths: 30 15 15 15 15
15803       :header-rows: 1
15804
15805       * - **Test Name**
15806         - mozilla-central
15807         - autoland
15808         - mozilla-release
15809         - mozilla-beta
15810       * - **browsertime-tp6-chrome-microsoft**
15811         - ❌
15812         - ❌
15813         - ❌
15814         - ❌
15815       * - **browsertime-tp6-chromium-microsoft**
15816         - ❌
15817         - ❌
15818         - ❌
15819         - ❌
15820       * - **browsertime-tp6-firefox-microsoft**
15821         - ✅
15822         - ✅
15823         - ✅
15824         - ✅
15825       * - **browsertime-tp6-live-chrome-microsoft**
15826         - ❌
15827         - ❌
15828         - ❌
15829         - ❌
15830       * - **browsertime-tp6-live-chromium-microsoft**
15831         - ❌
15832         - ❌
15833         - ❌
15834         - ❌
15835       * - **browsertime-tp6-live-firefox-microsoft**
15836         - ❌
15837         - ❌
15838         - ❌
15839         - ❌
15840       * - **browsertime-tp6-live-safari-microsoft**
15841         - ❌
15842         - ❌
15843         - ❌
15844         - ❌
15845
15846
15847    .. list-table:: **test-windows10-32-qr/opt**
15848       :widths: 30 15 15 15 15
15849       :header-rows: 1
15850
15851       * - **Test Name**
15852         - mozilla-central
15853         - autoland
15854         - mozilla-release
15855         - mozilla-beta
15856       * - **browsertime-tp6-firefox-microsoft**
15857         - ❌
15858         - ❌
15859         - ❌
15860         - ❌
15861       * - **browsertime-tp6-live-firefox-microsoft**
15862         - ❌
15863         - ❌
15864         - ❌
15865         - ❌
15866
15867
15868    .. list-table:: **test-windows10-32-shippable-qr/opt**
15869       :widths: 30 15 15 15 15
15870       :header-rows: 1
15871
15872       * - **Test Name**
15873         - mozilla-central
15874         - autoland
15875         - mozilla-release
15876         - mozilla-beta
15877       * - **browsertime-tp6-chrome-microsoft**
15878         - ❌
15879         - ❌
15880         - ❌
15881         - ❌
15882       * - **browsertime-tp6-chromium-microsoft**
15883         - ❌
15884         - ❌
15885         - ❌
15886         - ❌
15887       * - **browsertime-tp6-firefox-microsoft**
15888         - ❌
15889         - ❌
15890         - ❌
15891         - ❌
15892       * - **browsertime-tp6-live-chrome-microsoft**
15893         - ❌
15894         - ❌
15895         - ❌
15896         - ❌
15897       * - **browsertime-tp6-live-chromium-microsoft**
15898         - ❌
15899         - ❌
15900         - ❌
15901         - ❌
15902       * - **browsertime-tp6-live-firefox-microsoft**
15903         - ❌
15904         - ❌
15905         - ❌
15906         - ❌
15907
15908
15909    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
15910       :widths: 30 15 15 15 15
15911       :header-rows: 1
15912
15913       * - **Test Name**
15914         - mozilla-central
15915         - autoland
15916         - mozilla-release
15917         - mozilla-beta
15918       * - **browsertime-tp6-firefox-microsoft**
15919         - ❌
15920         - ❌
15921         - ❌
15922         - ❌
15923       * - **browsertime-tp6-live-firefox-microsoft**
15924         - ❌
15925         - ❌
15926         - ❌
15927         - ❌
15928
15929
15930    .. list-table:: **test-windows10-64-qr/opt**
15931       :widths: 30 15 15 15 15
15932       :header-rows: 1
15933
15934       * - **Test Name**
15935         - mozilla-central
15936         - autoland
15937         - mozilla-release
15938         - mozilla-beta
15939       * - **browsertime-tp6-firefox-microsoft**
15940         - ❌
15941         - ❌
15942         - ❌
15943         - ❌
15944       * - **browsertime-tp6-live-firefox-microsoft**
15945         - ❌
15946         - ❌
15947         - ❌
15948         - ❌
15949
15950
15951    .. list-table:: **test-windows10-64-shippable-qr/opt**
15952       :widths: 30 15 15 15 15
15953       :header-rows: 1
15954
15955       * - **Test Name**
15956         - mozilla-central
15957         - autoland
15958         - mozilla-release
15959         - mozilla-beta
15960       * - **browsertime-tp6-chrome-microsoft**
15961         - ❌
15962         - ❌
15963         - ❌
15964         - ❌
15965       * - **browsertime-tp6-chromium-microsoft**
15966         - ❌
15967         - ❌
15968         - ❌
15969         - ❌
15970       * - **browsertime-tp6-firefox-microsoft**
15971         - ✅
15972         - ✅
15973         - ✅
15974         - ✅
15975       * - **browsertime-tp6-live-chrome-microsoft**
15976         - ❌
15977         - ❌
15978         - ❌
15979         - ❌
15980       * - **browsertime-tp6-live-chromium-microsoft**
15981         - ❌
15982         - ❌
15983         - ❌
15984         - ❌
15985       * - **browsertime-tp6-live-firefox-microsoft**
15986         - ❌
15987         - ❌
15988         - ❌
15989         - ❌
15990
15991
15992
15993 .. dropdown:: netflix
15994    :class-container: anchor-id-netflix-d
15995
15996    **Owner**: PerfTest Team
15997
15998    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
15999    * **alert threshold**: 2.0
16000    * **apps**: firefox, chrome, chromium, safari, custom-car
16001    * **browser cycles**: 25
16002    * **expected**: pass
16003    * **gecko profile entries**: 14000000
16004    * **gecko profile interval**: 1
16005    * **lower is better**: true
16006    * **page cycles**: 25
16007    * **page timeout**: 60000
16008    * **playback**: mitmproxy
16009    * **playback pageset manifest**: mitm6-linux-firefox-netflix.manifest
16010    * **playback version**: 8.1.1
16011    * **secondary url**: `<https://www.netflix.com/title/699257>`__
16012    * **test url**: `<https://www.netflix.com/title/80117263>`__
16013    * **type**: pageload
16014    * **unit**: ms
16015    * **use live sites**: false
16016    * **Test Task**:
16017
16018    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16019       :widths: 30 15 15 15 15
16020       :header-rows: 1
16021
16022       * - **Test Name**
16023         - mozilla-central
16024         - autoland
16025         - mozilla-release
16026         - mozilla-beta
16027       * - **browsertime-tp6-firefox-netflix**
16028         - ❌
16029         - ❌
16030         - ❌
16031         - ❌
16032       * - **browsertime-tp6-live-firefox-netflix**
16033         - ❌
16034         - ❌
16035         - ❌
16036         - ❌
16037
16038
16039    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
16040       :widths: 30 15 15 15 15
16041       :header-rows: 1
16042
16043       * - **Test Name**
16044         - mozilla-central
16045         - autoland
16046         - mozilla-release
16047         - mozilla-beta
16048       * - **browsertime-tp6-firefox-netflix**
16049         - ❌
16050         - ❌
16051         - ❌
16052         - ❌
16053       * - **browsertime-tp6-live-firefox-netflix**
16054         - ❌
16055         - ❌
16056         - ❌
16057         - ❌
16058
16059
16060    .. list-table:: **test-linux1804-64-qr/opt**
16061       :widths: 30 15 15 15 15
16062       :header-rows: 1
16063
16064       * - **Test Name**
16065         - mozilla-central
16066         - autoland
16067         - mozilla-release
16068         - mozilla-beta
16069       * - **browsertime-tp6-firefox-netflix**
16070         - ❌
16071         - ❌
16072         - ❌
16073         - ❌
16074       * - **browsertime-tp6-live-firefox-netflix**
16075         - ❌
16076         - ❌
16077         - ❌
16078         - ❌
16079
16080
16081    .. list-table:: **test-linux1804-64-shippable-qr/opt**
16082       :widths: 30 15 15 15 15
16083       :header-rows: 1
16084
16085       * - **Test Name**
16086         - mozilla-central
16087         - autoland
16088         - mozilla-release
16089         - mozilla-beta
16090       * - **browsertime-tp6-chrome-netflix**
16091         - ❌
16092         - ❌
16093         - ❌
16094         - ❌
16095       * - **browsertime-tp6-chromium-netflix**
16096         - ❌
16097         - ❌
16098         - ❌
16099         - ❌
16100       * - **browsertime-tp6-firefox-netflix**
16101         - ✅
16102         - ✅
16103         - ✅
16104         - ✅
16105       * - **browsertime-tp6-live-chrome-netflix**
16106         - ❌
16107         - ❌
16108         - ❌
16109         - ❌
16110       * - **browsertime-tp6-live-chromium-netflix**
16111         - ❌
16112         - ❌
16113         - ❌
16114         - ❌
16115       * - **browsertime-tp6-live-firefox-netflix**
16116         - ❌
16117         - ❌
16118         - ❌
16119         - ❌
16120
16121
16122    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
16123       :widths: 30 15 15 15 15
16124       :header-rows: 1
16125
16126       * - **Test Name**
16127         - mozilla-central
16128         - autoland
16129         - mozilla-release
16130         - mozilla-beta
16131       * - **browsertime-tp6-firefox-netflix**
16132         - ❌
16133         - ❌
16134         - ❌
16135         - ❌
16136       * - **browsertime-tp6-live-firefox-netflix**
16137         - ❌
16138         - ❌
16139         - ❌
16140         - ❌
16141
16142
16143    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16144       :widths: 30 15 15 15 15
16145       :header-rows: 1
16146
16147       * - **Test Name**
16148         - mozilla-central
16149         - autoland
16150         - mozilla-release
16151         - mozilla-beta
16152       * - **browsertime-tp6-chrome-netflix**
16153         - ❌
16154         - ❌
16155         - ❌
16156         - ❌
16157       * - **browsertime-tp6-chromium-netflix**
16158         - ❌
16159         - ❌
16160         - ❌
16161         - ❌
16162       * - **browsertime-tp6-firefox-netflix**
16163         - ❌
16164         - ❌
16165         - ❌
16166         - ❌
16167       * - **browsertime-tp6-live-chrome-netflix**
16168         - ❌
16169         - ❌
16170         - ❌
16171         - ❌
16172       * - **browsertime-tp6-live-chromium-netflix**
16173         - ❌
16174         - ❌
16175         - ❌
16176         - ❌
16177       * - **browsertime-tp6-live-firefox-netflix**
16178         - ❌
16179         - ❌
16180         - ❌
16181         - ❌
16182
16183
16184    .. list-table:: **test-windows10-32-qr/opt**
16185       :widths: 30 15 15 15 15
16186       :header-rows: 1
16187
16188       * - **Test Name**
16189         - mozilla-central
16190         - autoland
16191         - mozilla-release
16192         - mozilla-beta
16193       * - **browsertime-tp6-firefox-netflix**
16194         - ❌
16195         - ❌
16196         - ❌
16197         - ❌
16198       * - **browsertime-tp6-live-firefox-netflix**
16199         - ❌
16200         - ❌
16201         - ❌
16202         - ❌
16203
16204
16205    .. list-table:: **test-windows10-32-shippable-qr/opt**
16206       :widths: 30 15 15 15 15
16207       :header-rows: 1
16208
16209       * - **Test Name**
16210         - mozilla-central
16211         - autoland
16212         - mozilla-release
16213         - mozilla-beta
16214       * - **browsertime-tp6-chrome-netflix**
16215         - ❌
16216         - ❌
16217         - ❌
16218         - ❌
16219       * - **browsertime-tp6-chromium-netflix**
16220         - ❌
16221         - ❌
16222         - ❌
16223         - ❌
16224       * - **browsertime-tp6-firefox-netflix**
16225         - ❌
16226         - ❌
16227         - ❌
16228         - ❌
16229       * - **browsertime-tp6-live-chrome-netflix**
16230         - ❌
16231         - ❌
16232         - ❌
16233         - ❌
16234       * - **browsertime-tp6-live-chromium-netflix**
16235         - ❌
16236         - ❌
16237         - ❌
16238         - ❌
16239       * - **browsertime-tp6-live-firefox-netflix**
16240         - ❌
16241         - ❌
16242         - ❌
16243         - ❌
16244
16245
16246    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
16247       :widths: 30 15 15 15 15
16248       :header-rows: 1
16249
16250       * - **Test Name**
16251         - mozilla-central
16252         - autoland
16253         - mozilla-release
16254         - mozilla-beta
16255       * - **browsertime-tp6-firefox-netflix**
16256         - ❌
16257         - ❌
16258         - ❌
16259         - ❌
16260       * - **browsertime-tp6-live-firefox-netflix**
16261         - ❌
16262         - ❌
16263         - ❌
16264         - ❌
16265
16266
16267    .. list-table:: **test-windows10-64-qr/opt**
16268       :widths: 30 15 15 15 15
16269       :header-rows: 1
16270
16271       * - **Test Name**
16272         - mozilla-central
16273         - autoland
16274         - mozilla-release
16275         - mozilla-beta
16276       * - **browsertime-tp6-firefox-netflix**
16277         - ❌
16278         - ❌
16279         - ❌
16280         - ❌
16281       * - **browsertime-tp6-live-firefox-netflix**
16282         - ❌
16283         - ❌
16284         - ❌
16285         - ❌
16286
16287
16288    .. list-table:: **test-windows10-64-shippable-qr/opt**
16289       :widths: 30 15 15 15 15
16290       :header-rows: 1
16291
16292       * - **Test Name**
16293         - mozilla-central
16294         - autoland
16295         - mozilla-release
16296         - mozilla-beta
16297       * - **browsertime-tp6-chrome-netflix**
16298         - ❌
16299         - ❌
16300         - ❌
16301         - ❌
16302       * - **browsertime-tp6-chromium-netflix**
16303         - ❌
16304         - ❌
16305         - ❌
16306         - ❌
16307       * - **browsertime-tp6-firefox-netflix**
16308         - ✅
16309         - ✅
16310         - ✅
16311         - ✅
16312       * - **browsertime-tp6-live-chrome-netflix**
16313         - ❌
16314         - ❌
16315         - ❌
16316         - ❌
16317       * - **browsertime-tp6-live-chromium-netflix**
16318         - ❌
16319         - ❌
16320         - ❌
16321         - ❌
16322       * - **browsertime-tp6-live-firefox-netflix**
16323         - ❌
16324         - ❌
16325         - ❌
16326         - ❌
16327
16328
16329
16330 .. dropdown:: nytimes
16331    :class-container: anchor-id-nytimes-d
16332
16333    **Owner**: PerfTest Team
16334
16335    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
16336    * **alert threshold**: 2.0
16337    * **apps**: firefox, chrome, chromium, safari, custom-car
16338    * **browser cycles**: 25
16339    * **expected**: pass
16340    * **gecko profile entries**: 14000000
16341    * **gecko profile interval**: 1
16342    * **lower is better**: true
16343    * **page cycles**: 25
16344    * **page timeout**: 60000
16345    * **playback**: mitmproxy
16346    * **playback pageset manifest**: mitm7-linux-firefox-nytimes.manifest
16347    * **playback version**: 8.1.1
16348    * **secondary url**: `<https://www.nytimes.com/section/opinion/columnists>`__
16349    * **test url**: `<https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html>`__
16350    * **type**: pageload
16351    * **unit**: ms
16352    * **use live sites**: false
16353    * **Test Task**:
16354
16355    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
16356       :widths: 30 15 15 15 15
16357       :header-rows: 1
16358
16359       * - **Test Name**
16360         - mozilla-central
16361         - autoland
16362         - mozilla-release
16363         - mozilla-beta
16364       * - **browsertime-tp6m-live-fenix-nytimes-nofis**
16365         - ❌
16366         - ❌
16367         - ❌
16368         - ❌
16369       * - **browsertime-tp6m-live-geckoview-nytimes-nofis**
16370         - ❌
16371         - ❌
16372         - ❌
16373         - ❌
16374
16375
16376    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
16377       :widths: 30 15 15 15 15
16378       :header-rows: 1
16379
16380       * - **Test Name**
16381         - mozilla-central
16382         - autoland
16383         - mozilla-release
16384         - mozilla-beta
16385       * - **browsertime-tp6m-live-chrome-m-nytimes-nofis**
16386         - ❌
16387         - ❌
16388         - ❌
16389         - ❌
16390       * - **browsertime-tp6m-live-fenix-nytimes-nofis**
16391         - ❌
16392         - ❌
16393         - ❌
16394         - ❌
16395       * - **browsertime-tp6m-live-geckoview-nytimes-nofis**
16396         - ❌
16397         - ❌
16398         - ❌
16399         - ❌
16400
16401
16402    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16403       :widths: 30 15 15 15 15
16404       :header-rows: 1
16405
16406       * - **Test Name**
16407         - mozilla-central
16408         - autoland
16409         - mozilla-release
16410         - mozilla-beta
16411       * - **browsertime-tp6-firefox-nytimes**
16412         - ❌
16413         - ❌
16414         - ❌
16415         - ❌
16416
16417
16418    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
16419       :widths: 30 15 15 15 15
16420       :header-rows: 1
16421
16422       * - **Test Name**
16423         - mozilla-central
16424         - autoland
16425         - mozilla-release
16426         - mozilla-beta
16427       * - **browsertime-tp6-firefox-nytimes**
16428         - ❌
16429         - ❌
16430         - ❌
16431         - ❌
16432
16433
16434    .. list-table:: **test-linux1804-64-qr/opt**
16435       :widths: 30 15 15 15 15
16436       :header-rows: 1
16437
16438       * - **Test Name**
16439         - mozilla-central
16440         - autoland
16441         - mozilla-release
16442         - mozilla-beta
16443       * - **browsertime-tp6-firefox-nytimes**
16444         - ❌
16445         - ❌
16446         - ❌
16447         - ❌
16448
16449
16450    .. list-table:: **test-linux1804-64-shippable-qr/opt**
16451       :widths: 30 15 15 15 15
16452       :header-rows: 1
16453
16454       * - **Test Name**
16455         - mozilla-central
16456         - autoland
16457         - mozilla-release
16458         - mozilla-beta
16459       * - **browsertime-tp6-chrome-nytimes**
16460         - ❌
16461         - ❌
16462         - ❌
16463         - ❌
16464       * - **browsertime-tp6-chromium-nytimes**
16465         - ❌
16466         - ❌
16467         - ❌
16468         - ❌
16469       * - **browsertime-tp6-firefox-nytimes**
16470         - ✅
16471         - ✅
16472         - ✅
16473         - ✅
16474
16475
16476    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
16477       :widths: 30 15 15 15 15
16478       :header-rows: 1
16479
16480       * - **Test Name**
16481         - mozilla-central
16482         - autoland
16483         - mozilla-release
16484         - mozilla-beta
16485       * - **browsertime-tp6-firefox-nytimes**
16486         - ❌
16487         - ❌
16488         - ❌
16489         - ❌
16490
16491
16492    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16493       :widths: 30 15 15 15 15
16494       :header-rows: 1
16495
16496       * - **Test Name**
16497         - mozilla-central
16498         - autoland
16499         - mozilla-release
16500         - mozilla-beta
16501       * - **browsertime-tp6-chrome-nytimes**
16502         - ❌
16503         - ❌
16504         - ❌
16505         - ❌
16506       * - **browsertime-tp6-chromium-nytimes**
16507         - ❌
16508         - ❌
16509         - ❌
16510         - ❌
16511       * - **browsertime-tp6-firefox-nytimes**
16512         - ✅
16513         - ✅
16514         - ✅
16515         - ✅
16516
16517
16518    .. list-table:: **test-windows10-32-qr/opt**
16519       :widths: 30 15 15 15 15
16520       :header-rows: 1
16521
16522       * - **Test Name**
16523         - mozilla-central
16524         - autoland
16525         - mozilla-release
16526         - mozilla-beta
16527       * - **browsertime-tp6-firefox-nytimes**
16528         - ❌
16529         - ❌
16530         - ❌
16531         - ❌
16532
16533
16534    .. list-table:: **test-windows10-32-shippable-qr/opt**
16535       :widths: 30 15 15 15 15
16536       :header-rows: 1
16537
16538       * - **Test Name**
16539         - mozilla-central
16540         - autoland
16541         - mozilla-release
16542         - mozilla-beta
16543       * - **browsertime-tp6-chrome-nytimes**
16544         - ❌
16545         - ❌
16546         - ❌
16547         - ❌
16548       * - **browsertime-tp6-chromium-nytimes**
16549         - ❌
16550         - ❌
16551         - ❌
16552         - ❌
16553       * - **browsertime-tp6-firefox-nytimes**
16554         - ❌
16555         - ❌
16556         - ❌
16557         - ❌
16558
16559
16560    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
16561       :widths: 30 15 15 15 15
16562       :header-rows: 1
16563
16564       * - **Test Name**
16565         - mozilla-central
16566         - autoland
16567         - mozilla-release
16568         - mozilla-beta
16569       * - **browsertime-tp6-firefox-nytimes**
16570         - ❌
16571         - ❌
16572         - ❌
16573         - ❌
16574
16575
16576    .. list-table:: **test-windows10-64-qr/opt**
16577       :widths: 30 15 15 15 15
16578       :header-rows: 1
16579
16580       * - **Test Name**
16581         - mozilla-central
16582         - autoland
16583         - mozilla-release
16584         - mozilla-beta
16585       * - **browsertime-tp6-firefox-nytimes**
16586         - ❌
16587         - ❌
16588         - ❌
16589         - ❌
16590
16591
16592    .. list-table:: **test-windows10-64-shippable-qr/opt**
16593       :widths: 30 15 15 15 15
16594       :header-rows: 1
16595
16596       * - **Test Name**
16597         - mozilla-central
16598         - autoland
16599         - mozilla-release
16600         - mozilla-beta
16601       * - **browsertime-tp6-chrome-nytimes**
16602         - ❌
16603         - ❌
16604         - ❌
16605         - ❌
16606       * - **browsertime-tp6-chromium-nytimes**
16607         - ❌
16608         - ❌
16609         - ❌
16610         - ❌
16611       * - **browsertime-tp6-firefox-nytimes**
16612         - ✅
16613         - ✅
16614         - ✅
16615         - ✅
16616
16617
16618
16619 .. dropdown:: office
16620    :class-container: anchor-id-office-d
16621
16622    **Owner**: PerfTest Team
16623
16624    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
16625    * **alert threshold**: 2.0
16626    * **apps**: firefox, chrome, chromium, safari, custom-car
16627    * **browser cycles**: 25
16628    * **expected**: pass
16629    * **gecko profile entries**: 14000000
16630    * **gecko profile interval**: 1
16631    * **lower is better**: true
16632    * **page cycles**: 25
16633    * **page timeout**: 60000
16634    * **playback**: mitmproxy
16635    * **playback pageset manifest**: mitm7-linux-firefox-office.manifest
16636    * **playback version**: 8.1.1
16637    * **secondary url**: `<https://www.office.com/>`__
16638    * **test url**: `<https://www.office.com/launch/powerpoint?auth=1>`__
16639    * **type**: pageload
16640    * **unit**: ms
16641    * **use live sites**: false
16642    * **Test Task**:
16643
16644    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16645       :widths: 30 15 15 15 15
16646       :header-rows: 1
16647
16648       * - **Test Name**
16649         - mozilla-central
16650         - autoland
16651         - mozilla-release
16652         - mozilla-beta
16653       * - **browsertime-tp6-firefox-office**
16654         - ❌
16655         - ❌
16656         - ❌
16657         - ❌
16658
16659
16660    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
16661       :widths: 30 15 15 15 15
16662       :header-rows: 1
16663
16664       * - **Test Name**
16665         - mozilla-central
16666         - autoland
16667         - mozilla-release
16668         - mozilla-beta
16669       * - **browsertime-tp6-firefox-office**
16670         - ❌
16671         - ❌
16672         - ❌
16673         - ❌
16674
16675
16676    .. list-table:: **test-linux1804-64-qr/opt**
16677       :widths: 30 15 15 15 15
16678       :header-rows: 1
16679
16680       * - **Test Name**
16681         - mozilla-central
16682         - autoland
16683         - mozilla-release
16684         - mozilla-beta
16685       * - **browsertime-tp6-firefox-office**
16686         - ❌
16687         - ❌
16688         - ❌
16689         - ❌
16690
16691
16692    .. list-table:: **test-linux1804-64-shippable-qr/opt**
16693       :widths: 30 15 15 15 15
16694       :header-rows: 1
16695
16696       * - **Test Name**
16697         - mozilla-central
16698         - autoland
16699         - mozilla-release
16700         - mozilla-beta
16701       * - **browsertime-tp6-chrome-office**
16702         - ❌
16703         - ❌
16704         - ❌
16705         - ❌
16706       * - **browsertime-tp6-chromium-office**
16707         - ❌
16708         - ❌
16709         - ❌
16710         - ❌
16711       * - **browsertime-tp6-firefox-office**
16712         - ✅
16713         - ✅
16714         - ✅
16715         - ✅
16716
16717
16718    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
16719       :widths: 30 15 15 15 15
16720       :header-rows: 1
16721
16722       * - **Test Name**
16723         - mozilla-central
16724         - autoland
16725         - mozilla-release
16726         - mozilla-beta
16727       * - **browsertime-tp6-firefox-office**
16728         - ❌
16729         - ❌
16730         - ❌
16731         - ❌
16732
16733
16734    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16735       :widths: 30 15 15 15 15
16736       :header-rows: 1
16737
16738       * - **Test Name**
16739         - mozilla-central
16740         - autoland
16741         - mozilla-release
16742         - mozilla-beta
16743       * - **browsertime-tp6-chrome-office**
16744         - ❌
16745         - ❌
16746         - ❌
16747         - ❌
16748       * - **browsertime-tp6-chromium-office**
16749         - ❌
16750         - ❌
16751         - ❌
16752         - ❌
16753       * - **browsertime-tp6-firefox-office**
16754         - ✅
16755         - ✅
16756         - ✅
16757         - ✅
16758
16759
16760    .. list-table:: **test-windows10-32-qr/opt**
16761       :widths: 30 15 15 15 15
16762       :header-rows: 1
16763
16764       * - **Test Name**
16765         - mozilla-central
16766         - autoland
16767         - mozilla-release
16768         - mozilla-beta
16769       * - **browsertime-tp6-firefox-office**
16770         - ❌
16771         - ❌
16772         - ❌
16773         - ❌
16774
16775
16776    .. list-table:: **test-windows10-32-shippable-qr/opt**
16777       :widths: 30 15 15 15 15
16778       :header-rows: 1
16779
16780       * - **Test Name**
16781         - mozilla-central
16782         - autoland
16783         - mozilla-release
16784         - mozilla-beta
16785       * - **browsertime-tp6-chrome-office**
16786         - ❌
16787         - ❌
16788         - ❌
16789         - ❌
16790       * - **browsertime-tp6-chromium-office**
16791         - ❌
16792         - ❌
16793         - ❌
16794         - ❌
16795       * - **browsertime-tp6-firefox-office**
16796         - ❌
16797         - ❌
16798         - ❌
16799         - ❌
16800
16801
16802    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
16803       :widths: 30 15 15 15 15
16804       :header-rows: 1
16805
16806       * - **Test Name**
16807         - mozilla-central
16808         - autoland
16809         - mozilla-release
16810         - mozilla-beta
16811       * - **browsertime-tp6-firefox-office**
16812         - ❌
16813         - ❌
16814         - ❌
16815         - ❌
16816
16817
16818    .. list-table:: **test-windows10-64-qr/opt**
16819       :widths: 30 15 15 15 15
16820       :header-rows: 1
16821
16822       * - **Test Name**
16823         - mozilla-central
16824         - autoland
16825         - mozilla-release
16826         - mozilla-beta
16827       * - **browsertime-tp6-firefox-office**
16828         - ❌
16829         - ❌
16830         - ❌
16831         - ❌
16832
16833
16834    .. list-table:: **test-windows10-64-shippable-qr/opt**
16835       :widths: 30 15 15 15 15
16836       :header-rows: 1
16837
16838       * - **Test Name**
16839         - mozilla-central
16840         - autoland
16841         - mozilla-release
16842         - mozilla-beta
16843       * - **browsertime-tp6-chrome-office**
16844         - ❌
16845         - ❌
16846         - ❌
16847         - ❌
16848       * - **browsertime-tp6-chromium-office**
16849         - ❌
16850         - ❌
16851         - ❌
16852         - ❌
16853       * - **browsertime-tp6-firefox-office**
16854         - ✅
16855         - ✅
16856         - ✅
16857         - ✅
16858
16859
16860
16861 .. dropdown:: outlook
16862    :class-container: anchor-id-outlook-d
16863
16864    **Owner**: PerfTest Team
16865
16866    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
16867    * **alert threshold**: 2.0
16868    * **apps**: firefox, chrome, chromium, safari, custom-car
16869    * **browser cycles**: 25
16870    * **expected**: pass
16871    * **gecko profile entries**: 14000000
16872    * **gecko profile interval**: 1
16873    * **lower is better**: true
16874    * **page cycles**: 25
16875    * **page timeout**: 60000
16876    * **playback**: mitmproxy
16877    * **playback pageset manifest**: mitm5-linux-firefox-live.manifest
16878    * **playback version**: 8.1.1
16879    * **test url**: `<https://outlook.live.com/mail/inbox>`__
16880    * **type**: pageload
16881    * **unit**: ms
16882    * **use live sites**: false
16883    * **Test Task**:
16884
16885    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16886       :widths: 30 15 15 15 15
16887       :header-rows: 1
16888
16889       * - **Test Name**
16890         - mozilla-central
16891         - autoland
16892         - mozilla-release
16893         - mozilla-beta
16894       * - **browsertime-tp6-firefox-outlook**
16895         - ❌
16896         - ❌
16897         - ❌
16898         - ❌
16899       * - **browsertime-tp6-live-firefox-outlook**
16900         - ❌
16901         - ❌
16902         - ❌
16903         - ❌
16904
16905
16906    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
16907       :widths: 30 15 15 15 15
16908       :header-rows: 1
16909
16910       * - **Test Name**
16911         - mozilla-central
16912         - autoland
16913         - mozilla-release
16914         - mozilla-beta
16915       * - **browsertime-tp6-firefox-outlook**
16916         - ❌
16917         - ❌
16918         - ❌
16919         - ❌
16920       * - **browsertime-tp6-live-firefox-outlook**
16921         - ❌
16922         - ❌
16923         - ❌
16924         - ❌
16925
16926
16927    .. list-table:: **test-linux1804-64-qr/opt**
16928       :widths: 30 15 15 15 15
16929       :header-rows: 1
16930
16931       * - **Test Name**
16932         - mozilla-central
16933         - autoland
16934         - mozilla-release
16935         - mozilla-beta
16936       * - **browsertime-tp6-firefox-outlook**
16937         - ❌
16938         - ❌
16939         - ❌
16940         - ❌
16941       * - **browsertime-tp6-live-firefox-outlook**
16942         - ❌
16943         - ❌
16944         - ❌
16945         - ❌
16946
16947
16948    .. list-table:: **test-linux1804-64-shippable-qr/opt**
16949       :widths: 30 15 15 15 15
16950       :header-rows: 1
16951
16952       * - **Test Name**
16953         - mozilla-central
16954         - autoland
16955         - mozilla-release
16956         - mozilla-beta
16957       * - **browsertime-tp6-chrome-outlook**
16958         - ❌
16959         - ❌
16960         - ❌
16961         - ❌
16962       * - **browsertime-tp6-chromium-outlook**
16963         - ❌
16964         - ❌
16965         - ❌
16966         - ❌
16967       * - **browsertime-tp6-firefox-outlook**
16968         - ✅
16969         - ✅
16970         - ✅
16971         - ✅
16972       * - **browsertime-tp6-live-chrome-outlook**
16973         - ❌
16974         - ❌
16975         - ❌
16976         - ❌
16977       * - **browsertime-tp6-live-chromium-outlook**
16978         - ❌
16979         - ❌
16980         - ❌
16981         - ❌
16982       * - **browsertime-tp6-live-firefox-outlook**
16983         - ❌
16984         - ❌
16985         - ❌
16986         - ❌
16987
16988
16989    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
16990       :widths: 30 15 15 15 15
16991       :header-rows: 1
16992
16993       * - **Test Name**
16994         - mozilla-central
16995         - autoland
16996         - mozilla-release
16997         - mozilla-beta
16998       * - **browsertime-tp6-firefox-outlook**
16999         - ❌
17000         - ❌
17001         - ❌
17002         - ❌
17003       * - **browsertime-tp6-live-firefox-outlook**
17004         - ❌
17005         - ❌
17006         - ❌
17007         - ❌
17008
17009
17010    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17011       :widths: 30 15 15 15 15
17012       :header-rows: 1
17013
17014       * - **Test Name**
17015         - mozilla-central
17016         - autoland
17017         - mozilla-release
17018         - mozilla-beta
17019       * - **browsertime-tp6-chrome-outlook**
17020         - ❌
17021         - ❌
17022         - ❌
17023         - ❌
17024       * - **browsertime-tp6-chromium-outlook**
17025         - ❌
17026         - ❌
17027         - ❌
17028         - ❌
17029       * - **browsertime-tp6-firefox-outlook**
17030         - ✅
17031         - ✅
17032         - ✅
17033         - ✅
17034       * - **browsertime-tp6-live-chrome-outlook**
17035         - ❌
17036         - ❌
17037         - ❌
17038         - ❌
17039       * - **browsertime-tp6-live-chromium-outlook**
17040         - ❌
17041         - ❌
17042         - ❌
17043         - ❌
17044       * - **browsertime-tp6-live-firefox-outlook**
17045         - ❌
17046         - ❌
17047         - ❌
17048         - ❌
17049       * - **browsertime-tp6-live-safari-outlook**
17050         - ❌
17051         - ❌
17052         - ❌
17053         - ❌
17054
17055
17056    .. list-table:: **test-windows10-32-qr/opt**
17057       :widths: 30 15 15 15 15
17058       :header-rows: 1
17059
17060       * - **Test Name**
17061         - mozilla-central
17062         - autoland
17063         - mozilla-release
17064         - mozilla-beta
17065       * - **browsertime-tp6-firefox-outlook**
17066         - ❌
17067         - ❌
17068         - ❌
17069         - ❌
17070       * - **browsertime-tp6-live-firefox-outlook**
17071         - ❌
17072         - ❌
17073         - ❌
17074         - ❌
17075
17076
17077    .. list-table:: **test-windows10-32-shippable-qr/opt**
17078       :widths: 30 15 15 15 15
17079       :header-rows: 1
17080
17081       * - **Test Name**
17082         - mozilla-central
17083         - autoland
17084         - mozilla-release
17085         - mozilla-beta
17086       * - **browsertime-tp6-chrome-outlook**
17087         - ❌
17088         - ❌
17089         - ❌
17090         - ❌
17091       * - **browsertime-tp6-chromium-outlook**
17092         - ❌
17093         - ❌
17094         - ❌
17095         - ❌
17096       * - **browsertime-tp6-firefox-outlook**
17097         - ❌
17098         - ❌
17099         - ❌
17100         - ❌
17101       * - **browsertime-tp6-live-chrome-outlook**
17102         - ❌
17103         - ❌
17104         - ❌
17105         - ❌
17106       * - **browsertime-tp6-live-chromium-outlook**
17107         - ❌
17108         - ❌
17109         - ❌
17110         - ❌
17111       * - **browsertime-tp6-live-firefox-outlook**
17112         - ❌
17113         - ❌
17114         - ❌
17115         - ❌
17116
17117
17118    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
17119       :widths: 30 15 15 15 15
17120       :header-rows: 1
17121
17122       * - **Test Name**
17123         - mozilla-central
17124         - autoland
17125         - mozilla-release
17126         - mozilla-beta
17127       * - **browsertime-tp6-firefox-outlook**
17128         - ❌
17129         - ❌
17130         - ❌
17131         - ❌
17132       * - **browsertime-tp6-live-firefox-outlook**
17133         - ❌
17134         - ❌
17135         - ❌
17136         - ❌
17137
17138
17139    .. list-table:: **test-windows10-64-qr/opt**
17140       :widths: 30 15 15 15 15
17141       :header-rows: 1
17142
17143       * - **Test Name**
17144         - mozilla-central
17145         - autoland
17146         - mozilla-release
17147         - mozilla-beta
17148       * - **browsertime-tp6-firefox-outlook**
17149         - ❌
17150         - ❌
17151         - ❌
17152         - ❌
17153       * - **browsertime-tp6-live-firefox-outlook**
17154         - ❌
17155         - ❌
17156         - ❌
17157         - ❌
17158
17159
17160    .. list-table:: **test-windows10-64-shippable-qr/opt**
17161       :widths: 30 15 15 15 15
17162       :header-rows: 1
17163
17164       * - **Test Name**
17165         - mozilla-central
17166         - autoland
17167         - mozilla-release
17168         - mozilla-beta
17169       * - **browsertime-tp6-chrome-outlook**
17170         - ❌
17171         - ❌
17172         - ❌
17173         - ❌
17174       * - **browsertime-tp6-chromium-outlook**
17175         - ❌
17176         - ❌
17177         - ❌
17178         - ❌
17179       * - **browsertime-tp6-firefox-outlook**
17180         - ✅
17181         - ✅
17182         - ✅
17183         - ✅
17184       * - **browsertime-tp6-live-chrome-outlook**
17185         - ❌
17186         - ❌
17187         - ❌
17188         - ❌
17189       * - **browsertime-tp6-live-chromium-outlook**
17190         - ❌
17191         - ❌
17192         - ❌
17193         - ❌
17194       * - **browsertime-tp6-live-firefox-outlook**
17195         - ❌
17196         - ❌
17197         - ❌
17198         - ❌
17199
17200
17201
17202 .. dropdown:: paypal
17203    :class-container: anchor-id-paypal-d
17204
17205    **Owner**: PerfTest Team
17206
17207    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
17208    * **alert threshold**: 2.0
17209    * **apps**: firefox, chrome, chromium, safari, custom-car
17210    * **browser cycles**: 25
17211    * **expected**: pass
17212    * **gecko profile entries**: 14000000
17213    * **gecko profile interval**: 1
17214    * **lower is better**: true
17215    * **page cycles**: 25
17216    * **page timeout**: 60000
17217    * **playback**: mitmproxy
17218    * **playback pageset manifest**: mitm5-linux-firefox-paypal.manifest
17219    * **playback version**: 8.1.1
17220    * **test url**: `<https://www.paypal.com/myaccount/summary/>`__
17221    * **type**: pageload
17222    * **unit**: ms
17223    * **use live sites**: false
17224    * **Test Task**:
17225
17226    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
17227       :widths: 30 15 15 15 15
17228       :header-rows: 1
17229
17230       * - **Test Name**
17231         - mozilla-central
17232         - autoland
17233         - mozilla-release
17234         - mozilla-beta
17235       * - **browsertime-tp6-firefox-paypal**
17236         - ❌
17237         - ❌
17238         - ❌
17239         - ❌
17240       * - **browsertime-tp6-live-firefox-paypal**
17241         - ❌
17242         - ❌
17243         - ❌
17244         - ❌
17245
17246
17247    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
17248       :widths: 30 15 15 15 15
17249       :header-rows: 1
17250
17251       * - **Test Name**
17252         - mozilla-central
17253         - autoland
17254         - mozilla-release
17255         - mozilla-beta
17256       * - **browsertime-tp6-firefox-paypal**
17257         - ❌
17258         - ❌
17259         - ❌
17260         - ❌
17261       * - **browsertime-tp6-live-firefox-paypal**
17262         - ❌
17263         - ❌
17264         - ❌
17265         - ❌
17266
17267
17268    .. list-table:: **test-linux1804-64-qr/opt**
17269       :widths: 30 15 15 15 15
17270       :header-rows: 1
17271
17272       * - **Test Name**
17273         - mozilla-central
17274         - autoland
17275         - mozilla-release
17276         - mozilla-beta
17277       * - **browsertime-tp6-firefox-paypal**
17278         - ❌
17279         - ❌
17280         - ❌
17281         - ❌
17282       * - **browsertime-tp6-live-firefox-paypal**
17283         - ❌
17284         - ❌
17285         - ❌
17286         - ❌
17287
17288
17289    .. list-table:: **test-linux1804-64-shippable-qr/opt**
17290       :widths: 30 15 15 15 15
17291       :header-rows: 1
17292
17293       * - **Test Name**
17294         - mozilla-central
17295         - autoland
17296         - mozilla-release
17297         - mozilla-beta
17298       * - **browsertime-tp6-chrome-paypal**
17299         - ❌
17300         - ❌
17301         - ❌
17302         - ❌
17303       * - **browsertime-tp6-chromium-paypal**
17304         - ❌
17305         - ❌
17306         - ❌
17307         - ❌
17308       * - **browsertime-tp6-firefox-paypal**
17309         - ✅
17310         - ✅
17311         - ✅
17312         - ✅
17313       * - **browsertime-tp6-live-chrome-paypal**
17314         - ❌
17315         - ❌
17316         - ❌
17317         - ❌
17318       * - **browsertime-tp6-live-chromium-paypal**
17319         - ❌
17320         - ❌
17321         - ❌
17322         - ❌
17323       * - **browsertime-tp6-live-firefox-paypal**
17324         - ❌
17325         - ❌
17326         - ❌
17327         - ❌
17328
17329
17330    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
17331       :widths: 30 15 15 15 15
17332       :header-rows: 1
17333
17334       * - **Test Name**
17335         - mozilla-central
17336         - autoland
17337         - mozilla-release
17338         - mozilla-beta
17339       * - **browsertime-tp6-firefox-paypal**
17340         - ❌
17341         - ❌
17342         - ❌
17343         - ❌
17344       * - **browsertime-tp6-live-firefox-paypal**
17345         - ❌
17346         - ❌
17347         - ❌
17348         - ❌
17349
17350
17351    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17352       :widths: 30 15 15 15 15
17353       :header-rows: 1
17354
17355       * - **Test Name**
17356         - mozilla-central
17357         - autoland
17358         - mozilla-release
17359         - mozilla-beta
17360       * - **browsertime-tp6-chrome-paypal**
17361         - ❌
17362         - ❌
17363         - ❌
17364         - ❌
17365       * - **browsertime-tp6-chromium-paypal**
17366         - ❌
17367         - ❌
17368         - ❌
17369         - ❌
17370       * - **browsertime-tp6-firefox-paypal**
17371         - ✅
17372         - ✅
17373         - ✅
17374         - ✅
17375       * - **browsertime-tp6-live-chrome-paypal**
17376         - ❌
17377         - ❌
17378         - ❌
17379         - ❌
17380       * - **browsertime-tp6-live-chromium-paypal**
17381         - ❌
17382         - ❌
17383         - ❌
17384         - ❌
17385       * - **browsertime-tp6-live-firefox-paypal**
17386         - ❌
17387         - ❌
17388         - ❌
17389         - ❌
17390       * - **browsertime-tp6-live-safari-paypal**
17391         - ❌
17392         - ❌
17393         - ❌
17394         - ❌
17395
17396
17397    .. list-table:: **test-windows10-32-qr/opt**
17398       :widths: 30 15 15 15 15
17399       :header-rows: 1
17400
17401       * - **Test Name**
17402         - mozilla-central
17403         - autoland
17404         - mozilla-release
17405         - mozilla-beta
17406       * - **browsertime-tp6-firefox-paypal**
17407         - ❌
17408         - ❌
17409         - ❌
17410         - ❌
17411       * - **browsertime-tp6-live-firefox-paypal**
17412         - ❌
17413         - ❌
17414         - ❌
17415         - ❌
17416
17417
17418    .. list-table:: **test-windows10-32-shippable-qr/opt**
17419       :widths: 30 15 15 15 15
17420       :header-rows: 1
17421
17422       * - **Test Name**
17423         - mozilla-central
17424         - autoland
17425         - mozilla-release
17426         - mozilla-beta
17427       * - **browsertime-tp6-chrome-paypal**
17428         - ❌
17429         - ❌
17430         - ❌
17431         - ❌
17432       * - **browsertime-tp6-chromium-paypal**
17433         - ❌
17434         - ❌
17435         - ❌
17436         - ❌
17437       * - **browsertime-tp6-firefox-paypal**
17438         - ❌
17439         - ❌
17440         - ❌
17441         - ❌
17442       * - **browsertime-tp6-live-chrome-paypal**
17443         - ❌
17444         - ❌
17445         - ❌
17446         - ❌
17447       * - **browsertime-tp6-live-chromium-paypal**
17448         - ❌
17449         - ❌
17450         - ❌
17451         - ❌
17452       * - **browsertime-tp6-live-firefox-paypal**
17453         - ❌
17454         - ❌
17455         - ❌
17456         - ❌
17457
17458
17459    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
17460       :widths: 30 15 15 15 15
17461       :header-rows: 1
17462
17463       * - **Test Name**
17464         - mozilla-central
17465         - autoland
17466         - mozilla-release
17467         - mozilla-beta
17468       * - **browsertime-tp6-firefox-paypal**
17469         - ❌
17470         - ❌
17471         - ❌
17472         - ❌
17473       * - **browsertime-tp6-live-firefox-paypal**
17474         - ❌
17475         - ❌
17476         - ❌
17477         - ❌
17478
17479
17480    .. list-table:: **test-windows10-64-qr/opt**
17481       :widths: 30 15 15 15 15
17482       :header-rows: 1
17483
17484       * - **Test Name**
17485         - mozilla-central
17486         - autoland
17487         - mozilla-release
17488         - mozilla-beta
17489       * - **browsertime-tp6-firefox-paypal**
17490         - ❌
17491         - ❌
17492         - ❌
17493         - ❌
17494       * - **browsertime-tp6-live-firefox-paypal**
17495         - ❌
17496         - ❌
17497         - ❌
17498         - ❌
17499
17500
17501    .. list-table:: **test-windows10-64-shippable-qr/opt**
17502       :widths: 30 15 15 15 15
17503       :header-rows: 1
17504
17505       * - **Test Name**
17506         - mozilla-central
17507         - autoland
17508         - mozilla-release
17509         - mozilla-beta
17510       * - **browsertime-tp6-chrome-paypal**
17511         - ❌
17512         - ❌
17513         - ❌
17514         - ❌
17515       * - **browsertime-tp6-chromium-paypal**
17516         - ❌
17517         - ❌
17518         - ❌
17519         - ❌
17520       * - **browsertime-tp6-firefox-paypal**
17521         - ✅
17522         - ✅
17523         - ✅
17524         - ✅
17525       * - **browsertime-tp6-live-chrome-paypal**
17526         - ❌
17527         - ❌
17528         - ❌
17529         - ❌
17530       * - **browsertime-tp6-live-chromium-paypal**
17531         - ❌
17532         - ❌
17533         - ❌
17534         - ❌
17535       * - **browsertime-tp6-live-firefox-paypal**
17536         - ❌
17537         - ❌
17538         - ❌
17539         - ❌
17540
17541
17542
17543 .. dropdown:: pinterest
17544    :class-container: anchor-id-pinterest-d
17545
17546    **Owner**: PerfTest Team
17547
17548    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
17549    * **alert threshold**: 2.0
17550    * **apps**: firefox, chrome, chromium, safari, custom-car
17551    * **browser cycles**: 25
17552    * **expected**: pass
17553    * **gecko profile entries**: 14000000
17554    * **gecko profile interval**: 1
17555    * **lower is better**: true
17556    * **page cycles**: 25
17557    * **page timeout**: 60000
17558    * **playback**: mitmproxy
17559    * **playback pageset manifest**: mitm6-linux-firefox-pinterest.manifest
17560    * **playback version**: 8.1.1
17561    * **secondary url**: `<https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/>`__
17562    * **test url**: `<https://pinterest.com/>`__
17563    * **type**: pageload
17564    * **unit**: ms
17565    * **use live sites**: false
17566    * **Test Task**:
17567
17568    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
17569       :widths: 30 15 15 15 15
17570       :header-rows: 1
17571
17572       * - **Test Name**
17573         - mozilla-central
17574         - autoland
17575         - mozilla-release
17576         - mozilla-beta
17577       * - **browsertime-tp6-firefox-pinterest**
17578         - ❌
17579         - ❌
17580         - ❌
17581         - ❌
17582       * - **browsertime-tp6-live-firefox-pinterest**
17583         - ❌
17584         - ❌
17585         - ❌
17586         - ❌
17587
17588
17589    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
17590       :widths: 30 15 15 15 15
17591       :header-rows: 1
17592
17593       * - **Test Name**
17594         - mozilla-central
17595         - autoland
17596         - mozilla-release
17597         - mozilla-beta
17598       * - **browsertime-tp6-firefox-pinterest**
17599         - ❌
17600         - ❌
17601         - ❌
17602         - ❌
17603       * - **browsertime-tp6-live-firefox-pinterest**
17604         - ❌
17605         - ❌
17606         - ❌
17607         - ❌
17608
17609
17610    .. list-table:: **test-linux1804-64-qr/opt**
17611       :widths: 30 15 15 15 15
17612       :header-rows: 1
17613
17614       * - **Test Name**
17615         - mozilla-central
17616         - autoland
17617         - mozilla-release
17618         - mozilla-beta
17619       * - **browsertime-tp6-firefox-pinterest**
17620         - ❌
17621         - ❌
17622         - ❌
17623         - ❌
17624       * - **browsertime-tp6-live-firefox-pinterest**
17625         - ❌
17626         - ❌
17627         - ❌
17628         - ❌
17629
17630
17631    .. list-table:: **test-linux1804-64-shippable-qr/opt**
17632       :widths: 30 15 15 15 15
17633       :header-rows: 1
17634
17635       * - **Test Name**
17636         - mozilla-central
17637         - autoland
17638         - mozilla-release
17639         - mozilla-beta
17640       * - **browsertime-tp6-chrome-pinterest**
17641         - ❌
17642         - ❌
17643         - ❌
17644         - ❌
17645       * - **browsertime-tp6-chromium-pinterest**
17646         - ❌
17647         - ❌
17648         - ❌
17649         - ❌
17650       * - **browsertime-tp6-firefox-pinterest**
17651         - ✅
17652         - ✅
17653         - ✅
17654         - ✅
17655       * - **browsertime-tp6-live-chrome-pinterest**
17656         - ❌
17657         - ❌
17658         - ❌
17659         - ❌
17660       * - **browsertime-tp6-live-chromium-pinterest**
17661         - ❌
17662         - ❌
17663         - ❌
17664         - ❌
17665       * - **browsertime-tp6-live-firefox-pinterest**
17666         - ❌
17667         - ❌
17668         - ❌
17669         - ❌
17670
17671
17672    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
17673       :widths: 30 15 15 15 15
17674       :header-rows: 1
17675
17676       * - **Test Name**
17677         - mozilla-central
17678         - autoland
17679         - mozilla-release
17680         - mozilla-beta
17681       * - **browsertime-tp6-firefox-pinterest**
17682         - ❌
17683         - ❌
17684         - ❌
17685         - ❌
17686       * - **browsertime-tp6-live-firefox-pinterest**
17687         - ❌
17688         - ❌
17689         - ❌
17690         - ❌
17691
17692
17693    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17694       :widths: 30 15 15 15 15
17695       :header-rows: 1
17696
17697       * - **Test Name**
17698         - mozilla-central
17699         - autoland
17700         - mozilla-release
17701         - mozilla-beta
17702       * - **browsertime-tp6-chrome-pinterest**
17703         - ❌
17704         - ❌
17705         - ❌
17706         - ❌
17707       * - **browsertime-tp6-chromium-pinterest**
17708         - ❌
17709         - ❌
17710         - ❌
17711         - ❌
17712       * - **browsertime-tp6-firefox-pinterest**
17713         - ✅
17714         - ✅
17715         - ✅
17716         - ✅
17717       * - **browsertime-tp6-live-chrome-pinterest**
17718         - ❌
17719         - ❌
17720         - ❌
17721         - ❌
17722       * - **browsertime-tp6-live-chromium-pinterest**
17723         - ❌
17724         - ❌
17725         - ❌
17726         - ❌
17727       * - **browsertime-tp6-live-firefox-pinterest**
17728         - ❌
17729         - ❌
17730         - ❌
17731         - ❌
17732       * - **browsertime-tp6-live-safari-pinterest**
17733         - ❌
17734         - ❌
17735         - ❌
17736         - ❌
17737
17738
17739    .. list-table:: **test-windows10-32-qr/opt**
17740       :widths: 30 15 15 15 15
17741       :header-rows: 1
17742
17743       * - **Test Name**
17744         - mozilla-central
17745         - autoland
17746         - mozilla-release
17747         - mozilla-beta
17748       * - **browsertime-tp6-firefox-pinterest**
17749         - ❌
17750         - ❌
17751         - ❌
17752         - ❌
17753       * - **browsertime-tp6-live-firefox-pinterest**
17754         - ❌
17755         - ❌
17756         - ❌
17757         - ❌
17758
17759
17760    .. list-table:: **test-windows10-32-shippable-qr/opt**
17761       :widths: 30 15 15 15 15
17762       :header-rows: 1
17763
17764       * - **Test Name**
17765         - mozilla-central
17766         - autoland
17767         - mozilla-release
17768         - mozilla-beta
17769       * - **browsertime-tp6-chrome-pinterest**
17770         - ❌
17771         - ❌
17772         - ❌
17773         - ❌
17774       * - **browsertime-tp6-chromium-pinterest**
17775         - ❌
17776         - ❌
17777         - ❌
17778         - ❌
17779       * - **browsertime-tp6-firefox-pinterest**
17780         - ❌
17781         - ❌
17782         - ❌
17783         - ❌
17784       * - **browsertime-tp6-live-chrome-pinterest**
17785         - ❌
17786         - ❌
17787         - ❌
17788         - ❌
17789       * - **browsertime-tp6-live-chromium-pinterest**
17790         - ❌
17791         - ❌
17792         - ❌
17793         - ❌
17794       * - **browsertime-tp6-live-firefox-pinterest**
17795         - ❌
17796         - ❌
17797         - ❌
17798         - ❌
17799
17800
17801    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
17802       :widths: 30 15 15 15 15
17803       :header-rows: 1
17804
17805       * - **Test Name**
17806         - mozilla-central
17807         - autoland
17808         - mozilla-release
17809         - mozilla-beta
17810       * - **browsertime-tp6-firefox-pinterest**
17811         - ❌
17812         - ❌
17813         - ❌
17814         - ❌
17815       * - **browsertime-tp6-live-firefox-pinterest**
17816         - ❌
17817         - ❌
17818         - ❌
17819         - ❌
17820
17821
17822    .. list-table:: **test-windows10-64-qr/opt**
17823       :widths: 30 15 15 15 15
17824       :header-rows: 1
17825
17826       * - **Test Name**
17827         - mozilla-central
17828         - autoland
17829         - mozilla-release
17830         - mozilla-beta
17831       * - **browsertime-tp6-firefox-pinterest**
17832         - ❌
17833         - ❌
17834         - ❌
17835         - ❌
17836       * - **browsertime-tp6-live-firefox-pinterest**
17837         - ❌
17838         - ❌
17839         - ❌
17840         - ❌
17841
17842
17843    .. list-table:: **test-windows10-64-shippable-qr/opt**
17844       :widths: 30 15 15 15 15
17845       :header-rows: 1
17846
17847       * - **Test Name**
17848         - mozilla-central
17849         - autoland
17850         - mozilla-release
17851         - mozilla-beta
17852       * - **browsertime-tp6-chrome-pinterest**
17853         - ❌
17854         - ❌
17855         - ❌
17856         - ❌
17857       * - **browsertime-tp6-chromium-pinterest**
17858         - ❌
17859         - ❌
17860         - ❌
17861         - ❌
17862       * - **browsertime-tp6-firefox-pinterest**
17863         - ✅
17864         - ✅
17865         - ✅
17866         - ✅
17867       * - **browsertime-tp6-live-chrome-pinterest**
17868         - ❌
17869         - ❌
17870         - ❌
17871         - ❌
17872       * - **browsertime-tp6-live-chromium-pinterest**
17873         - ❌
17874         - ❌
17875         - ❌
17876         - ❌
17877       * - **browsertime-tp6-live-firefox-pinterest**
17878         - ❌
17879         - ❌
17880         - ❌
17881         - ❌
17882
17883
17884
17885 .. dropdown:: reddit
17886    :class-container: anchor-id-reddit-d
17887
17888    **Owner**: PerfTest Team
17889
17890    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
17891    * **alert threshold**: 2.0
17892    * **apps**: firefox, chrome, chromium, safari, custom-car
17893    * **browser cycles**: 25
17894    * **expected**: pass
17895    * **gecko profile entries**: 14000000
17896    * **gecko profile interval**: 1
17897    * **lower is better**: true
17898    * **page cycles**: 25
17899    * **page timeout**: 60000
17900    * **playback**: mitmproxy
17901    * **playback pageset manifest**: mitm6-linux-firefox-reddit.manifest
17902    * **playback version**: 8.1.1
17903    * **secondary url**: `<https://www.reddit.com/r/technology/>`__
17904    * **test url**: `<https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/>`__
17905    * **type**: pageload
17906    * **unit**: ms
17907    * **use live sites**: false
17908    * **Test Task**:
17909
17910    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
17911       :widths: 30 15 15 15 15
17912       :header-rows: 1
17913
17914       * - **Test Name**
17915         - mozilla-central
17916         - autoland
17917         - mozilla-release
17918         - mozilla-beta
17919       * - **browsertime-tp6m-fenix-reddit**
17920         - ❌
17921         - ❌
17922         - ❌
17923         - ❌
17924       * - **browsertime-tp6m-fenix-reddit-nofis**
17925         - ❌
17926         - ❌
17927         - ❌
17928         - ❌
17929       * - **browsertime-tp6m-geckoview-reddit**
17930         - ❌
17931         - ❌
17932         - ❌
17933         - ❌
17934       * - **browsertime-tp6m-geckoview-reddit-nofis**
17935         - ❌
17936         - ❌
17937         - ❌
17938         - ❌
17939       * - **browsertime-tp6m-live-fenix-reddit-nofis**
17940         - ❌
17941         - ❌
17942         - ❌
17943         - ❌
17944       * - **browsertime-tp6m-live-geckoview-reddit-nofis**
17945         - ❌
17946         - ❌
17947         - ❌
17948         - ❌
17949       * - **browsertime-tp6m-refbrow-reddit**
17950         - ❌
17951         - ❌
17952         - ❌
17953         - ❌
17954
17955
17956    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
17957       :widths: 30 15 15 15 15
17958       :header-rows: 1
17959
17960       * - **Test Name**
17961         - mozilla-central
17962         - autoland
17963         - mozilla-release
17964         - mozilla-beta
17965       * - **browsertime-tp6m-chrome-m-reddit**
17966         - ❌
17967         - ❌
17968         - ❌
17969         - ❌
17970       * - **browsertime-tp6m-chrome-m-reddit-nofis**
17971         - ❌
17972         - ❌
17973         - ❌
17974         - ❌
17975       * - **browsertime-tp6m-fenix-reddit**
17976         - ❌
17977         - ❌
17978         - ❌
17979         - ❌
17980       * - **browsertime-tp6m-fenix-reddit-nofis**
17981         - ❌
17982         - ❌
17983         - ❌
17984         - ❌
17985       * - **browsertime-tp6m-geckoview-reddit**
17986         - ❌
17987         - ❌
17988         - ❌
17989         - ❌
17990       * - **browsertime-tp6m-geckoview-reddit-nofis**
17991         - ✅
17992         - ✅
17993         - ❌
17994         - ❌
17995       * - **browsertime-tp6m-live-chrome-m-reddit-nofis**
17996         - ❌
17997         - ❌
17998         - ❌
17999         - ❌
18000       * - **browsertime-tp6m-live-fenix-reddit-nofis**
18001         - ❌
18002         - ❌
18003         - ❌
18004         - ❌
18005       * - **browsertime-tp6m-live-geckoview-reddit-nofis**
18006         - ❌
18007         - ❌
18008         - ❌
18009         - ❌
18010       * - **browsertime-tp6m-refbrow-reddit**
18011         - ❌
18012         - ❌
18013         - ❌
18014         - ❌
18015
18016
18017    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
18018       :widths: 30 15 15 15 15
18019       :header-rows: 1
18020
18021       * - **Test Name**
18022         - mozilla-central
18023         - autoland
18024         - mozilla-release
18025         - mozilla-beta
18026       * - **browsertime-tp6-firefox-reddit**
18027         - ❌
18028         - ❌
18029         - ❌
18030         - ❌
18031       * - **browsertime-tp6-live-firefox-reddit**
18032         - ❌
18033         - ❌
18034         - ❌
18035         - ❌
18036
18037
18038    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
18039       :widths: 30 15 15 15 15
18040       :header-rows: 1
18041
18042       * - **Test Name**
18043         - mozilla-central
18044         - autoland
18045         - mozilla-release
18046         - mozilla-beta
18047       * - **browsertime-tp6-firefox-reddit**
18048         - ❌
18049         - ❌
18050         - ❌
18051         - ❌
18052       * - **browsertime-tp6-live-firefox-reddit**
18053         - ❌
18054         - ❌
18055         - ❌
18056         - ❌
18057
18058
18059    .. list-table:: **test-linux1804-64-qr/opt**
18060       :widths: 30 15 15 15 15
18061       :header-rows: 1
18062
18063       * - **Test Name**
18064         - mozilla-central
18065         - autoland
18066         - mozilla-release
18067         - mozilla-beta
18068       * - **browsertime-tp6-firefox-reddit**
18069         - ❌
18070         - ❌
18071         - ❌
18072         - ❌
18073       * - **browsertime-tp6-live-firefox-reddit**
18074         - ❌
18075         - ❌
18076         - ❌
18077         - ❌
18078
18079
18080    .. list-table:: **test-linux1804-64-shippable-qr/opt**
18081       :widths: 30 15 15 15 15
18082       :header-rows: 1
18083
18084       * - **Test Name**
18085         - mozilla-central
18086         - autoland
18087         - mozilla-release
18088         - mozilla-beta
18089       * - **browsertime-tp6-chrome-reddit**
18090         - ❌
18091         - ❌
18092         - ❌
18093         - ❌
18094       * - **browsertime-tp6-chromium-reddit**
18095         - ❌
18096         - ❌
18097         - ❌
18098         - ❌
18099       * - **browsertime-tp6-firefox-reddit**
18100         - ✅
18101         - ✅
18102         - ✅
18103         - ✅
18104       * - **browsertime-tp6-live-chrome-reddit**
18105         - ❌
18106         - ❌
18107         - ❌
18108         - ❌
18109       * - **browsertime-tp6-live-chromium-reddit**
18110         - ❌
18111         - ❌
18112         - ❌
18113         - ❌
18114       * - **browsertime-tp6-live-firefox-reddit**
18115         - ❌
18116         - ❌
18117         - ❌
18118         - ❌
18119
18120
18121    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
18122       :widths: 30 15 15 15 15
18123       :header-rows: 1
18124
18125       * - **Test Name**
18126         - mozilla-central
18127         - autoland
18128         - mozilla-release
18129         - mozilla-beta
18130       * - **browsertime-tp6-firefox-reddit**
18131         - ❌
18132         - ❌
18133         - ❌
18134         - ❌
18135       * - **browsertime-tp6-live-firefox-reddit**
18136         - ❌
18137         - ❌
18138         - ❌
18139         - ❌
18140
18141
18142    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
18143       :widths: 30 15 15 15 15
18144       :header-rows: 1
18145
18146       * - **Test Name**
18147         - mozilla-central
18148         - autoland
18149         - mozilla-release
18150         - mozilla-beta
18151       * - **browsertime-tp6-chrome-reddit**
18152         - ❌
18153         - ❌
18154         - ❌
18155         - ❌
18156       * - **browsertime-tp6-chromium-reddit**
18157         - ❌
18158         - ❌
18159         - ❌
18160         - ❌
18161       * - **browsertime-tp6-firefox-reddit**
18162         - ✅
18163         - ✅
18164         - ✅
18165         - ✅
18166       * - **browsertime-tp6-live-chrome-reddit**
18167         - ❌
18168         - ❌
18169         - ❌
18170         - ❌
18171       * - **browsertime-tp6-live-chromium-reddit**
18172         - ❌
18173         - ❌
18174         - ❌
18175         - ❌
18176       * - **browsertime-tp6-live-firefox-reddit**
18177         - ❌
18178         - ❌
18179         - ❌
18180         - ❌
18181       * - **browsertime-tp6-live-safari-reddit**
18182         - ❌
18183         - ❌
18184         - ❌
18185         - ❌
18186
18187
18188    .. list-table:: **test-windows10-32-qr/opt**
18189       :widths: 30 15 15 15 15
18190       :header-rows: 1
18191
18192       * - **Test Name**
18193         - mozilla-central
18194         - autoland
18195         - mozilla-release
18196         - mozilla-beta
18197       * - **browsertime-tp6-firefox-reddit**
18198         - ❌
18199         - ❌
18200         - ❌
18201         - ❌
18202       * - **browsertime-tp6-live-firefox-reddit**
18203         - ❌
18204         - ❌
18205         - ❌
18206         - ❌
18207
18208
18209    .. list-table:: **test-windows10-32-shippable-qr/opt**
18210       :widths: 30 15 15 15 15
18211       :header-rows: 1
18212
18213       * - **Test Name**
18214         - mozilla-central
18215         - autoland
18216         - mozilla-release
18217         - mozilla-beta
18218       * - **browsertime-tp6-chrome-reddit**
18219         - ❌
18220         - ❌
18221         - ❌
18222         - ❌
18223       * - **browsertime-tp6-chromium-reddit**
18224         - ❌
18225         - ❌
18226         - ❌
18227         - ❌
18228       * - **browsertime-tp6-firefox-reddit**
18229         - ❌
18230         - ❌
18231         - ❌
18232         - ❌
18233       * - **browsertime-tp6-live-chrome-reddit**
18234         - ❌
18235         - ❌
18236         - ❌
18237         - ❌
18238       * - **browsertime-tp6-live-chromium-reddit**
18239         - ❌
18240         - ❌
18241         - ❌
18242         - ❌
18243       * - **browsertime-tp6-live-firefox-reddit**
18244         - ❌
18245         - ❌
18246         - ❌
18247         - ❌
18248
18249
18250    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
18251       :widths: 30 15 15 15 15
18252       :header-rows: 1
18253
18254       * - **Test Name**
18255         - mozilla-central
18256         - autoland
18257         - mozilla-release
18258         - mozilla-beta
18259       * - **browsertime-tp6-firefox-reddit**
18260         - ❌
18261         - ❌
18262         - ❌
18263         - ❌
18264       * - **browsertime-tp6-live-firefox-reddit**
18265         - ❌
18266         - ❌
18267         - ❌
18268         - ❌
18269
18270
18271    .. list-table:: **test-windows10-64-qr/opt**
18272       :widths: 30 15 15 15 15
18273       :header-rows: 1
18274
18275       * - **Test Name**
18276         - mozilla-central
18277         - autoland
18278         - mozilla-release
18279         - mozilla-beta
18280       * - **browsertime-tp6-firefox-reddit**
18281         - ❌
18282         - ❌
18283         - ❌
18284         - ❌
18285       * - **browsertime-tp6-live-firefox-reddit**
18286         - ❌
18287         - ❌
18288         - ❌
18289         - ❌
18290
18291
18292    .. list-table:: **test-windows10-64-shippable-qr/opt**
18293       :widths: 30 15 15 15 15
18294       :header-rows: 1
18295
18296       * - **Test Name**
18297         - mozilla-central
18298         - autoland
18299         - mozilla-release
18300         - mozilla-beta
18301       * - **browsertime-tp6-chrome-reddit**
18302         - ❌
18303         - ❌
18304         - ❌
18305         - ❌
18306       * - **browsertime-tp6-chromium-reddit**
18307         - ❌
18308         - ❌
18309         - ❌
18310         - ❌
18311       * - **browsertime-tp6-firefox-reddit**
18312         - ✅
18313         - ✅
18314         - ✅
18315         - ✅
18316       * - **browsertime-tp6-live-chrome-reddit**
18317         - ❌
18318         - ❌
18319         - ❌
18320         - ❌
18321       * - **browsertime-tp6-live-chromium-reddit**
18322         - ❌
18323         - ❌
18324         - ❌
18325         - ❌
18326       * - **browsertime-tp6-live-firefox-reddit**
18327         - ❌
18328         - ❌
18329         - ❌
18330         - ❌
18331
18332
18333
18334 .. dropdown:: tumblr
18335    :class-container: anchor-id-tumblr-d
18336
18337    **Owner**: PerfTest Team
18338
18339    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
18340    * **alert threshold**: 2.0
18341    * **apps**: firefox, chrome, chromium, safari, custom-car
18342    * **browser cycles**: 25
18343    * **expected**: pass
18344    * **gecko profile entries**: 14000000
18345    * **gecko profile interval**: 1
18346    * **lower is better**: true
18347    * **page cycles**: 25
18348    * **page timeout**: 60000
18349    * **playback**: mitmproxy
18350    * **playback pageset manifest**: mitm6-linux-firefox-tumblr.manifest
18351    * **playback version**: 8.1.1
18352    * **secondary url**: `<https://www.tumblr.com/tagged/funny+cats?sort=top>`__
18353    * **test url**: `<https://www.tumblr.com/dashboard>`__
18354    * **type**: pageload
18355    * **unit**: ms
18356    * **use live sites**: false
18357    * **Test Task**:
18358
18359    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
18360       :widths: 30 15 15 15 15
18361       :header-rows: 1
18362
18363       * - **Test Name**
18364         - mozilla-central
18365         - autoland
18366         - mozilla-release
18367         - mozilla-beta
18368       * - **browsertime-tp6-firefox-tumblr**
18369         - ❌
18370         - ❌
18371         - ❌
18372         - ❌
18373       * - **browsertime-tp6-live-firefox-tumblr**
18374         - ❌
18375         - ❌
18376         - ❌
18377         - ❌
18378
18379
18380    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
18381       :widths: 30 15 15 15 15
18382       :header-rows: 1
18383
18384       * - **Test Name**
18385         - mozilla-central
18386         - autoland
18387         - mozilla-release
18388         - mozilla-beta
18389       * - **browsertime-tp6-firefox-tumblr**
18390         - ❌
18391         - ❌
18392         - ❌
18393         - ❌
18394       * - **browsertime-tp6-live-firefox-tumblr**
18395         - ❌
18396         - ❌
18397         - ❌
18398         - ❌
18399
18400
18401    .. list-table:: **test-linux1804-64-qr/opt**
18402       :widths: 30 15 15 15 15
18403       :header-rows: 1
18404
18405       * - **Test Name**
18406         - mozilla-central
18407         - autoland
18408         - mozilla-release
18409         - mozilla-beta
18410       * - **browsertime-tp6-firefox-tumblr**
18411         - ❌
18412         - ❌
18413         - ❌
18414         - ❌
18415       * - **browsertime-tp6-live-firefox-tumblr**
18416         - ❌
18417         - ❌
18418         - ❌
18419         - ❌
18420
18421
18422    .. list-table:: **test-linux1804-64-shippable-qr/opt**
18423       :widths: 30 15 15 15 15
18424       :header-rows: 1
18425
18426       * - **Test Name**
18427         - mozilla-central
18428         - autoland
18429         - mozilla-release
18430         - mozilla-beta
18431       * - **browsertime-tp6-chrome-tumblr**
18432         - ❌
18433         - ❌
18434         - ❌
18435         - ❌
18436       * - **browsertime-tp6-chromium-tumblr**
18437         - ❌
18438         - ❌
18439         - ❌
18440         - ❌
18441       * - **browsertime-tp6-firefox-tumblr**
18442         - ✅
18443         - ✅
18444         - ✅
18445         - ✅
18446       * - **browsertime-tp6-live-chrome-tumblr**
18447         - ❌
18448         - ❌
18449         - ❌
18450         - ❌
18451       * - **browsertime-tp6-live-chromium-tumblr**
18452         - ❌
18453         - ❌
18454         - ❌
18455         - ❌
18456       * - **browsertime-tp6-live-firefox-tumblr**
18457         - ❌
18458         - ❌
18459         - ❌
18460         - ❌
18461
18462
18463    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
18464       :widths: 30 15 15 15 15
18465       :header-rows: 1
18466
18467       * - **Test Name**
18468         - mozilla-central
18469         - autoland
18470         - mozilla-release
18471         - mozilla-beta
18472       * - **browsertime-tp6-firefox-tumblr**
18473         - ❌
18474         - ❌
18475         - ❌
18476         - ❌
18477       * - **browsertime-tp6-live-firefox-tumblr**
18478         - ❌
18479         - ❌
18480         - ❌
18481         - ❌
18482
18483
18484    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
18485       :widths: 30 15 15 15 15
18486       :header-rows: 1
18487
18488       * - **Test Name**
18489         - mozilla-central
18490         - autoland
18491         - mozilla-release
18492         - mozilla-beta
18493       * - **browsertime-tp6-chrome-tumblr**
18494         - ❌
18495         - ❌
18496         - ❌
18497         - ❌
18498       * - **browsertime-tp6-chromium-tumblr**
18499         - ❌
18500         - ❌
18501         - ❌
18502         - ❌
18503       * - **browsertime-tp6-firefox-tumblr**
18504         - ✅
18505         - ✅
18506         - ✅
18507         - ✅
18508       * - **browsertime-tp6-live-chrome-tumblr**
18509         - ❌
18510         - ❌
18511         - ❌
18512         - ❌
18513       * - **browsertime-tp6-live-chromium-tumblr**
18514         - ❌
18515         - ❌
18516         - ❌
18517         - ❌
18518       * - **browsertime-tp6-live-firefox-tumblr**
18519         - ❌
18520         - ❌
18521         - ❌
18522         - ❌
18523       * - **browsertime-tp6-live-safari-tumblr**
18524         - ❌
18525         - ❌
18526         - ❌
18527         - ❌
18528
18529
18530    .. list-table:: **test-windows10-32-qr/opt**
18531       :widths: 30 15 15 15 15
18532       :header-rows: 1
18533
18534       * - **Test Name**
18535         - mozilla-central
18536         - autoland
18537         - mozilla-release
18538         - mozilla-beta
18539       * - **browsertime-tp6-firefox-tumblr**
18540         - ❌
18541         - ❌
18542         - ❌
18543         - ❌
18544       * - **browsertime-tp6-live-firefox-tumblr**
18545         - ❌
18546         - ❌
18547         - ❌
18548         - ❌
18549
18550
18551    .. list-table:: **test-windows10-32-shippable-qr/opt**
18552       :widths: 30 15 15 15 15
18553       :header-rows: 1
18554
18555       * - **Test Name**
18556         - mozilla-central
18557         - autoland
18558         - mozilla-release
18559         - mozilla-beta
18560       * - **browsertime-tp6-chrome-tumblr**
18561         - ❌
18562         - ❌
18563         - ❌
18564         - ❌
18565       * - **browsertime-tp6-chromium-tumblr**
18566         - ❌
18567         - ❌
18568         - ❌
18569         - ❌
18570       * - **browsertime-tp6-firefox-tumblr**
18571         - ❌
18572         - ❌
18573         - ❌
18574         - ❌
18575       * - **browsertime-tp6-live-chrome-tumblr**
18576         - ❌
18577         - ❌
18578         - ❌
18579         - ❌
18580       * - **browsertime-tp6-live-chromium-tumblr**
18581         - ❌
18582         - ❌
18583         - ❌
18584         - ❌
18585       * - **browsertime-tp6-live-firefox-tumblr**
18586         - ❌
18587         - ❌
18588         - ❌
18589         - ❌
18590
18591
18592    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
18593       :widths: 30 15 15 15 15
18594       :header-rows: 1
18595
18596       * - **Test Name**
18597         - mozilla-central
18598         - autoland
18599         - mozilla-release
18600         - mozilla-beta
18601       * - **browsertime-tp6-firefox-tumblr**
18602         - ❌
18603         - ❌
18604         - ❌
18605         - ❌
18606       * - **browsertime-tp6-live-firefox-tumblr**
18607         - ❌
18608         - ❌
18609         - ❌
18610         - ❌
18611
18612
18613    .. list-table:: **test-windows10-64-qr/opt**
18614       :widths: 30 15 15 15 15
18615       :header-rows: 1
18616
18617       * - **Test Name**
18618         - mozilla-central
18619         - autoland
18620         - mozilla-release
18621         - mozilla-beta
18622       * - **browsertime-tp6-firefox-tumblr**
18623         - ❌
18624         - ❌
18625         - ❌
18626         - ❌
18627       * - **browsertime-tp6-live-firefox-tumblr**
18628         - ❌
18629         - ❌
18630         - ❌
18631         - ❌
18632
18633
18634    .. list-table:: **test-windows10-64-shippable-qr/opt**
18635       :widths: 30 15 15 15 15
18636       :header-rows: 1
18637
18638       * - **Test Name**
18639         - mozilla-central
18640         - autoland
18641         - mozilla-release
18642         - mozilla-beta
18643       * - **browsertime-tp6-chrome-tumblr**
18644         - ❌
18645         - ❌
18646         - ❌
18647         - ❌
18648       * - **browsertime-tp6-chromium-tumblr**
18649         - ❌
18650         - ❌
18651         - ❌
18652         - ❌
18653       * - **browsertime-tp6-firefox-tumblr**
18654         - ✅
18655         - ✅
18656         - ✅
18657         - ✅
18658       * - **browsertime-tp6-live-chrome-tumblr**
18659         - ❌
18660         - ❌
18661         - ❌
18662         - ❌
18663       * - **browsertime-tp6-live-chromium-tumblr**
18664         - ❌
18665         - ❌
18666         - ❌
18667         - ❌
18668       * - **browsertime-tp6-live-firefox-tumblr**
18669         - ❌
18670         - ❌
18671         - ❌
18672         - ❌
18673
18674
18675
18676 .. dropdown:: twitch
18677    :class-container: anchor-id-twitch-d
18678
18679    **Owner**: PerfTest Team
18680
18681    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
18682    * **alert threshold**: 2.0
18683    * **apps**: firefox, chrome, chromium, safari, custom-car
18684    * **browser cycles**: 25
18685    * **expected**: pass
18686    * **gecko profile entries**: 14000000
18687    * **gecko profile interval**: 1
18688    * **lower is better**: true
18689    * **page cycles**: 25
18690    * **page timeout**: 60000
18691    * **playback**: mitmproxy
18692    * **playback pageset manifest**: mitm7-linux-firefox-twitch.manifest
18693    * **playback version**: 8.1.1
18694    * **preferences**: {"media.autoplay.default": 5, "media.autoplay.ask-permission": true, "media.autoplay.blocking_policy": 1, "media.autoplay.block-webaudio": true, "media.allowed-to-play.enabled": false, "media.block-autoplay-until-in-foreground": true}
18695    * **secondary url**: `<https://www.twitch.tv/gmashley>`__
18696    * **test url**: `<https://www.twitch.tv/videos/894226211>`__
18697    * **type**: pageload
18698    * **unit**: ms
18699    * **use live sites**: false
18700    * **Test Task**:
18701
18702    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
18703       :widths: 30 15 15 15 15
18704       :header-rows: 1
18705
18706       * - **Test Name**
18707         - mozilla-central
18708         - autoland
18709         - mozilla-release
18710         - mozilla-beta
18711       * - **browsertime-tp6-firefox-twitch**
18712         - ❌
18713         - ❌
18714         - ❌
18715         - ❌
18716       * - **browsertime-tp6-live-firefox-twitch**
18717         - ❌
18718         - ❌
18719         - ❌
18720         - ❌
18721
18722
18723    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
18724       :widths: 30 15 15 15 15
18725       :header-rows: 1
18726
18727       * - **Test Name**
18728         - mozilla-central
18729         - autoland
18730         - mozilla-release
18731         - mozilla-beta
18732       * - **browsertime-tp6-firefox-twitch**
18733         - ❌
18734         - ❌
18735         - ❌
18736         - ❌
18737       * - **browsertime-tp6-live-firefox-twitch**
18738         - ❌
18739         - ❌
18740         - ❌
18741         - ❌
18742
18743
18744    .. list-table:: **test-linux1804-64-qr/opt**
18745       :widths: 30 15 15 15 15
18746       :header-rows: 1
18747
18748       * - **Test Name**
18749         - mozilla-central
18750         - autoland
18751         - mozilla-release
18752         - mozilla-beta
18753       * - **browsertime-tp6-firefox-twitch**
18754         - ❌
18755         - ❌
18756         - ❌
18757         - ❌
18758       * - **browsertime-tp6-live-firefox-twitch**
18759         - ❌
18760         - ❌
18761         - ❌
18762         - ❌
18763
18764
18765    .. list-table:: **test-linux1804-64-shippable-qr/opt**
18766       :widths: 30 15 15 15 15
18767       :header-rows: 1
18768
18769       * - **Test Name**
18770         - mozilla-central
18771         - autoland
18772         - mozilla-release
18773         - mozilla-beta
18774       * - **browsertime-tp6-chrome-twitch**
18775         - ❌
18776         - ❌
18777         - ❌
18778         - ❌
18779       * - **browsertime-tp6-chromium-twitch**
18780         - ❌
18781         - ❌
18782         - ❌
18783         - ❌
18784       * - **browsertime-tp6-firefox-twitch**
18785         - ✅
18786         - ✅
18787         - ✅
18788         - ✅
18789       * - **browsertime-tp6-live-chrome-twitch**
18790         - ❌
18791         - ❌
18792         - ❌
18793         - ❌
18794       * - **browsertime-tp6-live-chromium-twitch**
18795         - ❌
18796         - ❌
18797         - ❌
18798         - ❌
18799       * - **browsertime-tp6-live-firefox-twitch**
18800         - ❌
18801         - ❌
18802         - ❌
18803         - ❌
18804
18805
18806    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
18807       :widths: 30 15 15 15 15
18808       :header-rows: 1
18809
18810       * - **Test Name**
18811         - mozilla-central
18812         - autoland
18813         - mozilla-release
18814         - mozilla-beta
18815       * - **browsertime-tp6-firefox-twitch**
18816         - ❌
18817         - ❌
18818         - ❌
18819         - ❌
18820       * - **browsertime-tp6-live-firefox-twitch**
18821         - ❌
18822         - ❌
18823         - ❌
18824         - ❌
18825
18826
18827    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
18828       :widths: 30 15 15 15 15
18829       :header-rows: 1
18830
18831       * - **Test Name**
18832         - mozilla-central
18833         - autoland
18834         - mozilla-release
18835         - mozilla-beta
18836       * - **browsertime-tp6-chrome-twitch**
18837         - ❌
18838         - ❌
18839         - ❌
18840         - ❌
18841       * - **browsertime-tp6-chromium-twitch**
18842         - ❌
18843         - ❌
18844         - ❌
18845         - ❌
18846       * - **browsertime-tp6-firefox-twitch**
18847         - ✅
18848         - ✅
18849         - ✅
18850         - ✅
18851       * - **browsertime-tp6-live-chrome-twitch**
18852         - ❌
18853         - ❌
18854         - ❌
18855         - ❌
18856       * - **browsertime-tp6-live-chromium-twitch**
18857         - ❌
18858         - ❌
18859         - ❌
18860         - ❌
18861       * - **browsertime-tp6-live-firefox-twitch**
18862         - ❌
18863         - ❌
18864         - ❌
18865         - ❌
18866       * - **browsertime-tp6-live-safari-twitch**
18867         - ❌
18868         - ❌
18869         - ❌
18870         - ❌
18871
18872
18873    .. list-table:: **test-windows10-32-qr/opt**
18874       :widths: 30 15 15 15 15
18875       :header-rows: 1
18876
18877       * - **Test Name**
18878         - mozilla-central
18879         - autoland
18880         - mozilla-release
18881         - mozilla-beta
18882       * - **browsertime-tp6-firefox-twitch**
18883         - ❌
18884         - ❌
18885         - ❌
18886         - ❌
18887       * - **browsertime-tp6-live-firefox-twitch**
18888         - ❌
18889         - ❌
18890         - ❌
18891         - ❌
18892
18893
18894    .. list-table:: **test-windows10-32-shippable-qr/opt**
18895       :widths: 30 15 15 15 15
18896       :header-rows: 1
18897
18898       * - **Test Name**
18899         - mozilla-central
18900         - autoland
18901         - mozilla-release
18902         - mozilla-beta
18903       * - **browsertime-tp6-chrome-twitch**
18904         - ❌
18905         - ❌
18906         - ❌
18907         - ❌
18908       * - **browsertime-tp6-chromium-twitch**
18909         - ❌
18910         - ❌
18911         - ❌
18912         - ❌
18913       * - **browsertime-tp6-firefox-twitch**
18914         - ❌
18915         - ❌
18916         - ❌
18917         - ❌
18918       * - **browsertime-tp6-live-chrome-twitch**
18919         - ❌
18920         - ❌
18921         - ❌
18922         - ❌
18923       * - **browsertime-tp6-live-chromium-twitch**
18924         - ❌
18925         - ❌
18926         - ❌
18927         - ❌
18928       * - **browsertime-tp6-live-firefox-twitch**
18929         - ❌
18930         - ❌
18931         - ❌
18932         - ❌
18933
18934
18935    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
18936       :widths: 30 15 15 15 15
18937       :header-rows: 1
18938
18939       * - **Test Name**
18940         - mozilla-central
18941         - autoland
18942         - mozilla-release
18943         - mozilla-beta
18944       * - **browsertime-tp6-firefox-twitch**
18945         - ❌
18946         - ❌
18947         - ❌
18948         - ❌
18949       * - **browsertime-tp6-live-firefox-twitch**
18950         - ❌
18951         - ❌
18952         - ❌
18953         - ❌
18954
18955
18956    .. list-table:: **test-windows10-64-qr/opt**
18957       :widths: 30 15 15 15 15
18958       :header-rows: 1
18959
18960       * - **Test Name**
18961         - mozilla-central
18962         - autoland
18963         - mozilla-release
18964         - mozilla-beta
18965       * - **browsertime-tp6-firefox-twitch**
18966         - ❌
18967         - ❌
18968         - ❌
18969         - ❌
18970       * - **browsertime-tp6-live-firefox-twitch**
18971         - ❌
18972         - ❌
18973         - ❌
18974         - ❌
18975
18976
18977    .. list-table:: **test-windows10-64-shippable-qr/opt**
18978       :widths: 30 15 15 15 15
18979       :header-rows: 1
18980
18981       * - **Test Name**
18982         - mozilla-central
18983         - autoland
18984         - mozilla-release
18985         - mozilla-beta
18986       * - **browsertime-tp6-chrome-twitch**
18987         - ❌
18988         - ❌
18989         - ❌
18990         - ❌
18991       * - **browsertime-tp6-chromium-twitch**
18992         - ❌
18993         - ❌
18994         - ❌
18995         - ❌
18996       * - **browsertime-tp6-firefox-twitch**
18997         - ✅
18998         - ✅
18999         - ✅
19000         - ✅
19001       * - **browsertime-tp6-live-chrome-twitch**
19002         - ❌
19003         - ❌
19004         - ❌
19005         - ❌
19006       * - **browsertime-tp6-live-chromium-twitch**
19007         - ❌
19008         - ❌
19009         - ❌
19010         - ❌
19011       * - **browsertime-tp6-live-firefox-twitch**
19012         - ❌
19013         - ❌
19014         - ❌
19015         - ❌
19016
19017
19018
19019 .. dropdown:: twitter
19020    :class-container: anchor-id-twitter-d
19021
19022    **Owner**: PerfTest Team
19023
19024    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
19025    * **alert threshold**: 2.0
19026    * **apps**: firefox, chrome, chromium, safari, custom-car
19027    * **browser cycles**: 25
19028    * **expected**: pass
19029    * **gecko profile entries**: 14000000
19030    * **gecko profile interval**: 1
19031    * **lower is better**: true
19032    * **page cycles**: 25
19033    * **page timeout**: 60000
19034    * **playback**: mitmproxy
19035    * **playback pageset manifest**: mitm5-linux-firefox-twitter.manifest
19036    * **playback version**: 8.1.1
19037    * **test url**: `<https://twitter.com/BarackObama>`__
19038    * **type**: pageload
19039    * **unit**: ms
19040    * **use live sites**: false
19041    * **Test Task**:
19042
19043    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19044       :widths: 30 15 15 15 15
19045       :header-rows: 1
19046
19047       * - **Test Name**
19048         - mozilla-central
19049         - autoland
19050         - mozilla-release
19051         - mozilla-beta
19052       * - **browsertime-tp6-bytecode-firefox-twitter**
19053         - ❌
19054         - ❌
19055         - ❌
19056         - ❌
19057       * - **browsertime-tp6-essential-custom-car-twitter**
19058         - ❌
19059         - ❌
19060         - ❌
19061         - ❌
19062       * - **browsertime-tp6-essential-firefox-twitter**
19063         - ❌
19064         - ❌
19065         - ❌
19066         - ❌
19067       * - **browsertime-tp6-live-firefox-twitter**
19068         - ❌
19069         - ❌
19070         - ❌
19071         - ❌
19072
19073
19074    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
19075       :widths: 30 15 15 15 15
19076       :header-rows: 1
19077
19078       * - **Test Name**
19079         - mozilla-central
19080         - autoland
19081         - mozilla-release
19082         - mozilla-beta
19083       * - **browsertime-tp6-bytecode-firefox-twitter**
19084         - ❌
19085         - ❌
19086         - ❌
19087         - ❌
19088       * - **browsertime-tp6-essential-custom-car-twitter**
19089         - ❌
19090         - ❌
19091         - ❌
19092         - ❌
19093       * - **browsertime-tp6-essential-firefox-twitter**
19094         - ❌
19095         - ❌
19096         - ❌
19097         - ❌
19098       * - **browsertime-tp6-live-firefox-twitter**
19099         - ❌
19100         - ❌
19101         - ❌
19102         - ❌
19103
19104
19105    .. list-table:: **test-linux1804-64-qr/opt**
19106       :widths: 30 15 15 15 15
19107       :header-rows: 1
19108
19109       * - **Test Name**
19110         - mozilla-central
19111         - autoland
19112         - mozilla-release
19113         - mozilla-beta
19114       * - **browsertime-tp6-bytecode-firefox-twitter**
19115         - ❌
19116         - ❌
19117         - ❌
19118         - ❌
19119       * - **browsertime-tp6-essential-custom-car-twitter**
19120         - ❌
19121         - ❌
19122         - ❌
19123         - ❌
19124       * - **browsertime-tp6-essential-firefox-twitter**
19125         - ❌
19126         - ❌
19127         - ❌
19128         - ❌
19129       * - **browsertime-tp6-live-firefox-twitter**
19130         - ❌
19131         - ❌
19132         - ❌
19133         - ❌
19134
19135
19136    .. list-table:: **test-linux1804-64-shippable-qr/opt**
19137       :widths: 30 15 15 15 15
19138       :header-rows: 1
19139
19140       * - **Test Name**
19141         - mozilla-central
19142         - autoland
19143         - mozilla-release
19144         - mozilla-beta
19145       * - **browsertime-tp6-bytecode-firefox-twitter**
19146         - ✅
19147         - ✅
19148         - ✅
19149         - ✅
19150       * - **browsertime-tp6-essential-chrome-twitter**
19151         - ❌
19152         - ❌
19153         - ❌
19154         - ❌
19155       * - **browsertime-tp6-essential-chromium-twitter**
19156         - ❌
19157         - ❌
19158         - ❌
19159         - ❌
19160       * - **browsertime-tp6-essential-custom-car-twitter**
19161         - ❌
19162         - ❌
19163         - ❌
19164         - ❌
19165       * - **browsertime-tp6-essential-firefox-twitter**
19166         - ✅
19167         - ✅
19168         - ✅
19169         - ✅
19170       * - **browsertime-tp6-live-chrome-twitter**
19171         - ❌
19172         - ❌
19173         - ❌
19174         - ❌
19175       * - **browsertime-tp6-live-chromium-twitter**
19176         - ❌
19177         - ❌
19178         - ❌
19179         - ❌
19180       * - **browsertime-tp6-live-firefox-twitter**
19181         - ❌
19182         - ❌
19183         - ❌
19184         - ❌
19185
19186
19187    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
19188       :widths: 30 15 15 15 15
19189       :header-rows: 1
19190
19191       * - **Test Name**
19192         - mozilla-central
19193         - autoland
19194         - mozilla-release
19195         - mozilla-beta
19196       * - **browsertime-tp6-bytecode-firefox-twitter**
19197         - ❌
19198         - ❌
19199         - ❌
19200         - ❌
19201       * - **browsertime-tp6-essential-custom-car-twitter**
19202         - ❌
19203         - ❌
19204         - ❌
19205         - ❌
19206       * - **browsertime-tp6-essential-firefox-twitter**
19207         - ❌
19208         - ❌
19209         - ❌
19210         - ❌
19211       * - **browsertime-tp6-live-firefox-twitter**
19212         - ❌
19213         - ❌
19214         - ❌
19215         - ❌
19216
19217
19218    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
19219       :widths: 30 15 15 15 15
19220       :header-rows: 1
19221
19222       * - **Test Name**
19223         - mozilla-central
19224         - autoland
19225         - mozilla-release
19226         - mozilla-beta
19227       * - **browsertime-tp6-bytecode-firefox-twitter**
19228         - ✅
19229         - ✅
19230         - ✅
19231         - ✅
19232       * - **browsertime-tp6-essential-chrome-twitter**
19233         - ❌
19234         - ❌
19235         - ❌
19236         - ❌
19237       * - **browsertime-tp6-essential-chromium-twitter**
19238         - ❌
19239         - ❌
19240         - ❌
19241         - ❌
19242       * - **browsertime-tp6-essential-custom-car-twitter**
19243         - ❌
19244         - ❌
19245         - ❌
19246         - ❌
19247       * - **browsertime-tp6-essential-firefox-twitter**
19248         - ✅
19249         - ✅
19250         - ✅
19251         - ✅
19252       * - **browsertime-tp6-live-chrome-twitter**
19253         - ❌
19254         - ❌
19255         - ❌
19256         - ❌
19257       * - **browsertime-tp6-live-chromium-twitter**
19258         - ❌
19259         - ❌
19260         - ❌
19261         - ❌
19262       * - **browsertime-tp6-live-firefox-twitter**
19263         - ❌
19264         - ❌
19265         - ❌
19266         - ❌
19267       * - **browsertime-tp6-live-safari-twitter**
19268         - ❌
19269         - ❌
19270         - ❌
19271         - ❌
19272
19273
19274    .. list-table:: **test-windows10-32-qr/opt**
19275       :widths: 30 15 15 15 15
19276       :header-rows: 1
19277
19278       * - **Test Name**
19279         - mozilla-central
19280         - autoland
19281         - mozilla-release
19282         - mozilla-beta
19283       * - **browsertime-tp6-bytecode-firefox-twitter**
19284         - ❌
19285         - ❌
19286         - ❌
19287         - ❌
19288       * - **browsertime-tp6-essential-custom-car-twitter**
19289         - ❌
19290         - ❌
19291         - ❌
19292         - ❌
19293       * - **browsertime-tp6-essential-firefox-twitter**
19294         - ❌
19295         - ❌
19296         - ❌
19297         - ❌
19298       * - **browsertime-tp6-live-firefox-twitter**
19299         - ❌
19300         - ❌
19301         - ❌
19302         - ❌
19303
19304
19305    .. list-table:: **test-windows10-32-shippable-qr/opt**
19306       :widths: 30 15 15 15 15
19307       :header-rows: 1
19308
19309       * - **Test Name**
19310         - mozilla-central
19311         - autoland
19312         - mozilla-release
19313         - mozilla-beta
19314       * - **browsertime-tp6-bytecode-firefox-twitter**
19315         - ❌
19316         - ❌
19317         - ❌
19318         - ❌
19319       * - **browsertime-tp6-essential-chrome-twitter**
19320         - ❌
19321         - ❌
19322         - ❌
19323         - ❌
19324       * - **browsertime-tp6-essential-chromium-twitter**
19325         - ❌
19326         - ❌
19327         - ❌
19328         - ❌
19329       * - **browsertime-tp6-essential-custom-car-twitter**
19330         - ❌
19331         - ❌
19332         - ❌
19333         - ❌
19334       * - **browsertime-tp6-essential-firefox-twitter**
19335         - ❌
19336         - ❌
19337         - ❌
19338         - ❌
19339       * - **browsertime-tp6-live-chrome-twitter**
19340         - ❌
19341         - ❌
19342         - ❌
19343         - ❌
19344       * - **browsertime-tp6-live-chromium-twitter**
19345         - ❌
19346         - ❌
19347         - ❌
19348         - ❌
19349       * - **browsertime-tp6-live-firefox-twitter**
19350         - ❌
19351         - ❌
19352         - ❌
19353         - ❌
19354
19355
19356    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
19357       :widths: 30 15 15 15 15
19358       :header-rows: 1
19359
19360       * - **Test Name**
19361         - mozilla-central
19362         - autoland
19363         - mozilla-release
19364         - mozilla-beta
19365       * - **browsertime-tp6-bytecode-firefox-twitter**
19366         - ❌
19367         - ❌
19368         - ❌
19369         - ❌
19370       * - **browsertime-tp6-essential-custom-car-twitter**
19371         - ❌
19372         - ❌
19373         - ❌
19374         - ❌
19375       * - **browsertime-tp6-essential-firefox-twitter**
19376         - ❌
19377         - ❌
19378         - ❌
19379         - ❌
19380       * - **browsertime-tp6-live-firefox-twitter**
19381         - ❌
19382         - ❌
19383         - ❌
19384         - ❌
19385
19386
19387    .. list-table:: **test-windows10-64-qr/opt**
19388       :widths: 30 15 15 15 15
19389       :header-rows: 1
19390
19391       * - **Test Name**
19392         - mozilla-central
19393         - autoland
19394         - mozilla-release
19395         - mozilla-beta
19396       * - **browsertime-tp6-bytecode-firefox-twitter**
19397         - ❌
19398         - ❌
19399         - ❌
19400         - ❌
19401       * - **browsertime-tp6-essential-custom-car-twitter**
19402         - ❌
19403         - ❌
19404         - ❌
19405         - ❌
19406       * - **browsertime-tp6-essential-firefox-twitter**
19407         - ❌
19408         - ❌
19409         - ❌
19410         - ❌
19411       * - **browsertime-tp6-live-firefox-twitter**
19412         - ❌
19413         - ❌
19414         - ❌
19415         - ❌
19416
19417
19418    .. list-table:: **test-windows10-64-shippable-qr/opt**
19419       :widths: 30 15 15 15 15
19420       :header-rows: 1
19421
19422       * - **Test Name**
19423         - mozilla-central
19424         - autoland
19425         - mozilla-release
19426         - mozilla-beta
19427       * - **browsertime-tp6-bytecode-firefox-twitter**
19428         - ✅
19429         - ✅
19430         - ✅
19431         - ✅
19432       * - **browsertime-tp6-essential-chrome-twitter**
19433         - ❌
19434         - ❌
19435         - ❌
19436         - ❌
19437       * - **browsertime-tp6-essential-chromium-twitter**
19438         - ❌
19439         - ❌
19440         - ❌
19441         - ❌
19442       * - **browsertime-tp6-essential-custom-car-twitter**
19443         - ❌
19444         - ❌
19445         - ❌
19446         - ❌
19447       * - **browsertime-tp6-essential-firefox-twitter**
19448         - ✅
19449         - ✅
19450         - ✅
19451         - ✅
19452       * - **browsertime-tp6-live-chrome-twitter**
19453         - ❌
19454         - ❌
19455         - ❌
19456         - ❌
19457       * - **browsertime-tp6-live-chromium-twitter**
19458         - ❌
19459         - ❌
19460         - ❌
19461         - ❌
19462       * - **browsertime-tp6-live-firefox-twitter**
19463         - ❌
19464         - ❌
19465         - ❌
19466         - ❌
19467
19468
19469
19470 .. dropdown:: wikia
19471    :class-container: anchor-id-wikia-d
19472
19473    **Owner**: PerfTest Team
19474
19475    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
19476    * **alert threshold**: 2.0
19477    * **apps**: firefox, chrome, chromium, safari, custom-car
19478    * **browser cycles**: 25
19479    * **expected**: pass
19480    * **gecko profile entries**: 14000000
19481    * **gecko profile interval**: 1
19482    * **lower is better**: true
19483    * **page cycles**: 25
19484    * **page timeout**: 60000
19485    * **playback**: mitmproxy
19486    * **playback pageset manifest**: mitm7-linux-firefox-wikia.manifest
19487    * **playback version**: 8.1.1
19488    * **secondary url**: `<https://marvel.fandom.com/wiki/Celestials>`__
19489    * **test url**: `<https://marvel.fandom.com/wiki/Black_Panther>`__
19490    * **type**: pageload
19491    * **unit**: ms
19492    * **use live sites**: false
19493    * **Test Task**:
19494
19495    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19496       :widths: 30 15 15 15 15
19497       :header-rows: 1
19498
19499       * - **Test Name**
19500         - mozilla-central
19501         - autoland
19502         - mozilla-release
19503         - mozilla-beta
19504       * - **browsertime-tp6-firefox-wikia**
19505         - ❌
19506         - ❌
19507         - ❌
19508         - ❌
19509
19510
19511    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
19512       :widths: 30 15 15 15 15
19513       :header-rows: 1
19514
19515       * - **Test Name**
19516         - mozilla-central
19517         - autoland
19518         - mozilla-release
19519         - mozilla-beta
19520       * - **browsertime-tp6-firefox-wikia**
19521         - ❌
19522         - ❌
19523         - ❌
19524         - ❌
19525
19526
19527    .. list-table:: **test-linux1804-64-qr/opt**
19528       :widths: 30 15 15 15 15
19529       :header-rows: 1
19530
19531       * - **Test Name**
19532         - mozilla-central
19533         - autoland
19534         - mozilla-release
19535         - mozilla-beta
19536       * - **browsertime-tp6-firefox-wikia**
19537         - ❌
19538         - ❌
19539         - ❌
19540         - ❌
19541
19542
19543    .. list-table:: **test-linux1804-64-shippable-qr/opt**
19544       :widths: 30 15 15 15 15
19545       :header-rows: 1
19546
19547       * - **Test Name**
19548         - mozilla-central
19549         - autoland
19550         - mozilla-release
19551         - mozilla-beta
19552       * - **browsertime-tp6-chrome-wikia**
19553         - ❌
19554         - ❌
19555         - ❌
19556         - ❌
19557       * - **browsertime-tp6-chromium-wikia**
19558         - ❌
19559         - ❌
19560         - ❌
19561         - ❌
19562       * - **browsertime-tp6-firefox-wikia**
19563         - ✅
19564         - ✅
19565         - ✅
19566         - ✅
19567
19568
19569    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
19570       :widths: 30 15 15 15 15
19571       :header-rows: 1
19572
19573       * - **Test Name**
19574         - mozilla-central
19575         - autoland
19576         - mozilla-release
19577         - mozilla-beta
19578       * - **browsertime-tp6-firefox-wikia**
19579         - ❌
19580         - ❌
19581         - ❌
19582         - ❌
19583
19584
19585    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
19586       :widths: 30 15 15 15 15
19587       :header-rows: 1
19588
19589       * - **Test Name**
19590         - mozilla-central
19591         - autoland
19592         - mozilla-release
19593         - mozilla-beta
19594       * - **browsertime-tp6-chrome-wikia**
19595         - ❌
19596         - ❌
19597         - ❌
19598         - ❌
19599       * - **browsertime-tp6-chromium-wikia**
19600         - ❌
19601         - ❌
19602         - ❌
19603         - ❌
19604       * - **browsertime-tp6-firefox-wikia**
19605         - ✅
19606         - ✅
19607         - ✅
19608         - ✅
19609
19610
19611    .. list-table:: **test-windows10-32-qr/opt**
19612       :widths: 30 15 15 15 15
19613       :header-rows: 1
19614
19615       * - **Test Name**
19616         - mozilla-central
19617         - autoland
19618         - mozilla-release
19619         - mozilla-beta
19620       * - **browsertime-tp6-firefox-wikia**
19621         - ❌
19622         - ❌
19623         - ❌
19624         - ❌
19625
19626
19627    .. list-table:: **test-windows10-32-shippable-qr/opt**
19628       :widths: 30 15 15 15 15
19629       :header-rows: 1
19630
19631       * - **Test Name**
19632         - mozilla-central
19633         - autoland
19634         - mozilla-release
19635         - mozilla-beta
19636       * - **browsertime-tp6-chrome-wikia**
19637         - ❌
19638         - ❌
19639         - ❌
19640         - ❌
19641       * - **browsertime-tp6-chromium-wikia**
19642         - ❌
19643         - ❌
19644         - ❌
19645         - ❌
19646       * - **browsertime-tp6-firefox-wikia**
19647         - ❌
19648         - ❌
19649         - ❌
19650         - ❌
19651
19652
19653    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
19654       :widths: 30 15 15 15 15
19655       :header-rows: 1
19656
19657       * - **Test Name**
19658         - mozilla-central
19659         - autoland
19660         - mozilla-release
19661         - mozilla-beta
19662       * - **browsertime-tp6-firefox-wikia**
19663         - ❌
19664         - ❌
19665         - ❌
19666         - ❌
19667
19668
19669    .. list-table:: **test-windows10-64-qr/opt**
19670       :widths: 30 15 15 15 15
19671       :header-rows: 1
19672
19673       * - **Test Name**
19674         - mozilla-central
19675         - autoland
19676         - mozilla-release
19677         - mozilla-beta
19678       * - **browsertime-tp6-firefox-wikia**
19679         - ❌
19680         - ❌
19681         - ❌
19682         - ❌
19683
19684
19685    .. list-table:: **test-windows10-64-shippable-qr/opt**
19686       :widths: 30 15 15 15 15
19687       :header-rows: 1
19688
19689       * - **Test Name**
19690         - mozilla-central
19691         - autoland
19692         - mozilla-release
19693         - mozilla-beta
19694       * - **browsertime-tp6-chrome-wikia**
19695         - ❌
19696         - ❌
19697         - ❌
19698         - ❌
19699       * - **browsertime-tp6-chromium-wikia**
19700         - ❌
19701         - ❌
19702         - ❌
19703         - ❌
19704       * - **browsertime-tp6-firefox-wikia**
19705         - ✅
19706         - ✅
19707         - ✅
19708         - ✅
19709
19710
19711
19712 .. dropdown:: wikipedia
19713    :class-container: anchor-id-wikipedia-d
19714
19715    **Owner**: PerfTest Team
19716
19717    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
19718    * **alert threshold**: 2.0
19719    * **apps**: firefox, chrome, chromium, safari, custom-car
19720    * **browser cycles**: 25
19721    * **expected**: pass
19722    * **gecko profile entries**: 14000000
19723    * **gecko profile interval**: 1
19724    * **lower is better**: true
19725    * **page cycles**: 25
19726    * **page timeout**: 60000
19727    * **playback**: mitmproxy
19728    * **playback pageset manifest**: mitm7-linux-firefox-wikipedia.manifest
19729    * **playback version**: 8.1.1
19730    * **secondary url**: `<https://en.wikipedia.org/wiki/Joe_Biden>`__
19731    * **test url**: `<https://en.wikipedia.org/wiki/Barack_Obama>`__
19732    * **type**: pageload
19733    * **unit**: ms
19734    * **use live sites**: false
19735    * **Test Task**:
19736
19737    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
19738       :widths: 30 15 15 15 15
19739       :header-rows: 1
19740
19741       * - **Test Name**
19742         - mozilla-central
19743         - autoland
19744         - mozilla-release
19745         - mozilla-beta
19746       * - **browsertime-tp6m-fenix-wikipedia**
19747         - ❌
19748         - ❌
19749         - ❌
19750         - ❌
19751       * - **browsertime-tp6m-fenix-wikipedia-nofis**
19752         - ❌
19753         - ❌
19754         - ❌
19755         - ❌
19756       * - **browsertime-tp6m-geckoview-wikipedia**
19757         - ❌
19758         - ❌
19759         - ❌
19760         - ❌
19761       * - **browsertime-tp6m-geckoview-wikipedia-nofis**
19762         - ❌
19763         - ❌
19764         - ❌
19765         - ❌
19766       * - **browsertime-tp6m-live-fenix-wikipedia-nofis**
19767         - ❌
19768         - ❌
19769         - ❌
19770         - ❌
19771       * - **browsertime-tp6m-live-geckoview-wikipedia-nofis**
19772         - ❌
19773         - ❌
19774         - ❌
19775         - ❌
19776       * - **browsertime-tp6m-refbrow-wikipedia**
19777         - ❌
19778         - ❌
19779         - ❌
19780         - ❌
19781
19782
19783    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
19784       :widths: 30 15 15 15 15
19785       :header-rows: 1
19786
19787       * - **Test Name**
19788         - mozilla-central
19789         - autoland
19790         - mozilla-release
19791         - mozilla-beta
19792       * - **browsertime-tp6m-chrome-m-wikipedia**
19793         - ❌
19794         - ❌
19795         - ❌
19796         - ❌
19797       * - **browsertime-tp6m-chrome-m-wikipedia-nofis**
19798         - ❌
19799         - ❌
19800         - ❌
19801         - ❌
19802       * - **browsertime-tp6m-fenix-wikipedia**
19803         - ❌
19804         - ❌
19805         - ❌
19806         - ❌
19807       * - **browsertime-tp6m-fenix-wikipedia-nofis**
19808         - ❌
19809         - ❌
19810         - ❌
19811         - ❌
19812       * - **browsertime-tp6m-geckoview-wikipedia**
19813         - ❌
19814         - ❌
19815         - ❌
19816         - ❌
19817       * - **browsertime-tp6m-geckoview-wikipedia-nofis**
19818         - ✅
19819         - ✅
19820         - ❌
19821         - ❌
19822       * - **browsertime-tp6m-live-chrome-m-wikipedia-nofis**
19823         - ❌
19824         - ❌
19825         - ❌
19826         - ❌
19827       * - **browsertime-tp6m-live-fenix-wikipedia-nofis**
19828         - ❌
19829         - ❌
19830         - ❌
19831         - ❌
19832       * - **browsertime-tp6m-live-geckoview-wikipedia-nofis**
19833         - ❌
19834         - ❌
19835         - ❌
19836         - ❌
19837       * - **browsertime-tp6m-refbrow-wikipedia**
19838         - ❌
19839         - ❌
19840         - ❌
19841         - ❌
19842
19843
19844    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19845       :widths: 30 15 15 15 15
19846       :header-rows: 1
19847
19848       * - **Test Name**
19849         - mozilla-central
19850         - autoland
19851         - mozilla-release
19852         - mozilla-beta
19853       * - **browsertime-tp6-bytecode-firefox-wikipedia**
19854         - ❌
19855         - ❌
19856         - ❌
19857         - ❌
19858       * - **browsertime-tp6-essential-custom-car-wikipedia**
19859         - ❌
19860         - ❌
19861         - ❌
19862         - ❌
19863       * - **browsertime-tp6-essential-firefox-wikipedia**
19864         - ❌
19865         - ❌
19866         - ❌
19867         - ❌
19868       * - **browsertime-tp6-live-firefox-wikipedia**
19869         - ❌
19870         - ❌
19871         - ❌
19872         - ❌
19873
19874
19875    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
19876       :widths: 30 15 15 15 15
19877       :header-rows: 1
19878
19879       * - **Test Name**
19880         - mozilla-central
19881         - autoland
19882         - mozilla-release
19883         - mozilla-beta
19884       * - **browsertime-tp6-bytecode-firefox-wikipedia**
19885         - ❌
19886         - ❌
19887         - ❌
19888         - ❌
19889       * - **browsertime-tp6-essential-custom-car-wikipedia**
19890         - ❌
19891         - ❌
19892         - ❌
19893         - ❌
19894       * - **browsertime-tp6-essential-firefox-wikipedia**
19895         - ❌
19896         - ❌
19897         - ❌
19898         - ❌
19899       * - **browsertime-tp6-live-firefox-wikipedia**
19900         - ❌
19901         - ❌
19902         - ❌
19903         - ❌
19904
19905
19906    .. list-table:: **test-linux1804-64-qr/opt**
19907       :widths: 30 15 15 15 15
19908       :header-rows: 1
19909
19910       * - **Test Name**
19911         - mozilla-central
19912         - autoland
19913         - mozilla-release
19914         - mozilla-beta
19915       * - **browsertime-tp6-bytecode-firefox-wikipedia**
19916         - ❌
19917         - ❌
19918         - ❌
19919         - ❌
19920       * - **browsertime-tp6-essential-custom-car-wikipedia**
19921         - ❌
19922         - ❌
19923         - ❌
19924         - ❌
19925       * - **browsertime-tp6-essential-firefox-wikipedia**
19926         - ❌
19927         - ❌
19928         - ❌
19929         - ❌
19930       * - **browsertime-tp6-live-firefox-wikipedia**
19931         - ❌
19932         - ❌
19933         - ❌
19934         - ❌
19935
19936
19937    .. list-table:: **test-linux1804-64-shippable-qr/opt**
19938       :widths: 30 15 15 15 15
19939       :header-rows: 1
19940
19941       * - **Test Name**
19942         - mozilla-central
19943         - autoland
19944         - mozilla-release
19945         - mozilla-beta
19946       * - **browsertime-tp6-bytecode-firefox-wikipedia**
19947         - ✅
19948         - ✅
19949         - ✅
19950         - ✅
19951       * - **browsertime-tp6-essential-chrome-wikipedia**
19952         - ❌
19953         - ❌
19954         - ❌
19955         - ❌
19956       * - **browsertime-tp6-essential-chromium-wikipedia**
19957         - ❌
19958         - ❌
19959         - ❌
19960         - ❌
19961       * - **browsertime-tp6-essential-custom-car-wikipedia**
19962         - ❌
19963         - ❌
19964         - ❌
19965         - ❌
19966       * - **browsertime-tp6-essential-firefox-wikipedia**
19967         - ✅
19968         - ✅
19969         - ✅
19970         - ✅
19971       * - **browsertime-tp6-live-chrome-wikipedia**
19972         - ❌
19973         - ❌
19974         - ❌
19975         - ❌
19976       * - **browsertime-tp6-live-chromium-wikipedia**
19977         - ❌
19978         - ❌
19979         - ❌
19980         - ❌
19981       * - **browsertime-tp6-live-firefox-wikipedia**
19982         - ❌
19983         - ❌
19984         - ❌
19985         - ❌
19986
19987
19988    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
19989       :widths: 30 15 15 15 15
19990       :header-rows: 1
19991
19992       * - **Test Name**
19993         - mozilla-central
19994         - autoland
19995         - mozilla-release
19996         - mozilla-beta
19997       * - **browsertime-tp6-bytecode-firefox-wikipedia**
19998         - ❌
19999         - ❌
20000         - ❌
20001         - ❌
20002       * - **browsertime-tp6-essential-custom-car-wikipedia**
20003         - ❌
20004         - ❌
20005         - ❌
20006         - ❌
20007       * - **browsertime-tp6-essential-firefox-wikipedia**
20008         - ❌
20009         - ❌
20010         - ❌
20011         - ❌
20012       * - **browsertime-tp6-live-firefox-wikipedia**
20013         - ❌
20014         - ❌
20015         - ❌
20016         - ❌
20017
20018
20019    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
20020       :widths: 30 15 15 15 15
20021       :header-rows: 1
20022
20023       * - **Test Name**
20024         - mozilla-central
20025         - autoland
20026         - mozilla-release
20027         - mozilla-beta
20028       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20029         - ✅
20030         - ✅
20031         - ✅
20032         - ✅
20033       * - **browsertime-tp6-essential-chrome-wikipedia**
20034         - ❌
20035         - ❌
20036         - ❌
20037         - ❌
20038       * - **browsertime-tp6-essential-chromium-wikipedia**
20039         - ❌
20040         - ❌
20041         - ❌
20042         - ❌
20043       * - **browsertime-tp6-essential-custom-car-wikipedia**
20044         - ❌
20045         - ❌
20046         - ❌
20047         - ❌
20048       * - **browsertime-tp6-essential-firefox-wikipedia**
20049         - ✅
20050         - ✅
20051         - ✅
20052         - ✅
20053       * - **browsertime-tp6-live-chrome-wikipedia**
20054         - ❌
20055         - ❌
20056         - ❌
20057         - ❌
20058       * - **browsertime-tp6-live-chromium-wikipedia**
20059         - ❌
20060         - ❌
20061         - ❌
20062         - ❌
20063       * - **browsertime-tp6-live-firefox-wikipedia**
20064         - ❌
20065         - ❌
20066         - ❌
20067         - ❌
20068       * - **browsertime-tp6-live-safari-wikipedia**
20069         - ❌
20070         - ❌
20071         - ❌
20072         - ❌
20073
20074
20075    .. list-table:: **test-windows10-32-qr/opt**
20076       :widths: 30 15 15 15 15
20077       :header-rows: 1
20078
20079       * - **Test Name**
20080         - mozilla-central
20081         - autoland
20082         - mozilla-release
20083         - mozilla-beta
20084       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20085         - ❌
20086         - ❌
20087         - ❌
20088         - ❌
20089       * - **browsertime-tp6-essential-custom-car-wikipedia**
20090         - ❌
20091         - ❌
20092         - ❌
20093         - ❌
20094       * - **browsertime-tp6-essential-firefox-wikipedia**
20095         - ❌
20096         - ❌
20097         - ❌
20098         - ❌
20099       * - **browsertime-tp6-live-firefox-wikipedia**
20100         - ❌
20101         - ❌
20102         - ❌
20103         - ❌
20104
20105
20106    .. list-table:: **test-windows10-32-shippable-qr/opt**
20107       :widths: 30 15 15 15 15
20108       :header-rows: 1
20109
20110       * - **Test Name**
20111         - mozilla-central
20112         - autoland
20113         - mozilla-release
20114         - mozilla-beta
20115       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20116         - ❌
20117         - ❌
20118         - ❌
20119         - ❌
20120       * - **browsertime-tp6-essential-chrome-wikipedia**
20121         - ❌
20122         - ❌
20123         - ❌
20124         - ❌
20125       * - **browsertime-tp6-essential-chromium-wikipedia**
20126         - ❌
20127         - ❌
20128         - ❌
20129         - ❌
20130       * - **browsertime-tp6-essential-custom-car-wikipedia**
20131         - ❌
20132         - ❌
20133         - ❌
20134         - ❌
20135       * - **browsertime-tp6-essential-firefox-wikipedia**
20136         - ❌
20137         - ❌
20138         - ❌
20139         - ❌
20140       * - **browsertime-tp6-live-chrome-wikipedia**
20141         - ❌
20142         - ❌
20143         - ❌
20144         - ❌
20145       * - **browsertime-tp6-live-chromium-wikipedia**
20146         - ❌
20147         - ❌
20148         - ❌
20149         - ❌
20150       * - **browsertime-tp6-live-firefox-wikipedia**
20151         - ❌
20152         - ❌
20153         - ❌
20154         - ❌
20155
20156
20157    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
20158       :widths: 30 15 15 15 15
20159       :header-rows: 1
20160
20161       * - **Test Name**
20162         - mozilla-central
20163         - autoland
20164         - mozilla-release
20165         - mozilla-beta
20166       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20167         - ❌
20168         - ❌
20169         - ❌
20170         - ❌
20171       * - **browsertime-tp6-essential-custom-car-wikipedia**
20172         - ❌
20173         - ❌
20174         - ❌
20175         - ❌
20176       * - **browsertime-tp6-essential-firefox-wikipedia**
20177         - ❌
20178         - ❌
20179         - ❌
20180         - ❌
20181       * - **browsertime-tp6-live-firefox-wikipedia**
20182         - ❌
20183         - ❌
20184         - ❌
20185         - ❌
20186
20187
20188    .. list-table:: **test-windows10-64-qr/opt**
20189       :widths: 30 15 15 15 15
20190       :header-rows: 1
20191
20192       * - **Test Name**
20193         - mozilla-central
20194         - autoland
20195         - mozilla-release
20196         - mozilla-beta
20197       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20198         - ❌
20199         - ❌
20200         - ❌
20201         - ❌
20202       * - **browsertime-tp6-essential-custom-car-wikipedia**
20203         - ❌
20204         - ❌
20205         - ❌
20206         - ❌
20207       * - **browsertime-tp6-essential-firefox-wikipedia**
20208         - ❌
20209         - ❌
20210         - ❌
20211         - ❌
20212       * - **browsertime-tp6-live-firefox-wikipedia**
20213         - ❌
20214         - ❌
20215         - ❌
20216         - ❌
20217
20218
20219    .. list-table:: **test-windows10-64-shippable-qr/opt**
20220       :widths: 30 15 15 15 15
20221       :header-rows: 1
20222
20223       * - **Test Name**
20224         - mozilla-central
20225         - autoland
20226         - mozilla-release
20227         - mozilla-beta
20228       * - **browsertime-tp6-bytecode-firefox-wikipedia**
20229         - ✅
20230         - ✅
20231         - ✅
20232         - ✅
20233       * - **browsertime-tp6-essential-chrome-wikipedia**
20234         - ❌
20235         - ❌
20236         - ❌
20237         - ❌
20238       * - **browsertime-tp6-essential-chromium-wikipedia**
20239         - ❌
20240         - ❌
20241         - ❌
20242         - ❌
20243       * - **browsertime-tp6-essential-custom-car-wikipedia**
20244         - ❌
20245         - ❌
20246         - ❌
20247         - ❌
20248       * - **browsertime-tp6-essential-firefox-wikipedia**
20249         - ✅
20250         - ✅
20251         - ✅
20252         - ✅
20253       * - **browsertime-tp6-live-chrome-wikipedia**
20254         - ❌
20255         - ❌
20256         - ❌
20257         - ❌
20258       * - **browsertime-tp6-live-chromium-wikipedia**
20259         - ❌
20260         - ❌
20261         - ❌
20262         - ❌
20263       * - **browsertime-tp6-live-firefox-wikipedia**
20264         - ❌
20265         - ❌
20266         - ❌
20267         - ❌
20268
20269
20270
20271 .. dropdown:: yahoo-mail
20272    :class-container: anchor-id-yahoo-mail-d
20273
20274    **Owner**: PerfTest Team
20275
20276    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
20277    * **alert threshold**: 2.0
20278    * **apps**: firefox, chrome, chromium, safari, custom-car
20279    * **browser cycles**: 25
20280    * **expected**: pass
20281    * **gecko profile entries**: 14000000
20282    * **gecko profile interval**: 1
20283    * **lower is better**: true
20284    * **page cycles**: 25
20285    * **page timeout**: 60000
20286    * **playback**: mitmproxy
20287    * **playback pageset manifest**: mitm5-linux-firefox-yahoo-mail.manifest
20288    * **playback version**: 8.1.1
20289    * **test url**: `<https://mail.yahoo.com/>`__
20290    * **type**: pageload
20291    * **unit**: ms
20292    * **use live sites**: false
20293    * **Test Task**:
20294
20295    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
20296       :widths: 30 15 15 15 15
20297       :header-rows: 1
20298
20299       * - **Test Name**
20300         - mozilla-central
20301         - autoland
20302         - mozilla-release
20303         - mozilla-beta
20304       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20305         - ❌
20306         - ❌
20307         - ❌
20308         - ❌
20309       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20310         - ❌
20311         - ❌
20312         - ❌
20313         - ❌
20314       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20315         - ❌
20316         - ❌
20317         - ❌
20318         - ❌
20319       * - **browsertime-tp6-live-firefox-yahoo-mail**
20320         - ❌
20321         - ❌
20322         - ❌
20323         - ❌
20324
20325
20326    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
20327       :widths: 30 15 15 15 15
20328       :header-rows: 1
20329
20330       * - **Test Name**
20331         - mozilla-central
20332         - autoland
20333         - mozilla-release
20334         - mozilla-beta
20335       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20336         - ❌
20337         - ❌
20338         - ❌
20339         - ❌
20340       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20341         - ❌
20342         - ❌
20343         - ❌
20344         - ❌
20345       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20346         - ❌
20347         - ❌
20348         - ❌
20349         - ❌
20350       * - **browsertime-tp6-live-firefox-yahoo-mail**
20351         - ❌
20352         - ❌
20353         - ❌
20354         - ❌
20355
20356
20357    .. list-table:: **test-linux1804-64-qr/opt**
20358       :widths: 30 15 15 15 15
20359       :header-rows: 1
20360
20361       * - **Test Name**
20362         - mozilla-central
20363         - autoland
20364         - mozilla-release
20365         - mozilla-beta
20366       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20367         - ❌
20368         - ❌
20369         - ❌
20370         - ❌
20371       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20372         - ❌
20373         - ❌
20374         - ❌
20375         - ❌
20376       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20377         - ❌
20378         - ❌
20379         - ❌
20380         - ❌
20381       * - **browsertime-tp6-live-firefox-yahoo-mail**
20382         - ❌
20383         - ❌
20384         - ❌
20385         - ❌
20386
20387
20388    .. list-table:: **test-linux1804-64-shippable-qr/opt**
20389       :widths: 30 15 15 15 15
20390       :header-rows: 1
20391
20392       * - **Test Name**
20393         - mozilla-central
20394         - autoland
20395         - mozilla-release
20396         - mozilla-beta
20397       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20398         - ✅
20399         - ✅
20400         - ✅
20401         - ✅
20402       * - **browsertime-tp6-essential-chrome-yahoo-mail**
20403         - ❌
20404         - ❌
20405         - ❌
20406         - ❌
20407       * - **browsertime-tp6-essential-chromium-yahoo-mail**
20408         - ❌
20409         - ❌
20410         - ❌
20411         - ❌
20412       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20413         - ❌
20414         - ❌
20415         - ❌
20416         - ❌
20417       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20418         - ✅
20419         - ✅
20420         - ✅
20421         - ✅
20422       * - **browsertime-tp6-live-chrome-yahoo-mail**
20423         - ❌
20424         - ❌
20425         - ❌
20426         - ❌
20427       * - **browsertime-tp6-live-chromium-yahoo-mail**
20428         - ❌
20429         - ❌
20430         - ❌
20431         - ❌
20432       * - **browsertime-tp6-live-firefox-yahoo-mail**
20433         - ❌
20434         - ❌
20435         - ❌
20436         - ❌
20437
20438
20439    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
20440       :widths: 30 15 15 15 15
20441       :header-rows: 1
20442
20443       * - **Test Name**
20444         - mozilla-central
20445         - autoland
20446         - mozilla-release
20447         - mozilla-beta
20448       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20449         - ❌
20450         - ❌
20451         - ❌
20452         - ❌
20453       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20454         - ❌
20455         - ❌
20456         - ❌
20457         - ❌
20458       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20459         - ❌
20460         - ❌
20461         - ❌
20462         - ❌
20463       * - **browsertime-tp6-live-firefox-yahoo-mail**
20464         - ❌
20465         - ❌
20466         - ❌
20467         - ❌
20468
20469
20470    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
20471       :widths: 30 15 15 15 15
20472       :header-rows: 1
20473
20474       * - **Test Name**
20475         - mozilla-central
20476         - autoland
20477         - mozilla-release
20478         - mozilla-beta
20479       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20480         - ✅
20481         - ✅
20482         - ✅
20483         - ✅
20484       * - **browsertime-tp6-essential-chrome-yahoo-mail**
20485         - ❌
20486         - ❌
20487         - ❌
20488         - ❌
20489       * - **browsertime-tp6-essential-chromium-yahoo-mail**
20490         - ❌
20491         - ❌
20492         - ❌
20493         - ❌
20494       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20495         - ❌
20496         - ❌
20497         - ❌
20498         - ❌
20499       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20500         - ✅
20501         - ✅
20502         - ✅
20503         - ✅
20504       * - **browsertime-tp6-live-chrome-yahoo-mail**
20505         - ❌
20506         - ❌
20507         - ❌
20508         - ❌
20509       * - **browsertime-tp6-live-chromium-yahoo-mail**
20510         - ❌
20511         - ❌
20512         - ❌
20513         - ❌
20514       * - **browsertime-tp6-live-firefox-yahoo-mail**
20515         - ❌
20516         - ❌
20517         - ❌
20518         - ❌
20519
20520
20521    .. list-table:: **test-windows10-32-qr/opt**
20522       :widths: 30 15 15 15 15
20523       :header-rows: 1
20524
20525       * - **Test Name**
20526         - mozilla-central
20527         - autoland
20528         - mozilla-release
20529         - mozilla-beta
20530       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20531         - ❌
20532         - ❌
20533         - ❌
20534         - ❌
20535       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20536         - ❌
20537         - ❌
20538         - ❌
20539         - ❌
20540       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20541         - ❌
20542         - ❌
20543         - ❌
20544         - ❌
20545       * - **browsertime-tp6-live-firefox-yahoo-mail**
20546         - ❌
20547         - ❌
20548         - ❌
20549         - ❌
20550
20551
20552    .. list-table:: **test-windows10-32-shippable-qr/opt**
20553       :widths: 30 15 15 15 15
20554       :header-rows: 1
20555
20556       * - **Test Name**
20557         - mozilla-central
20558         - autoland
20559         - mozilla-release
20560         - mozilla-beta
20561       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20562         - ❌
20563         - ❌
20564         - ❌
20565         - ❌
20566       * - **browsertime-tp6-essential-chrome-yahoo-mail**
20567         - ❌
20568         - ❌
20569         - ❌
20570         - ❌
20571       * - **browsertime-tp6-essential-chromium-yahoo-mail**
20572         - ❌
20573         - ❌
20574         - ❌
20575         - ❌
20576       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20577         - ❌
20578         - ❌
20579         - ❌
20580         - ❌
20581       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20582         - ❌
20583         - ❌
20584         - ❌
20585         - ❌
20586       * - **browsertime-tp6-live-chrome-yahoo-mail**
20587         - ❌
20588         - ❌
20589         - ❌
20590         - ❌
20591       * - **browsertime-tp6-live-chromium-yahoo-mail**
20592         - ❌
20593         - ❌
20594         - ❌
20595         - ❌
20596       * - **browsertime-tp6-live-firefox-yahoo-mail**
20597         - ❌
20598         - ❌
20599         - ❌
20600         - ❌
20601
20602
20603    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
20604       :widths: 30 15 15 15 15
20605       :header-rows: 1
20606
20607       * - **Test Name**
20608         - mozilla-central
20609         - autoland
20610         - mozilla-release
20611         - mozilla-beta
20612       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20613         - ❌
20614         - ❌
20615         - ❌
20616         - ❌
20617       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20618         - ❌
20619         - ❌
20620         - ❌
20621         - ❌
20622       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20623         - ❌
20624         - ❌
20625         - ❌
20626         - ❌
20627       * - **browsertime-tp6-live-firefox-yahoo-mail**
20628         - ❌
20629         - ❌
20630         - ❌
20631         - ❌
20632
20633
20634    .. list-table:: **test-windows10-64-qr/opt**
20635       :widths: 30 15 15 15 15
20636       :header-rows: 1
20637
20638       * - **Test Name**
20639         - mozilla-central
20640         - autoland
20641         - mozilla-release
20642         - mozilla-beta
20643       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20644         - ❌
20645         - ❌
20646         - ❌
20647         - ❌
20648       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20649         - ❌
20650         - ❌
20651         - ❌
20652         - ❌
20653       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20654         - ❌
20655         - ❌
20656         - ❌
20657         - ❌
20658       * - **browsertime-tp6-live-firefox-yahoo-mail**
20659         - ❌
20660         - ❌
20661         - ❌
20662         - ❌
20663
20664
20665    .. list-table:: **test-windows10-64-shippable-qr/opt**
20666       :widths: 30 15 15 15 15
20667       :header-rows: 1
20668
20669       * - **Test Name**
20670         - mozilla-central
20671         - autoland
20672         - mozilla-release
20673         - mozilla-beta
20674       * - **browsertime-tp6-bytecode-firefox-yahoo-mail**
20675         - ✅
20676         - ✅
20677         - ✅
20678         - ✅
20679       * - **browsertime-tp6-essential-chrome-yahoo-mail**
20680         - ❌
20681         - ❌
20682         - ❌
20683         - ❌
20684       * - **browsertime-tp6-essential-chromium-yahoo-mail**
20685         - ❌
20686         - ❌
20687         - ❌
20688         - ❌
20689       * - **browsertime-tp6-essential-custom-car-yahoo-mail**
20690         - ❌
20691         - ❌
20692         - ❌
20693         - ❌
20694       * - **browsertime-tp6-essential-firefox-yahoo-mail**
20695         - ✅
20696         - ✅
20697         - ✅
20698         - ✅
20699       * - **browsertime-tp6-live-chrome-yahoo-mail**
20700         - ❌
20701         - ❌
20702         - ❌
20703         - ❌
20704       * - **browsertime-tp6-live-chromium-yahoo-mail**
20705         - ❌
20706         - ❌
20707         - ❌
20708         - ❌
20709       * - **browsertime-tp6-live-firefox-yahoo-mail**
20710         - ❌
20711         - ❌
20712         - ❌
20713         - ❌
20714
20715
20716
20717 .. dropdown:: youtube
20718    :class-container: anchor-id-youtube-d
20719
20720    **Owner**: PerfTest Team
20721
20722    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
20723    * **alert threshold**: 2.0
20724    * **apps**: firefox, chrome, chromium, safari, custom-car
20725    * **browser cycles**: 25
20726    * **expected**: pass
20727    * **gecko profile entries**: 14000000
20728    * **gecko profile interval**: 1
20729    * **lower is better**: true
20730    * **page cycles**: 25
20731    * **page timeout**: 60000
20732    * **playback**: mitmproxy
20733    * **playback pageset manifest**: mitm7-linux-firefox-youtube.manifest
20734    * **playback version**: 8.1.1
20735    * **secondary url**: `<https://www.youtube.com/watch?v=JrdEMERq8MA>`__
20736    * **test url**: `<https://www.youtube.com>`__
20737    * **type**: pageload
20738    * **unit**: ms
20739    * **use live sites**: false
20740    * **Test Task**:
20741
20742    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
20743       :widths: 30 15 15 15 15
20744       :header-rows: 1
20745
20746       * - **Test Name**
20747         - mozilla-central
20748         - autoland
20749         - mozilla-release
20750         - mozilla-beta
20751       * - **browsertime-tp6m-fenix-youtube**
20752         - ❌
20753         - ❌
20754         - ❌
20755         - ❌
20756       * - **browsertime-tp6m-fenix-youtube-nofis**
20757         - ❌
20758         - ❌
20759         - ❌
20760         - ❌
20761       * - **browsertime-tp6m-geckoview-youtube**
20762         - ❌
20763         - ❌
20764         - ❌
20765         - ❌
20766       * - **browsertime-tp6m-geckoview-youtube-nofis**
20767         - ❌
20768         - ❌
20769         - ❌
20770         - ❌
20771       * - **browsertime-tp6m-live-fenix-youtube-nofis**
20772         - ❌
20773         - ❌
20774         - ❌
20775         - ❌
20776       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
20777         - ❌
20778         - ❌
20779         - ❌
20780         - ❌
20781       * - **browsertime-tp6m-refbrow-youtube**
20782         - ❌
20783         - ❌
20784         - ❌
20785         - ❌
20786
20787
20788    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
20789       :widths: 30 15 15 15 15
20790       :header-rows: 1
20791
20792       * - **Test Name**
20793         - mozilla-central
20794         - autoland
20795         - mozilla-release
20796         - mozilla-beta
20797       * - **browsertime-tp6m-chrome-m-youtube**
20798         - ❌
20799         - ❌
20800         - ❌
20801         - ❌
20802       * - **browsertime-tp6m-chrome-m-youtube-nofis**
20803         - ❌
20804         - ❌
20805         - ❌
20806         - ❌
20807       * - **browsertime-tp6m-fenix-youtube**
20808         - ❌
20809         - ❌
20810         - ❌
20811         - ❌
20812       * - **browsertime-tp6m-fenix-youtube-nofis**
20813         - ❌
20814         - ❌
20815         - ❌
20816         - ❌
20817       * - **browsertime-tp6m-geckoview-youtube**
20818         - ❌
20819         - ❌
20820         - ❌
20821         - ❌
20822       * - **browsertime-tp6m-geckoview-youtube-nofis**
20823         - ✅
20824         - ✅
20825         - ❌
20826         - ❌
20827       * - **browsertime-tp6m-live-chrome-m-youtube-nofis**
20828         - ❌
20829         - ❌
20830         - ❌
20831         - ❌
20832       * - **browsertime-tp6m-live-fenix-youtube-nofis**
20833         - ❌
20834         - ❌
20835         - ❌
20836         - ❌
20837       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
20838         - ❌
20839         - ❌
20840         - ❌
20841         - ❌
20842       * - **browsertime-tp6m-refbrow-youtube**
20843         - ❌
20844         - ❌
20845         - ❌
20846         - ❌
20847
20848
20849    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
20850       :widths: 30 15 15 15 15
20851       :header-rows: 1
20852
20853       * - **Test Name**
20854         - mozilla-central
20855         - autoland
20856         - mozilla-release
20857         - mozilla-beta
20858       * - **browsertime-tp6-firefox-youtube**
20859         - ❌
20860         - ❌
20861         - ❌
20862         - ❌
20863       * - **browsertime-tp6-live-firefox-youtube**
20864         - ❌
20865         - ❌
20866         - ❌
20867         - ❌
20868
20869
20870    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
20871       :widths: 30 15 15 15 15
20872       :header-rows: 1
20873
20874       * - **Test Name**
20875         - mozilla-central
20876         - autoland
20877         - mozilla-release
20878         - mozilla-beta
20879       * - **browsertime-tp6-firefox-youtube**
20880         - ❌
20881         - ❌
20882         - ❌
20883         - ❌
20884       * - **browsertime-tp6-live-firefox-youtube**
20885         - ❌
20886         - ❌
20887         - ❌
20888         - ❌
20889
20890
20891    .. list-table:: **test-linux1804-64-qr/opt**
20892       :widths: 30 15 15 15 15
20893       :header-rows: 1
20894
20895       * - **Test Name**
20896         - mozilla-central
20897         - autoland
20898         - mozilla-release
20899         - mozilla-beta
20900       * - **browsertime-tp6-firefox-youtube**
20901         - ❌
20902         - ❌
20903         - ❌
20904         - ❌
20905       * - **browsertime-tp6-live-firefox-youtube**
20906         - ❌
20907         - ❌
20908         - ❌
20909         - ❌
20910
20911
20912    .. list-table:: **test-linux1804-64-shippable-qr/opt**
20913       :widths: 30 15 15 15 15
20914       :header-rows: 1
20915
20916       * - **Test Name**
20917         - mozilla-central
20918         - autoland
20919         - mozilla-release
20920         - mozilla-beta
20921       * - **browsertime-tp6-chrome-youtube**
20922         - ❌
20923         - ❌
20924         - ❌
20925         - ❌
20926       * - **browsertime-tp6-chromium-youtube**
20927         - ❌
20928         - ❌
20929         - ❌
20930         - ❌
20931       * - **browsertime-tp6-firefox-youtube**
20932         - ✅
20933         - ✅
20934         - ✅
20935         - ✅
20936       * - **browsertime-tp6-live-chrome-youtube**
20937         - ❌
20938         - ❌
20939         - ❌
20940         - ❌
20941       * - **browsertime-tp6-live-chromium-youtube**
20942         - ❌
20943         - ❌
20944         - ❌
20945         - ❌
20946       * - **browsertime-tp6-live-firefox-youtube**
20947         - ❌
20948         - ❌
20949         - ❌
20950         - ❌
20951
20952
20953    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
20954       :widths: 30 15 15 15 15
20955       :header-rows: 1
20956
20957       * - **Test Name**
20958         - mozilla-central
20959         - autoland
20960         - mozilla-release
20961         - mozilla-beta
20962       * - **browsertime-tp6-firefox-youtube**
20963         - ❌
20964         - ❌
20965         - ❌
20966         - ❌
20967       * - **browsertime-tp6-live-firefox-youtube**
20968         - ❌
20969         - ❌
20970         - ❌
20971         - ❌
20972
20973
20974    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
20975       :widths: 30 15 15 15 15
20976       :header-rows: 1
20977
20978       * - **Test Name**
20979         - mozilla-central
20980         - autoland
20981         - mozilla-release
20982         - mozilla-beta
20983       * - **browsertime-tp6-chrome-youtube**
20984         - ❌
20985         - ❌
20986         - ❌
20987         - ❌
20988       * - **browsertime-tp6-chromium-youtube**
20989         - ❌
20990         - ❌
20991         - ❌
20992         - ❌
20993       * - **browsertime-tp6-firefox-youtube**
20994         - ✅
20995         - ✅
20996         - ✅
20997         - ✅
20998       * - **browsertime-tp6-live-chrome-youtube**
20999         - ❌
21000         - ❌
21001         - ❌
21002         - ❌
21003       * - **browsertime-tp6-live-chromium-youtube**
21004         - ❌
21005         - ❌
21006         - ❌
21007         - ❌
21008       * - **browsertime-tp6-live-firefox-youtube**
21009         - ❌
21010         - ❌
21011         - ❌
21012         - ❌
21013       * - **browsertime-tp6-live-safari-youtube**
21014         - ❌
21015         - ❌
21016         - ❌
21017         - ❌
21018
21019
21020    .. list-table:: **test-windows10-32-qr/opt**
21021       :widths: 30 15 15 15 15
21022       :header-rows: 1
21023
21024       * - **Test Name**
21025         - mozilla-central
21026         - autoland
21027         - mozilla-release
21028         - mozilla-beta
21029       * - **browsertime-tp6-firefox-youtube**
21030         - ❌
21031         - ❌
21032         - ❌
21033         - ❌
21034       * - **browsertime-tp6-live-firefox-youtube**
21035         - ❌
21036         - ❌
21037         - ❌
21038         - ❌
21039
21040
21041    .. list-table:: **test-windows10-32-shippable-qr/opt**
21042       :widths: 30 15 15 15 15
21043       :header-rows: 1
21044
21045       * - **Test Name**
21046         - mozilla-central
21047         - autoland
21048         - mozilla-release
21049         - mozilla-beta
21050       * - **browsertime-tp6-chrome-youtube**
21051         - ❌
21052         - ❌
21053         - ❌
21054         - ❌
21055       * - **browsertime-tp6-chromium-youtube**
21056         - ❌
21057         - ❌
21058         - ❌
21059         - ❌
21060       * - **browsertime-tp6-firefox-youtube**
21061         - ❌
21062         - ❌
21063         - ❌
21064         - ❌
21065       * - **browsertime-tp6-live-chrome-youtube**
21066         - ❌
21067         - ❌
21068         - ❌
21069         - ❌
21070       * - **browsertime-tp6-live-chromium-youtube**
21071         - ❌
21072         - ❌
21073         - ❌
21074         - ❌
21075       * - **browsertime-tp6-live-firefox-youtube**
21076         - ❌
21077         - ❌
21078         - ❌
21079         - ❌
21080
21081
21082    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
21083       :widths: 30 15 15 15 15
21084       :header-rows: 1
21085
21086       * - **Test Name**
21087         - mozilla-central
21088         - autoland
21089         - mozilla-release
21090         - mozilla-beta
21091       * - **browsertime-tp6-firefox-youtube**
21092         - ❌
21093         - ❌
21094         - ❌
21095         - ❌
21096       * - **browsertime-tp6-live-firefox-youtube**
21097         - ❌
21098         - ❌
21099         - ❌
21100         - ❌
21101
21102
21103    .. list-table:: **test-windows10-64-qr/opt**
21104       :widths: 30 15 15 15 15
21105       :header-rows: 1
21106
21107       * - **Test Name**
21108         - mozilla-central
21109         - autoland
21110         - mozilla-release
21111         - mozilla-beta
21112       * - **browsertime-tp6-firefox-youtube**
21113         - ❌
21114         - ❌
21115         - ❌
21116         - ❌
21117       * - **browsertime-tp6-live-firefox-youtube**
21118         - ❌
21119         - ❌
21120         - ❌
21121         - ❌
21122
21123
21124    .. list-table:: **test-windows10-64-shippable-qr/opt**
21125       :widths: 30 15 15 15 15
21126       :header-rows: 1
21127
21128       * - **Test Name**
21129         - mozilla-central
21130         - autoland
21131         - mozilla-release
21132         - mozilla-beta
21133       * - **browsertime-tp6-chrome-youtube**
21134         - ❌
21135         - ❌
21136         - ❌
21137         - ❌
21138       * - **browsertime-tp6-chromium-youtube**
21139         - ❌
21140         - ❌
21141         - ❌
21142         - ❌
21143       * - **browsertime-tp6-firefox-youtube**
21144         - ✅
21145         - ✅
21146         - ✅
21147         - ✅
21148       * - **browsertime-tp6-live-chrome-youtube**
21149         - ❌
21150         - ❌
21151         - ❌
21152         - ❌
21153       * - **browsertime-tp6-live-chromium-youtube**
21154         - ❌
21155         - ❌
21156         - ❌
21157         - ❌
21158       * - **browsertime-tp6-live-firefox-youtube**
21159         - ❌
21160         - ❌
21161         - ❌
21162         - ❌
21163
21164
21165
21166
21167 Interactive
21168 -----------
21169 Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. These form of tests allow the specification of browsertime commands through the test manifest.
21170
21171 .. dropdown:: cnn-nav
21172    :class-container: anchor-id-cnn-nav-i
21173
21174    **Owner**: PerfTest Team
21175
21176    * **accept zero vismet**: true
21177    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
21178    * **alert threshold**: 2.0
21179    * **apps**: firefox, chrome, chromium, safari
21180    * **browser cycles**: 10
21181    * **expected**: pass
21182    * **gecko profile entries**: 14000000
21183    * **gecko profile interval**: 1
21184    * **interactive**: true
21185    * **lower is better**: true
21186    * **page cycles**: 25
21187    * **page timeout**: 60000
21188    * **playback**: mitmproxy
21189    * **playback pageset manifest**: mitm7-linux-firefox-cnn-nav.manifest
21190    * **playback version**: 8.1.1
21191    * **test cmds**:  ["measure.start", "landing"], ["navigate", "https://www.cnn.com"], ["wait.byTime", 4000], ["measure.stop", ""], ["measure.start", "world"], ["click.byXpathAndWait", "/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a"], ["wait.byTime", 1000], ["measure.stop", ""],
21192    * **test url**: `<https://www.cnn.com/>`__
21193    * **type**: pageload
21194    * **unit**: ms
21195    * **use live sites**: false
21196    * **Test Task**:
21197
21198    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21199       :widths: 30 15 15 15 15
21200       :header-rows: 1
21201
21202       * - **Test Name**
21203         - mozilla-central
21204         - autoland
21205         - mozilla-release
21206         - mozilla-beta
21207       * - **browsertime-responsiveness-firefox-cnn-nav**
21208         - ❌
21209         - ❌
21210         - ❌
21211         - ❌
21212
21213
21214    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
21215       :widths: 30 15 15 15 15
21216       :header-rows: 1
21217
21218       * - **Test Name**
21219         - mozilla-central
21220         - autoland
21221         - mozilla-release
21222         - mozilla-beta
21223       * - **browsertime-responsiveness-firefox-cnn-nav**
21224         - ❌
21225         - ❌
21226         - ❌
21227         - ❌
21228
21229
21230    .. list-table:: **test-linux1804-64-qr/opt**
21231       :widths: 30 15 15 15 15
21232       :header-rows: 1
21233
21234       * - **Test Name**
21235         - mozilla-central
21236         - autoland
21237         - mozilla-release
21238         - mozilla-beta
21239       * - **browsertime-responsiveness-firefox-cnn-nav**
21240         - ❌
21241         - ❌
21242         - ❌
21243         - ❌
21244
21245
21246    .. list-table:: **test-linux1804-64-shippable-qr/opt**
21247       :widths: 30 15 15 15 15
21248       :header-rows: 1
21249
21250       * - **Test Name**
21251         - mozilla-central
21252         - autoland
21253         - mozilla-release
21254         - mozilla-beta
21255       * - **browsertime-responsiveness-chrome-cnn-nav**
21256         - ❌
21257         - ❌
21258         - ❌
21259         - ❌
21260       * - **browsertime-responsiveness-chromium-cnn-nav**
21261         - ❌
21262         - ❌
21263         - ❌
21264         - ❌
21265       * - **browsertime-responsiveness-firefox-cnn-nav**
21266         - ✅
21267         - ✅
21268         - ❌
21269         - ❌
21270
21271
21272    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
21273       :widths: 30 15 15 15 15
21274       :header-rows: 1
21275
21276       * - **Test Name**
21277         - mozilla-central
21278         - autoland
21279         - mozilla-release
21280         - mozilla-beta
21281       * - **browsertime-responsiveness-firefox-cnn-nav**
21282         - ❌
21283         - ❌
21284         - ❌
21285         - ❌
21286
21287
21288    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
21289       :widths: 30 15 15 15 15
21290       :header-rows: 1
21291
21292       * - **Test Name**
21293         - mozilla-central
21294         - autoland
21295         - mozilla-release
21296         - mozilla-beta
21297       * - **browsertime-responsiveness-chrome-cnn-nav**
21298         - ❌
21299         - ❌
21300         - ❌
21301         - ❌
21302       * - **browsertime-responsiveness-chromium-cnn-nav**
21303         - ❌
21304         - ❌
21305         - ❌
21306         - ❌
21307       * - **browsertime-responsiveness-firefox-cnn-nav**
21308         - ✅
21309         - ✅
21310         - ❌
21311         - ❌
21312
21313
21314    .. list-table:: **test-windows10-32-qr/opt**
21315       :widths: 30 15 15 15 15
21316       :header-rows: 1
21317
21318       * - **Test Name**
21319         - mozilla-central
21320         - autoland
21321         - mozilla-release
21322         - mozilla-beta
21323       * - **browsertime-responsiveness-firefox-cnn-nav**
21324         - ❌
21325         - ❌
21326         - ❌
21327         - ❌
21328
21329
21330    .. list-table:: **test-windows10-32-shippable-qr/opt**
21331       :widths: 30 15 15 15 15
21332       :header-rows: 1
21333
21334       * - **Test Name**
21335         - mozilla-central
21336         - autoland
21337         - mozilla-release
21338         - mozilla-beta
21339       * - **browsertime-responsiveness-chrome-cnn-nav**
21340         - ❌
21341         - ❌
21342         - ❌
21343         - ❌
21344       * - **browsertime-responsiveness-chromium-cnn-nav**
21345         - ❌
21346         - ❌
21347         - ❌
21348         - ❌
21349       * - **browsertime-responsiveness-firefox-cnn-nav**
21350         - ❌
21351         - ❌
21352         - ❌
21353         - ❌
21354
21355
21356    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
21357       :widths: 30 15 15 15 15
21358       :header-rows: 1
21359
21360       * - **Test Name**
21361         - mozilla-central
21362         - autoland
21363         - mozilla-release
21364         - mozilla-beta
21365       * - **browsertime-responsiveness-firefox-cnn-nav**
21366         - ❌
21367         - ❌
21368         - ❌
21369         - ❌
21370
21371
21372    .. list-table:: **test-windows10-64-qr/opt**
21373       :widths: 30 15 15 15 15
21374       :header-rows: 1
21375
21376       * - **Test Name**
21377         - mozilla-central
21378         - autoland
21379         - mozilla-release
21380         - mozilla-beta
21381       * - **browsertime-responsiveness-firefox-cnn-nav**
21382         - ❌
21383         - ❌
21384         - ❌
21385         - ❌
21386
21387
21388    .. list-table:: **test-windows10-64-shippable-qr/opt**
21389       :widths: 30 15 15 15 15
21390       :header-rows: 1
21391
21392       * - **Test Name**
21393         - mozilla-central
21394         - autoland
21395         - mozilla-release
21396         - mozilla-beta
21397       * - **browsertime-responsiveness-chrome-cnn-nav**
21398         - ❌
21399         - ❌
21400         - ❌
21401         - ❌
21402       * - **browsertime-responsiveness-chromium-cnn-nav**
21403         - ❌
21404         - ❌
21405         - ❌
21406         - ❌
21407       * - **browsertime-responsiveness-firefox-cnn-nav**
21408         - ✅
21409         - ✅
21410         - ❌
21411         - ❌
21412
21413
21414
21415 .. dropdown:: facebook-nav
21416    :class-container: anchor-id-facebook-nav-i
21417
21418    **Owner**: PerfTest Team
21419
21420    * **accept zero vismet**: true
21421    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
21422    * **alert threshold**: 2.0
21423    * **apps**: firefox, chrome, chromium, safari
21424    * **browser cycles**: 10
21425    * **expected**: pass
21426    * **gecko profile entries**: 14000000
21427    * **gecko profile interval**: 1
21428    * **interactive**: true
21429    * **lower is better**: true
21430    * **page cycles**: 25
21431    * **page timeout**: 90000
21432    * **playback**: mitmproxy
21433    * **playback pageset manifest**: mitm6-windows-firefox-facebook-nav.manifest
21434    * **playback version**: 8.1.1
21435    * **test cmds**:  ["measure.start", "landing"], ["navigate", "https://www.facebook.com/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "marketplace"], ["navigate", "https://www.facebook.com/marketplace"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "groups"], ["navigate", "https://www.facebook.com/groups/discover/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "friends"], ["navigate", "https://www.facebook.com/friends/"], ["wait.byTime", 5000], ["measure.stop", ""],
21436    * **test url**: `<https://www.facebook.com>`__
21437    * **type**: pageload
21438    * **unit**: ms
21439    * **use live sites**: false
21440    * **Test Task**:
21441
21442    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21443       :widths: 30 15 15 15 15
21444       :header-rows: 1
21445
21446       * - **Test Name**
21447         - mozilla-central
21448         - autoland
21449         - mozilla-release
21450         - mozilla-beta
21451       * - **browsertime-responsiveness-firefox-facebook-nav**
21452         - ❌
21453         - ❌
21454         - ❌
21455         - ❌
21456
21457
21458    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
21459       :widths: 30 15 15 15 15
21460       :header-rows: 1
21461
21462       * - **Test Name**
21463         - mozilla-central
21464         - autoland
21465         - mozilla-release
21466         - mozilla-beta
21467       * - **browsertime-responsiveness-firefox-facebook-nav**
21468         - ❌
21469         - ❌
21470         - ❌
21471         - ❌
21472
21473
21474    .. list-table:: **test-linux1804-64-qr/opt**
21475       :widths: 30 15 15 15 15
21476       :header-rows: 1
21477
21478       * - **Test Name**
21479         - mozilla-central
21480         - autoland
21481         - mozilla-release
21482         - mozilla-beta
21483       * - **browsertime-responsiveness-firefox-facebook-nav**
21484         - ❌
21485         - ❌
21486         - ❌
21487         - ❌
21488
21489
21490    .. list-table:: **test-linux1804-64-shippable-qr/opt**
21491       :widths: 30 15 15 15 15
21492       :header-rows: 1
21493
21494       * - **Test Name**
21495         - mozilla-central
21496         - autoland
21497         - mozilla-release
21498         - mozilla-beta
21499       * - **browsertime-responsiveness-chrome-facebook-nav**
21500         - ❌
21501         - ❌
21502         - ❌
21503         - ❌
21504       * - **browsertime-responsiveness-chromium-facebook-nav**
21505         - ❌
21506         - ❌
21507         - ❌
21508         - ❌
21509       * - **browsertime-responsiveness-firefox-facebook-nav**
21510         - ✅
21511         - ✅
21512         - ❌
21513         - ❌
21514
21515
21516    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
21517       :widths: 30 15 15 15 15
21518       :header-rows: 1
21519
21520       * - **Test Name**
21521         - mozilla-central
21522         - autoland
21523         - mozilla-release
21524         - mozilla-beta
21525       * - **browsertime-responsiveness-firefox-facebook-nav**
21526         - ❌
21527         - ❌
21528         - ❌
21529         - ❌
21530
21531
21532    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
21533       :widths: 30 15 15 15 15
21534       :header-rows: 1
21535
21536       * - **Test Name**
21537         - mozilla-central
21538         - autoland
21539         - mozilla-release
21540         - mozilla-beta
21541       * - **browsertime-responsiveness-chrome-facebook-nav**
21542         - ❌
21543         - ❌
21544         - ❌
21545         - ❌
21546       * - **browsertime-responsiveness-chromium-facebook-nav**
21547         - ❌
21548         - ❌
21549         - ❌
21550         - ❌
21551       * - **browsertime-responsiveness-firefox-facebook-nav**
21552         - ✅
21553         - ✅
21554         - ❌
21555         - ❌
21556
21557
21558    .. list-table:: **test-windows10-32-qr/opt**
21559       :widths: 30 15 15 15 15
21560       :header-rows: 1
21561
21562       * - **Test Name**
21563         - mozilla-central
21564         - autoland
21565         - mozilla-release
21566         - mozilla-beta
21567       * - **browsertime-responsiveness-firefox-facebook-nav**
21568         - ❌
21569         - ❌
21570         - ❌
21571         - ❌
21572
21573
21574    .. list-table:: **test-windows10-32-shippable-qr/opt**
21575       :widths: 30 15 15 15 15
21576       :header-rows: 1
21577
21578       * - **Test Name**
21579         - mozilla-central
21580         - autoland
21581         - mozilla-release
21582         - mozilla-beta
21583       * - **browsertime-responsiveness-chrome-facebook-nav**
21584         - ❌
21585         - ❌
21586         - ❌
21587         - ❌
21588       * - **browsertime-responsiveness-chromium-facebook-nav**
21589         - ❌
21590         - ❌
21591         - ❌
21592         - ❌
21593       * - **browsertime-responsiveness-firefox-facebook-nav**
21594         - ❌
21595         - ❌
21596         - ❌
21597         - ❌
21598
21599
21600    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
21601       :widths: 30 15 15 15 15
21602       :header-rows: 1
21603
21604       * - **Test Name**
21605         - mozilla-central
21606         - autoland
21607         - mozilla-release
21608         - mozilla-beta
21609       * - **browsertime-responsiveness-firefox-facebook-nav**
21610         - ❌
21611         - ❌
21612         - ❌
21613         - ❌
21614
21615
21616    .. list-table:: **test-windows10-64-qr/opt**
21617       :widths: 30 15 15 15 15
21618       :header-rows: 1
21619
21620       * - **Test Name**
21621         - mozilla-central
21622         - autoland
21623         - mozilla-release
21624         - mozilla-beta
21625       * - **browsertime-responsiveness-firefox-facebook-nav**
21626         - ❌
21627         - ❌
21628         - ❌
21629         - ❌
21630
21631
21632    .. list-table:: **test-windows10-64-shippable-qr/opt**
21633       :widths: 30 15 15 15 15
21634       :header-rows: 1
21635
21636       * - **Test Name**
21637         - mozilla-central
21638         - autoland
21639         - mozilla-release
21640         - mozilla-beta
21641       * - **browsertime-responsiveness-chrome-facebook-nav**
21642         - ❌
21643         - ❌
21644         - ❌
21645         - ❌
21646       * - **browsertime-responsiveness-chromium-facebook-nav**
21647         - ❌
21648         - ❌
21649         - ❌
21650         - ❌
21651       * - **browsertime-responsiveness-firefox-facebook-nav**
21652         - ✅
21653         - ✅
21654         - ❌
21655         - ❌
21656
21657
21658
21659 .. dropdown:: reddit-billgates-ama
21660    :class-container: anchor-id-reddit-billgates-ama-i
21661
21662    **Owner**: PerfTest Team
21663
21664    * **accept zero vismet**: true
21665    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
21666    * **alert threshold**: 2.0
21667    * **apps**: firefox, chrome, chromium, safari
21668    * **browser cycles**: 10
21669    * **expected**: pass
21670    * **gecko profile entries**: 14000000
21671    * **gecko profile interval**: 1
21672    * **interactive**: true
21673    * **lower is better**: true
21674    * **page cycles**: 25
21675    * **page timeout**: 240000
21676    * **playback**: mitmproxy
21677    * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-ama.manifest
21678    * **playback version**: 8.1.1
21679    * **test cmds**:  ["measure.start", "billg-ama"], ["navigate", "https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "members"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div"], ["wait.byTime", 1000], ["measure.stop", ""],
21680    * **test url**: `<https://www.reddit.com/>`__
21681    * **type**: pageload
21682    * **unit**: ms
21683    * **use live sites**: false
21684    * **Test Task**:
21685
21686    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21687       :widths: 30 15 15 15 15
21688       :header-rows: 1
21689
21690       * - **Test Name**
21691         - mozilla-central
21692         - autoland
21693         - mozilla-release
21694         - mozilla-beta
21695       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21696         - ❌
21697         - ❌
21698         - ❌
21699         - ❌
21700
21701
21702    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
21703       :widths: 30 15 15 15 15
21704       :header-rows: 1
21705
21706       * - **Test Name**
21707         - mozilla-central
21708         - autoland
21709         - mozilla-release
21710         - mozilla-beta
21711       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21712         - ❌
21713         - ❌
21714         - ❌
21715         - ❌
21716
21717
21718    .. list-table:: **test-linux1804-64-qr/opt**
21719       :widths: 30 15 15 15 15
21720       :header-rows: 1
21721
21722       * - **Test Name**
21723         - mozilla-central
21724         - autoland
21725         - mozilla-release
21726         - mozilla-beta
21727       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21728         - ❌
21729         - ❌
21730         - ❌
21731         - ❌
21732
21733
21734    .. list-table:: **test-linux1804-64-shippable-qr/opt**
21735       :widths: 30 15 15 15 15
21736       :header-rows: 1
21737
21738       * - **Test Name**
21739         - mozilla-central
21740         - autoland
21741         - mozilla-release
21742         - mozilla-beta
21743       * - **browsertime-responsiveness-chrome-reddit-billgates-ama**
21744         - ❌
21745         - ❌
21746         - ❌
21747         - ❌
21748       * - **browsertime-responsiveness-chromium-reddit-billgates-ama**
21749         - ❌
21750         - ❌
21751         - ❌
21752         - ❌
21753       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21754         - ✅
21755         - ✅
21756         - ❌
21757         - ❌
21758
21759
21760    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
21761       :widths: 30 15 15 15 15
21762       :header-rows: 1
21763
21764       * - **Test Name**
21765         - mozilla-central
21766         - autoland
21767         - mozilla-release
21768         - mozilla-beta
21769       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21770         - ❌
21771         - ❌
21772         - ❌
21773         - ❌
21774
21775
21776    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
21777       :widths: 30 15 15 15 15
21778       :header-rows: 1
21779
21780       * - **Test Name**
21781         - mozilla-central
21782         - autoland
21783         - mozilla-release
21784         - mozilla-beta
21785       * - **browsertime-responsiveness-chrome-reddit-billgates-ama**
21786         - ❌
21787         - ❌
21788         - ❌
21789         - ❌
21790       * - **browsertime-responsiveness-chromium-reddit-billgates-ama**
21791         - ❌
21792         - ❌
21793         - ❌
21794         - ❌
21795       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21796         - ✅
21797         - ✅
21798         - ❌
21799         - ❌
21800
21801
21802    .. list-table:: **test-windows10-32-qr/opt**
21803       :widths: 30 15 15 15 15
21804       :header-rows: 1
21805
21806       * - **Test Name**
21807         - mozilla-central
21808         - autoland
21809         - mozilla-release
21810         - mozilla-beta
21811       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21812         - ❌
21813         - ❌
21814         - ❌
21815         - ❌
21816
21817
21818    .. list-table:: **test-windows10-32-shippable-qr/opt**
21819       :widths: 30 15 15 15 15
21820       :header-rows: 1
21821
21822       * - **Test Name**
21823         - mozilla-central
21824         - autoland
21825         - mozilla-release
21826         - mozilla-beta
21827       * - **browsertime-responsiveness-chrome-reddit-billgates-ama**
21828         - ❌
21829         - ❌
21830         - ❌
21831         - ❌
21832       * - **browsertime-responsiveness-chromium-reddit-billgates-ama**
21833         - ❌
21834         - ❌
21835         - ❌
21836         - ❌
21837       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21838         - ❌
21839         - ❌
21840         - ❌
21841         - ❌
21842
21843
21844    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
21845       :widths: 30 15 15 15 15
21846       :header-rows: 1
21847
21848       * - **Test Name**
21849         - mozilla-central
21850         - autoland
21851         - mozilla-release
21852         - mozilla-beta
21853       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21854         - ❌
21855         - ❌
21856         - ❌
21857         - ❌
21858
21859
21860    .. list-table:: **test-windows10-64-qr/opt**
21861       :widths: 30 15 15 15 15
21862       :header-rows: 1
21863
21864       * - **Test Name**
21865         - mozilla-central
21866         - autoland
21867         - mozilla-release
21868         - mozilla-beta
21869       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21870         - ❌
21871         - ❌
21872         - ❌
21873         - ❌
21874
21875
21876    .. list-table:: **test-windows10-64-shippable-qr/opt**
21877       :widths: 30 15 15 15 15
21878       :header-rows: 1
21879
21880       * - **Test Name**
21881         - mozilla-central
21882         - autoland
21883         - mozilla-release
21884         - mozilla-beta
21885       * - **browsertime-responsiveness-chrome-reddit-billgates-ama**
21886         - ❌
21887         - ❌
21888         - ❌
21889         - ❌
21890       * - **browsertime-responsiveness-chromium-reddit-billgates-ama**
21891         - ❌
21892         - ❌
21893         - ❌
21894         - ❌
21895       * - **browsertime-responsiveness-firefox-reddit-billgates-ama**
21896         - ✅
21897         - ✅
21898         - ❌
21899         - ❌
21900
21901
21902
21903 .. dropdown:: reddit-billgates-post-1
21904    :class-container: anchor-id-reddit-billgates-post-1-i
21905
21906    **Owner**: PerfTest Team
21907
21908    * **accept zero vismet**: true
21909    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
21910    * **alert threshold**: 2.0
21911    * **apps**: firefox, chrome, chromium, safari
21912    * **browser cycles**: 10
21913    * **expected**: pass
21914    * **gecko profile entries**: 14000000
21915    * **gecko profile interval**: 1
21916    * **interactive**: true
21917    * **lower is better**: true
21918    * **page cycles**: 25
21919    * **page timeout**: 90000
21920    * **playback**: mitmproxy
21921    * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest
21922    * **playback version**: 8.1.1
21923    * **test cmds**:  ["measure.start", "billg"], ["navigate", "https://www.reddit.com/user/thisisbillgates/"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "posts"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "comments"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]"], ["wait.byTime", 500], ["measure.stop", ""], ["wait.byTime", 500],
21924    * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__
21925    * **type**: pageload
21926    * **unit**: ms
21927    * **use live sites**: false
21928    * **Test Task**:
21929
21930    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21931       :widths: 30 15 15 15 15
21932       :header-rows: 1
21933
21934       * - **Test Name**
21935         - mozilla-central
21936         - autoland
21937         - mozilla-release
21938         - mozilla-beta
21939       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
21940         - ❌
21941         - ❌
21942         - ❌
21943         - ❌
21944
21945
21946    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
21947       :widths: 30 15 15 15 15
21948       :header-rows: 1
21949
21950       * - **Test Name**
21951         - mozilla-central
21952         - autoland
21953         - mozilla-release
21954         - mozilla-beta
21955       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
21956         - ❌
21957         - ❌
21958         - ❌
21959         - ❌
21960
21961
21962    .. list-table:: **test-linux1804-64-qr/opt**
21963       :widths: 30 15 15 15 15
21964       :header-rows: 1
21965
21966       * - **Test Name**
21967         - mozilla-central
21968         - autoland
21969         - mozilla-release
21970         - mozilla-beta
21971       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
21972         - ❌
21973         - ❌
21974         - ❌
21975         - ❌
21976
21977
21978    .. list-table:: **test-linux1804-64-shippable-qr/opt**
21979       :widths: 30 15 15 15 15
21980       :header-rows: 1
21981
21982       * - **Test Name**
21983         - mozilla-central
21984         - autoland
21985         - mozilla-release
21986         - mozilla-beta
21987       * - **browsertime-responsiveness-chrome-reddit-billgates-post-1**
21988         - ❌
21989         - ❌
21990         - ❌
21991         - ❌
21992       * - **browsertime-responsiveness-chromium-reddit-billgates-post-1**
21993         - ❌
21994         - ❌
21995         - ❌
21996         - ❌
21997       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
21998         - ✅
21999         - ✅
22000         - ❌
22001         - ❌
22002
22003
22004    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
22005       :widths: 30 15 15 15 15
22006       :header-rows: 1
22007
22008       * - **Test Name**
22009         - mozilla-central
22010         - autoland
22011         - mozilla-release
22012         - mozilla-beta
22013       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22014         - ❌
22015         - ❌
22016         - ❌
22017         - ❌
22018
22019
22020    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22021       :widths: 30 15 15 15 15
22022       :header-rows: 1
22023
22024       * - **Test Name**
22025         - mozilla-central
22026         - autoland
22027         - mozilla-release
22028         - mozilla-beta
22029       * - **browsertime-responsiveness-chrome-reddit-billgates-post-1**
22030         - ❌
22031         - ❌
22032         - ❌
22033         - ❌
22034       * - **browsertime-responsiveness-chromium-reddit-billgates-post-1**
22035         - ❌
22036         - ❌
22037         - ❌
22038         - ❌
22039       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22040         - ✅
22041         - ✅
22042         - ❌
22043         - ❌
22044
22045
22046    .. list-table:: **test-windows10-32-qr/opt**
22047       :widths: 30 15 15 15 15
22048       :header-rows: 1
22049
22050       * - **Test Name**
22051         - mozilla-central
22052         - autoland
22053         - mozilla-release
22054         - mozilla-beta
22055       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22056         - ❌
22057         - ❌
22058         - ❌
22059         - ❌
22060
22061
22062    .. list-table:: **test-windows10-32-shippable-qr/opt**
22063       :widths: 30 15 15 15 15
22064       :header-rows: 1
22065
22066       * - **Test Name**
22067         - mozilla-central
22068         - autoland
22069         - mozilla-release
22070         - mozilla-beta
22071       * - **browsertime-responsiveness-chrome-reddit-billgates-post-1**
22072         - ❌
22073         - ❌
22074         - ❌
22075         - ❌
22076       * - **browsertime-responsiveness-chromium-reddit-billgates-post-1**
22077         - ❌
22078         - ❌
22079         - ❌
22080         - ❌
22081       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22082         - ❌
22083         - ❌
22084         - ❌
22085         - ❌
22086
22087
22088    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
22089       :widths: 30 15 15 15 15
22090       :header-rows: 1
22091
22092       * - **Test Name**
22093         - mozilla-central
22094         - autoland
22095         - mozilla-release
22096         - mozilla-beta
22097       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22098         - ❌
22099         - ❌
22100         - ❌
22101         - ❌
22102
22103
22104    .. list-table:: **test-windows10-64-qr/opt**
22105       :widths: 30 15 15 15 15
22106       :header-rows: 1
22107
22108       * - **Test Name**
22109         - mozilla-central
22110         - autoland
22111         - mozilla-release
22112         - mozilla-beta
22113       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22114         - ❌
22115         - ❌
22116         - ❌
22117         - ❌
22118
22119
22120    .. list-table:: **test-windows10-64-shippable-qr/opt**
22121       :widths: 30 15 15 15 15
22122       :header-rows: 1
22123
22124       * - **Test Name**
22125         - mozilla-central
22126         - autoland
22127         - mozilla-release
22128         - mozilla-beta
22129       * - **browsertime-responsiveness-chrome-reddit-billgates-post-1**
22130         - ❌
22131         - ❌
22132         - ❌
22133         - ❌
22134       * - **browsertime-responsiveness-chromium-reddit-billgates-post-1**
22135         - ❌
22136         - ❌
22137         - ❌
22138         - ❌
22139       * - **browsertime-responsiveness-firefox-reddit-billgates-post-1**
22140         - ✅
22141         - ✅
22142         - ❌
22143         - ❌
22144
22145
22146
22147 .. dropdown:: reddit-billgates-post-2
22148    :class-container: anchor-id-reddit-billgates-post-2-i
22149
22150    **Owner**: PerfTest Team
22151
22152    * **accept zero vismet**: true
22153    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
22154    * **alert threshold**: 2.0
22155    * **apps**: firefox, chrome, chromium, safari
22156    * **browser cycles**: 10
22157    * **expected**: pass
22158    * **gecko profile entries**: 14000000
22159    * **gecko profile interval**: 1
22160    * **interactive**: true
22161    * **lower is better**: true
22162    * **page cycles**: 25
22163    * **page timeout**: 90000
22164    * **playback**: mitmproxy
22165    * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest
22166    * **playback version**: 8.1.1
22167    * **test cmds**:  ["measure.start", "billg"], ["navigate", "https://www.reddit.com/user/thisisbillgates/"], ["wait.byTime", 500], ["measure.stop", ""], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]"], ["wait.byTime", 500], ["measure.start", "hot"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "top"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]"], ["wait.byTime", 500], ["measure.stop", ""], ["wait.byTime", 500],
22168    * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__
22169    * **type**: pageload
22170    * **unit**: ms
22171    * **use live sites**: false
22172    * **Test Task**:
22173
22174    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
22175       :widths: 30 15 15 15 15
22176       :header-rows: 1
22177
22178       * - **Test Name**
22179         - mozilla-central
22180         - autoland
22181         - mozilla-release
22182         - mozilla-beta
22183       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22184         - ❌
22185         - ❌
22186         - ❌
22187         - ❌
22188
22189
22190    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
22191       :widths: 30 15 15 15 15
22192       :header-rows: 1
22193
22194       * - **Test Name**
22195         - mozilla-central
22196         - autoland
22197         - mozilla-release
22198         - mozilla-beta
22199       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22200         - ❌
22201         - ❌
22202         - ❌
22203         - ❌
22204
22205
22206    .. list-table:: **test-linux1804-64-qr/opt**
22207       :widths: 30 15 15 15 15
22208       :header-rows: 1
22209
22210       * - **Test Name**
22211         - mozilla-central
22212         - autoland
22213         - mozilla-release
22214         - mozilla-beta
22215       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22216         - ❌
22217         - ❌
22218         - ❌
22219         - ❌
22220
22221
22222    .. list-table:: **test-linux1804-64-shippable-qr/opt**
22223       :widths: 30 15 15 15 15
22224       :header-rows: 1
22225
22226       * - **Test Name**
22227         - mozilla-central
22228         - autoland
22229         - mozilla-release
22230         - mozilla-beta
22231       * - **browsertime-responsiveness-chrome-reddit-billgates-post-2**
22232         - ❌
22233         - ❌
22234         - ❌
22235         - ❌
22236       * - **browsertime-responsiveness-chromium-reddit-billgates-post-2**
22237         - ❌
22238         - ❌
22239         - ❌
22240         - ❌
22241       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22242         - ✅
22243         - ✅
22244         - ❌
22245         - ❌
22246
22247
22248    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
22249       :widths: 30 15 15 15 15
22250       :header-rows: 1
22251
22252       * - **Test Name**
22253         - mozilla-central
22254         - autoland
22255         - mozilla-release
22256         - mozilla-beta
22257       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22258         - ❌
22259         - ❌
22260         - ❌
22261         - ❌
22262
22263
22264    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22265       :widths: 30 15 15 15 15
22266       :header-rows: 1
22267
22268       * - **Test Name**
22269         - mozilla-central
22270         - autoland
22271         - mozilla-release
22272         - mozilla-beta
22273       * - **browsertime-responsiveness-chrome-reddit-billgates-post-2**
22274         - ❌
22275         - ❌
22276         - ❌
22277         - ❌
22278       * - **browsertime-responsiveness-chromium-reddit-billgates-post-2**
22279         - ❌
22280         - ❌
22281         - ❌
22282         - ❌
22283       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22284         - ✅
22285         - ✅
22286         - ❌
22287         - ❌
22288
22289
22290    .. list-table:: **test-windows10-32-qr/opt**
22291       :widths: 30 15 15 15 15
22292       :header-rows: 1
22293
22294       * - **Test Name**
22295         - mozilla-central
22296         - autoland
22297         - mozilla-release
22298         - mozilla-beta
22299       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22300         - ❌
22301         - ❌
22302         - ❌
22303         - ❌
22304
22305
22306    .. list-table:: **test-windows10-32-shippable-qr/opt**
22307       :widths: 30 15 15 15 15
22308       :header-rows: 1
22309
22310       * - **Test Name**
22311         - mozilla-central
22312         - autoland
22313         - mozilla-release
22314         - mozilla-beta
22315       * - **browsertime-responsiveness-chrome-reddit-billgates-post-2**
22316         - ❌
22317         - ❌
22318         - ❌
22319         - ❌
22320       * - **browsertime-responsiveness-chromium-reddit-billgates-post-2**
22321         - ❌
22322         - ❌
22323         - ❌
22324         - ❌
22325       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22326         - ❌
22327         - ❌
22328         - ❌
22329         - ❌
22330
22331
22332    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
22333       :widths: 30 15 15 15 15
22334       :header-rows: 1
22335
22336       * - **Test Name**
22337         - mozilla-central
22338         - autoland
22339         - mozilla-release
22340         - mozilla-beta
22341       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22342         - ❌
22343         - ❌
22344         - ❌
22345         - ❌
22346
22347
22348    .. list-table:: **test-windows10-64-qr/opt**
22349       :widths: 30 15 15 15 15
22350       :header-rows: 1
22351
22352       * - **Test Name**
22353         - mozilla-central
22354         - autoland
22355         - mozilla-release
22356         - mozilla-beta
22357       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22358         - ❌
22359         - ❌
22360         - ❌
22361         - ❌
22362
22363
22364    .. list-table:: **test-windows10-64-shippable-qr/opt**
22365       :widths: 30 15 15 15 15
22366       :header-rows: 1
22367
22368       * - **Test Name**
22369         - mozilla-central
22370         - autoland
22371         - mozilla-release
22372         - mozilla-beta
22373       * - **browsertime-responsiveness-chrome-reddit-billgates-post-2**
22374         - ❌
22375         - ❌
22376         - ❌
22377         - ❌
22378       * - **browsertime-responsiveness-chromium-reddit-billgates-post-2**
22379         - ❌
22380         - ❌
22381         - ❌
22382         - ❌
22383       * - **browsertime-responsiveness-firefox-reddit-billgates-post-2**
22384         - ✅
22385         - ✅
22386         - ❌
22387         - ❌
22388
22389
22390
22391
22392 Live
22393 ----
22394 A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.
22395
22396 .. dropdown:: booking-sf
22397    :class-container: anchor-id-booking-sf-l
22398
22399    **Owner**: PerfTest Team
22400
22401    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
22402    * **alert threshold**: 2.0
22403    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
22404    * **browser cycles**: 15
22405    * **expected**: pass
22406    * **lower is better**: true
22407    * **page cycles**: 25
22408    * **page timeout**: 60000
22409    * **test url**: `<https://www.booking.com/hotel/us/edwardian-san-francisco.html>`__
22410    * **type**: pageload
22411    * **unit**: ms
22412    * **use live sites**: true
22413    * **Test Task**:
22414
22415    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
22416       :widths: 30 15 15 15 15
22417       :header-rows: 1
22418
22419       * - **Test Name**
22420         - mozilla-central
22421         - autoland
22422         - mozilla-release
22423         - mozilla-beta
22424       * - **browsertime-tp6m-live-fenix-booking-sf-nofis**
22425         - ❌
22426         - ❌
22427         - ❌
22428         - ❌
22429       * - **browsertime-tp6m-live-geckoview-booking-sf-nofis**
22430         - ❌
22431         - ❌
22432         - ❌
22433         - ❌
22434
22435
22436    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
22437       :widths: 30 15 15 15 15
22438       :header-rows: 1
22439
22440       * - **Test Name**
22441         - mozilla-central
22442         - autoland
22443         - mozilla-release
22444         - mozilla-beta
22445       * - **browsertime-tp6m-live-chrome-m-booking-sf-nofis**
22446         - ❌
22447         - ❌
22448         - ❌
22449         - ❌
22450       * - **browsertime-tp6m-live-fenix-booking-sf-nofis**
22451         - ❌
22452         - ❌
22453         - ❌
22454         - ❌
22455       * - **browsertime-tp6m-live-geckoview-booking-sf-nofis**
22456         - ❌
22457         - ❌
22458         - ❌
22459         - ❌
22460
22461
22462
22463 .. dropdown:: cnn
22464    :class-container: anchor-id-cnn-l
22465
22466    **Owner**: PerfTest Team
22467
22468    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
22469    * **alert threshold**: 2.0
22470    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
22471    * **browser cycles**: 15
22472    * **expected**: pass
22473    * **lower is better**: true
22474    * **page cycles**: 25
22475    * **page timeout**: 60000
22476    * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
22477    * **type**: pageload
22478    * **unit**: ms
22479    * **use live sites**: true
22480    * **Test Task**:
22481
22482    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
22483       :widths: 30 15 15 15 15
22484       :header-rows: 1
22485
22486       * - **Test Name**
22487         - mozilla-central
22488         - autoland
22489         - mozilla-release
22490         - mozilla-beta
22491       * - **browsertime-tp6m-fenix-cnn**
22492         - ❌
22493         - ❌
22494         - ❌
22495         - ❌
22496       * - **browsertime-tp6m-fenix-cnn-nofis**
22497         - ❌
22498         - ❌
22499         - ❌
22500         - ❌
22501       * - **browsertime-tp6m-geckoview-cnn**
22502         - ❌
22503         - ❌
22504         - ❌
22505         - ❌
22506       * - **browsertime-tp6m-geckoview-cnn-nofis**
22507         - ❌
22508         - ❌
22509         - ❌
22510         - ❌
22511       * - **browsertime-tp6m-live-fenix-cnn-nofis**
22512         - ❌
22513         - ❌
22514         - ❌
22515         - ❌
22516       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
22517         - ❌
22518         - ❌
22519         - ❌
22520         - ❌
22521       * - **browsertime-tp6m-refbrow-cnn**
22522         - ❌
22523         - ❌
22524         - ❌
22525         - ❌
22526
22527
22528    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
22529       :widths: 30 15 15 15 15
22530       :header-rows: 1
22531
22532       * - **Test Name**
22533         - mozilla-central
22534         - autoland
22535         - mozilla-release
22536         - mozilla-beta
22537       * - **browsertime-tp6m-chrome-m-cnn**
22538         - ❌
22539         - ❌
22540         - ❌
22541         - ❌
22542       * - **browsertime-tp6m-chrome-m-cnn-nofis**
22543         - ❌
22544         - ❌
22545         - ❌
22546         - ❌
22547       * - **browsertime-tp6m-fenix-cnn**
22548         - ❌
22549         - ❌
22550         - ❌
22551         - ❌
22552       * - **browsertime-tp6m-fenix-cnn-nofis**
22553         - ❌
22554         - ❌
22555         - ❌
22556         - ❌
22557       * - **browsertime-tp6m-geckoview-cnn**
22558         - ❌
22559         - ❌
22560         - ❌
22561         - ❌
22562       * - **browsertime-tp6m-geckoview-cnn-nofis**
22563         - ✅
22564         - ✅
22565         - ❌
22566         - ❌
22567       * - **browsertime-tp6m-live-chrome-m-cnn-nofis**
22568         - ❌
22569         - ❌
22570         - ❌
22571         - ❌
22572       * - **browsertime-tp6m-live-fenix-cnn-nofis**
22573         - ❌
22574         - ❌
22575         - ❌
22576         - ❌
22577       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
22578         - ❌
22579         - ❌
22580         - ❌
22581         - ❌
22582       * - **browsertime-tp6m-refbrow-cnn**
22583         - ❌
22584         - ❌
22585         - ❌
22586         - ❌
22587
22588
22589    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
22590       :widths: 30 15 15 15 15
22591       :header-rows: 1
22592
22593       * - **Test Name**
22594         - mozilla-central
22595         - autoland
22596         - mozilla-release
22597         - mozilla-beta
22598       * - **browsertime-tp6-bytecode-firefox-cnn**
22599         - ❌
22600         - ❌
22601         - ❌
22602         - ❌
22603       * - **browsertime-tp6-essential-custom-car-cnn**
22604         - ❌
22605         - ❌
22606         - ❌
22607         - ❌
22608       * - **browsertime-tp6-essential-firefox-cnn**
22609         - ❌
22610         - ❌
22611         - ❌
22612         - ❌
22613       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22614         - ❌
22615         - ❌
22616         - ❌
22617         - ❌
22618
22619
22620    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
22621       :widths: 30 15 15 15 15
22622       :header-rows: 1
22623
22624       * - **Test Name**
22625         - mozilla-central
22626         - autoland
22627         - mozilla-release
22628         - mozilla-beta
22629       * - **browsertime-tp6-bytecode-firefox-cnn**
22630         - ❌
22631         - ❌
22632         - ❌
22633         - ❌
22634       * - **browsertime-tp6-essential-custom-car-cnn**
22635         - ❌
22636         - ❌
22637         - ❌
22638         - ❌
22639       * - **browsertime-tp6-essential-firefox-cnn**
22640         - ❌
22641         - ❌
22642         - ❌
22643         - ❌
22644       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22645         - ❌
22646         - ❌
22647         - ❌
22648         - ❌
22649
22650
22651    .. list-table:: **test-linux1804-64-qr/opt**
22652       :widths: 30 15 15 15 15
22653       :header-rows: 1
22654
22655       * - **Test Name**
22656         - mozilla-central
22657         - autoland
22658         - mozilla-release
22659         - mozilla-beta
22660       * - **browsertime-tp6-bytecode-firefox-cnn**
22661         - ❌
22662         - ❌
22663         - ❌
22664         - ❌
22665       * - **browsertime-tp6-essential-custom-car-cnn**
22666         - ❌
22667         - ❌
22668         - ❌
22669         - ❌
22670       * - **browsertime-tp6-essential-firefox-cnn**
22671         - ❌
22672         - ❌
22673         - ❌
22674         - ❌
22675       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22676         - ❌
22677         - ❌
22678         - ❌
22679         - ❌
22680
22681
22682    .. list-table:: **test-linux1804-64-shippable-qr/opt**
22683       :widths: 30 15 15 15 15
22684       :header-rows: 1
22685
22686       * - **Test Name**
22687         - mozilla-central
22688         - autoland
22689         - mozilla-release
22690         - mozilla-beta
22691       * - **browsertime-tp6-bytecode-firefox-cnn**
22692         - ✅
22693         - ✅
22694         - ✅
22695         - ✅
22696       * - **browsertime-tp6-essential-chrome-cnn**
22697         - ❌
22698         - ❌
22699         - ❌
22700         - ❌
22701       * - **browsertime-tp6-essential-chromium-cnn**
22702         - ❌
22703         - ❌
22704         - ❌
22705         - ❌
22706       * - **browsertime-tp6-essential-custom-car-cnn**
22707         - ❌
22708         - ❌
22709         - ❌
22710         - ❌
22711       * - **browsertime-tp6-essential-firefox-cnn**
22712         - ✅
22713         - ✅
22714         - ✅
22715         - ✅
22716       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22717         - ❌
22718         - ❌
22719         - ❌
22720         - ❌
22721
22722
22723    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
22724       :widths: 30 15 15 15 15
22725       :header-rows: 1
22726
22727       * - **Test Name**
22728         - mozilla-central
22729         - autoland
22730         - mozilla-release
22731         - mozilla-beta
22732       * - **browsertime-tp6-bytecode-firefox-cnn**
22733         - ❌
22734         - ❌
22735         - ❌
22736         - ❌
22737       * - **browsertime-tp6-essential-custom-car-cnn**
22738         - ❌
22739         - ❌
22740         - ❌
22741         - ❌
22742       * - **browsertime-tp6-essential-firefox-cnn**
22743         - ❌
22744         - ❌
22745         - ❌
22746         - ❌
22747       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22748         - ❌
22749         - ❌
22750         - ❌
22751         - ❌
22752
22753
22754    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22755       :widths: 30 15 15 15 15
22756       :header-rows: 1
22757
22758       * - **Test Name**
22759         - mozilla-central
22760         - autoland
22761         - mozilla-release
22762         - mozilla-beta
22763       * - **browsertime-tp6-bytecode-firefox-cnn**
22764         - ✅
22765         - ✅
22766         - ✅
22767         - ✅
22768       * - **browsertime-tp6-essential-chrome-cnn**
22769         - ❌
22770         - ❌
22771         - ❌
22772         - ❌
22773       * - **browsertime-tp6-essential-chromium-cnn**
22774         - ❌
22775         - ❌
22776         - ❌
22777         - ❌
22778       * - **browsertime-tp6-essential-custom-car-cnn**
22779         - ❌
22780         - ❌
22781         - ❌
22782         - ❌
22783       * - **browsertime-tp6-essential-firefox-cnn**
22784         - ✅
22785         - ✅
22786         - ✅
22787         - ✅
22788       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22789         - ❌
22790         - ❌
22791         - ❌
22792         - ❌
22793
22794
22795    .. list-table:: **test-windows10-32-qr/opt**
22796       :widths: 30 15 15 15 15
22797       :header-rows: 1
22798
22799       * - **Test Name**
22800         - mozilla-central
22801         - autoland
22802         - mozilla-release
22803         - mozilla-beta
22804       * - **browsertime-tp6-bytecode-firefox-cnn**
22805         - ❌
22806         - ❌
22807         - ❌
22808         - ❌
22809       * - **browsertime-tp6-essential-custom-car-cnn**
22810         - ❌
22811         - ❌
22812         - ❌
22813         - ❌
22814       * - **browsertime-tp6-essential-firefox-cnn**
22815         - ❌
22816         - ❌
22817         - ❌
22818         - ❌
22819       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22820         - ❌
22821         - ❌
22822         - ❌
22823         - ❌
22824
22825
22826    .. list-table:: **test-windows10-32-shippable-qr/opt**
22827       :widths: 30 15 15 15 15
22828       :header-rows: 1
22829
22830       * - **Test Name**
22831         - mozilla-central
22832         - autoland
22833         - mozilla-release
22834         - mozilla-beta
22835       * - **browsertime-tp6-bytecode-firefox-cnn**
22836         - ❌
22837         - ❌
22838         - ❌
22839         - ❌
22840       * - **browsertime-tp6-essential-chrome-cnn**
22841         - ❌
22842         - ❌
22843         - ❌
22844         - ❌
22845       * - **browsertime-tp6-essential-chromium-cnn**
22846         - ❌
22847         - ❌
22848         - ❌
22849         - ❌
22850       * - **browsertime-tp6-essential-custom-car-cnn**
22851         - ❌
22852         - ❌
22853         - ❌
22854         - ❌
22855       * - **browsertime-tp6-essential-firefox-cnn**
22856         - ❌
22857         - ❌
22858         - ❌
22859         - ❌
22860       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22861         - ❌
22862         - ❌
22863         - ❌
22864         - ❌
22865
22866
22867    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
22868       :widths: 30 15 15 15 15
22869       :header-rows: 1
22870
22871       * - **Test Name**
22872         - mozilla-central
22873         - autoland
22874         - mozilla-release
22875         - mozilla-beta
22876       * - **browsertime-tp6-bytecode-firefox-cnn**
22877         - ❌
22878         - ❌
22879         - ❌
22880         - ❌
22881       * - **browsertime-tp6-essential-custom-car-cnn**
22882         - ❌
22883         - ❌
22884         - ❌
22885         - ❌
22886       * - **browsertime-tp6-essential-firefox-cnn**
22887         - ❌
22888         - ❌
22889         - ❌
22890         - ❌
22891       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22892         - ❌
22893         - ❌
22894         - ❌
22895         - ❌
22896
22897
22898    .. list-table:: **test-windows10-64-qr/opt**
22899       :widths: 30 15 15 15 15
22900       :header-rows: 1
22901
22902       * - **Test Name**
22903         - mozilla-central
22904         - autoland
22905         - mozilla-release
22906         - mozilla-beta
22907       * - **browsertime-tp6-bytecode-firefox-cnn**
22908         - ❌
22909         - ❌
22910         - ❌
22911         - ❌
22912       * - **browsertime-tp6-essential-custom-car-cnn**
22913         - ❌
22914         - ❌
22915         - ❌
22916         - ❌
22917       * - **browsertime-tp6-essential-firefox-cnn**
22918         - ❌
22919         - ❌
22920         - ❌
22921         - ❌
22922       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22923         - ❌
22924         - ❌
22925         - ❌
22926         - ❌
22927
22928
22929    .. list-table:: **test-windows10-64-shippable-qr/opt**
22930       :widths: 30 15 15 15 15
22931       :header-rows: 1
22932
22933       * - **Test Name**
22934         - mozilla-central
22935         - autoland
22936         - mozilla-release
22937         - mozilla-beta
22938       * - **browsertime-tp6-bytecode-firefox-cnn**
22939         - ✅
22940         - ✅
22941         - ✅
22942         - ✅
22943       * - **browsertime-tp6-essential-chrome-cnn**
22944         - ❌
22945         - ❌
22946         - ❌
22947         - ❌
22948       * - **browsertime-tp6-essential-chromium-cnn**
22949         - ❌
22950         - ❌
22951         - ❌
22952         - ❌
22953       * - **browsertime-tp6-essential-custom-car-cnn**
22954         - ❌
22955         - ❌
22956         - ❌
22957         - ❌
22958       * - **browsertime-tp6-essential-firefox-cnn**
22959         - ✅
22960         - ✅
22961         - ✅
22962         - ✅
22963       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
22964         - ❌
22965         - ❌
22966         - ❌
22967         - ❌
22968
22969
22970
22971 .. dropdown:: cnn-ampstories
22972    :class-container: anchor-id-cnn-ampstories-l
22973
22974    **Owner**: PerfTest Team
22975
22976    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
22977    * **alert threshold**: 2.0
22978    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
22979    * **browser cycles**: 15
22980    * **expected**: pass
22981    * **lower is better**: true
22982    * **page cycles**: 25
22983    * **page timeout**: 60000
22984    * **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
22985    * **type**: pageload
22986    * **unit**: ms
22987    * **use live sites**: true
22988    * **Test Task**:
22989
22990    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
22991       :widths: 30 15 15 15 15
22992       :header-rows: 1
22993
22994       * - **Test Name**
22995         - mozilla-central
22996         - autoland
22997         - mozilla-release
22998         - mozilla-beta
22999       * - **browsertime-tp6m-fenix-cnn-ampstories**
23000         - ❌
23001         - ❌
23002         - ❌
23003         - ❌
23004       * - **browsertime-tp6m-fenix-cnn-ampstories-nofis**
23005         - ❌
23006         - ❌
23007         - ❌
23008         - ❌
23009       * - **browsertime-tp6m-geckoview-cnn-ampstories**
23010         - ❌
23011         - ❌
23012         - ❌
23013         - ❌
23014       * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis**
23015         - ❌
23016         - ❌
23017         - ❌
23018         - ❌
23019       * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis**
23020         - ❌
23021         - ❌
23022         - ❌
23023         - ❌
23024       * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis**
23025         - ❌
23026         - ❌
23027         - ❌
23028         - ❌
23029       * - **browsertime-tp6m-refbrow-cnn-ampstories**
23030         - ❌
23031         - ❌
23032         - ❌
23033         - ❌
23034
23035
23036    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23037       :widths: 30 15 15 15 15
23038       :header-rows: 1
23039
23040       * - **Test Name**
23041         - mozilla-central
23042         - autoland
23043         - mozilla-release
23044         - mozilla-beta
23045       * - **browsertime-tp6m-chrome-m-cnn-ampstories**
23046         - ❌
23047         - ❌
23048         - ❌
23049         - ❌
23050       * - **browsertime-tp6m-chrome-m-cnn-ampstories-nofis**
23051         - ❌
23052         - ❌
23053         - ❌
23054         - ❌
23055       * - **browsertime-tp6m-fenix-cnn-ampstories**
23056         - ❌
23057         - ❌
23058         - ❌
23059         - ❌
23060       * - **browsertime-tp6m-fenix-cnn-ampstories-nofis**
23061         - ❌
23062         - ❌
23063         - ❌
23064         - ❌
23065       * - **browsertime-tp6m-geckoview-cnn-ampstories**
23066         - ❌
23067         - ❌
23068         - ❌
23069         - ❌
23070       * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis**
23071         - ✅
23072         - ✅
23073         - ❌
23074         - ❌
23075       * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis**
23076         - ❌
23077         - ❌
23078         - ❌
23079         - ❌
23080       * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis**
23081         - ❌
23082         - ❌
23083         - ❌
23084         - ❌
23085       * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis**
23086         - ❌
23087         - ✅
23088         - ❌
23089         - ❌
23090       * - **browsertime-tp6m-refbrow-cnn-ampstories**
23091         - ❌
23092         - ❌
23093         - ❌
23094         - ❌
23095
23096
23097
23098 .. dropdown:: discord
23099    :class-container: anchor-id-discord-l
23100
23101    **Owner**: PerfTest Team
23102
23103    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23104    * **alert threshold**: 2.0
23105    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23106    * **browser cycles**: 15
23107    * **expected**: pass
23108    * **lower is better**: true
23109    * **page cycles**: 25
23110    * **page timeout**: 60000
23111    * **test url**: `<https://discordapp.com/>`__
23112    * **type**: pageload
23113    * **unit**: ms
23114    * **use live sites**: true
23115    * **Test Task**:
23116
23117    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23118       :widths: 30 15 15 15 15
23119       :header-rows: 1
23120
23121       * - **Test Name**
23122         - mozilla-central
23123         - autoland
23124         - mozilla-release
23125         - mozilla-beta
23126       * - **browsertime-tp6m-live-fenix-discord-nofis**
23127         - ❌
23128         - ❌
23129         - ❌
23130         - ❌
23131       * - **browsertime-tp6m-live-geckoview-discord-nofis**
23132         - ❌
23133         - ❌
23134         - ❌
23135         - ❌
23136
23137
23138    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23139       :widths: 30 15 15 15 15
23140       :header-rows: 1
23141
23142       * - **Test Name**
23143         - mozilla-central
23144         - autoland
23145         - mozilla-release
23146         - mozilla-beta
23147       * - **browsertime-tp6m-live-chrome-m-discord-nofis**
23148         - ❌
23149         - ❌
23150         - ❌
23151         - ❌
23152       * - **browsertime-tp6m-live-fenix-discord-nofis**
23153         - ❌
23154         - ❌
23155         - ❌
23156         - ❌
23157       * - **browsertime-tp6m-live-geckoview-discord-nofis**
23158         - ❌
23159         - ❌
23160         - ❌
23161         - ❌
23162
23163
23164
23165 .. dropdown:: expedia
23166    :class-container: anchor-id-expedia-l
23167
23168    **Owner**: PerfTest Team
23169
23170    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23171    * **alert threshold**: 2.0
23172    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23173    * **browser cycles**: 15
23174    * **expected**: pass
23175    * **lower is better**: true
23176    * **page cycles**: 25
23177    * **page timeout**: 60000
23178    * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__
23179    * **type**: pageload
23180    * **unit**: ms
23181    * **use live sites**: true
23182    * **Test Task**:
23183
23184    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23185       :widths: 30 15 15 15 15
23186       :header-rows: 1
23187
23188       * - **Test Name**
23189         - mozilla-central
23190         - autoland
23191         - mozilla-release
23192         - mozilla-beta
23193       * - **browsertime-tp6m-live-fenix-expedia-nofis**
23194         - ❌
23195         - ❌
23196         - ❌
23197         - ❌
23198       * - **browsertime-tp6m-live-geckoview-expedia-nofis**
23199         - ❌
23200         - ❌
23201         - ❌
23202         - ❌
23203
23204
23205    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23206       :widths: 30 15 15 15 15
23207       :header-rows: 1
23208
23209       * - **Test Name**
23210         - mozilla-central
23211         - autoland
23212         - mozilla-release
23213         - mozilla-beta
23214       * - **browsertime-tp6m-live-chrome-m-expedia-nofis**
23215         - ❌
23216         - ❌
23217         - ❌
23218         - ❌
23219       * - **browsertime-tp6m-live-fenix-expedia-nofis**
23220         - ❌
23221         - ❌
23222         - ❌
23223         - ❌
23224       * - **browsertime-tp6m-live-geckoview-expedia-nofis**
23225         - ❌
23226         - ❌
23227         - ❌
23228         - ❌
23229
23230
23231    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
23232       :widths: 30 15 15 15 15
23233       :header-rows: 1
23234
23235       * - **Test Name**
23236         - mozilla-central
23237         - autoland
23238         - mozilla-release
23239         - mozilla-beta
23240       * - **browsertime-tp6-firefox-expedia**
23241         - ❌
23242         - ❌
23243         - ❌
23244         - ❌
23245
23246
23247    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
23248       :widths: 30 15 15 15 15
23249       :header-rows: 1
23250
23251       * - **Test Name**
23252         - mozilla-central
23253         - autoland
23254         - mozilla-release
23255         - mozilla-beta
23256       * - **browsertime-tp6-firefox-expedia**
23257         - ❌
23258         - ❌
23259         - ❌
23260         - ❌
23261
23262
23263    .. list-table:: **test-linux1804-64-qr/opt**
23264       :widths: 30 15 15 15 15
23265       :header-rows: 1
23266
23267       * - **Test Name**
23268         - mozilla-central
23269         - autoland
23270         - mozilla-release
23271         - mozilla-beta
23272       * - **browsertime-tp6-firefox-expedia**
23273         - ❌
23274         - ❌
23275         - ❌
23276         - ❌
23277
23278
23279    .. list-table:: **test-linux1804-64-shippable-qr/opt**
23280       :widths: 30 15 15 15 15
23281       :header-rows: 1
23282
23283       * - **Test Name**
23284         - mozilla-central
23285         - autoland
23286         - mozilla-release
23287         - mozilla-beta
23288       * - **browsertime-tp6-chrome-expedia**
23289         - ❌
23290         - ❌
23291         - ❌
23292         - ❌
23293       * - **browsertime-tp6-chromium-expedia**
23294         - ❌
23295         - ❌
23296         - ❌
23297         - ❌
23298       * - **browsertime-tp6-firefox-expedia**
23299         - ✅
23300         - ✅
23301         - ✅
23302         - ✅
23303
23304
23305    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
23306       :widths: 30 15 15 15 15
23307       :header-rows: 1
23308
23309       * - **Test Name**
23310         - mozilla-central
23311         - autoland
23312         - mozilla-release
23313         - mozilla-beta
23314       * - **browsertime-tp6-firefox-expedia**
23315         - ❌
23316         - ❌
23317         - ❌
23318         - ❌
23319
23320
23321    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
23322       :widths: 30 15 15 15 15
23323       :header-rows: 1
23324
23325       * - **Test Name**
23326         - mozilla-central
23327         - autoland
23328         - mozilla-release
23329         - mozilla-beta
23330       * - **browsertime-tp6-chrome-expedia**
23331         - ❌
23332         - ❌
23333         - ❌
23334         - ❌
23335       * - **browsertime-tp6-chromium-expedia**
23336         - ❌
23337         - ❌
23338         - ❌
23339         - ❌
23340       * - **browsertime-tp6-firefox-expedia**
23341         - ✅
23342         - ✅
23343         - ✅
23344         - ✅
23345
23346
23347    .. list-table:: **test-windows10-32-qr/opt**
23348       :widths: 30 15 15 15 15
23349       :header-rows: 1
23350
23351       * - **Test Name**
23352         - mozilla-central
23353         - autoland
23354         - mozilla-release
23355         - mozilla-beta
23356       * - **browsertime-tp6-firefox-expedia**
23357         - ❌
23358         - ❌
23359         - ❌
23360         - ❌
23361
23362
23363    .. list-table:: **test-windows10-32-shippable-qr/opt**
23364       :widths: 30 15 15 15 15
23365       :header-rows: 1
23366
23367       * - **Test Name**
23368         - mozilla-central
23369         - autoland
23370         - mozilla-release
23371         - mozilla-beta
23372       * - **browsertime-tp6-chrome-expedia**
23373         - ❌
23374         - ❌
23375         - ❌
23376         - ❌
23377       * - **browsertime-tp6-chromium-expedia**
23378         - ❌
23379         - ❌
23380         - ❌
23381         - ❌
23382       * - **browsertime-tp6-firefox-expedia**
23383         - ❌
23384         - ❌
23385         - ❌
23386         - ❌
23387
23388
23389    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
23390       :widths: 30 15 15 15 15
23391       :header-rows: 1
23392
23393       * - **Test Name**
23394         - mozilla-central
23395         - autoland
23396         - mozilla-release
23397         - mozilla-beta
23398       * - **browsertime-tp6-firefox-expedia**
23399         - ❌
23400         - ❌
23401         - ❌
23402         - ❌
23403
23404
23405    .. list-table:: **test-windows10-64-qr/opt**
23406       :widths: 30 15 15 15 15
23407       :header-rows: 1
23408
23409       * - **Test Name**
23410         - mozilla-central
23411         - autoland
23412         - mozilla-release
23413         - mozilla-beta
23414       * - **browsertime-tp6-firefox-expedia**
23415         - ❌
23416         - ❌
23417         - ❌
23418         - ❌
23419
23420
23421    .. list-table:: **test-windows10-64-shippable-qr/opt**
23422       :widths: 30 15 15 15 15
23423       :header-rows: 1
23424
23425       * - **Test Name**
23426         - mozilla-central
23427         - autoland
23428         - mozilla-release
23429         - mozilla-beta
23430       * - **browsertime-tp6-chrome-expedia**
23431         - ❌
23432         - ❌
23433         - ❌
23434         - ❌
23435       * - **browsertime-tp6-chromium-expedia**
23436         - ❌
23437         - ❌
23438         - ❌
23439         - ❌
23440       * - **browsertime-tp6-firefox-expedia**
23441         - ✅
23442         - ✅
23443         - ✅
23444         - ✅
23445
23446
23447
23448 .. dropdown:: fashionbeans
23449    :class-container: anchor-id-fashionbeans-l
23450
23451    **Owner**: PerfTest Team
23452
23453    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23454    * **alert threshold**: 2.0
23455    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23456    * **browser cycles**: 15
23457    * **expected**: pass
23458    * **lower is better**: true
23459    * **page cycles**: 25
23460    * **page timeout**: 60000
23461    * **test url**: `<https://fashionbeans.com/article/coolest-menswear-stores-in-the-world>`__
23462    * **type**: pageload
23463    * **unit**: ms
23464    * **use live sites**: true
23465    * **Test Task**:
23466
23467    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23468       :widths: 30 15 15 15 15
23469       :header-rows: 1
23470
23471       * - **Test Name**
23472         - mozilla-central
23473         - autoland
23474         - mozilla-release
23475         - mozilla-beta
23476       * - **browsertime-tp6m-live-fenix-fashionbeans-nofis**
23477         - ❌
23478         - ❌
23479         - ❌
23480         - ❌
23481       * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis**
23482         - ❌
23483         - ❌
23484         - ❌
23485         - ❌
23486
23487
23488    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23489       :widths: 30 15 15 15 15
23490       :header-rows: 1
23491
23492       * - **Test Name**
23493         - mozilla-central
23494         - autoland
23495         - mozilla-release
23496         - mozilla-beta
23497       * - **browsertime-tp6m-live-chrome-m-fashionbeans-nofis**
23498         - ❌
23499         - ❌
23500         - ❌
23501         - ❌
23502       * - **browsertime-tp6m-live-fenix-fashionbeans-nofis**
23503         - ❌
23504         - ❌
23505         - ❌
23506         - ❌
23507       * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis**
23508         - ❌
23509         - ❌
23510         - ❌
23511         - ❌
23512
23513
23514
23515 .. dropdown:: google-accounts
23516    :class-container: anchor-id-google-accounts-l
23517
23518    **Owner**: PerfTest Team
23519
23520    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23521    * **alert threshold**: 2.0
23522    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23523    * **browser cycles**: 15
23524    * **expected**: pass
23525    * **lower is better**: true
23526    * **page cycles**: 25
23527    * **page timeout**: 60000
23528    * **test url**: `<https://accounts.google.com>`__
23529    * **type**: pageload
23530    * **unit**: ms
23531    * **use live sites**: true
23532    * **Test Task**:
23533
23534    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23535       :widths: 30 15 15 15 15
23536       :header-rows: 1
23537
23538       * - **Test Name**
23539         - mozilla-central
23540         - autoland
23541         - mozilla-release
23542         - mozilla-beta
23543       * - **browsertime-tp6m-live-fenix-google-accounts-nofis**
23544         - ❌
23545         - ❌
23546         - ❌
23547         - ❌
23548       * - **browsertime-tp6m-live-geckoview-google-accounts-nofis**
23549         - ❌
23550         - ❌
23551         - ❌
23552         - ❌
23553
23554
23555    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23556       :widths: 30 15 15 15 15
23557       :header-rows: 1
23558
23559       * - **Test Name**
23560         - mozilla-central
23561         - autoland
23562         - mozilla-release
23563         - mozilla-beta
23564       * - **browsertime-tp6m-live-chrome-m-google-accounts-nofis**
23565         - ❌
23566         - ❌
23567         - ❌
23568         - ❌
23569       * - **browsertime-tp6m-live-fenix-google-accounts-nofis**
23570         - ❌
23571         - ❌
23572         - ❌
23573         - ❌
23574       * - **browsertime-tp6m-live-geckoview-google-accounts-nofis**
23575         - ❌
23576         - ❌
23577         - ❌
23578         - ❌
23579
23580
23581
23582 .. dropdown:: imdb-firefox
23583    :class-container: anchor-id-imdb-firefox-l
23584
23585    **Owner**: PerfTest Team
23586
23587    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23588    * **alert threshold**: 2.0
23589    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23590    * **browser cycles**: 15
23591    * **expected**: pass
23592    * **lower is better**: true
23593    * **page cycles**: 25
23594    * **page timeout**: 60000
23595    * **test url**: `<https://m.imdb.com/title/tt0083943/>`__
23596    * **type**: pageload
23597    * **unit**: ms
23598    * **use live sites**: true
23599    * **Test Task**:
23600
23601    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23602       :widths: 30 15 15 15 15
23603       :header-rows: 1
23604
23605       * - **Test Name**
23606         - mozilla-central
23607         - autoland
23608         - mozilla-release
23609         - mozilla-beta
23610       * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis**
23611         - ❌
23612         - ❌
23613         - ❌
23614         - ❌
23615       * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis**
23616         - ❌
23617         - ❌
23618         - ❌
23619         - ❌
23620
23621
23622    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23623       :widths: 30 15 15 15 15
23624       :header-rows: 1
23625
23626       * - **Test Name**
23627         - mozilla-central
23628         - autoland
23629         - mozilla-release
23630         - mozilla-beta
23631       * - **browsertime-tp6m-live-chrome-m-imdb-firefox-nofis**
23632         - ❌
23633         - ❌
23634         - ❌
23635         - ❌
23636       * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis**
23637         - ❌
23638         - ❌
23639         - ❌
23640         - ❌
23641       * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis**
23642         - ❌
23643         - ❌
23644         - ❌
23645         - ❌
23646
23647
23648
23649 .. dropdown:: medium-article
23650    :class-container: anchor-id-medium-article-l
23651
23652    **Owner**: PerfTest Team
23653
23654    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23655    * **alert threshold**: 2.0
23656    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23657    * **browser cycles**: 15
23658    * **expected**: pass
23659    * **lower is better**: true
23660    * **page cycles**: 25
23661    * **page timeout**: 60000
23662    * **test url**: `<https://medium.com/s/coincidences-are-a-lie/could-america-have-also-been-the-birthplace-of-impressionism-cb3d31a2e22d>`__
23663    * **type**: pageload
23664    * **unit**: ms
23665    * **use live sites**: true
23666    * **Test Task**:
23667
23668    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23669       :widths: 30 15 15 15 15
23670       :header-rows: 1
23671
23672       * - **Test Name**
23673         - mozilla-central
23674         - autoland
23675         - mozilla-release
23676         - mozilla-beta
23677       * - **browsertime-tp6m-live-fenix-medium-article-nofis**
23678         - ❌
23679         - ❌
23680         - ❌
23681         - ❌
23682       * - **browsertime-tp6m-live-geckoview-medium-article-nofis**
23683         - ❌
23684         - ❌
23685         - ❌
23686         - ❌
23687
23688
23689    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23690       :widths: 30 15 15 15 15
23691       :header-rows: 1
23692
23693       * - **Test Name**
23694         - mozilla-central
23695         - autoland
23696         - mozilla-release
23697         - mozilla-beta
23698       * - **browsertime-tp6m-live-chrome-m-medium-article-nofis**
23699         - ❌
23700         - ❌
23701         - ❌
23702         - ❌
23703       * - **browsertime-tp6m-live-fenix-medium-article-nofis**
23704         - ❌
23705         - ❌
23706         - ❌
23707         - ❌
23708       * - **browsertime-tp6m-live-geckoview-medium-article-nofis**
23709         - ❌
23710         - ❌
23711         - ❌
23712         - ❌
23713
23714
23715
23716 .. dropdown:: nytimes
23717    :class-container: anchor-id-nytimes-l
23718
23719    **Owner**: PerfTest Team
23720
23721    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
23722    * **alert threshold**: 2.0
23723    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23724    * **browser cycles**: 15
23725    * **expected**: pass
23726    * **lower is better**: true
23727    * **page cycles**: 25
23728    * **page timeout**: 60000
23729    * **test url**: `<https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html>`__
23730    * **type**: pageload
23731    * **unit**: ms
23732    * **use live sites**: true
23733    * **Test Task**:
23734
23735    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
23736       :widths: 30 15 15 15 15
23737       :header-rows: 1
23738
23739       * - **Test Name**
23740         - mozilla-central
23741         - autoland
23742         - mozilla-release
23743         - mozilla-beta
23744       * - **browsertime-tp6m-live-fenix-nytimes-nofis**
23745         - ❌
23746         - ❌
23747         - ❌
23748         - ❌
23749       * - **browsertime-tp6m-live-geckoview-nytimes-nofis**
23750         - ❌
23751         - ❌
23752         - ❌
23753         - ❌
23754
23755
23756    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
23757       :widths: 30 15 15 15 15
23758       :header-rows: 1
23759
23760       * - **Test Name**
23761         - mozilla-central
23762         - autoland
23763         - mozilla-release
23764         - mozilla-beta
23765       * - **browsertime-tp6m-live-chrome-m-nytimes-nofis**
23766         - ❌
23767         - ❌
23768         - ❌
23769         - ❌
23770       * - **browsertime-tp6m-live-fenix-nytimes-nofis**
23771         - ❌
23772         - ❌
23773         - ❌
23774         - ❌
23775       * - **browsertime-tp6m-live-geckoview-nytimes-nofis**
23776         - ❌
23777         - ❌
23778         - ❌
23779         - ❌
23780
23781
23782    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
23783       :widths: 30 15 15 15 15
23784       :header-rows: 1
23785
23786       * - **Test Name**
23787         - mozilla-central
23788         - autoland
23789         - mozilla-release
23790         - mozilla-beta
23791       * - **browsertime-tp6-firefox-nytimes**
23792         - ❌
23793         - ❌
23794         - ❌
23795         - ❌
23796
23797
23798    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
23799       :widths: 30 15 15 15 15
23800       :header-rows: 1
23801
23802       * - **Test Name**
23803         - mozilla-central
23804         - autoland
23805         - mozilla-release
23806         - mozilla-beta
23807       * - **browsertime-tp6-firefox-nytimes**
23808         - ❌
23809         - ❌
23810         - ❌
23811         - ❌
23812
23813
23814    .. list-table:: **test-linux1804-64-qr/opt**
23815       :widths: 30 15 15 15 15
23816       :header-rows: 1
23817
23818       * - **Test Name**
23819         - mozilla-central
23820         - autoland
23821         - mozilla-release
23822         - mozilla-beta
23823       * - **browsertime-tp6-firefox-nytimes**
23824         - ❌
23825         - ❌
23826         - ❌
23827         - ❌
23828
23829
23830    .. list-table:: **test-linux1804-64-shippable-qr/opt**
23831       :widths: 30 15 15 15 15
23832       :header-rows: 1
23833
23834       * - **Test Name**
23835         - mozilla-central
23836         - autoland
23837         - mozilla-release
23838         - mozilla-beta
23839       * - **browsertime-tp6-chrome-nytimes**
23840         - ❌
23841         - ❌
23842         - ❌
23843         - ❌
23844       * - **browsertime-tp6-chromium-nytimes**
23845         - ❌
23846         - ❌
23847         - ❌
23848         - ❌
23849       * - **browsertime-tp6-firefox-nytimes**
23850         - ✅
23851         - ✅
23852         - ✅
23853         - ✅
23854
23855
23856    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
23857       :widths: 30 15 15 15 15
23858       :header-rows: 1
23859
23860       * - **Test Name**
23861         - mozilla-central
23862         - autoland
23863         - mozilla-release
23864         - mozilla-beta
23865       * - **browsertime-tp6-firefox-nytimes**
23866         - ❌
23867         - ❌
23868         - ❌
23869         - ❌
23870
23871
23872    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
23873       :widths: 30 15 15 15 15
23874       :header-rows: 1
23875
23876       * - **Test Name**
23877         - mozilla-central
23878         - autoland
23879         - mozilla-release
23880         - mozilla-beta
23881       * - **browsertime-tp6-chrome-nytimes**
23882         - ❌
23883         - ❌
23884         - ❌
23885         - ❌
23886       * - **browsertime-tp6-chromium-nytimes**
23887         - ❌
23888         - ❌
23889         - ❌
23890         - ❌
23891       * - **browsertime-tp6-firefox-nytimes**
23892         - ✅
23893         - ✅
23894         - ✅
23895         - ✅
23896
23897
23898    .. list-table:: **test-windows10-32-qr/opt**
23899       :widths: 30 15 15 15 15
23900       :header-rows: 1
23901
23902       * - **Test Name**
23903         - mozilla-central
23904         - autoland
23905         - mozilla-release
23906         - mozilla-beta
23907       * - **browsertime-tp6-firefox-nytimes**
23908         - ❌
23909         - ❌
23910         - ❌
23911         - ❌
23912
23913
23914    .. list-table:: **test-windows10-32-shippable-qr/opt**
23915       :widths: 30 15 15 15 15
23916       :header-rows: 1
23917
23918       * - **Test Name**
23919         - mozilla-central
23920         - autoland
23921         - mozilla-release
23922         - mozilla-beta
23923       * - **browsertime-tp6-chrome-nytimes**
23924         - ❌
23925         - ❌
23926         - ❌
23927         - ❌
23928       * - **browsertime-tp6-chromium-nytimes**
23929         - ❌
23930         - ❌
23931         - ❌
23932         - ❌
23933       * - **browsertime-tp6-firefox-nytimes**
23934         - ❌
23935         - ❌
23936         - ❌
23937         - ❌
23938
23939
23940    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
23941       :widths: 30 15 15 15 15
23942       :header-rows: 1
23943
23944       * - **Test Name**
23945         - mozilla-central
23946         - autoland
23947         - mozilla-release
23948         - mozilla-beta
23949       * - **browsertime-tp6-firefox-nytimes**
23950         - ❌
23951         - ❌
23952         - ❌
23953         - ❌
23954
23955
23956    .. list-table:: **test-windows10-64-qr/opt**
23957       :widths: 30 15 15 15 15
23958       :header-rows: 1
23959
23960       * - **Test Name**
23961         - mozilla-central
23962         - autoland
23963         - mozilla-release
23964         - mozilla-beta
23965       * - **browsertime-tp6-firefox-nytimes**
23966         - ❌
23967         - ❌
23968         - ❌
23969         - ❌
23970
23971
23972    .. list-table:: **test-windows10-64-shippable-qr/opt**
23973       :widths: 30 15 15 15 15
23974       :header-rows: 1
23975
23976       * - **Test Name**
23977         - mozilla-central
23978         - autoland
23979         - mozilla-release
23980         - mozilla-beta
23981       * - **browsertime-tp6-chrome-nytimes**
23982         - ❌
23983         - ❌
23984         - ❌
23985         - ❌
23986       * - **browsertime-tp6-chromium-nytimes**
23987         - ❌
23988         - ❌
23989         - ❌
23990         - ❌
23991       * - **browsertime-tp6-firefox-nytimes**
23992         - ✅
23993         - ✅
23994         - ✅
23995         - ✅
23996
23997
23998
23999 .. dropdown:: people-article
24000    :class-container: anchor-id-people-article-l
24001
24002    **Owner**: PerfTest Team
24003
24004    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24005    * **alert threshold**: 2.0
24006    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24007    * **browser cycles**: 15
24008    * **expected**: pass
24009    * **lower is better**: true
24010    * **page cycles**: 25
24011    * **page timeout**: 60000
24012    * **test url**: `<https://people.com/amp-stories/royal-a-to-z/>`__
24013    * **type**: pageload
24014    * **unit**: ms
24015    * **use live sites**: true
24016    * **Test Task**:
24017
24018    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24019       :widths: 30 15 15 15 15
24020       :header-rows: 1
24021
24022       * - **Test Name**
24023         - mozilla-central
24024         - autoland
24025         - mozilla-release
24026         - mozilla-beta
24027       * - **browsertime-tp6m-live-fenix-people-article-nofis**
24028         - ❌
24029         - ❌
24030         - ❌
24031         - ❌
24032       * - **browsertime-tp6m-live-geckoview-people-article-nofis**
24033         - ❌
24034         - ❌
24035         - ❌
24036         - ❌
24037
24038
24039    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24040       :widths: 30 15 15 15 15
24041       :header-rows: 1
24042
24043       * - **Test Name**
24044         - mozilla-central
24045         - autoland
24046         - mozilla-release
24047         - mozilla-beta
24048       * - **browsertime-tp6m-live-chrome-m-people-article-nofis**
24049         - ❌
24050         - ❌
24051         - ❌
24052         - ❌
24053       * - **browsertime-tp6m-live-fenix-people-article-nofis**
24054         - ❌
24055         - ❌
24056         - ❌
24057         - ❌
24058       * - **browsertime-tp6m-live-geckoview-people-article-nofis**
24059         - ❌
24060         - ❌
24061         - ❌
24062         - ❌
24063
24064
24065
24066 .. dropdown:: reddit-thread
24067    :class-container: anchor-id-reddit-thread-l
24068
24069    **Owner**: PerfTest Team
24070
24071    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24072    * **alert threshold**: 2.0
24073    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24074    * **browser cycles**: 15
24075    * **expected**: pass
24076    * **lower is better**: true
24077    * **page cycles**: 25
24078    * **page timeout**: 60000
24079    * **test url**: `<https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/>`__
24080    * **type**: pageload
24081    * **unit**: ms
24082    * **use live sites**: true
24083    * **Test Task**:
24084
24085    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24086       :widths: 30 15 15 15 15
24087       :header-rows: 1
24088
24089       * - **Test Name**
24090         - mozilla-central
24091         - autoland
24092         - mozilla-release
24093         - mozilla-beta
24094       * - **browsertime-tp6m-live-fenix-reddit-thread-nofis**
24095         - ❌
24096         - ❌
24097         - ❌
24098         - ❌
24099       * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis**
24100         - ❌
24101         - ❌
24102         - ❌
24103         - ❌
24104
24105
24106    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24107       :widths: 30 15 15 15 15
24108       :header-rows: 1
24109
24110       * - **Test Name**
24111         - mozilla-central
24112         - autoland
24113         - mozilla-release
24114         - mozilla-beta
24115       * - **browsertime-tp6m-live-chrome-m-reddit-thread-nofis**
24116         - ❌
24117         - ❌
24118         - ❌
24119         - ❌
24120       * - **browsertime-tp6m-live-fenix-reddit-thread-nofis**
24121         - ❌
24122         - ❌
24123         - ❌
24124         - ❌
24125       * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis**
24126         - ❌
24127         - ❌
24128         - ❌
24129         - ❌
24130
24131
24132
24133 .. dropdown:: rumble-fox
24134    :class-container: anchor-id-rumble-fox-l
24135
24136    **Owner**: PerfTest Team
24137
24138    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24139    * **alert threshold**: 2.0
24140    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24141    * **browser cycles**: 15
24142    * **expected**: pass
24143    * **lower is better**: true
24144    * **page cycles**: 25
24145    * **page timeout**: 60000
24146    * **test url**: `<https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html>`__
24147    * **type**: pageload
24148    * **unit**: ms
24149    * **use live sites**: true
24150    * **Test Task**:
24151
24152    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24153       :widths: 30 15 15 15 15
24154       :header-rows: 1
24155
24156       * - **Test Name**
24157         - mozilla-central
24158         - autoland
24159         - mozilla-release
24160         - mozilla-beta
24161       * - **browsertime-tp6m-live-fenix-rumble-fox-nofis**
24162         - ❌
24163         - ❌
24164         - ❌
24165         - ❌
24166       * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis**
24167         - ❌
24168         - ❌
24169         - ❌
24170         - ❌
24171
24172
24173    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24174       :widths: 30 15 15 15 15
24175       :header-rows: 1
24176
24177       * - **Test Name**
24178         - mozilla-central
24179         - autoland
24180         - mozilla-release
24181         - mozilla-beta
24182       * - **browsertime-tp6m-live-chrome-m-rumble-fox-nofis**
24183         - ❌
24184         - ❌
24185         - ❌
24186         - ❌
24187       * - **browsertime-tp6m-live-fenix-rumble-fox-nofis**
24188         - ❌
24189         - ❌
24190         - ❌
24191         - ❌
24192       * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis**
24193         - ❌
24194         - ❌
24195         - ❌
24196         - ❌
24197
24198
24199
24200 .. dropdown:: stackoverflow-question
24201    :class-container: anchor-id-stackoverflow-question-l
24202
24203    **Owner**: PerfTest Team
24204
24205    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24206    * **alert threshold**: 2.0
24207    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24208    * **browser cycles**: 15
24209    * **expected**: pass
24210    * **lower is better**: true
24211    * **page cycles**: 25
24212    * **page timeout**: 60000
24213    * **test url**: `<https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git>`__
24214    * **type**: pageload
24215    * **unit**: ms
24216    * **use live sites**: true
24217    * **Test Task**:
24218
24219    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24220       :widths: 30 15 15 15 15
24221       :header-rows: 1
24222
24223       * - **Test Name**
24224         - mozilla-central
24225         - autoland
24226         - mozilla-release
24227         - mozilla-beta
24228       * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis**
24229         - ❌
24230         - ❌
24231         - ❌
24232         - ❌
24233       * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis**
24234         - ❌
24235         - ❌
24236         - ❌
24237         - ❌
24238
24239
24240    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24241       :widths: 30 15 15 15 15
24242       :header-rows: 1
24243
24244       * - **Test Name**
24245         - mozilla-central
24246         - autoland
24247         - mozilla-release
24248         - mozilla-beta
24249       * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis**
24250         - ❌
24251         - ❌
24252         - ❌
24253         - ❌
24254       * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis**
24255         - ❌
24256         - ❌
24257         - ❌
24258         - ❌
24259       * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis**
24260         - ❌
24261         - ❌
24262         - ❌
24263         - ❌
24264
24265
24266
24267 .. dropdown:: urbandictionary-define
24268    :class-container: anchor-id-urbandictionary-define-l
24269
24270    **Owner**: PerfTest Team
24271
24272    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24273    * **alert threshold**: 2.0
24274    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24275    * **browser cycles**: 15
24276    * **expected**: pass
24277    * **lower is better**: true
24278    * **page cycles**: 25
24279    * **page timeout**: 60000
24280    * **test url**: `<https://urbandictionary.com/define.php?term=awesome%20sauce>`__
24281    * **type**: pageload
24282    * **unit**: ms
24283    * **use live sites**: true
24284    * **Test Task**:
24285
24286    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24287       :widths: 30 15 15 15 15
24288       :header-rows: 1
24289
24290       * - **Test Name**
24291         - mozilla-central
24292         - autoland
24293         - mozilla-release
24294         - mozilla-beta
24295       * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis**
24296         - ❌
24297         - ❌
24298         - ❌
24299         - ❌
24300       * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis**
24301         - ❌
24302         - ❌
24303         - ❌
24304         - ❌
24305
24306
24307    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24308       :widths: 30 15 15 15 15
24309       :header-rows: 1
24310
24311       * - **Test Name**
24312         - mozilla-central
24313         - autoland
24314         - mozilla-release
24315         - mozilla-beta
24316       * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis**
24317         - ❌
24318         - ❌
24319         - ❌
24320         - ❌
24321       * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis**
24322         - ❌
24323         - ❌
24324         - ❌
24325         - ❌
24326       * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis**
24327         - ❌
24328         - ❌
24329         - ❌
24330         - ❌
24331
24332
24333
24334 .. dropdown:: wikia-marvel
24335    :class-container: anchor-id-wikia-marvel-l
24336
24337    **Owner**: PerfTest Team
24338
24339    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24340    * **alert threshold**: 2.0
24341    * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24342    * **browser cycles**: 15
24343    * **expected**: pass
24344    * **lower is better**: true
24345    * **page cycles**: 25
24346    * **page timeout**: 60000
24347    * **test url**: `<https://marvel.wikia.com/wiki/Black_Panther>`__
24348    * **type**: pageload
24349    * **unit**: ms
24350    * **use live sites**: true
24351    * **Test Task**:
24352
24353    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24354       :widths: 30 15 15 15 15
24355       :header-rows: 1
24356
24357       * - **Test Name**
24358         - mozilla-central
24359         - autoland
24360         - mozilla-release
24361         - mozilla-beta
24362       * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis**
24363         - ❌
24364         - ❌
24365         - ❌
24366         - ❌
24367       * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis**
24368         - ❌
24369         - ❌
24370         - ❌
24371         - ❌
24372
24373
24374    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24375       :widths: 30 15 15 15 15
24376       :header-rows: 1
24377
24378       * - **Test Name**
24379         - mozilla-central
24380         - autoland
24381         - mozilla-release
24382         - mozilla-beta
24383       * - **browsertime-tp6m-live-chrome-m-wikia-marvel-nofis**
24384         - ❌
24385         - ❌
24386         - ❌
24387         - ❌
24388       * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis**
24389         - ❌
24390         - ❌
24391         - ❌
24392         - ❌
24393       * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis**
24394         - ❌
24395         - ❌
24396         - ❌
24397         - ❌
24398
24399
24400
24401
24402 Mobile
24403 ------
24404 Page-load performance test suite on Android. The links direct to the actual websites that are being tested.
24405
24406 .. dropdown:: allrecipes
24407    :class-container: anchor-id-allrecipes-m
24408
24409    **Owner**: PerfTest Team
24410
24411    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24412    * **alert threshold**: 2.0
24413    * **apps**: geckoview, fenix, refbrow, chrome-m
24414    * **browser cycles**: 15
24415    * **expected**: pass
24416    * **lower is better**: true
24417    * **page cycles**: 25
24418    * **page timeout**: 60000
24419    * **playback**: mitmproxy-android
24420    * **playback pageset manifest**: mitm6-android-fenix-allrecipes.manifest
24421    * **playback version**: 8.1.1
24422    * **test url**: `<https://www.allrecipes.com/>`__
24423    * **type**: pageload
24424    * **unit**: ms
24425    * **use live sites**: false
24426    * **Test Task**:
24427
24428    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24429       :widths: 30 15 15 15 15
24430       :header-rows: 1
24431
24432       * - **Test Name**
24433         - mozilla-central
24434         - autoland
24435         - mozilla-release
24436         - mozilla-beta
24437       * - **browsertime-tp6m-essential-fenix-allrecipes-nofis**
24438         - ❌
24439         - ❌
24440         - ❌
24441         - ❌
24442       * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis**
24443         - ❌
24444         - ❌
24445         - ❌
24446         - ❌
24447       * - **browsertime-tp6m-live-fenix-allrecipes-nofis**
24448         - ❌
24449         - ❌
24450         - ❌
24451         - ❌
24452       * - **browsertime-tp6m-live-geckoview-allrecipes-nofis**
24453         - ❌
24454         - ❌
24455         - ❌
24456         - ❌
24457
24458
24459    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24460       :widths: 30 15 15 15 15
24461       :header-rows: 1
24462
24463       * - **Test Name**
24464         - mozilla-central
24465         - autoland
24466         - mozilla-release
24467         - mozilla-beta
24468       * - **browsertime-tp6m-essential-chrome-m-allrecipes-nofis**
24469         - ❌
24470         - ❌
24471         - ❌
24472         - ❌
24473       * - **browsertime-tp6m-essential-fenix-allrecipes-nofis**
24474         - ❌
24475         - ❌
24476         - ❌
24477         - ❌
24478       * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis**
24479         - ✅
24480         - ✅
24481         - ❌
24482         - ❌
24483       * - **browsertime-tp6m-live-chrome-m-allrecipes-nofis**
24484         - ❌
24485         - ❌
24486         - ❌
24487         - ❌
24488       * - **browsertime-tp6m-live-fenix-allrecipes-nofis**
24489         - ❌
24490         - ❌
24491         - ❌
24492         - ❌
24493       * - **browsertime-tp6m-live-geckoview-allrecipes-nofis**
24494         - ❌
24495         - ❌
24496         - ❌
24497         - ❌
24498
24499
24500
24501 .. dropdown:: amazon
24502    :class-container: anchor-id-amazon-m
24503
24504    **Owner**: PerfTest Team
24505
24506    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
24507    * **alert threshold**: 2.0
24508    * **apps**: geckoview, fenix, refbrow, chrome-m
24509    * **browser cycles**: 15
24510    * **expected**: pass
24511    * **lower is better**: true
24512    * **page cycles**: 25
24513    * **page timeout**: 60000
24514    * **playback**: mitmproxy-android
24515    * **playback pageset manifest**: mitm6-android-fenix-amazon.manifest
24516    * **playback version**: 8.1.1
24517    * **test url**: `<https://www.amazon.com>`__
24518    * **type**: pageload
24519    * **unit**: ms
24520    * **use live sites**: false
24521    * **Test Task**:
24522
24523    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
24524       :widths: 30 15 15 15 15
24525       :header-rows: 1
24526
24527       * - **Test Name**
24528         - mozilla-central
24529         - autoland
24530         - mozilla-release
24531         - mozilla-beta
24532       * - **browsertime-tp6m-fenix-amazon**
24533         - ❌
24534         - ❌
24535         - ❌
24536         - ❌
24537       * - **browsertime-tp6m-fenix-amazon-nofis**
24538         - ❌
24539         - ❌
24540         - ❌
24541         - ❌
24542       * - **browsertime-tp6m-geckoview-amazon**
24543         - ❌
24544         - ❌
24545         - ❌
24546         - ❌
24547       * - **browsertime-tp6m-geckoview-amazon-nofis**
24548         - ❌
24549         - ❌
24550         - ❌
24551         - ❌
24552       * - **browsertime-tp6m-live-fenix-amazon-nofis**
24553         - ❌
24554         - ❌
24555         - ❌
24556         - ❌
24557       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
24558         - ❌
24559         - ❌
24560         - ❌
24561         - ❌
24562       * - **browsertime-tp6m-refbrow-amazon**
24563         - ❌
24564         - ❌
24565         - ❌
24566         - ❌
24567
24568
24569    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
24570       :widths: 30 15 15 15 15
24571       :header-rows: 1
24572
24573       * - **Test Name**
24574         - mozilla-central
24575         - autoland
24576         - mozilla-release
24577         - mozilla-beta
24578       * - **browsertime-tp6m-chrome-m-amazon**
24579         - ❌
24580         - ❌
24581         - ❌
24582         - ❌
24583       * - **browsertime-tp6m-chrome-m-amazon-nofis**
24584         - ❌
24585         - ❌
24586         - ❌
24587         - ❌
24588       * - **browsertime-tp6m-fenix-amazon**
24589         - ❌
24590         - ❌
24591         - ❌
24592         - ❌
24593       * - **browsertime-tp6m-fenix-amazon-nofis**
24594         - ❌
24595         - ❌
24596         - ❌
24597         - ❌
24598       * - **browsertime-tp6m-geckoview-amazon**
24599         - ❌
24600         - ❌
24601         - ❌
24602         - ❌
24603       * - **browsertime-tp6m-geckoview-amazon-nofis**
24604         - ✅
24605         - ✅
24606         - ❌
24607         - ❌
24608       * - **browsertime-tp6m-live-chrome-m-amazon-nofis**
24609         - ❌
24610         - ❌
24611         - ❌
24612         - ❌
24613       * - **browsertime-tp6m-live-fenix-amazon-nofis**
24614         - ❌
24615         - ❌
24616         - ❌
24617         - ❌
24618       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
24619         - ❌
24620         - ❌
24621         - ❌
24622         - ❌
24623       * - **browsertime-tp6m-refbrow-amazon**
24624         - ❌
24625         - ❌
24626         - ❌
24627         - ❌
24628
24629
24630    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
24631       :widths: 30 15 15 15 15
24632       :header-rows: 1
24633
24634       * - **Test Name**
24635         - mozilla-central
24636         - autoland
24637         - mozilla-release
24638         - mozilla-beta
24639       * - **browsertime-tp6-bytecode-firefox-amazon**
24640         - ❌
24641         - ❌
24642         - ❌
24643         - ❌
24644       * - **browsertime-tp6-essential-custom-car-amazon**
24645         - ❌
24646         - ❌
24647         - ❌
24648         - ❌
24649       * - **browsertime-tp6-essential-firefox-amazon**
24650         - ❌
24651         - ❌
24652         - ❌
24653         - ❌
24654       * - **browsertime-tp6-live-firefox-amazon**
24655         - ❌
24656         - ❌
24657         - ❌
24658         - ❌
24659
24660
24661    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
24662       :widths: 30 15 15 15 15
24663       :header-rows: 1
24664
24665       * - **Test Name**
24666         - mozilla-central
24667         - autoland
24668         - mozilla-release
24669         - mozilla-beta
24670       * - **browsertime-tp6-bytecode-firefox-amazon**
24671         - ❌
24672         - ❌
24673         - ❌
24674         - ❌
24675       * - **browsertime-tp6-essential-custom-car-amazon**
24676         - ❌
24677         - ❌
24678         - ❌
24679         - ❌
24680       * - **browsertime-tp6-essential-firefox-amazon**
24681         - ❌
24682         - ❌
24683         - ❌
24684         - ❌
24685       * - **browsertime-tp6-live-firefox-amazon**
24686         - ❌
24687         - ❌
24688         - ❌
24689         - ❌
24690
24691
24692    .. list-table:: **test-linux1804-64-qr/opt**
24693       :widths: 30 15 15 15 15
24694       :header-rows: 1
24695
24696       * - **Test Name**
24697         - mozilla-central
24698         - autoland
24699         - mozilla-release
24700         - mozilla-beta
24701       * - **browsertime-tp6-bytecode-firefox-amazon**
24702         - ❌
24703         - ❌
24704         - ❌
24705         - ❌
24706       * - **browsertime-tp6-essential-custom-car-amazon**
24707         - ❌
24708         - ❌
24709         - ❌
24710         - ❌
24711       * - **browsertime-tp6-essential-firefox-amazon**
24712         - ❌
24713         - ❌
24714         - ❌
24715         - ❌
24716       * - **browsertime-tp6-live-firefox-amazon**
24717         - ❌
24718         - ❌
24719         - ❌
24720         - ❌
24721
24722
24723    .. list-table:: **test-linux1804-64-shippable-qr/opt**
24724       :widths: 30 15 15 15 15
24725       :header-rows: 1
24726
24727       * - **Test Name**
24728         - mozilla-central
24729         - autoland
24730         - mozilla-release
24731         - mozilla-beta
24732       * - **browsertime-tp6-bytecode-firefox-amazon**
24733         - ✅
24734         - ✅
24735         - ✅
24736         - ✅
24737       * - **browsertime-tp6-essential-chrome-amazon**
24738         - ❌
24739         - ❌
24740         - ❌
24741         - ❌
24742       * - **browsertime-tp6-essential-chromium-amazon**
24743         - ❌
24744         - ❌
24745         - ❌
24746         - ❌
24747       * - **browsertime-tp6-essential-custom-car-amazon**
24748         - ❌
24749         - ❌
24750         - ❌
24751         - ❌
24752       * - **browsertime-tp6-essential-firefox-amazon**
24753         - ✅
24754         - ✅
24755         - ✅
24756         - ✅
24757       * - **browsertime-tp6-live-chrome-amazon**
24758         - ❌
24759         - ❌
24760         - ❌
24761         - ❌
24762       * - **browsertime-tp6-live-chromium-amazon**
24763         - ❌
24764         - ❌
24765         - ❌
24766         - ❌
24767       * - **browsertime-tp6-live-firefox-amazon**
24768         - ❌
24769         - ❌
24770         - ❌
24771         - ❌
24772       * - **browsertime-tp6-profiling-firefox-amazon**
24773         - ✅
24774         - ❌
24775         - ❌
24776         - ❌
24777
24778
24779    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
24780       :widths: 30 15 15 15 15
24781       :header-rows: 1
24782
24783       * - **Test Name**
24784         - mozilla-central
24785         - autoland
24786         - mozilla-release
24787         - mozilla-beta
24788       * - **browsertime-tp6-bytecode-firefox-amazon**
24789         - ❌
24790         - ❌
24791         - ❌
24792         - ❌
24793       * - **browsertime-tp6-essential-custom-car-amazon**
24794         - ❌
24795         - ❌
24796         - ❌
24797         - ❌
24798       * - **browsertime-tp6-essential-firefox-amazon**
24799         - ❌
24800         - ❌
24801         - ❌
24802         - ❌
24803       * - **browsertime-tp6-live-firefox-amazon**
24804         - ❌
24805         - ❌
24806         - ❌
24807         - ❌
24808
24809
24810    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
24811       :widths: 30 15 15 15 15
24812       :header-rows: 1
24813
24814       * - **Test Name**
24815         - mozilla-central
24816         - autoland
24817         - mozilla-release
24818         - mozilla-beta
24819       * - **browsertime-tp6-bytecode-firefox-amazon**
24820         - ✅
24821         - ✅
24822         - ✅
24823         - ✅
24824       * - **browsertime-tp6-essential-chrome-amazon**
24825         - ❌
24826         - ❌
24827         - ❌
24828         - ❌
24829       * - **browsertime-tp6-essential-chromium-amazon**
24830         - ❌
24831         - ❌
24832         - ❌
24833         - ❌
24834       * - **browsertime-tp6-essential-custom-car-amazon**
24835         - ❌
24836         - ❌
24837         - ❌
24838         - ❌
24839       * - **browsertime-tp6-essential-firefox-amazon**
24840         - ✅
24841         - ✅
24842         - ✅
24843         - ✅
24844       * - **browsertime-tp6-live-chrome-amazon**
24845         - ❌
24846         - ❌
24847         - ❌
24848         - ❌
24849       * - **browsertime-tp6-live-chromium-amazon**
24850         - ❌
24851         - ❌
24852         - ❌
24853         - ❌
24854       * - **browsertime-tp6-live-firefox-amazon**
24855         - ❌
24856         - ❌
24857         - ❌
24858         - ❌
24859       * - **browsertime-tp6-live-safari-amazon**
24860         - ❌
24861         - ❌
24862         - ❌
24863         - ❌
24864       * - **browsertime-tp6-profiling-firefox-amazon**
24865         - ✅
24866         - ❌
24867         - ❌
24868         - ❌
24869
24870
24871    .. list-table:: **test-windows10-32-qr/opt**
24872       :widths: 30 15 15 15 15
24873       :header-rows: 1
24874
24875       * - **Test Name**
24876         - mozilla-central
24877         - autoland
24878         - mozilla-release
24879         - mozilla-beta
24880       * - **browsertime-tp6-bytecode-firefox-amazon**
24881         - ❌
24882         - ❌
24883         - ❌
24884         - ❌
24885       * - **browsertime-tp6-essential-custom-car-amazon**
24886         - ❌
24887         - ❌
24888         - ❌
24889         - ❌
24890       * - **browsertime-tp6-essential-firefox-amazon**
24891         - ❌
24892         - ❌
24893         - ❌
24894         - ❌
24895       * - **browsertime-tp6-live-firefox-amazon**
24896         - ❌
24897         - ❌
24898         - ❌
24899         - ❌
24900
24901
24902    .. list-table:: **test-windows10-32-shippable-qr/opt**
24903       :widths: 30 15 15 15 15
24904       :header-rows: 1
24905
24906       * - **Test Name**
24907         - mozilla-central
24908         - autoland
24909         - mozilla-release
24910         - mozilla-beta
24911       * - **browsertime-tp6-bytecode-firefox-amazon**
24912         - ❌
24913         - ❌
24914         - ❌
24915         - ❌
24916       * - **browsertime-tp6-essential-chrome-amazon**
24917         - ❌
24918         - ❌
24919         - ❌
24920         - ❌
24921       * - **browsertime-tp6-essential-chromium-amazon**
24922         - ❌
24923         - ❌
24924         - ❌
24925         - ❌
24926       * - **browsertime-tp6-essential-custom-car-amazon**
24927         - ❌
24928         - ❌
24929         - ❌
24930         - ❌
24931       * - **browsertime-tp6-essential-firefox-amazon**
24932         - ❌
24933         - ❌
24934         - ❌
24935         - ❌
24936       * - **browsertime-tp6-live-chrome-amazon**
24937         - ❌
24938         - ❌
24939         - ❌
24940         - ❌
24941       * - **browsertime-tp6-live-chromium-amazon**
24942         - ❌
24943         - ❌
24944         - ❌
24945         - ❌
24946       * - **browsertime-tp6-live-firefox-amazon**
24947         - ❌
24948         - ❌
24949         - ❌
24950         - ❌
24951
24952
24953    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
24954       :widths: 30 15 15 15 15
24955       :header-rows: 1
24956
24957       * - **Test Name**
24958         - mozilla-central
24959         - autoland
24960         - mozilla-release
24961         - mozilla-beta
24962       * - **browsertime-tp6-bytecode-firefox-amazon**
24963         - ❌
24964         - ❌
24965         - ❌
24966         - ❌
24967       * - **browsertime-tp6-essential-custom-car-amazon**
24968         - ❌
24969         - ❌
24970         - ❌
24971         - ❌
24972       * - **browsertime-tp6-essential-firefox-amazon**
24973         - ❌
24974         - ❌
24975         - ❌
24976         - ❌
24977       * - **browsertime-tp6-live-firefox-amazon**
24978         - ❌
24979         - ❌
24980         - ❌
24981         - ❌
24982
24983
24984    .. list-table:: **test-windows10-64-qr/opt**
24985       :widths: 30 15 15 15 15
24986       :header-rows: 1
24987
24988       * - **Test Name**
24989         - mozilla-central
24990         - autoland
24991         - mozilla-release
24992         - mozilla-beta
24993       * - **browsertime-tp6-bytecode-firefox-amazon**
24994         - ❌
24995         - ❌
24996         - ❌
24997         - ❌
24998       * - **browsertime-tp6-essential-custom-car-amazon**
24999         - ❌
25000         - ❌
25001         - ❌
25002         - ❌
25003       * - **browsertime-tp6-essential-firefox-amazon**
25004         - ❌
25005         - ❌
25006         - ❌
25007         - ❌
25008       * - **browsertime-tp6-live-firefox-amazon**
25009         - ❌
25010         - ❌
25011         - ❌
25012         - ❌
25013
25014
25015    .. list-table:: **test-windows10-64-shippable-qr/opt**
25016       :widths: 30 15 15 15 15
25017       :header-rows: 1
25018
25019       * - **Test Name**
25020         - mozilla-central
25021         - autoland
25022         - mozilla-release
25023         - mozilla-beta
25024       * - **browsertime-tp6-bytecode-firefox-amazon**
25025         - ✅
25026         - ✅
25027         - ✅
25028         - ✅
25029       * - **browsertime-tp6-essential-chrome-amazon**
25030         - ❌
25031         - ❌
25032         - ❌
25033         - ❌
25034       * - **browsertime-tp6-essential-chromium-amazon**
25035         - ❌
25036         - ❌
25037         - ❌
25038         - ❌
25039       * - **browsertime-tp6-essential-custom-car-amazon**
25040         - ❌
25041         - ❌
25042         - ❌
25043         - ❌
25044       * - **browsertime-tp6-essential-firefox-amazon**
25045         - ✅
25046         - ✅
25047         - ✅
25048         - ✅
25049       * - **browsertime-tp6-live-chrome-amazon**
25050         - ❌
25051         - ❌
25052         - ❌
25053         - ❌
25054       * - **browsertime-tp6-live-chromium-amazon**
25055         - ❌
25056         - ❌
25057         - ❌
25058         - ❌
25059       * - **browsertime-tp6-live-firefox-amazon**
25060         - ❌
25061         - ❌
25062         - ❌
25063         - ❌
25064
25065
25066
25067 .. dropdown:: amazon-search
25068    :class-container: anchor-id-amazon-search-m
25069
25070    **Owner**: PerfTest Team
25071
25072    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
25073    * **alert threshold**: 2.0
25074    * **apps**: geckoview, fenix, refbrow, chrome-m
25075    * **browser cycles**: 15
25076    * **expected**: pass
25077    * **lower is better**: true
25078    * **page cycles**: 25
25079    * **page timeout**: 60000
25080    * **playback**: mitmproxy-android
25081    * **playback pageset manifest**: mitm6-android-fenix-amazon-search.manifest
25082    * **playback version**: 8.1.1
25083    * **test url**: `<https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone>`__
25084    * **type**: pageload
25085    * **unit**: ms
25086    * **use live sites**: false
25087    * **Test Task**:
25088
25089    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
25090       :widths: 30 15 15 15 15
25091       :header-rows: 1
25092
25093       * - **Test Name**
25094         - mozilla-central
25095         - autoland
25096         - mozilla-release
25097         - mozilla-beta
25098       * - **browsertime-tp6m-essential-fenix-amazon-search-nofis**
25099         - ❌
25100         - ❌
25101         - ❌
25102         - ❌
25103       * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis**
25104         - ❌
25105         - ❌
25106         - ❌
25107         - ❌
25108       * - **browsertime-tp6m-live-fenix-amazon-search-nofis**
25109         - ❌
25110         - ❌
25111         - ❌
25112         - ❌
25113       * - **browsertime-tp6m-live-geckoview-amazon-search-nofis**
25114         - ❌
25115         - ❌
25116         - ❌
25117         - ❌
25118
25119
25120    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
25121       :widths: 30 15 15 15 15
25122       :header-rows: 1
25123
25124       * - **Test Name**
25125         - mozilla-central
25126         - autoland
25127         - mozilla-release
25128         - mozilla-beta
25129       * - **browsertime-tp6m-essential-chrome-m-amazon-search-nofis**
25130         - ❌
25131         - ❌
25132         - ❌
25133         - ❌
25134       * - **browsertime-tp6m-essential-fenix-amazon-search-nofis**
25135         - ❌
25136         - ❌
25137         - ❌
25138         - ❌
25139       * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis**
25140         - ✅
25141         - ✅
25142         - ❌
25143         - ❌
25144       * - **browsertime-tp6m-live-chrome-m-amazon-search-nofis**
25145         - ❌
25146         - ❌
25147         - ❌
25148         - ❌
25149       * - **browsertime-tp6m-live-fenix-amazon-search-nofis**
25150         - ❌
25151         - ❌
25152         - ❌
25153         - ❌
25154       * - **browsertime-tp6m-live-geckoview-amazon-search-nofis**
25155         - ❌
25156         - ❌
25157         - ❌
25158         - ❌
25159
25160
25161
25162 .. dropdown:: bing
25163    :class-container: anchor-id-bing-m
25164
25165    **Owner**: PerfTest Team
25166
25167    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
25168    * **alert threshold**: 2.0
25169    * **apps**: geckoview, fenix, refbrow, chrome-m
25170    * **browser cycles**: 15
25171    * **expected**: pass
25172    * **lower is better**: true
25173    * **page cycles**: 25
25174    * **page timeout**: 60000
25175    * **playback**: mitmproxy-android
25176    * **playback pageset manifest**: mitm6-android-fenix-bing.manifest
25177    * **playback version**: 8.1.1
25178    * **test url**: `<https://www.bing.com/>`__
25179    * **type**: pageload
25180    * **unit**: ms
25181    * **use live sites**: false
25182    * **Test Task**:
25183
25184    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
25185       :widths: 30 15 15 15 15
25186       :header-rows: 1
25187
25188       * - **Test Name**
25189         - mozilla-central
25190         - autoland
25191         - mozilla-release
25192         - mozilla-beta
25193       * - **browsertime-tp6m-fenix-bing**
25194         - ❌
25195         - ❌
25196         - ❌
25197         - ❌
25198       * - **browsertime-tp6m-fenix-bing-nofis**
25199         - ❌
25200         - ❌
25201         - ❌
25202         - ❌
25203       * - **browsertime-tp6m-geckoview-bing**
25204         - ❌
25205         - ❌
25206         - ❌
25207         - ❌
25208       * - **browsertime-tp6m-geckoview-bing-nofis**
25209         - ❌
25210         - ❌
25211         - ❌
25212         - ❌
25213       * - **browsertime-tp6m-live-fenix-bing-nofis**
25214         - ❌
25215         - ❌
25216         - ❌
25217         - ❌
25218       * - **browsertime-tp6m-live-geckoview-bing-nofis**
25219         - ❌
25220         - ❌
25221         - ❌
25222         - ❌
25223       * - **browsertime-tp6m-refbrow-bing**
25224         - ❌
25225         - ❌
25226         - ❌
25227         - ❌
25228
25229
25230    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
25231       :widths: 30 15 15 15 15
25232       :header-rows: 1
25233
25234       * - **Test Name**
25235         - mozilla-central
25236         - autoland
25237         - mozilla-release
25238         - mozilla-beta
25239       * - **browsertime-tp6m-chrome-m-bing**
25240         - ❌
25241         - ❌
25242         - ❌
25243         - ❌
25244       * - **browsertime-tp6m-chrome-m-bing-nofis**
25245         - ❌
25246         - ❌
25247         - ❌
25248         - ❌
25249       * - **browsertime-tp6m-fenix-bing**
25250         - ❌
25251         - ❌
25252         - ❌
25253         - ❌
25254       * - **browsertime-tp6m-fenix-bing-nofis**
25255         - ❌
25256         - ❌
25257         - ❌
25258         - ❌
25259       * - **browsertime-tp6m-geckoview-bing**
25260         - ❌
25261         - ❌
25262         - ❌
25263         - ❌
25264       * - **browsertime-tp6m-geckoview-bing-nofis**
25265         - ✅
25266         - ✅
25267         - ❌
25268         - ❌
25269       * - **browsertime-tp6m-live-chrome-m-bing-nofis**
25270         - ❌
25271         - ❌
25272         - ❌
25273         - ❌
25274       * - **browsertime-tp6m-live-fenix-bing-nofis**
25275         - ❌
25276         - ❌
25277         - ❌
25278         - ❌
25279       * - **browsertime-tp6m-live-geckoview-bing-nofis**
25280         - ❌
25281         - ❌
25282         - ❌
25283         - ❌
25284       * - **browsertime-tp6m-refbrow-bing**
25285         - ❌
25286         - ❌
25287         - ❌
25288         - ❌
25289
25290
25291
25292 .. dropdown:: bing-search-restaurants
25293    :class-container: anchor-id-bing-search-restaurants-m
25294
25295    **Owner**: PerfTest Team
25296
25297    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
25298    * **alert threshold**: 2.0
25299    * **apps**: geckoview, fenix, refbrow, chrome-m
25300    * **browser cycles**: 15
25301    * **expected**: pass
25302    * **lower is better**: true
25303    * **page cycles**: 25
25304    * **page timeout**: 60000
25305    * **playback**: mitmproxy-android
25306    * **playback pageset manifest**: mitm6-android-fenix-bing-search-restaurants.manifest
25307    * **playback version**: 8.1.1
25308    * **test url**: `<https://www.bing.com/search?q=restaurants+in+exton+pa+19341>`__
25309    * **type**: pageload
25310    * **unit**: ms
25311    * **use live sites**: false
25312    * **Test Task**:
25313
25314    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
25315       :widths: 30 15 15 15 15
25316       :header-rows: 1
25317
25318       * - **Test Name**
25319         - mozilla-central
25320         - autoland
25321         - mozilla-release
25322         - mozilla-beta
25323       * - **browsertime-tp6m-fenix-bing-search-restaurants**
25324         - ❌
25325         - ❌
25326         - ❌
25327         - ❌
25328       * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis**
25329         - ❌
25330         - ❌
25331         - ❌
25332         - ❌
25333       * - **browsertime-tp6m-geckoview-bing-search-restaurants**
25334         - ❌
25335         - ❌
25336         - ❌
25337         - ❌
25338       * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis**
25339         - ❌
25340         - ❌
25341         - ❌
25342         - ❌
25343       * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis**
25344         - ❌
25345         - ❌
25346         - ❌
25347         - ❌
25348       * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis**
25349         - ❌
25350         - ❌
25351         - ❌
25352         - ❌
25353       * - **browsertime-tp6m-refbrow-bing-search-restaurants**
25354         - ❌
25355         - ❌
25356         - ❌
25357         - ❌
25358
25359
25360    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
25361       :widths: 30 15 15 15 15
25362       :header-rows: 1
25363
25364       * - **Test Name**
25365         - mozilla-central
25366         - autoland
25367         - mozilla-release
25368         - mozilla-beta
25369       * - **browsertime-tp6m-chrome-m-bing-search-restaurants**
25370         - ❌
25371         - ❌
25372         - ❌
25373         - ❌
25374       * - **browsertime-tp6m-chrome-m-bing-search-restaurants-nofis**
25375         - ❌
25376         - ❌
25377         - ❌
25378         - ❌
25379       * - **browsertime-tp6m-fenix-bing-search-restaurants**
25380         - ❌
25381         - ❌
25382         - ❌
25383         - ❌
25384       * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis**
25385         - ❌
25386         - ❌
25387         - ❌
25388         - ❌
25389       * - **browsertime-tp6m-geckoview-bing-search-restaurants**
25390         - ❌
25391         - ❌
25392         - ❌
25393         - ❌
25394       * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis**
25395         - ✅
25396         - ✅
25397         - ❌
25398         - ❌
25399       * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis**
25400         - ❌
25401         - ❌
25402         - ❌
25403         - ❌
25404       * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis**
25405         - ❌
25406         - ❌
25407         - ❌
25408         - ❌
25409       * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis**
25410         - ❌
25411         - ❌
25412         - ❌
25413         - ❌
25414       * - **browsertime-tp6m-refbrow-bing-search-restaurants**
25415         - ❌
25416         - ❌
25417         - ❌
25418         - ❌
25419
25420
25421
25422 .. dropdown:: booking
25423    :class-container: anchor-id-booking-m
25424
25425    **Owner**: PerfTest Team
25426
25427    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
25428    * **alert threshold**: 2.0
25429    * **apps**: geckoview, fenix, refbrow, chrome-m
25430    * **browser cycles**: 15
25431    * **expected**: pass
25432    * **lower is better**: true
25433    * **page cycles**: 25
25434    * **page timeout**: 60000
25435    * **playback**: mitmproxy-android
25436    * **playback pageset manifest**: mitm6-android-fenix-booking.manifest
25437    * **playback version**: 8.1.1
25438    * **test url**: `<https://www.booking.com/>`__
25439    * **type**: pageload
25440    * **unit**: ms
25441    * **use live sites**: false
25442    * **Test Task**:
25443
25444    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
25445       :widths: 30 15 15 15 15
25446       :header-rows: 1
25447
25448       * - **Test Name**
25449         - mozilla-central
25450         - autoland
25451         - mozilla-release
25452         - mozilla-beta
25453       * - **browsertime-tp6m-fenix-booking**
25454         - ❌
25455         - ❌
25456         - ❌
25457         - ❌
25458       * - **browsertime-tp6m-fenix-booking-nofis**
25459         - ❌
25460         - ❌
25461         - ❌
25462         - ❌
25463       * - **browsertime-tp6m-geckoview-booking**
25464         - ❌
25465         - ❌
25466         - ❌
25467         - ❌
25468       * - **browsertime-tp6m-geckoview-booking-nofis**
25469         - ❌
25470         - ❌
25471         - ❌
25472         - ❌
25473       * - **browsertime-tp6m-live-fenix-booking-nofis**
25474         - ❌
25475         - ❌
25476         - ❌
25477         - ❌
25478       * - **browsertime-tp6m-live-geckoview-booking-nofis**
25479         - ❌
25480         - ❌
25481         - ❌
25482         - ❌
25483       * - **browsertime-tp6m-refbrow-booking**
25484         - ❌
25485         - ❌
25486         - ❌
25487         - ❌
25488
25489
25490    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
25491       :widths: 30 15 15 15 15
25492       :header-rows: 1
25493
25494       * - **Test Name**
25495         - mozilla-central
25496         - autoland
25497         - mozilla-release
25498         - mozilla-beta
25499       * - **browsertime-tp6m-chrome-m-booking**
25500         - ❌
25501         - ❌
25502         - ❌
25503         - ❌
25504       * - **browsertime-tp6m-chrome-m-booking-nofis**
25505         - ❌
25506         - ❌
25507         - ❌
25508         - ❌
25509       * - **browsertime-tp6m-fenix-booking**
25510         - ❌
25511         - ❌
25512         - ❌
25513         - ❌
25514       * - **browsertime-tp6m-fenix-booking-nofis**
25515         - ❌
25516         - ❌
25517         - ❌
25518         - ❌
25519       * - **browsertime-tp6m-geckoview-booking**
25520         - ❌
25521         - ❌
25522         - ❌
25523         - ❌
25524       * - **browsertime-tp6m-geckoview-booking-nofis**
25525         - ✅
25526         - ✅
25527         - ❌
25528         - ❌
25529       * - **browsertime-tp6m-live-chrome-m-booking-nofis**
25530         - ❌
25531         - ❌
25532         - ❌
25533         - ❌
25534       * - **browsertime-tp6m-live-fenix-booking-nofis**
25535         - ❌
25536         - ❌
25537         - ❌
25538         - ❌
25539       * - **browsertime-tp6m-live-geckoview-booking-nofis**
25540         - ❌
25541         - ❌
25542         - ❌
25543         - ❌
25544       * - **browsertime-tp6m-refbrow-booking**
25545         - ❌
25546         - ❌
25547         - ❌
25548         - ❌
25549
25550
25551
25552 .. dropdown:: cnn
25553    :class-container: anchor-id-cnn-m
25554
25555    **Owner**: PerfTest Team
25556
25557    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
25558    * **alert threshold**: 2.0
25559    * **apps**: geckoview, fenix, refbrow, chrome-m
25560    * **browser cycles**: 15
25561    * **expected**: pass
25562    * **lower is better**: true
25563    * **page cycles**: 25
25564    * **page timeout**: 60000
25565    * **playback**: mitmproxy-android
25566    * **playback pageset manifest**: mitm6-android-fenix-cnn.manifest
25567    * **playback version**: 8.1.1
25568    * **test url**: `<https://cnn.com>`__
25569    * **type**: pageload
25570    * **unit**: ms
25571    * **use live sites**: false
25572    * **Test Task**:
25573
25574    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
25575       :widths: 30 15 15 15 15
25576       :header-rows: 1
25577
25578       * - **Test Name**
25579         - mozilla-central
25580         - autoland
25581         - mozilla-release
25582         - mozilla-beta
25583       * - **browsertime-tp6m-fenix-cnn**
25584         - ❌
25585         - ❌
25586         - ❌
25587         - ❌
25588       * - **browsertime-tp6m-fenix-cnn-nofis**
25589         - ❌
25590         - ❌
25591         - ❌
25592         - ❌
25593       * - **browsertime-tp6m-geckoview-cnn**
25594         - ❌
25595         - ❌
25596         - ❌
25597         - ❌
25598       * - **browsertime-tp6m-geckoview-cnn-nofis**
25599         - ❌
25600         - ❌
25601         - ❌
25602         - ❌
25603       * - **browsertime-tp6m-live-fenix-cnn-nofis**
25604         - ❌
25605         - ❌
25606         - ❌
25607         - ❌
25608       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
25609         - ❌
25610         - ❌
25611         - ❌
25612         - ❌
25613       * - **browsertime-tp6m-refbrow-cnn**
25614         - ❌
25615         - ❌
25616         - ❌
25617         - ❌
25618
25619
25620    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
25621       :widths: 30 15 15 15 15
25622       :header-rows: 1
25623
25624       * - **Test Name**
25625         - mozilla-central
25626         - autoland
25627         - mozilla-release
25628         - mozilla-beta
25629       * - **browsertime-tp6m-chrome-m-cnn**
25630         - ❌
25631         - ❌
25632         - ❌
25633         - ❌
25634       * - **browsertime-tp6m-chrome-m-cnn-nofis**
25635         - ❌
25636         - ❌
25637         - ❌
25638         - ❌
25639       * - **browsertime-tp6m-fenix-cnn**
25640         - ❌
25641         - ❌
25642         - ❌
25643         - ❌
25644       * - **browsertime-tp6m-fenix-cnn-nofis**
25645         - ❌
25646         - ❌
25647         - ❌
25648         - ❌
25649       * - **browsertime-tp6m-geckoview-cnn**
25650         - ❌
25651         - ❌
25652         - ❌
25653         - ❌
25654       * - **browsertime-tp6m-geckoview-cnn-nofis**
25655         - ✅
25656         - ✅
25657         - ❌
25658         - ❌
25659       * - **browsertime-tp6m-live-chrome-m-cnn-nofis**
25660         - ❌
25661         - ❌
25662         - ❌
25663         - ❌
25664       * - **browsertime-tp6m-live-fenix-cnn-nofis**
25665         - ❌
25666         - ❌
25667         - ❌
25668         - ❌
25669       * - **browsertime-tp6m-live-geckoview-cnn-nofis**
25670         - ❌
25671         - ❌
25672         - ❌
25673         - ❌
25674       * - **browsertime-tp6m-refbrow-cnn**
25675         - ❌
25676         - ❌
25677         - ❌
25678         - ❌
25679
25680
25681    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
25682       :widths: 30 15 15 15 15
25683       :header-rows: 1
25684
25685       * - **Test Name**
25686         - mozilla-central
25687         - autoland
25688         - mozilla-release
25689         - mozilla-beta
25690       * - **browsertime-tp6-bytecode-firefox-cnn**
25691         - ❌
25692         - ❌
25693         - ❌
25694         - ❌
25695       * - **browsertime-tp6-essential-custom-car-cnn**
25696         - ❌
25697         - ❌
25698         - ❌
25699         - ❌
25700       * - **browsertime-tp6-essential-firefox-cnn**
25701         - ❌
25702         - ❌
25703         - ❌
25704         - ❌
25705       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25706         - ❌
25707         - ❌
25708         - ❌
25709         - ❌
25710
25711
25712    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
25713       :widths: 30 15 15 15 15
25714       :header-rows: 1
25715
25716       * - **Test Name**
25717         - mozilla-central
25718         - autoland
25719         - mozilla-release
25720         - mozilla-beta
25721       * - **browsertime-tp6-bytecode-firefox-cnn**
25722         - ❌
25723         - ❌
25724         - ❌
25725         - ❌
25726       * - **browsertime-tp6-essential-custom-car-cnn**
25727         - ❌
25728         - ❌
25729         - ❌
25730         - ❌
25731       * - **browsertime-tp6-essential-firefox-cnn**
25732         - ❌
25733         - ❌
25734         - ❌
25735         - ❌
25736       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25737         - ❌
25738         - ❌
25739         - ❌
25740         - ❌
25741
25742
25743    .. list-table:: **test-linux1804-64-qr/opt**
25744       :widths: 30 15 15 15 15
25745       :header-rows: 1
25746
25747       * - **Test Name**
25748         - mozilla-central
25749         - autoland
25750         - mozilla-release
25751         - mozilla-beta
25752       * - **browsertime-tp6-bytecode-firefox-cnn**
25753         - ❌
25754         - ❌
25755         - ❌
25756         - ❌
25757       * - **browsertime-tp6-essential-custom-car-cnn**
25758         - ❌
25759         - ❌
25760         - ❌
25761         - ❌
25762       * - **browsertime-tp6-essential-firefox-cnn**
25763         - ❌
25764         - ❌
25765         - ❌
25766         - ❌
25767       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25768         - ❌
25769         - ❌
25770         - ❌
25771         - ❌
25772
25773
25774    .. list-table:: **test-linux1804-64-shippable-qr/opt**
25775       :widths: 30 15 15 15 15
25776       :header-rows: 1
25777
25778       * - **Test Name**
25779         - mozilla-central
25780         - autoland
25781         - mozilla-release
25782         - mozilla-beta
25783       * - **browsertime-tp6-bytecode-firefox-cnn**
25784         - ✅
25785         - ✅
25786         - ✅
25787         - ✅
25788       * - **browsertime-tp6-essential-chrome-cnn**
25789         - ❌
25790         - ❌
25791         - ❌
25792         - ❌
25793       * - **browsertime-tp6-essential-chromium-cnn**
25794         - ❌
25795         - ❌
25796         - ❌
25797         - ❌
25798       * - **browsertime-tp6-essential-custom-car-cnn**
25799         - ❌
25800         - ❌
25801         - ❌
25802         - ❌
25803       * - **browsertime-tp6-essential-firefox-cnn**
25804         - ✅
25805         - ✅
25806         - ✅
25807         - ✅
25808       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25809         - ❌
25810         - ❌
25811         - ❌
25812         - ❌
25813
25814
25815    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
25816       :widths: 30 15 15 15 15
25817       :header-rows: 1
25818
25819       * - **Test Name**
25820         - mozilla-central
25821         - autoland
25822         - mozilla-release
25823         - mozilla-beta
25824       * - **browsertime-tp6-bytecode-firefox-cnn**
25825         - ❌
25826         - ❌
25827         - ❌
25828         - ❌
25829       * - **browsertime-tp6-essential-custom-car-cnn**
25830         - ❌
25831         - ❌
25832         - ❌
25833         - ❌
25834       * - **browsertime-tp6-essential-firefox-cnn**
25835         - ❌
25836         - ❌
25837         - ❌
25838         - ❌
25839       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25840         - ❌
25841         - ❌
25842         - ❌
25843         - ❌
25844
25845
25846    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
25847       :widths: 30 15 15 15 15
25848       :header-rows: 1
25849
25850       * - **Test Name**
25851         - mozilla-central
25852         - autoland
25853         - mozilla-release
25854         - mozilla-beta
25855       * - **browsertime-tp6-bytecode-firefox-cnn**
25856         - ✅
25857         - ✅
25858         - ✅
25859         - ✅
25860       * - **browsertime-tp6-essential-chrome-cnn**
25861         - ❌
25862         - ❌
25863         - ❌
25864         - ❌
25865       * - **browsertime-tp6-essential-chromium-cnn**
25866         - ❌
25867         - ❌
25868         - ❌
25869         - ❌
25870       * - **browsertime-tp6-essential-custom-car-cnn**
25871         - ❌
25872         - ❌
25873         - ❌
25874         - ❌
25875       * - **browsertime-tp6-essential-firefox-cnn**
25876         - ✅
25877         - ✅
25878         - ✅
25879         - ✅
25880       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25881         - ❌
25882         - ❌
25883         - ❌
25884         - ❌
25885
25886
25887    .. list-table:: **test-windows10-32-qr/opt**
25888       :widths: 30 15 15 15 15
25889       :header-rows: 1
25890
25891       * - **Test Name**
25892         - mozilla-central
25893         - autoland
25894         - mozilla-release
25895         - mozilla-beta
25896       * - **browsertime-tp6-bytecode-firefox-cnn**
25897         - ❌
25898         - ❌
25899         - ❌
25900         - ❌
25901       * - **browsertime-tp6-essential-custom-car-cnn**
25902         - ❌
25903         - ❌
25904         - ❌
25905         - ❌
25906       * - **browsertime-tp6-essential-firefox-cnn**
25907         - ❌
25908         - ❌
25909         - ❌
25910         - ❌
25911       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25912         - ❌
25913         - ❌
25914         - ❌
25915         - ❌
25916
25917
25918    .. list-table:: **test-windows10-32-shippable-qr/opt**
25919       :widths: 30 15 15 15 15
25920       :header-rows: 1
25921
25922       * - **Test Name**
25923         - mozilla-central
25924         - autoland
25925         - mozilla-release
25926         - mozilla-beta
25927       * - **browsertime-tp6-bytecode-firefox-cnn**
25928         - ❌
25929         - ❌
25930         - ❌
25931         - ❌
25932       * - **browsertime-tp6-essential-chrome-cnn**
25933         - ❌
25934         - ❌
25935         - ❌
25936         - ❌
25937       * - **browsertime-tp6-essential-chromium-cnn**
25938         - ❌
25939         - ❌
25940         - ❌
25941         - ❌
25942       * - **browsertime-tp6-essential-custom-car-cnn**
25943         - ❌
25944         - ❌
25945         - ❌
25946         - ❌
25947       * - **browsertime-tp6-essential-firefox-cnn**
25948         - ❌
25949         - ❌
25950         - ❌
25951         - ❌
25952       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25953         - ❌
25954         - ❌
25955         - ❌
25956         - ❌
25957
25958
25959    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
25960       :widths: 30 15 15 15 15
25961       :header-rows: 1
25962
25963       * - **Test Name**
25964         - mozilla-central
25965         - autoland
25966         - mozilla-release
25967         - mozilla-beta
25968       * - **browsertime-tp6-bytecode-firefox-cnn**
25969         - ❌
25970         - ❌
25971         - ❌
25972         - ❌
25973       * - **browsertime-tp6-essential-custom-car-cnn**
25974         - ❌
25975         - ❌
25976         - ❌
25977         - ❌
25978       * - **browsertime-tp6-essential-firefox-cnn**
25979         - ❌
25980         - ❌
25981         - ❌
25982         - ❌
25983       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
25984         - ❌
25985         - ❌
25986         - ❌
25987         - ❌
25988
25989
25990    .. list-table:: **test-windows10-64-qr/opt**
25991       :widths: 30 15 15 15 15
25992       :header-rows: 1
25993
25994       * - **Test Name**
25995         - mozilla-central
25996         - autoland
25997         - mozilla-release
25998         - mozilla-beta
25999       * - **browsertime-tp6-bytecode-firefox-cnn**
26000         - ❌
26001         - ❌
26002         - ❌
26003         - ❌
26004       * - **browsertime-tp6-essential-custom-car-cnn**
26005         - ❌
26006         - ❌
26007         - ❌
26008         - ❌
26009       * - **browsertime-tp6-essential-firefox-cnn**
26010         - ❌
26011         - ❌
26012         - ❌
26013         - ❌
26014       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
26015         - ❌
26016         - ❌
26017         - ❌
26018         - ❌
26019
26020
26021    .. list-table:: **test-windows10-64-shippable-qr/opt**
26022       :widths: 30 15 15 15 15
26023       :header-rows: 1
26024
26025       * - **Test Name**
26026         - mozilla-central
26027         - autoland
26028         - mozilla-release
26029         - mozilla-beta
26030       * - **browsertime-tp6-bytecode-firefox-cnn**
26031         - ✅
26032         - ✅
26033         - ✅
26034         - ✅
26035       * - **browsertime-tp6-essential-chrome-cnn**
26036         - ❌
26037         - ❌
26038         - ❌
26039         - ❌
26040       * - **browsertime-tp6-essential-chromium-cnn**
26041         - ❌
26042         - ❌
26043         - ❌
26044         - ❌
26045       * - **browsertime-tp6-essential-custom-car-cnn**
26046         - ❌
26047         - ❌
26048         - ❌
26049         - ❌
26050       * - **browsertime-tp6-essential-firefox-cnn**
26051         - ✅
26052         - ✅
26053         - ✅
26054         - ✅
26055       * - **browsertime-tp6-live-sheriffed-firefox-cnn**
26056         - ❌
26057         - ❌
26058         - ❌
26059         - ❌
26060
26061
26062
26063 .. dropdown:: cnn-ampstories
26064    :class-container: anchor-id-cnn-ampstories-m
26065
26066    **Owner**: PerfTest Team
26067
26068    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26069    * **alert threshold**: 2.0
26070    * **apps**: geckoview, fenix, refbrow, chrome-m
26071    * **browser cycles**: 15
26072    * **expected**: pass
26073    * **lower is better**: true
26074    * **page cycles**: 25
26075    * **page timeout**: 60000
26076    * **playback**: mitmproxy-android
26077    * **playback pageset manifest**: mitm6-android-fenix-cnn-ampstories.manifest
26078    * **playback version**: 8.1.1
26079    * **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
26080    * **type**: pageload
26081    * **unit**: ms
26082    * **use live sites**: false
26083    * **Test Task**:
26084
26085    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26086       :widths: 30 15 15 15 15
26087       :header-rows: 1
26088
26089       * - **Test Name**
26090         - mozilla-central
26091         - autoland
26092         - mozilla-release
26093         - mozilla-beta
26094       * - **browsertime-tp6m-fenix-cnn-ampstories**
26095         - ❌
26096         - ❌
26097         - ❌
26098         - ❌
26099       * - **browsertime-tp6m-fenix-cnn-ampstories-nofis**
26100         - ❌
26101         - ❌
26102         - ❌
26103         - ❌
26104       * - **browsertime-tp6m-geckoview-cnn-ampstories**
26105         - ❌
26106         - ❌
26107         - ❌
26108         - ❌
26109       * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis**
26110         - ❌
26111         - ❌
26112         - ❌
26113         - ❌
26114       * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis**
26115         - ❌
26116         - ❌
26117         - ❌
26118         - ❌
26119       * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis**
26120         - ❌
26121         - ❌
26122         - ❌
26123         - ❌
26124       * - **browsertime-tp6m-refbrow-cnn-ampstories**
26125         - ❌
26126         - ❌
26127         - ❌
26128         - ❌
26129
26130
26131    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26132       :widths: 30 15 15 15 15
26133       :header-rows: 1
26134
26135       * - **Test Name**
26136         - mozilla-central
26137         - autoland
26138         - mozilla-release
26139         - mozilla-beta
26140       * - **browsertime-tp6m-chrome-m-cnn-ampstories**
26141         - ❌
26142         - ❌
26143         - ❌
26144         - ❌
26145       * - **browsertime-tp6m-chrome-m-cnn-ampstories-nofis**
26146         - ❌
26147         - ❌
26148         - ❌
26149         - ❌
26150       * - **browsertime-tp6m-fenix-cnn-ampstories**
26151         - ❌
26152         - ❌
26153         - ❌
26154         - ❌
26155       * - **browsertime-tp6m-fenix-cnn-ampstories-nofis**
26156         - ❌
26157         - ❌
26158         - ❌
26159         - ❌
26160       * - **browsertime-tp6m-geckoview-cnn-ampstories**
26161         - ❌
26162         - ❌
26163         - ❌
26164         - ❌
26165       * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis**
26166         - ✅
26167         - ✅
26168         - ❌
26169         - ❌
26170       * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis**
26171         - ❌
26172         - ❌
26173         - ❌
26174         - ❌
26175       * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis**
26176         - ❌
26177         - ❌
26178         - ❌
26179         - ❌
26180       * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis**
26181         - ❌
26182         - ✅
26183         - ❌
26184         - ❌
26185       * - **browsertime-tp6m-refbrow-cnn-ampstories**
26186         - ❌
26187         - ❌
26188         - ❌
26189         - ❌
26190
26191
26192
26193 .. dropdown:: dailymail
26194    :class-container: anchor-id-dailymail-m
26195
26196    **Owner**: PerfTest Team
26197
26198    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26199    * **alert threshold**: 2.0
26200    * **apps**: geckoview, fenix, refbrow, chrome-m
26201    * **browser cycles**: 15
26202    * **expected**: pass
26203    * **lower is better**: true
26204    * **page cycles**: 25
26205    * **page timeout**: 60000
26206    * **playback**: mitmproxy-android
26207    * **playback pageset manifest**: mitm6-android-fenix-dailymail.manifest
26208    * **playback version**: 8.1.1
26209    * **test url**: `<https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html>`__
26210    * **type**: pageload
26211    * **unit**: ms
26212    * **use live sites**: false
26213    * **Test Task**:
26214
26215    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26216       :widths: 30 15 15 15 15
26217       :header-rows: 1
26218
26219       * - **Test Name**
26220         - mozilla-central
26221         - autoland
26222         - mozilla-release
26223         - mozilla-beta
26224       * - **browsertime-tp6m-fenix-dailymail**
26225         - ❌
26226         - ❌
26227         - ❌
26228         - ❌
26229       * - **browsertime-tp6m-fenix-dailymail-nofis**
26230         - ❌
26231         - ❌
26232         - ❌
26233         - ❌
26234       * - **browsertime-tp6m-geckoview-dailymail**
26235         - ❌
26236         - ❌
26237         - ❌
26238         - ❌
26239       * - **browsertime-tp6m-geckoview-dailymail-nofis**
26240         - ❌
26241         - ❌
26242         - ❌
26243         - ❌
26244       * - **browsertime-tp6m-live-fenix-dailymail-nofis**
26245         - ❌
26246         - ❌
26247         - ❌
26248         - ❌
26249       * - **browsertime-tp6m-live-geckoview-dailymail-nofis**
26250         - ❌
26251         - ❌
26252         - ❌
26253         - ❌
26254       * - **browsertime-tp6m-refbrow-dailymail**
26255         - ❌
26256         - ❌
26257         - ❌
26258         - ❌
26259
26260
26261    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26262       :widths: 30 15 15 15 15
26263       :header-rows: 1
26264
26265       * - **Test Name**
26266         - mozilla-central
26267         - autoland
26268         - mozilla-release
26269         - mozilla-beta
26270       * - **browsertime-tp6m-chrome-m-dailymail**
26271         - ❌
26272         - ❌
26273         - ❌
26274         - ❌
26275       * - **browsertime-tp6m-chrome-m-dailymail-nofis**
26276         - ❌
26277         - ❌
26278         - ❌
26279         - ❌
26280       * - **browsertime-tp6m-fenix-dailymail**
26281         - ❌
26282         - ❌
26283         - ❌
26284         - ❌
26285       * - **browsertime-tp6m-fenix-dailymail-nofis**
26286         - ❌
26287         - ❌
26288         - ❌
26289         - ❌
26290       * - **browsertime-tp6m-geckoview-dailymail**
26291         - ❌
26292         - ❌
26293         - ❌
26294         - ❌
26295       * - **browsertime-tp6m-geckoview-dailymail-nofis**
26296         - ✅
26297         - ✅
26298         - ❌
26299         - ❌
26300       * - **browsertime-tp6m-live-chrome-m-dailymail-nofis**
26301         - ❌
26302         - ❌
26303         - ❌
26304         - ❌
26305       * - **browsertime-tp6m-live-fenix-dailymail-nofis**
26306         - ❌
26307         - ❌
26308         - ❌
26309         - ❌
26310       * - **browsertime-tp6m-live-geckoview-dailymail-nofis**
26311         - ❌
26312         - ❌
26313         - ❌
26314         - ❌
26315       * - **browsertime-tp6m-refbrow-dailymail**
26316         - ❌
26317         - ❌
26318         - ❌
26319         - ❌
26320
26321
26322
26323 .. dropdown:: ebay-kleinanzeigen
26324    :class-container: anchor-id-ebay-kleinanzeigen-m
26325
26326    **Owner**: PerfTest Team
26327
26328    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26329    * **alert threshold**: 2.0
26330    * **apps**: geckoview, fenix, refbrow, chrome-m
26331    * **browser cycles**: 15
26332    * **expected**: pass
26333    * **lower is better**: true
26334    * **page cycles**: 25
26335    * **page timeout**: 60000
26336    * **playback**: mitmproxy-android
26337    * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen.manifest
26338    * **playback version**: 8.1.1
26339    * **test url**: `<https://m.ebay-kleinanzeigen.de>`__
26340    * **type**: pageload
26341    * **unit**: ms
26342    * **use live sites**: false
26343    * **Test Task**:
26344
26345    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26346       :widths: 30 15 15 15 15
26347       :header-rows: 1
26348
26349       * - **Test Name**
26350         - mozilla-central
26351         - autoland
26352         - mozilla-release
26353         - mozilla-beta
26354       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen**
26355         - ❌
26356         - ❌
26357         - ❌
26358         - ❌
26359       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis**
26360         - ❌
26361         - ❌
26362         - ❌
26363         - ❌
26364       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen**
26365         - ❌
26366         - ❌
26367         - ❌
26368         - ❌
26369       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis**
26370         - ❌
26371         - ❌
26372         - ❌
26373         - ❌
26374       * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis**
26375         - ❌
26376         - ❌
26377         - ❌
26378         - ❌
26379       * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis**
26380         - ❌
26381         - ❌
26382         - ❌
26383         - ❌
26384       * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen**
26385         - ❌
26386         - ❌
26387         - ❌
26388         - ❌
26389
26390
26391    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26392       :widths: 30 15 15 15 15
26393       :header-rows: 1
26394
26395       * - **Test Name**
26396         - mozilla-central
26397         - autoland
26398         - mozilla-release
26399         - mozilla-beta
26400       * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen**
26401         - ❌
26402         - ❌
26403         - ❌
26404         - ❌
26405       * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis**
26406         - ❌
26407         - ❌
26408         - ❌
26409         - ❌
26410       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen**
26411         - ❌
26412         - ❌
26413         - ❌
26414         - ❌
26415       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis**
26416         - ❌
26417         - ❌
26418         - ❌
26419         - ❌
26420       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen**
26421         - ❌
26422         - ❌
26423         - ❌
26424         - ❌
26425       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis**
26426         - ✅
26427         - ✅
26428         - ❌
26429         - ❌
26430       * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis**
26431         - ❌
26432         - ❌
26433         - ❌
26434         - ❌
26435       * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis**
26436         - ❌
26437         - ❌
26438         - ❌
26439         - ❌
26440       * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis**
26441         - ❌
26442         - ❌
26443         - ❌
26444         - ❌
26445       * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen**
26446         - ❌
26447         - ❌
26448         - ❌
26449         - ❌
26450
26451
26452
26453 .. dropdown:: ebay-kleinanzeigen-search
26454    :class-container: anchor-id-ebay-kleinanzeigen-search-m
26455
26456    **Owner**: PerfTest Team
26457
26458    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26459    * **alert threshold**: 2.0
26460    * **apps**: geckoview, fenix, refbrow, chrome-m
26461    * **browser cycles**: 15
26462    * **expected**: pass
26463    * **lower is better**: true
26464    * **page cycles**: 25
26465    * **page timeout**: 60000
26466    * **playback**: mitmproxy-android
26467    * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest
26468    * **playback version**: 8.1.1
26469    * **test url**: `<https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331>`__
26470    * **type**: pageload
26471    * **unit**: ms
26472    * **use live sites**: false
26473    * **Test Task**:
26474
26475    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26476       :widths: 30 15 15 15 15
26477       :header-rows: 1
26478
26479       * - **Test Name**
26480         - mozilla-central
26481         - autoland
26482         - mozilla-release
26483         - mozilla-beta
26484       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search**
26485         - ❌
26486         - ❌
26487         - ❌
26488         - ❌
26489       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis**
26490         - ❌
26491         - ❌
26492         - ❌
26493         - ❌
26494       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search**
26495         - ❌
26496         - ❌
26497         - ❌
26498         - ❌
26499       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis**
26500         - ❌
26501         - ❌
26502         - ❌
26503         - ❌
26504       * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis**
26505         - ❌
26506         - ❌
26507         - ❌
26508         - ❌
26509       * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis**
26510         - ❌
26511         - ❌
26512         - ❌
26513         - ❌
26514       * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search**
26515         - ❌
26516         - ❌
26517         - ❌
26518         - ❌
26519
26520
26521    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26522       :widths: 30 15 15 15 15
26523       :header-rows: 1
26524
26525       * - **Test Name**
26526         - mozilla-central
26527         - autoland
26528         - mozilla-release
26529         - mozilla-beta
26530       * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search**
26531         - ❌
26532         - ❌
26533         - ❌
26534         - ❌
26535       * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis**
26536         - ❌
26537         - ❌
26538         - ❌
26539         - ❌
26540       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search**
26541         - ❌
26542         - ❌
26543         - ❌
26544         - ❌
26545       * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis**
26546         - ❌
26547         - ❌
26548         - ❌
26549         - ❌
26550       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search**
26551         - ❌
26552         - ❌
26553         - ❌
26554         - ❌
26555       * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis**
26556         - ✅
26557         - ✅
26558         - ❌
26559         - ❌
26560       * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis**
26561         - ❌
26562         - ❌
26563         - ❌
26564         - ❌
26565       * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis**
26566         - ❌
26567         - ❌
26568         - ❌
26569         - ❌
26570       * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis**
26571         - ❌
26572         - ❌
26573         - ❌
26574         - ❌
26575       * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search**
26576         - ❌
26577         - ❌
26578         - ❌
26579         - ❌
26580
26581
26582
26583 .. dropdown:: espn
26584    :class-container: anchor-id-espn-m
26585
26586    **Owner**: PerfTest Team
26587
26588    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26589    * **alert threshold**: 2.0
26590    * **apps**: geckoview, fenix, refbrow, chrome-m
26591    * **browser cycles**: 15
26592    * **expected**: pass
26593    * **lower is better**: true
26594    * **page cycles**: 25
26595    * **page timeout**: 60000
26596    * **playback**: mitmproxy-android
26597    * **playback pageset manifest**: mitm6-android-fenix-espn.manifest
26598    * **playback version**: 8.1.1
26599    * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
26600    * **type**: pageload
26601    * **unit**: ms
26602    * **use live sites**: false
26603    * **Test Task**:
26604
26605    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26606       :widths: 30 15 15 15 15
26607       :header-rows: 1
26608
26609       * - **Test Name**
26610         - mozilla-central
26611         - autoland
26612         - mozilla-release
26613         - mozilla-beta
26614       * - **browsertime-tp6m-essential-fenix-espn-nofis**
26615         - ❌
26616         - ❌
26617         - ❌
26618         - ❌
26619       * - **browsertime-tp6m-essential-geckoview-espn-nofis**
26620         - ❌
26621         - ❌
26622         - ❌
26623         - ❌
26624       * - **browsertime-tp6m-live-fenix-espn-nofis**
26625         - ❌
26626         - ❌
26627         - ❌
26628         - ❌
26629       * - **browsertime-tp6m-live-geckoview-espn-nofis**
26630         - ❌
26631         - ❌
26632         - ❌
26633         - ❌
26634
26635
26636    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26637       :widths: 30 15 15 15 15
26638       :header-rows: 1
26639
26640       * - **Test Name**
26641         - mozilla-central
26642         - autoland
26643         - mozilla-release
26644         - mozilla-beta
26645       * - **browsertime-tp6m-essential-chrome-m-espn-nofis**
26646         - ❌
26647         - ❌
26648         - ❌
26649         - ❌
26650       * - **browsertime-tp6m-essential-fenix-espn-nofis**
26651         - ❌
26652         - ❌
26653         - ❌
26654         - ❌
26655       * - **browsertime-tp6m-essential-geckoview-espn-nofis**
26656         - ✅
26657         - ✅
26658         - ❌
26659         - ❌
26660       * - **browsertime-tp6m-live-chrome-m-espn-nofis**
26661         - ❌
26662         - ❌
26663         - ❌
26664         - ❌
26665       * - **browsertime-tp6m-live-fenix-espn-nofis**
26666         - ❌
26667         - ❌
26668         - ❌
26669         - ❌
26670       * - **browsertime-tp6m-live-geckoview-espn-nofis**
26671         - ❌
26672         - ❌
26673         - ❌
26674         - ❌
26675
26676
26677    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
26678       :widths: 30 15 15 15 15
26679       :header-rows: 1
26680
26681       * - **Test Name**
26682         - mozilla-central
26683         - autoland
26684         - mozilla-release
26685         - mozilla-beta
26686       * - **browsertime-tp6-firefox-espn**
26687         - ❌
26688         - ❌
26689         - ❌
26690         - ❌
26691
26692
26693    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
26694       :widths: 30 15 15 15 15
26695       :header-rows: 1
26696
26697       * - **Test Name**
26698         - mozilla-central
26699         - autoland
26700         - mozilla-release
26701         - mozilla-beta
26702       * - **browsertime-tp6-firefox-espn**
26703         - ❌
26704         - ❌
26705         - ❌
26706         - ❌
26707
26708
26709    .. list-table:: **test-linux1804-64-qr/opt**
26710       :widths: 30 15 15 15 15
26711       :header-rows: 1
26712
26713       * - **Test Name**
26714         - mozilla-central
26715         - autoland
26716         - mozilla-release
26717         - mozilla-beta
26718       * - **browsertime-tp6-firefox-espn**
26719         - ❌
26720         - ❌
26721         - ❌
26722         - ❌
26723
26724
26725    .. list-table:: **test-linux1804-64-shippable-qr/opt**
26726       :widths: 30 15 15 15 15
26727       :header-rows: 1
26728
26729       * - **Test Name**
26730         - mozilla-central
26731         - autoland
26732         - mozilla-release
26733         - mozilla-beta
26734       * - **browsertime-tp6-chrome-espn**
26735         - ❌
26736         - ❌
26737         - ❌
26738         - ❌
26739       * - **browsertime-tp6-chromium-espn**
26740         - ❌
26741         - ❌
26742         - ❌
26743         - ❌
26744       * - **browsertime-tp6-firefox-espn**
26745         - ✅
26746         - ✅
26747         - ✅
26748         - ✅
26749
26750
26751    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
26752       :widths: 30 15 15 15 15
26753       :header-rows: 1
26754
26755       * - **Test Name**
26756         - mozilla-central
26757         - autoland
26758         - mozilla-release
26759         - mozilla-beta
26760       * - **browsertime-tp6-firefox-espn**
26761         - ❌
26762         - ❌
26763         - ❌
26764         - ❌
26765
26766
26767    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
26768       :widths: 30 15 15 15 15
26769       :header-rows: 1
26770
26771       * - **Test Name**
26772         - mozilla-central
26773         - autoland
26774         - mozilla-release
26775         - mozilla-beta
26776       * - **browsertime-tp6-chrome-espn**
26777         - ❌
26778         - ❌
26779         - ❌
26780         - ❌
26781       * - **browsertime-tp6-chromium-espn**
26782         - ❌
26783         - ❌
26784         - ❌
26785         - ❌
26786       * - **browsertime-tp6-firefox-espn**
26787         - ✅
26788         - ✅
26789         - ✅
26790         - ✅
26791
26792
26793    .. list-table:: **test-windows10-32-qr/opt**
26794       :widths: 30 15 15 15 15
26795       :header-rows: 1
26796
26797       * - **Test Name**
26798         - mozilla-central
26799         - autoland
26800         - mozilla-release
26801         - mozilla-beta
26802       * - **browsertime-tp6-firefox-espn**
26803         - ❌
26804         - ❌
26805         - ❌
26806         - ❌
26807
26808
26809    .. list-table:: **test-windows10-32-shippable-qr/opt**
26810       :widths: 30 15 15 15 15
26811       :header-rows: 1
26812
26813       * - **Test Name**
26814         - mozilla-central
26815         - autoland
26816         - mozilla-release
26817         - mozilla-beta
26818       * - **browsertime-tp6-chrome-espn**
26819         - ❌
26820         - ❌
26821         - ❌
26822         - ❌
26823       * - **browsertime-tp6-chromium-espn**
26824         - ❌
26825         - ❌
26826         - ❌
26827         - ❌
26828       * - **browsertime-tp6-firefox-espn**
26829         - ❌
26830         - ❌
26831         - ❌
26832         - ❌
26833
26834
26835    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
26836       :widths: 30 15 15 15 15
26837       :header-rows: 1
26838
26839       * - **Test Name**
26840         - mozilla-central
26841         - autoland
26842         - mozilla-release
26843         - mozilla-beta
26844       * - **browsertime-tp6-firefox-espn**
26845         - ❌
26846         - ❌
26847         - ❌
26848         - ❌
26849
26850
26851    .. list-table:: **test-windows10-64-qr/opt**
26852       :widths: 30 15 15 15 15
26853       :header-rows: 1
26854
26855       * - **Test Name**
26856         - mozilla-central
26857         - autoland
26858         - mozilla-release
26859         - mozilla-beta
26860       * - **browsertime-tp6-firefox-espn**
26861         - ❌
26862         - ❌
26863         - ❌
26864         - ❌
26865
26866
26867    .. list-table:: **test-windows10-64-shippable-qr/opt**
26868       :widths: 30 15 15 15 15
26869       :header-rows: 1
26870
26871       * - **Test Name**
26872         - mozilla-central
26873         - autoland
26874         - mozilla-release
26875         - mozilla-beta
26876       * - **browsertime-tp6-chrome-espn**
26877         - ❌
26878         - ❌
26879         - ❌
26880         - ❌
26881       * - **browsertime-tp6-chromium-espn**
26882         - ❌
26883         - ❌
26884         - ❌
26885         - ❌
26886       * - **browsertime-tp6-firefox-espn**
26887         - ✅
26888         - ✅
26889         - ✅
26890         - ✅
26891
26892
26893
26894 .. dropdown:: facebook
26895    :class-container: anchor-id-facebook-m
26896
26897    **Owner**: PerfTest Team
26898
26899    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
26900    * **alert threshold**: 2.0
26901    * **apps**: geckoview, fenix, refbrow, chrome-m
26902    * **browser cycles**: 15
26903    * **expected**: pass
26904    * **login**: true
26905    * **lower is better**: true
26906    * **page cycles**: 25
26907    * **page timeout**: 60000
26908    * **playback**: mitmproxy-android
26909    * **playback pageset manifest**: mitm6-g5-fenix-facebook.manifest
26910    * **playback version**: 8.1.1
26911    * **test url**: `<https://m.facebook.com>`__
26912    * **type**: pageload
26913    * **unit**: ms
26914    * **use live sites**: false
26915    * **Test Task**:
26916
26917    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
26918       :widths: 30 15 15 15 15
26919       :header-rows: 1
26920
26921       * - **Test Name**
26922         - mozilla-central
26923         - autoland
26924         - mozilla-release
26925         - mozilla-beta
26926       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
26927         - ❌
26928         - ❌
26929         - ❌
26930         - ❌
26931       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
26932         - ❌
26933         - ❌
26934         - ❌
26935         - ❌
26936       * - **browsertime-tp6m-live-fenix-facebook-nofis**
26937         - ❌
26938         - ❌
26939         - ❌
26940         - ❌
26941       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
26942         - ❌
26943         - ❌
26944         - ❌
26945         - ❌
26946
26947
26948    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
26949       :widths: 30 15 15 15 15
26950       :header-rows: 1
26951
26952       * - **Test Name**
26953         - mozilla-central
26954         - autoland
26955         - mozilla-release
26956         - mozilla-beta
26957       * - **browsertime-tp6m-essential-chrome-m-facebook-nofis**
26958         - ❌
26959         - ❌
26960         - ❌
26961         - ❌
26962       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
26963         - ❌
26964         - ❌
26965         - ❌
26966         - ❌
26967       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
26968         - ✅
26969         - ✅
26970         - ❌
26971         - ❌
26972       * - **browsertime-tp6m-live-chrome-m-facebook-nofis**
26973         - ❌
26974         - ❌
26975         - ❌
26976         - ❌
26977       * - **browsertime-tp6m-live-fenix-facebook-nofis**
26978         - ❌
26979         - ❌
26980         - ❌
26981         - ❌
26982       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
26983         - ❌
26984         - ❌
26985         - ❌
26986         - ❌
26987
26988
26989    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
26990       :widths: 30 15 15 15 15
26991       :header-rows: 1
26992
26993       * - **Test Name**
26994         - mozilla-central
26995         - autoland
26996         - mozilla-release
26997         - mozilla-beta
26998       * - **browsertime-tp6-firefox-facebook**
26999         - ❌
27000         - ❌
27001         - ❌
27002         - ❌
27003       * - **browsertime-tp6-live-firefox-facebook**
27004         - ❌
27005         - ❌
27006         - ❌
27007         - ❌
27008
27009
27010    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
27011       :widths: 30 15 15 15 15
27012       :header-rows: 1
27013
27014       * - **Test Name**
27015         - mozilla-central
27016         - autoland
27017         - mozilla-release
27018         - mozilla-beta
27019       * - **browsertime-tp6-firefox-facebook**
27020         - ❌
27021         - ❌
27022         - ❌
27023         - ❌
27024       * - **browsertime-tp6-live-firefox-facebook**
27025         - ❌
27026         - ❌
27027         - ❌
27028         - ❌
27029
27030
27031    .. list-table:: **test-linux1804-64-qr/opt**
27032       :widths: 30 15 15 15 15
27033       :header-rows: 1
27034
27035       * - **Test Name**
27036         - mozilla-central
27037         - autoland
27038         - mozilla-release
27039         - mozilla-beta
27040       * - **browsertime-tp6-firefox-facebook**
27041         - ❌
27042         - ❌
27043         - ❌
27044         - ❌
27045       * - **browsertime-tp6-live-firefox-facebook**
27046         - ❌
27047         - ❌
27048         - ❌
27049         - ❌
27050
27051
27052    .. list-table:: **test-linux1804-64-shippable-qr/opt**
27053       :widths: 30 15 15 15 15
27054       :header-rows: 1
27055
27056       * - **Test Name**
27057         - mozilla-central
27058         - autoland
27059         - mozilla-release
27060         - mozilla-beta
27061       * - **browsertime-tp6-chrome-facebook**
27062         - ❌
27063         - ❌
27064         - ❌
27065         - ❌
27066       * - **browsertime-tp6-chromium-facebook**
27067         - ❌
27068         - ❌
27069         - ❌
27070         - ❌
27071       * - **browsertime-tp6-firefox-facebook**
27072         - ✅
27073         - ✅
27074         - ✅
27075         - ✅
27076       * - **browsertime-tp6-live-chrome-facebook**
27077         - ❌
27078         - ❌
27079         - ❌
27080         - ❌
27081       * - **browsertime-tp6-live-chromium-facebook**
27082         - ❌
27083         - ❌
27084         - ❌
27085         - ❌
27086       * - **browsertime-tp6-live-firefox-facebook**
27087         - ❌
27088         - ❌
27089         - ❌
27090         - ❌
27091
27092
27093    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
27094       :widths: 30 15 15 15 15
27095       :header-rows: 1
27096
27097       * - **Test Name**
27098         - mozilla-central
27099         - autoland
27100         - mozilla-release
27101         - mozilla-beta
27102       * - **browsertime-tp6-firefox-facebook**
27103         - ❌
27104         - ❌
27105         - ❌
27106         - ❌
27107       * - **browsertime-tp6-live-firefox-facebook**
27108         - ❌
27109         - ❌
27110         - ❌
27111         - ❌
27112
27113
27114    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
27115       :widths: 30 15 15 15 15
27116       :header-rows: 1
27117
27118       * - **Test Name**
27119         - mozilla-central
27120         - autoland
27121         - mozilla-release
27122         - mozilla-beta
27123       * - **browsertime-tp6-chrome-facebook**
27124         - ❌
27125         - ❌
27126         - ❌
27127         - ❌
27128       * - **browsertime-tp6-chromium-facebook**
27129         - ❌
27130         - ❌
27131         - ❌
27132         - ❌
27133       * - **browsertime-tp6-firefox-facebook**
27134         - ✅
27135         - ✅
27136         - ✅
27137         - ✅
27138       * - **browsertime-tp6-live-chrome-facebook**
27139         - ❌
27140         - ❌
27141         - ❌
27142         - ❌
27143       * - **browsertime-tp6-live-chromium-facebook**
27144         - ❌
27145         - ❌
27146         - ❌
27147         - ❌
27148       * - **browsertime-tp6-live-firefox-facebook**
27149         - ❌
27150         - ❌
27151         - ❌
27152         - ❌
27153       * - **browsertime-tp6-live-safari-facebook**
27154         - ❌
27155         - ❌
27156         - ❌
27157         - ❌
27158
27159
27160    .. list-table:: **test-windows10-32-qr/opt**
27161       :widths: 30 15 15 15 15
27162       :header-rows: 1
27163
27164       * - **Test Name**
27165         - mozilla-central
27166         - autoland
27167         - mozilla-release
27168         - mozilla-beta
27169       * - **browsertime-tp6-firefox-facebook**
27170         - ❌
27171         - ❌
27172         - ❌
27173         - ❌
27174       * - **browsertime-tp6-live-firefox-facebook**
27175         - ❌
27176         - ❌
27177         - ❌
27178         - ❌
27179
27180
27181    .. list-table:: **test-windows10-32-shippable-qr/opt**
27182       :widths: 30 15 15 15 15
27183       :header-rows: 1
27184
27185       * - **Test Name**
27186         - mozilla-central
27187         - autoland
27188         - mozilla-release
27189         - mozilla-beta
27190       * - **browsertime-tp6-chrome-facebook**
27191         - ❌
27192         - ❌
27193         - ❌
27194         - ❌
27195       * - **browsertime-tp6-chromium-facebook**
27196         - ❌
27197         - ❌
27198         - ❌
27199         - ❌
27200       * - **browsertime-tp6-firefox-facebook**
27201         - ❌
27202         - ❌
27203         - ❌
27204         - ❌
27205       * - **browsertime-tp6-live-chrome-facebook**
27206         - ❌
27207         - ❌
27208         - ❌
27209         - ❌
27210       * - **browsertime-tp6-live-chromium-facebook**
27211         - ❌
27212         - ❌
27213         - ❌
27214         - ❌
27215       * - **browsertime-tp6-live-firefox-facebook**
27216         - ❌
27217         - ❌
27218         - ❌
27219         - ❌
27220
27221
27222    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
27223       :widths: 30 15 15 15 15
27224       :header-rows: 1
27225
27226       * - **Test Name**
27227         - mozilla-central
27228         - autoland
27229         - mozilla-release
27230         - mozilla-beta
27231       * - **browsertime-tp6-firefox-facebook**
27232         - ❌
27233         - ❌
27234         - ❌
27235         - ❌
27236       * - **browsertime-tp6-live-firefox-facebook**
27237         - ❌
27238         - ❌
27239         - ❌
27240         - ❌
27241
27242
27243    .. list-table:: **test-windows10-64-qr/opt**
27244       :widths: 30 15 15 15 15
27245       :header-rows: 1
27246
27247       * - **Test Name**
27248         - mozilla-central
27249         - autoland
27250         - mozilla-release
27251         - mozilla-beta
27252       * - **browsertime-tp6-firefox-facebook**
27253         - ❌
27254         - ❌
27255         - ❌
27256         - ❌
27257       * - **browsertime-tp6-live-firefox-facebook**
27258         - ❌
27259         - ❌
27260         - ❌
27261         - ❌
27262
27263
27264    .. list-table:: **test-windows10-64-shippable-qr/opt**
27265       :widths: 30 15 15 15 15
27266       :header-rows: 1
27267
27268       * - **Test Name**
27269         - mozilla-central
27270         - autoland
27271         - mozilla-release
27272         - mozilla-beta
27273       * - **browsertime-tp6-chrome-facebook**
27274         - ❌
27275         - ❌
27276         - ❌
27277         - ❌
27278       * - **browsertime-tp6-chromium-facebook**
27279         - ❌
27280         - ❌
27281         - ❌
27282         - ❌
27283       * - **browsertime-tp6-firefox-facebook**
27284         - ✅
27285         - ✅
27286         - ✅
27287         - ✅
27288       * - **browsertime-tp6-live-chrome-facebook**
27289         - ❌
27290         - ❌
27291         - ❌
27292         - ❌
27293       * - **browsertime-tp6-live-chromium-facebook**
27294         - ❌
27295         - ❌
27296         - ❌
27297         - ❌
27298       * - **browsertime-tp6-live-firefox-facebook**
27299         - ❌
27300         - ❌
27301         - ❌
27302         - ❌
27303
27304
27305
27306 .. dropdown:: facebook-cristiano
27307    :class-container: anchor-id-facebook-cristiano-m
27308
27309    **Owner**: PerfTest Team
27310
27311    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
27312    * **alert threshold**: 2.0
27313    * **apps**: geckoview, fenix, refbrow, chrome-m
27314    * **browser cycles**: 15
27315    * **expected**: pass
27316    * **lower is better**: true
27317    * **page cycles**: 25
27318    * **page timeout**: 60000
27319    * **playback**: mitmproxy-android
27320    * **playback pageset manifest**: mitm6-android-fenix-facebook-cristiano.manifest
27321    * **playback version**: 8.1.1
27322    * **test url**: `<https://m.facebook.com/Cristiano>`__
27323    * **type**: pageload
27324    * **unit**: ms
27325    * **use live sites**: false
27326    * **Test Task**:
27327
27328    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
27329       :widths: 30 15 15 15 15
27330       :header-rows: 1
27331
27332       * - **Test Name**
27333         - mozilla-central
27334         - autoland
27335         - mozilla-release
27336         - mozilla-beta
27337       * - **browsertime-tp6m-fenix-facebook-cristiano**
27338         - ❌
27339         - ❌
27340         - ❌
27341         - ❌
27342       * - **browsertime-tp6m-fenix-facebook-cristiano-nofis**
27343         - ❌
27344         - ❌
27345         - ❌
27346         - ❌
27347       * - **browsertime-tp6m-geckoview-facebook-cristiano**
27348         - ❌
27349         - ❌
27350         - ❌
27351         - ❌
27352       * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis**
27353         - ❌
27354         - ❌
27355         - ❌
27356         - ❌
27357       * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis**
27358         - ❌
27359         - ❌
27360         - ❌
27361         - ❌
27362       * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis**
27363         - ❌
27364         - ❌
27365         - ❌
27366         - ❌
27367       * - **browsertime-tp6m-refbrow-facebook-cristiano**
27368         - ❌
27369         - ❌
27370         - ❌
27371         - ❌
27372
27373
27374    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
27375       :widths: 30 15 15 15 15
27376       :header-rows: 1
27377
27378       * - **Test Name**
27379         - mozilla-central
27380         - autoland
27381         - mozilla-release
27382         - mozilla-beta
27383       * - **browsertime-tp6m-chrome-m-facebook-cristiano**
27384         - ❌
27385         - ❌
27386         - ❌
27387         - ❌
27388       * - **browsertime-tp6m-chrome-m-facebook-cristiano-nofis**
27389         - ❌
27390         - ❌
27391         - ❌
27392         - ❌
27393       * - **browsertime-tp6m-fenix-facebook-cristiano**
27394         - ❌
27395         - ❌
27396         - ❌
27397         - ❌
27398       * - **browsertime-tp6m-fenix-facebook-cristiano-nofis**
27399         - ❌
27400         - ❌
27401         - ❌
27402         - ❌
27403       * - **browsertime-tp6m-geckoview-facebook-cristiano**
27404         - ❌
27405         - ❌
27406         - ❌
27407         - ❌
27408       * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis**
27409         - ✅
27410         - ✅
27411         - ❌
27412         - ❌
27413       * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis**
27414         - ❌
27415         - ❌
27416         - ❌
27417         - ❌
27418       * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis**
27419         - ❌
27420         - ❌
27421         - ❌
27422         - ❌
27423       * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis**
27424         - ❌
27425         - ❌
27426         - ❌
27427         - ❌
27428       * - **browsertime-tp6m-refbrow-facebook-cristiano**
27429         - ❌
27430         - ❌
27431         - ❌
27432         - ❌
27433
27434
27435
27436 .. dropdown:: google
27437    :class-container: anchor-id-google-m
27438
27439    **Owner**: PerfTest Team
27440
27441    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
27442    * **alert threshold**: 2.0
27443    * **apps**: geckoview, fenix, refbrow, chrome-m
27444    * **browser cycles**: 15
27445    * **expected**: pass
27446    * **login**: true
27447    * **lower is better**: true
27448    * **page cycles**: 25
27449    * **page timeout**: 60000
27450    * **playback**: mitmproxy-android
27451    * **playback pageset manifest**: mitm6-g5-fenix-google.manifest
27452    * **playback version**: 8.1.1
27453    * **test url**: `<https://www.google.com>`__
27454    * **type**: pageload
27455    * **unit**: ms
27456    * **use live sites**: false
27457    * **Test Task**:
27458
27459    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
27460       :widths: 30 15 15 15 15
27461       :header-rows: 1
27462
27463       * - **Test Name**
27464         - mozilla-central
27465         - autoland
27466         - mozilla-release
27467         - mozilla-beta
27468       * - **browsertime-tp6m-essential-fenix-google-nofis**
27469         - ❌
27470         - ❌
27471         - ❌
27472         - ❌
27473       * - **browsertime-tp6m-essential-geckoview-google-nofis**
27474         - ❌
27475         - ❌
27476         - ❌
27477         - ❌
27478       * - **browsertime-tp6m-live-fenix-google-nofis**
27479         - ❌
27480         - ❌
27481         - ❌
27482         - ❌
27483       * - **browsertime-tp6m-live-geckoview-google-nofis**
27484         - ❌
27485         - ❌
27486         - ❌
27487         - ❌
27488
27489
27490    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
27491       :widths: 30 15 15 15 15
27492       :header-rows: 1
27493
27494       * - **Test Name**
27495         - mozilla-central
27496         - autoland
27497         - mozilla-release
27498         - mozilla-beta
27499       * - **browsertime-tp6m-essential-chrome-m-google-nofis**
27500         - ❌
27501         - ❌
27502         - ❌
27503         - ❌
27504       * - **browsertime-tp6m-essential-fenix-google-nofis**
27505         - ❌
27506         - ❌
27507         - ❌
27508         - ❌
27509       * - **browsertime-tp6m-essential-geckoview-google-nofis**
27510         - ✅
27511         - ✅
27512         - ❌
27513         - ❌
27514       * - **browsertime-tp6m-live-chrome-m-google-nofis**
27515         - ❌
27516         - ❌
27517         - ❌
27518         - ❌
27519       * - **browsertime-tp6m-live-fenix-google-nofis**
27520         - ❌
27521         - ❌
27522         - ❌
27523         - ❌
27524       * - **browsertime-tp6m-live-geckoview-google-nofis**
27525         - ❌
27526         - ❌
27527         - ❌
27528         - ❌
27529
27530
27531
27532 .. dropdown:: google-maps
27533    :class-container: anchor-id-google-maps-m
27534
27535    **Owner**: PerfTest Team
27536
27537    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
27538    * **alert threshold**: 2.0
27539    * **apps**: geckoview, fenix, refbrow, chrome-m
27540    * **browser cycles**: 15
27541    * **expected**: pass
27542    * **lower is better**: true
27543    * **page cycles**: 25
27544    * **page timeout**: 60000
27545    * **playback**: mitmproxy-android
27546    * **playback pageset manifest**: mitm6-android-fenix-google-maps.manifest
27547    * **playback version**: 8.1.1
27548    * **test url**: `<https://www.google.com/maps?force=pwa>`__
27549    * **type**: pageload
27550    * **unit**: ms
27551    * **use live sites**: false
27552    * **Test Task**:
27553
27554    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
27555       :widths: 30 15 15 15 15
27556       :header-rows: 1
27557
27558       * - **Test Name**
27559         - mozilla-central
27560         - autoland
27561         - mozilla-release
27562         - mozilla-beta
27563       * - **browsertime-tp6m-fenix-google-maps**
27564         - ❌
27565         - ❌
27566         - ❌
27567         - ❌
27568       * - **browsertime-tp6m-fenix-google-maps-nofis**
27569         - ❌
27570         - ❌
27571         - ❌
27572         - ❌
27573       * - **browsertime-tp6m-geckoview-google-maps**
27574         - ❌
27575         - ❌
27576         - ❌
27577         - ❌
27578       * - **browsertime-tp6m-geckoview-google-maps-nofis**
27579         - ❌
27580         - ❌
27581         - ❌
27582         - ❌
27583       * - **browsertime-tp6m-live-fenix-google-maps-nofis**
27584         - ❌
27585         - ❌
27586         - ❌
27587         - ❌
27588       * - **browsertime-tp6m-live-geckoview-google-maps-nofis**
27589         - ❌
27590         - ❌
27591         - ❌
27592         - ❌
27593       * - **browsertime-tp6m-refbrow-google-maps**
27594         - ❌
27595         - ❌
27596         - ❌
27597         - ❌
27598
27599
27600    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
27601       :widths: 30 15 15 15 15
27602       :header-rows: 1
27603
27604       * - **Test Name**
27605         - mozilla-central
27606         - autoland
27607         - mozilla-release
27608         - mozilla-beta
27609       * - **browsertime-tp6m-chrome-m-google-maps**
27610         - ❌
27611         - ❌
27612         - ❌
27613         - ❌
27614       * - **browsertime-tp6m-chrome-m-google-maps-nofis**
27615         - ❌
27616         - ❌
27617         - ❌
27618         - ❌
27619       * - **browsertime-tp6m-fenix-google-maps**
27620         - ❌
27621         - ❌
27622         - ❌
27623         - ❌
27624       * - **browsertime-tp6m-fenix-google-maps-nofis**
27625         - ❌
27626         - ❌
27627         - ❌
27628         - ❌
27629       * - **browsertime-tp6m-geckoview-google-maps**
27630         - ❌
27631         - ❌
27632         - ❌
27633         - ❌
27634       * - **browsertime-tp6m-geckoview-google-maps-nofis**
27635         - ✅
27636         - ✅
27637         - ❌
27638         - ❌
27639       * - **browsertime-tp6m-live-chrome-m-google-maps-nofis**
27640         - ❌
27641         - ❌
27642         - ❌
27643         - ❌
27644       * - **browsertime-tp6m-live-fenix-google-maps-nofis**
27645         - ❌
27646         - ❌
27647         - ❌
27648         - ❌
27649       * - **browsertime-tp6m-live-geckoview-google-maps-nofis**
27650         - ❌
27651         - ❌
27652         - ❌
27653         - ❌
27654       * - **browsertime-tp6m-refbrow-google-maps**
27655         - ❌
27656         - ❌
27657         - ❌
27658         - ❌
27659
27660
27661
27662 .. dropdown:: google-search-restaurants
27663    :class-container: anchor-id-google-search-restaurants-m
27664
27665    **Owner**: PerfTest Team
27666
27667    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
27668    * **alert threshold**: 2.0
27669    * **apps**: geckoview, fenix, refbrow, chrome-m
27670    * **browser cycles**: 15
27671    * **expected**: pass
27672    * **login**: true
27673    * **lower is better**: true
27674    * **page cycles**: 25
27675    * **page timeout**: 60000
27676    * **playback**: mitmproxy-android
27677    * **playback pageset manifest**: mitm6-g5-fenix-google-search-restaurants.manifest
27678    * **playback version**: 8.1.1
27679    * **test url**: `<https://www.google.com/search?q=restaurants+near+me>`__
27680    * **type**: pageload
27681    * **unit**: ms
27682    * **use live sites**: false
27683    * **Test Task**:
27684
27685    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
27686       :widths: 30 15 15 15 15
27687       :header-rows: 1
27688
27689       * - **Test Name**
27690         - mozilla-central
27691         - autoland
27692         - mozilla-release
27693         - mozilla-beta
27694       * - **browsertime-tp6m-fenix-google-search-restaurants**
27695         - ❌
27696         - ❌
27697         - ❌
27698         - ❌
27699       * - **browsertime-tp6m-fenix-google-search-restaurants-nofis**
27700         - ❌
27701         - ❌
27702         - ❌
27703         - ❌
27704       * - **browsertime-tp6m-geckoview-google-search-restaurants**
27705         - ❌
27706         - ❌
27707         - ❌
27708         - ❌
27709       * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis**
27710         - ❌
27711         - ❌
27712         - ❌
27713         - ❌
27714       * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis**
27715         - ❌
27716         - ❌
27717         - ❌
27718         - ❌
27719       * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis**
27720         - ❌
27721         - ❌
27722         - ❌
27723         - ❌
27724       * - **browsertime-tp6m-refbrow-google-search-restaurants**
27725         - ❌
27726         - ❌
27727         - ❌
27728         - ❌
27729
27730
27731    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
27732       :widths: 30 15 15 15 15
27733       :header-rows: 1
27734
27735       * - **Test Name**
27736         - mozilla-central
27737         - autoland
27738         - mozilla-release
27739         - mozilla-beta
27740       * - **browsertime-tp6m-chrome-m-google-search-restaurants**
27741         - ❌
27742         - ❌
27743         - ❌
27744         - ❌
27745       * - **browsertime-tp6m-chrome-m-google-search-restaurants-nofis**
27746         - ❌
27747         - ❌
27748         - ❌
27749         - ❌
27750       * - **browsertime-tp6m-fenix-google-search-restaurants**
27751         - ❌
27752         - ❌
27753         - ❌
27754         - ❌
27755       * - **browsertime-tp6m-fenix-google-search-restaurants-nofis**
27756         - ❌
27757         - ❌
27758         - ❌
27759         - ❌
27760       * - **browsertime-tp6m-geckoview-google-search-restaurants**
27761         - ❌
27762         - ❌
27763         - ❌
27764         - ❌
27765       * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis**
27766         - ✅
27767         - ✅
27768         - ❌
27769         - ❌
27770       * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis**
27771         - ❌
27772         - ❌
27773         - ❌
27774         - ❌
27775       * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis**
27776         - ❌
27777         - ❌
27778         - ❌
27779         - ❌
27780       * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis**
27781         - ❌
27782         - ❌
27783         - ❌
27784         - ❌
27785       * - **browsertime-tp6m-refbrow-google-search-restaurants**
27786         - ❌
27787         - ❌
27788         - ❌
27789         - ❌
27790
27791
27792
27793 .. dropdown:: imdb
27794    :class-container: anchor-id-imdb-m
27795
27796    **Owner**: PerfTest Team
27797
27798    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
27799    * **alert threshold**: 2.0
27800    * **apps**: geckoview, fenix, refbrow, chrome-m
27801    * **browser cycles**: 15
27802    * **expected**: pass
27803    * **lower is better**: true
27804    * **page cycles**: 25
27805    * **page timeout**: 60000
27806    * **playback**: mitmproxy-android
27807    * **playback pageset manifest**: mitm6-android-fenix-imdb.manifest
27808    * **playback version**: 8.1.1
27809    * **test url**: `<https://m.imdb.com/>`__
27810    * **type**: pageload
27811    * **unit**: ms
27812    * **use live sites**: false
27813    * **Test Task**:
27814
27815    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
27816       :widths: 30 15 15 15 15
27817       :header-rows: 1
27818
27819       * - **Test Name**
27820         - mozilla-central
27821         - autoland
27822         - mozilla-release
27823         - mozilla-beta
27824       * - **browsertime-tp6m-fenix-imdb**
27825         - ❌
27826         - ❌
27827         - ❌
27828         - ❌
27829       * - **browsertime-tp6m-fenix-imdb-nofis**
27830         - ❌
27831         - ❌
27832         - ❌
27833         - ❌
27834       * - **browsertime-tp6m-geckoview-imdb**
27835         - ❌
27836         - ❌
27837         - ❌
27838         - ❌
27839       * - **browsertime-tp6m-geckoview-imdb-nofis**
27840         - ❌
27841         - ❌
27842         - ❌
27843         - ❌
27844       * - **browsertime-tp6m-live-fenix-imdb-nofis**
27845         - ❌
27846         - ❌
27847         - ❌
27848         - ❌
27849       * - **browsertime-tp6m-live-geckoview-imdb-nofis**
27850         - ❌
27851         - ❌
27852         - ❌
27853         - ❌
27854       * - **browsertime-tp6m-refbrow-imdb**
27855         - ❌
27856         - ❌
27857         - ❌
27858         - ❌
27859
27860
27861    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
27862       :widths: 30 15 15 15 15
27863       :header-rows: 1
27864
27865       * - **Test Name**
27866         - mozilla-central
27867         - autoland
27868         - mozilla-release
27869         - mozilla-beta
27870       * - **browsertime-tp6m-chrome-m-imdb**
27871         - ❌
27872         - ❌
27873         - ❌
27874         - ❌
27875       * - **browsertime-tp6m-chrome-m-imdb-nofis**
27876         - ❌
27877         - ❌
27878         - ❌
27879         - ❌
27880       * - **browsertime-tp6m-fenix-imdb**
27881         - ❌
27882         - ❌
27883         - ❌
27884         - ❌
27885       * - **browsertime-tp6m-fenix-imdb-nofis**
27886         - ❌
27887         - ❌
27888         - ❌
27889         - ❌
27890       * - **browsertime-tp6m-geckoview-imdb**
27891         - ❌
27892         - ❌
27893         - ❌
27894         - ❌
27895       * - **browsertime-tp6m-geckoview-imdb-nofis**
27896         - ✅
27897         - ✅
27898         - ❌
27899         - ❌
27900       * - **browsertime-tp6m-live-chrome-m-imdb-nofis**
27901         - ❌
27902         - ❌
27903         - ❌
27904         - ❌
27905       * - **browsertime-tp6m-live-fenix-imdb-nofis**
27906         - ❌
27907         - ❌
27908         - ❌
27909         - ❌
27910       * - **browsertime-tp6m-live-geckoview-imdb-nofis**
27911         - ❌
27912         - ❌
27913         - ❌
27914         - ❌
27915       * - **browsertime-tp6m-refbrow-imdb**
27916         - ❌
27917         - ❌
27918         - ❌
27919         - ❌
27920
27921
27922    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
27923       :widths: 30 15 15 15 15
27924       :header-rows: 1
27925
27926       * - **Test Name**
27927         - mozilla-central
27928         - autoland
27929         - mozilla-release
27930         - mozilla-beta
27931       * - **browsertime-tp6-firefox-imdb**
27932         - ❌
27933         - ❌
27934         - ❌
27935         - ❌
27936       * - **browsertime-tp6-live-firefox-imdb**
27937         - ❌
27938         - ❌
27939         - ❌
27940         - ❌
27941
27942
27943    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
27944       :widths: 30 15 15 15 15
27945       :header-rows: 1
27946
27947       * - **Test Name**
27948         - mozilla-central
27949         - autoland
27950         - mozilla-release
27951         - mozilla-beta
27952       * - **browsertime-tp6-firefox-imdb**
27953         - ❌
27954         - ❌
27955         - ❌
27956         - ❌
27957       * - **browsertime-tp6-live-firefox-imdb**
27958         - ❌
27959         - ❌
27960         - ❌
27961         - ❌
27962
27963
27964    .. list-table:: **test-linux1804-64-qr/opt**
27965       :widths: 30 15 15 15 15
27966       :header-rows: 1
27967
27968       * - **Test Name**
27969         - mozilla-central
27970         - autoland
27971         - mozilla-release
27972         - mozilla-beta
27973       * - **browsertime-tp6-firefox-imdb**
27974         - ❌
27975         - ❌
27976         - ❌
27977         - ❌
27978       * - **browsertime-tp6-live-firefox-imdb**
27979         - ❌
27980         - ❌
27981         - ❌
27982         - ❌
27983
27984
27985    .. list-table:: **test-linux1804-64-shippable-qr/opt**
27986       :widths: 30 15 15 15 15
27987       :header-rows: 1
27988
27989       * - **Test Name**
27990         - mozilla-central
27991         - autoland
27992         - mozilla-release
27993         - mozilla-beta
27994       * - **browsertime-tp6-chrome-imdb**
27995         - ❌
27996         - ❌
27997         - ❌
27998         - ❌
27999       * - **browsertime-tp6-chromium-imdb**
28000         - ❌
28001         - ❌
28002         - ❌
28003         - ❌
28004       * - **browsertime-tp6-firefox-imdb**
28005         - ✅
28006         - ✅
28007         - ✅
28008         - ✅
28009       * - **browsertime-tp6-live-chrome-imdb**
28010         - ❌
28011         - ❌
28012         - ❌
28013         - ❌
28014       * - **browsertime-tp6-live-chromium-imdb**
28015         - ❌
28016         - ❌
28017         - ❌
28018         - ❌
28019       * - **browsertime-tp6-live-firefox-imdb**
28020         - ❌
28021         - ❌
28022         - ❌
28023         - ❌
28024
28025
28026    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
28027       :widths: 30 15 15 15 15
28028       :header-rows: 1
28029
28030       * - **Test Name**
28031         - mozilla-central
28032         - autoland
28033         - mozilla-release
28034         - mozilla-beta
28035       * - **browsertime-tp6-firefox-imdb**
28036         - ❌
28037         - ❌
28038         - ❌
28039         - ❌
28040       * - **browsertime-tp6-live-firefox-imdb**
28041         - ❌
28042         - ❌
28043         - ❌
28044         - ❌
28045
28046
28047    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
28048       :widths: 30 15 15 15 15
28049       :header-rows: 1
28050
28051       * - **Test Name**
28052         - mozilla-central
28053         - autoland
28054         - mozilla-release
28055         - mozilla-beta
28056       * - **browsertime-tp6-chrome-imdb**
28057         - ❌
28058         - ❌
28059         - ❌
28060         - ❌
28061       * - **browsertime-tp6-chromium-imdb**
28062         - ❌
28063         - ❌
28064         - ❌
28065         - ❌
28066       * - **browsertime-tp6-firefox-imdb**
28067         - ✅
28068         - ✅
28069         - ✅
28070         - ✅
28071       * - **browsertime-tp6-live-chrome-imdb**
28072         - ❌
28073         - ❌
28074         - ❌
28075         - ❌
28076       * - **browsertime-tp6-live-chromium-imdb**
28077         - ❌
28078         - ❌
28079         - ❌
28080         - ❌
28081       * - **browsertime-tp6-live-firefox-imdb**
28082         - ❌
28083         - ❌
28084         - ❌
28085         - ❌
28086       * - **browsertime-tp6-live-safari-imdb**
28087         - ❌
28088         - ❌
28089         - ❌
28090         - ❌
28091
28092
28093    .. list-table:: **test-windows10-32-qr/opt**
28094       :widths: 30 15 15 15 15
28095       :header-rows: 1
28096
28097       * - **Test Name**
28098         - mozilla-central
28099         - autoland
28100         - mozilla-release
28101         - mozilla-beta
28102       * - **browsertime-tp6-firefox-imdb**
28103         - ❌
28104         - ❌
28105         - ❌
28106         - ❌
28107       * - **browsertime-tp6-live-firefox-imdb**
28108         - ❌
28109         - ❌
28110         - ❌
28111         - ❌
28112
28113
28114    .. list-table:: **test-windows10-32-shippable-qr/opt**
28115       :widths: 30 15 15 15 15
28116       :header-rows: 1
28117
28118       * - **Test Name**
28119         - mozilla-central
28120         - autoland
28121         - mozilla-release
28122         - mozilla-beta
28123       * - **browsertime-tp6-chrome-imdb**
28124         - ❌
28125         - ❌
28126         - ❌
28127         - ❌
28128       * - **browsertime-tp6-chromium-imdb**
28129         - ❌
28130         - ❌
28131         - ❌
28132         - ❌
28133       * - **browsertime-tp6-firefox-imdb**
28134         - ❌
28135         - ❌
28136         - ❌
28137         - ❌
28138       * - **browsertime-tp6-live-chrome-imdb**
28139         - ❌
28140         - ❌
28141         - ❌
28142         - ❌
28143       * - **browsertime-tp6-live-chromium-imdb**
28144         - ❌
28145         - ❌
28146         - ❌
28147         - ❌
28148       * - **browsertime-tp6-live-firefox-imdb**
28149         - ❌
28150         - ❌
28151         - ❌
28152         - ❌
28153
28154
28155    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
28156       :widths: 30 15 15 15 15
28157       :header-rows: 1
28158
28159       * - **Test Name**
28160         - mozilla-central
28161         - autoland
28162         - mozilla-release
28163         - mozilla-beta
28164       * - **browsertime-tp6-firefox-imdb**
28165         - ❌
28166         - ❌
28167         - ❌
28168         - ❌
28169       * - **browsertime-tp6-live-firefox-imdb**
28170         - ❌
28171         - ❌
28172         - ❌
28173         - ❌
28174
28175
28176    .. list-table:: **test-windows10-64-qr/opt**
28177       :widths: 30 15 15 15 15
28178       :header-rows: 1
28179
28180       * - **Test Name**
28181         - mozilla-central
28182         - autoland
28183         - mozilla-release
28184         - mozilla-beta
28185       * - **browsertime-tp6-firefox-imdb**
28186         - ❌
28187         - ❌
28188         - ❌
28189         - ❌
28190       * - **browsertime-tp6-live-firefox-imdb**
28191         - ❌
28192         - ❌
28193         - ❌
28194         - ❌
28195
28196
28197    .. list-table:: **test-windows10-64-shippable-qr/opt**
28198       :widths: 30 15 15 15 15
28199       :header-rows: 1
28200
28201       * - **Test Name**
28202         - mozilla-central
28203         - autoland
28204         - mozilla-release
28205         - mozilla-beta
28206       * - **browsertime-tp6-chrome-imdb**
28207         - ❌
28208         - ❌
28209         - ❌
28210         - ❌
28211       * - **browsertime-tp6-chromium-imdb**
28212         - ❌
28213         - ❌
28214         - ❌
28215         - ❌
28216       * - **browsertime-tp6-firefox-imdb**
28217         - ✅
28218         - ✅
28219         - ✅
28220         - ✅
28221       * - **browsertime-tp6-live-chrome-imdb**
28222         - ❌
28223         - ❌
28224         - ❌
28225         - ❌
28226       * - **browsertime-tp6-live-chromium-imdb**
28227         - ❌
28228         - ❌
28229         - ❌
28230         - ❌
28231       * - **browsertime-tp6-live-firefox-imdb**
28232         - ❌
28233         - ❌
28234         - ❌
28235         - ❌
28236
28237
28238
28239 .. dropdown:: instagram
28240    :class-container: anchor-id-instagram-m
28241
28242    **Owner**: PerfTest Team
28243
28244    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
28245    * **alert threshold**: 2.0
28246    * **apps**: geckoview, fenix, refbrow, chrome-m
28247    * **browser cycles**: 15
28248    * **expected**: pass
28249    * **login**: true
28250    * **lower is better**: true
28251    * **page cycles**: 25
28252    * **page timeout**: 60000
28253    * **playback**: mitmproxy-android
28254    * **playback pageset manifest**: mitm8-android-gve-instagram.manifest
28255    * **playback version**: 8.1.1
28256    * **test url**: `<https://www.instagram.com>`__
28257    * **type**: pageload
28258    * **unit**: ms
28259    * **use live sites**: false
28260    * **Test Task**:
28261
28262    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
28263       :widths: 30 15 15 15 15
28264       :header-rows: 1
28265
28266       * - **Test Name**
28267         - mozilla-central
28268         - autoland
28269         - mozilla-release
28270         - mozilla-beta
28271       * - **browsertime-tp6m-fenix-instagram**
28272         - ❌
28273         - ❌
28274         - ❌
28275         - ❌
28276       * - **browsertime-tp6m-fenix-instagram-nofis**
28277         - ❌
28278         - ❌
28279         - ❌
28280         - ❌
28281       * - **browsertime-tp6m-geckoview-instagram**
28282         - ❌
28283         - ❌
28284         - ❌
28285         - ❌
28286       * - **browsertime-tp6m-geckoview-instagram-nofis**
28287         - ❌
28288         - ❌
28289         - ❌
28290         - ❌
28291       * - **browsertime-tp6m-live-fenix-instagram-nofis**
28292         - ❌
28293         - ❌
28294         - ❌
28295         - ❌
28296       * - **browsertime-tp6m-live-geckoview-instagram-nofis**
28297         - ❌
28298         - ❌
28299         - ❌
28300         - ❌
28301       * - **browsertime-tp6m-refbrow-instagram**
28302         - ❌
28303         - ❌
28304         - ❌
28305         - ❌
28306
28307
28308    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
28309       :widths: 30 15 15 15 15
28310       :header-rows: 1
28311
28312       * - **Test Name**
28313         - mozilla-central
28314         - autoland
28315         - mozilla-release
28316         - mozilla-beta
28317       * - **browsertime-tp6m-chrome-m-instagram**
28318         - ❌
28319         - ❌
28320         - ❌
28321         - ❌
28322       * - **browsertime-tp6m-chrome-m-instagram-nofis**
28323         - ❌
28324         - ❌
28325         - ❌
28326         - ❌
28327       * - **browsertime-tp6m-fenix-instagram**
28328         - ❌
28329         - ❌
28330         - ❌
28331         - ❌
28332       * - **browsertime-tp6m-fenix-instagram-nofis**
28333         - ❌
28334         - ❌
28335         - ❌
28336         - ❌
28337       * - **browsertime-tp6m-geckoview-instagram**
28338         - ❌
28339         - ❌
28340         - ❌
28341         - ❌
28342       * - **browsertime-tp6m-geckoview-instagram-nofis**
28343         - ✅
28344         - ✅
28345         - ❌
28346         - ❌
28347       * - **browsertime-tp6m-live-chrome-m-instagram-nofis**
28348         - ❌
28349         - ❌
28350         - ❌
28351         - ❌
28352       * - **browsertime-tp6m-live-fenix-instagram-nofis**
28353         - ❌
28354         - ❌
28355         - ❌
28356         - ❌
28357       * - **browsertime-tp6m-live-geckoview-instagram-nofis**
28358         - ❌
28359         - ❌
28360         - ❌
28361         - ❌
28362       * - **browsertime-tp6m-refbrow-instagram**
28363         - ❌
28364         - ❌
28365         - ❌
28366         - ❌
28367
28368
28369    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
28370       :widths: 30 15 15 15 15
28371       :header-rows: 1
28372
28373       * - **Test Name**
28374         - mozilla-central
28375         - autoland
28376         - mozilla-release
28377         - mozilla-beta
28378       * - **browsertime-tp6-bytecode-firefox-instagram**
28379         - ❌
28380         - ❌
28381         - ❌
28382         - ❌
28383       * - **browsertime-tp6-essential-custom-car-instagram**
28384         - ❌
28385         - ❌
28386         - ❌
28387         - ❌
28388       * - **browsertime-tp6-essential-firefox-instagram**
28389         - ❌
28390         - ❌
28391         - ❌
28392         - ❌
28393
28394
28395    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
28396       :widths: 30 15 15 15 15
28397       :header-rows: 1
28398
28399       * - **Test Name**
28400         - mozilla-central
28401         - autoland
28402         - mozilla-release
28403         - mozilla-beta
28404       * - **browsertime-tp6-bytecode-firefox-instagram**
28405         - ❌
28406         - ❌
28407         - ❌
28408         - ❌
28409       * - **browsertime-tp6-essential-custom-car-instagram**
28410         - ❌
28411         - ❌
28412         - ❌
28413         - ❌
28414       * - **browsertime-tp6-essential-firefox-instagram**
28415         - ❌
28416         - ❌
28417         - ❌
28418         - ❌
28419
28420
28421    .. list-table:: **test-linux1804-64-qr/opt**
28422       :widths: 30 15 15 15 15
28423       :header-rows: 1
28424
28425       * - **Test Name**
28426         - mozilla-central
28427         - autoland
28428         - mozilla-release
28429         - mozilla-beta
28430       * - **browsertime-tp6-bytecode-firefox-instagram**
28431         - ❌
28432         - ❌
28433         - ❌
28434         - ❌
28435       * - **browsertime-tp6-essential-custom-car-instagram**
28436         - ❌
28437         - ❌
28438         - ❌
28439         - ❌
28440       * - **browsertime-tp6-essential-firefox-instagram**
28441         - ❌
28442         - ❌
28443         - ❌
28444         - ❌
28445
28446
28447    .. list-table:: **test-linux1804-64-shippable-qr/opt**
28448       :widths: 30 15 15 15 15
28449       :header-rows: 1
28450
28451       * - **Test Name**
28452         - mozilla-central
28453         - autoland
28454         - mozilla-release
28455         - mozilla-beta
28456       * - **browsertime-tp6-bytecode-firefox-instagram**
28457         - ✅
28458         - ✅
28459         - ✅
28460         - ✅
28461       * - **browsertime-tp6-essential-chrome-instagram**
28462         - ❌
28463         - ❌
28464         - ❌
28465         - ❌
28466       * - **browsertime-tp6-essential-chromium-instagram**
28467         - ❌
28468         - ❌
28469         - ❌
28470         - ❌
28471       * - **browsertime-tp6-essential-custom-car-instagram**
28472         - ❌
28473         - ❌
28474         - ❌
28475         - ❌
28476       * - **browsertime-tp6-essential-firefox-instagram**
28477         - ✅
28478         - ✅
28479         - ✅
28480         - ✅
28481
28482
28483    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
28484       :widths: 30 15 15 15 15
28485       :header-rows: 1
28486
28487       * - **Test Name**
28488         - mozilla-central
28489         - autoland
28490         - mozilla-release
28491         - mozilla-beta
28492       * - **browsertime-tp6-bytecode-firefox-instagram**
28493         - ❌
28494         - ❌
28495         - ❌
28496         - ❌
28497       * - **browsertime-tp6-essential-custom-car-instagram**
28498         - ❌
28499         - ❌
28500         - ❌
28501         - ❌
28502       * - **browsertime-tp6-essential-firefox-instagram**
28503         - ❌
28504         - ❌
28505         - ❌
28506         - ❌
28507
28508
28509    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
28510       :widths: 30 15 15 15 15
28511       :header-rows: 1
28512
28513       * - **Test Name**
28514         - mozilla-central
28515         - autoland
28516         - mozilla-release
28517         - mozilla-beta
28518       * - **browsertime-tp6-bytecode-firefox-instagram**
28519         - ✅
28520         - ✅
28521         - ✅
28522         - ✅
28523       * - **browsertime-tp6-essential-chrome-instagram**
28524         - ❌
28525         - ❌
28526         - ❌
28527         - ❌
28528       * - **browsertime-tp6-essential-chromium-instagram**
28529         - ❌
28530         - ❌
28531         - ❌
28532         - ❌
28533       * - **browsertime-tp6-essential-custom-car-instagram**
28534         - ❌
28535         - ❌
28536         - ❌
28537         - ❌
28538       * - **browsertime-tp6-essential-firefox-instagram**
28539         - ✅
28540         - ✅
28541         - ✅
28542         - ✅
28543
28544
28545    .. list-table:: **test-windows10-32-qr/opt**
28546       :widths: 30 15 15 15 15
28547       :header-rows: 1
28548
28549       * - **Test Name**
28550         - mozilla-central
28551         - autoland
28552         - mozilla-release
28553         - mozilla-beta
28554       * - **browsertime-tp6-bytecode-firefox-instagram**
28555         - ❌
28556         - ❌
28557         - ❌
28558         - ❌
28559       * - **browsertime-tp6-essential-custom-car-instagram**
28560         - ❌
28561         - ❌
28562         - ❌
28563         - ❌
28564       * - **browsertime-tp6-essential-firefox-instagram**
28565         - ❌
28566         - ❌
28567         - ❌
28568         - ❌
28569
28570
28571    .. list-table:: **test-windows10-32-shippable-qr/opt**
28572       :widths: 30 15 15 15 15
28573       :header-rows: 1
28574
28575       * - **Test Name**
28576         - mozilla-central
28577         - autoland
28578         - mozilla-release
28579         - mozilla-beta
28580       * - **browsertime-tp6-bytecode-firefox-instagram**
28581         - ❌
28582         - ❌
28583         - ❌
28584         - ❌
28585       * - **browsertime-tp6-essential-chrome-instagram**
28586         - ❌
28587         - ❌
28588         - ❌
28589         - ❌
28590       * - **browsertime-tp6-essential-chromium-instagram**
28591         - ❌
28592         - ❌
28593         - ❌
28594         - ❌
28595       * - **browsertime-tp6-essential-custom-car-instagram**
28596         - ❌
28597         - ❌
28598         - ❌
28599         - ❌
28600       * - **browsertime-tp6-essential-firefox-instagram**
28601         - ❌
28602         - ❌
28603         - ❌
28604         - ❌
28605
28606
28607    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
28608       :widths: 30 15 15 15 15
28609       :header-rows: 1
28610
28611       * - **Test Name**
28612         - mozilla-central
28613         - autoland
28614         - mozilla-release
28615         - mozilla-beta
28616       * - **browsertime-tp6-bytecode-firefox-instagram**
28617         - ❌
28618         - ❌
28619         - ❌
28620         - ❌
28621       * - **browsertime-tp6-essential-custom-car-instagram**
28622         - ❌
28623         - ❌
28624         - ❌
28625         - ❌
28626       * - **browsertime-tp6-essential-firefox-instagram**
28627         - ❌
28628         - ❌
28629         - ❌
28630         - ❌
28631
28632
28633    .. list-table:: **test-windows10-64-qr/opt**
28634       :widths: 30 15 15 15 15
28635       :header-rows: 1
28636
28637       * - **Test Name**
28638         - mozilla-central
28639         - autoland
28640         - mozilla-release
28641         - mozilla-beta
28642       * - **browsertime-tp6-bytecode-firefox-instagram**
28643         - ❌
28644         - ❌
28645         - ❌
28646         - ❌
28647       * - **browsertime-tp6-essential-custom-car-instagram**
28648         - ❌
28649         - ❌
28650         - ❌
28651         - ❌
28652       * - **browsertime-tp6-essential-firefox-instagram**
28653         - ❌
28654         - ❌
28655         - ❌
28656         - ❌
28657
28658
28659    .. list-table:: **test-windows10-64-shippable-qr/opt**
28660       :widths: 30 15 15 15 15
28661       :header-rows: 1
28662
28663       * - **Test Name**
28664         - mozilla-central
28665         - autoland
28666         - mozilla-release
28667         - mozilla-beta
28668       * - **browsertime-tp6-bytecode-firefox-instagram**
28669         - ✅
28670         - ✅
28671         - ✅
28672         - ✅
28673       * - **browsertime-tp6-essential-chrome-instagram**
28674         - ❌
28675         - ❌
28676         - ❌
28677         - ❌
28678       * - **browsertime-tp6-essential-chromium-instagram**
28679         - ❌
28680         - ❌
28681         - ❌
28682         - ❌
28683       * - **browsertime-tp6-essential-custom-car-instagram**
28684         - ❌
28685         - ❌
28686         - ❌
28687         - ❌
28688       * - **browsertime-tp6-essential-firefox-instagram**
28689         - ✅
28690         - ✅
28691         - ✅
28692         - ✅
28693
28694
28695
28696 .. dropdown:: microsoft-support
28697    :class-container: anchor-id-microsoft-support-m
28698
28699    **Owner**: PerfTest Team
28700
28701    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
28702    * **alert threshold**: 2.0
28703    * **apps**: geckoview, fenix, refbrow, chrome-m
28704    * **browser cycles**: 15
28705    * **expected**: pass
28706    * **lower is better**: true
28707    * **page cycles**: 25
28708    * **page timeout**: 60000
28709    * **playback**: mitmproxy-android
28710    * **playback pageset manifest**: mitm6-android-fenix-microsoft-support.manifest
28711    * **playback version**: 8.1.1
28712    * **test url**: `<https://support.microsoft.com/en-us>`__
28713    * **type**: pageload
28714    * **unit**: ms
28715    * **use live sites**: false
28716    * **Test Task**:
28717
28718    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
28719       :widths: 30 15 15 15 15
28720       :header-rows: 1
28721
28722       * - **Test Name**
28723         - mozilla-central
28724         - autoland
28725         - mozilla-release
28726         - mozilla-beta
28727       * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis**
28728         - ❌
28729         - ❌
28730         - ❌
28731         - ❌
28732       * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis**
28733         - ❌
28734         - ❌
28735         - ❌
28736         - ❌
28737       * - **browsertime-tp6m-live-fenix-microsoft-support-nofis**
28738         - ❌
28739         - ❌
28740         - ❌
28741         - ❌
28742       * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis**
28743         - ❌
28744         - ❌
28745         - ❌
28746         - ❌
28747
28748
28749    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
28750       :widths: 30 15 15 15 15
28751       :header-rows: 1
28752
28753       * - **Test Name**
28754         - mozilla-central
28755         - autoland
28756         - mozilla-release
28757         - mozilla-beta
28758       * - **browsertime-tp6m-essential-chrome-m-microsoft-support-nofis**
28759         - ❌
28760         - ❌
28761         - ❌
28762         - ❌
28763       * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis**
28764         - ❌
28765         - ❌
28766         - ❌
28767         - ❌
28768       * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis**
28769         - ✅
28770         - ✅
28771         - ❌
28772         - ❌
28773       * - **browsertime-tp6m-live-chrome-m-microsoft-support-nofis**
28774         - ❌
28775         - ❌
28776         - ❌
28777         - ❌
28778       * - **browsertime-tp6m-live-fenix-microsoft-support-nofis**
28779         - ❌
28780         - ❌
28781         - ❌
28782         - ❌
28783       * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis**
28784         - ❌
28785         - ❌
28786         - ❌
28787         - ❌
28788
28789
28790
28791 .. dropdown:: reddit
28792    :class-container: anchor-id-reddit-m
28793
28794    **Owner**: PerfTest Team
28795
28796    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
28797    * **alert threshold**: 2.0
28798    * **apps**: geckoview, fenix, refbrow, chrome-m
28799    * **browser cycles**: 15
28800    * **expected**: pass
28801    * **lower is better**: true
28802    * **page cycles**: 25
28803    * **page timeout**: 60000
28804    * **playback**: mitmproxy-android
28805    * **playback pageset manifest**: mitm6-android-fenix-reddit.manifest
28806    * **playback version**: 8.1.1
28807    * **test url**: `<https://www.reddit.com>`__
28808    * **type**: pageload
28809    * **unit**: ms
28810    * **use live sites**: false
28811    * **Test Task**:
28812
28813    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
28814       :widths: 30 15 15 15 15
28815       :header-rows: 1
28816
28817       * - **Test Name**
28818         - mozilla-central
28819         - autoland
28820         - mozilla-release
28821         - mozilla-beta
28822       * - **browsertime-tp6m-fenix-reddit**
28823         - ❌
28824         - ❌
28825         - ❌
28826         - ❌
28827       * - **browsertime-tp6m-fenix-reddit-nofis**
28828         - ❌
28829         - ❌
28830         - ❌
28831         - ❌
28832       * - **browsertime-tp6m-geckoview-reddit**
28833         - ❌
28834         - ❌
28835         - ❌
28836         - ❌
28837       * - **browsertime-tp6m-geckoview-reddit-nofis**
28838         - ❌
28839         - ❌
28840         - ❌
28841         - ❌
28842       * - **browsertime-tp6m-live-fenix-reddit-nofis**
28843         - ❌
28844         - ❌
28845         - ❌
28846         - ❌
28847       * - **browsertime-tp6m-live-geckoview-reddit-nofis**
28848         - ❌
28849         - ❌
28850         - ❌
28851         - ❌
28852       * - **browsertime-tp6m-refbrow-reddit**
28853         - ❌
28854         - ❌
28855         - ❌
28856         - ❌
28857
28858
28859    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
28860       :widths: 30 15 15 15 15
28861       :header-rows: 1
28862
28863       * - **Test Name**
28864         - mozilla-central
28865         - autoland
28866         - mozilla-release
28867         - mozilla-beta
28868       * - **browsertime-tp6m-chrome-m-reddit**
28869         - ❌
28870         - ❌
28871         - ❌
28872         - ❌
28873       * - **browsertime-tp6m-chrome-m-reddit-nofis**
28874         - ❌
28875         - ❌
28876         - ❌
28877         - ❌
28878       * - **browsertime-tp6m-fenix-reddit**
28879         - ❌
28880         - ❌
28881         - ❌
28882         - ❌
28883       * - **browsertime-tp6m-fenix-reddit-nofis**
28884         - ❌
28885         - ❌
28886         - ❌
28887         - ❌
28888       * - **browsertime-tp6m-geckoview-reddit**
28889         - ❌
28890         - ❌
28891         - ❌
28892         - ❌
28893       * - **browsertime-tp6m-geckoview-reddit-nofis**
28894         - ✅
28895         - ✅
28896         - ❌
28897         - ❌
28898       * - **browsertime-tp6m-live-chrome-m-reddit-nofis**
28899         - ❌
28900         - ❌
28901         - ❌
28902         - ❌
28903       * - **browsertime-tp6m-live-fenix-reddit-nofis**
28904         - ❌
28905         - ❌
28906         - ❌
28907         - ❌
28908       * - **browsertime-tp6m-live-geckoview-reddit-nofis**
28909         - ❌
28910         - ❌
28911         - ❌
28912         - ❌
28913       * - **browsertime-tp6m-refbrow-reddit**
28914         - ❌
28915         - ❌
28916         - ❌
28917         - ❌
28918
28919
28920    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
28921       :widths: 30 15 15 15 15
28922       :header-rows: 1
28923
28924       * - **Test Name**
28925         - mozilla-central
28926         - autoland
28927         - mozilla-release
28928         - mozilla-beta
28929       * - **browsertime-tp6-firefox-reddit**
28930         - ❌
28931         - ❌
28932         - ❌
28933         - ❌
28934       * - **browsertime-tp6-live-firefox-reddit**
28935         - ❌
28936         - ❌
28937         - ❌
28938         - ❌
28939
28940
28941    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
28942       :widths: 30 15 15 15 15
28943       :header-rows: 1
28944
28945       * - **Test Name**
28946         - mozilla-central
28947         - autoland
28948         - mozilla-release
28949         - mozilla-beta
28950       * - **browsertime-tp6-firefox-reddit**
28951         - ❌
28952         - ❌
28953         - ❌
28954         - ❌
28955       * - **browsertime-tp6-live-firefox-reddit**
28956         - ❌
28957         - ❌
28958         - ❌
28959         - ❌
28960
28961
28962    .. list-table:: **test-linux1804-64-qr/opt**
28963       :widths: 30 15 15 15 15
28964       :header-rows: 1
28965
28966       * - **Test Name**
28967         - mozilla-central
28968         - autoland
28969         - mozilla-release
28970         - mozilla-beta
28971       * - **browsertime-tp6-firefox-reddit**
28972         - ❌
28973         - ❌
28974         - ❌
28975         - ❌
28976       * - **browsertime-tp6-live-firefox-reddit**
28977         - ❌
28978         - ❌
28979         - ❌
28980         - ❌
28981
28982
28983    .. list-table:: **test-linux1804-64-shippable-qr/opt**
28984       :widths: 30 15 15 15 15
28985       :header-rows: 1
28986
28987       * - **Test Name**
28988         - mozilla-central
28989         - autoland
28990         - mozilla-release
28991         - mozilla-beta
28992       * - **browsertime-tp6-chrome-reddit**
28993         - ❌
28994         - ❌
28995         - ❌
28996         - ❌
28997       * - **browsertime-tp6-chromium-reddit**
28998         - ❌
28999         - ❌
29000         - ❌
29001         - ❌
29002       * - **browsertime-tp6-firefox-reddit**
29003         - ✅
29004         - ✅
29005         - ✅
29006         - ✅
29007       * - **browsertime-tp6-live-chrome-reddit**
29008         - ❌
29009         - ❌
29010         - ❌
29011         - ❌
29012       * - **browsertime-tp6-live-chromium-reddit**
29013         - ❌
29014         - ❌
29015         - ❌
29016         - ❌
29017       * - **browsertime-tp6-live-firefox-reddit**
29018         - ❌
29019         - ❌
29020         - ❌
29021         - ❌
29022
29023
29024    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
29025       :widths: 30 15 15 15 15
29026       :header-rows: 1
29027
29028       * - **Test Name**
29029         - mozilla-central
29030         - autoland
29031         - mozilla-release
29032         - mozilla-beta
29033       * - **browsertime-tp6-firefox-reddit**
29034         - ❌
29035         - ❌
29036         - ❌
29037         - ❌
29038       * - **browsertime-tp6-live-firefox-reddit**
29039         - ❌
29040         - ❌
29041         - ❌
29042         - ❌
29043
29044
29045    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
29046       :widths: 30 15 15 15 15
29047       :header-rows: 1
29048
29049       * - **Test Name**
29050         - mozilla-central
29051         - autoland
29052         - mozilla-release
29053         - mozilla-beta
29054       * - **browsertime-tp6-chrome-reddit**
29055         - ❌
29056         - ❌
29057         - ❌
29058         - ❌
29059       * - **browsertime-tp6-chromium-reddit**
29060         - ❌
29061         - ❌
29062         - ❌
29063         - ❌
29064       * - **browsertime-tp6-firefox-reddit**
29065         - ✅
29066         - ✅
29067         - ✅
29068         - ✅
29069       * - **browsertime-tp6-live-chrome-reddit**
29070         - ❌
29071         - ❌
29072         - ❌
29073         - ❌
29074       * - **browsertime-tp6-live-chromium-reddit**
29075         - ❌
29076         - ❌
29077         - ❌
29078         - ❌
29079       * - **browsertime-tp6-live-firefox-reddit**
29080         - ❌
29081         - ❌
29082         - ❌
29083         - ❌
29084       * - **browsertime-tp6-live-safari-reddit**
29085         - ❌
29086         - ❌
29087         - ❌
29088         - ❌
29089
29090
29091    .. list-table:: **test-windows10-32-qr/opt**
29092       :widths: 30 15 15 15 15
29093       :header-rows: 1
29094
29095       * - **Test Name**
29096         - mozilla-central
29097         - autoland
29098         - mozilla-release
29099         - mozilla-beta
29100       * - **browsertime-tp6-firefox-reddit**
29101         - ❌
29102         - ❌
29103         - ❌
29104         - ❌
29105       * - **browsertime-tp6-live-firefox-reddit**
29106         - ❌
29107         - ❌
29108         - ❌
29109         - ❌
29110
29111
29112    .. list-table:: **test-windows10-32-shippable-qr/opt**
29113       :widths: 30 15 15 15 15
29114       :header-rows: 1
29115
29116       * - **Test Name**
29117         - mozilla-central
29118         - autoland
29119         - mozilla-release
29120         - mozilla-beta
29121       * - **browsertime-tp6-chrome-reddit**
29122         - ❌
29123         - ❌
29124         - ❌
29125         - ❌
29126       * - **browsertime-tp6-chromium-reddit**
29127         - ❌
29128         - ❌
29129         - ❌
29130         - ❌
29131       * - **browsertime-tp6-firefox-reddit**
29132         - ❌
29133         - ❌
29134         - ❌
29135         - ❌
29136       * - **browsertime-tp6-live-chrome-reddit**
29137         - ❌
29138         - ❌
29139         - ❌
29140         - ❌
29141       * - **browsertime-tp6-live-chromium-reddit**
29142         - ❌
29143         - ❌
29144         - ❌
29145         - ❌
29146       * - **browsertime-tp6-live-firefox-reddit**
29147         - ❌
29148         - ❌
29149         - ❌
29150         - ❌
29151
29152
29153    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
29154       :widths: 30 15 15 15 15
29155       :header-rows: 1
29156
29157       * - **Test Name**
29158         - mozilla-central
29159         - autoland
29160         - mozilla-release
29161         - mozilla-beta
29162       * - **browsertime-tp6-firefox-reddit**
29163         - ❌
29164         - ❌
29165         - ❌
29166         - ❌
29167       * - **browsertime-tp6-live-firefox-reddit**
29168         - ❌
29169         - ❌
29170         - ❌
29171         - ❌
29172
29173
29174    .. list-table:: **test-windows10-64-qr/opt**
29175       :widths: 30 15 15 15 15
29176       :header-rows: 1
29177
29178       * - **Test Name**
29179         - mozilla-central
29180         - autoland
29181         - mozilla-release
29182         - mozilla-beta
29183       * - **browsertime-tp6-firefox-reddit**
29184         - ❌
29185         - ❌
29186         - ❌
29187         - ❌
29188       * - **browsertime-tp6-live-firefox-reddit**
29189         - ❌
29190         - ❌
29191         - ❌
29192         - ❌
29193
29194
29195    .. list-table:: **test-windows10-64-shippable-qr/opt**
29196       :widths: 30 15 15 15 15
29197       :header-rows: 1
29198
29199       * - **Test Name**
29200         - mozilla-central
29201         - autoland
29202         - mozilla-release
29203         - mozilla-beta
29204       * - **browsertime-tp6-chrome-reddit**
29205         - ❌
29206         - ❌
29207         - ❌
29208         - ❌
29209       * - **browsertime-tp6-chromium-reddit**
29210         - ❌
29211         - ❌
29212         - ❌
29213         - ❌
29214       * - **browsertime-tp6-firefox-reddit**
29215         - ✅
29216         - ✅
29217         - ✅
29218         - ✅
29219       * - **browsertime-tp6-live-chrome-reddit**
29220         - ❌
29221         - ❌
29222         - ❌
29223         - ❌
29224       * - **browsertime-tp6-live-chromium-reddit**
29225         - ❌
29226         - ❌
29227         - ❌
29228         - ❌
29229       * - **browsertime-tp6-live-firefox-reddit**
29230         - ❌
29231         - ❌
29232         - ❌
29233         - ❌
29234
29235
29236
29237 .. dropdown:: sina
29238    :class-container: anchor-id-sina-m
29239
29240    **Owner**: PerfTest Team
29241
29242    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
29243    * **alert threshold**: 2.0
29244    * **apps**: geckoview, fenix, refbrow, chrome-m
29245    * **browser cycles**: 15
29246    * **expected**: pass
29247    * **lower is better**: true
29248    * **page cycles**: 25
29249    * **page timeout**: 60000
29250    * **playback**: mitmproxy-android
29251    * **playback pageset manifest**: mitm6-android-fenix-sina.manifest
29252    * **playback version**: 8.1.1
29253    * **test url**: `<https://www.sina.com.cn/>`__
29254    * **type**: pageload
29255    * **unit**: ms
29256    * **use live sites**: false
29257    * **Test Task**:
29258
29259    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
29260       :widths: 30 15 15 15 15
29261       :header-rows: 1
29262
29263       * - **Test Name**
29264         - mozilla-central
29265         - autoland
29266         - mozilla-release
29267         - mozilla-beta
29268       * - **browsertime-tp6m-fenix-sina**
29269         - ❌
29270         - ❌
29271         - ❌
29272         - ❌
29273       * - **browsertime-tp6m-fenix-sina-nofis**
29274         - ❌
29275         - ❌
29276         - ❌
29277         - ❌
29278       * - **browsertime-tp6m-geckoview-sina**
29279         - ❌
29280         - ❌
29281         - ❌
29282         - ❌
29283       * - **browsertime-tp6m-geckoview-sina-nofis**
29284         - ❌
29285         - ❌
29286         - ❌
29287         - ❌
29288       * - **browsertime-tp6m-refbrow-sina**
29289         - ❌
29290         - ❌
29291         - ❌
29292         - ❌
29293
29294
29295    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
29296       :widths: 30 15 15 15 15
29297       :header-rows: 1
29298
29299       * - **Test Name**
29300         - mozilla-central
29301         - autoland
29302         - mozilla-release
29303         - mozilla-beta
29304       * - **browsertime-tp6m-chrome-m-sina**
29305         - ❌
29306         - ❌
29307         - ❌
29308         - ❌
29309       * - **browsertime-tp6m-chrome-m-sina-nofis**
29310         - ❌
29311         - ❌
29312         - ❌
29313         - ❌
29314       * - **browsertime-tp6m-fenix-sina**
29315         - ❌
29316         - ❌
29317         - ❌
29318         - ❌
29319       * - **browsertime-tp6m-fenix-sina-nofis**
29320         - ❌
29321         - ❌
29322         - ❌
29323         - ❌
29324       * - **browsertime-tp6m-geckoview-sina**
29325         - ❌
29326         - ❌
29327         - ❌
29328         - ❌
29329       * - **browsertime-tp6m-geckoview-sina-nofis**
29330         - ✅
29331         - ✅
29332         - ❌
29333         - ❌
29334       * - **browsertime-tp6m-refbrow-sina**
29335         - ❌
29336         - ❌
29337         - ❌
29338         - ❌
29339
29340
29341
29342 .. dropdown:: stackoverflow
29343    :class-container: anchor-id-stackoverflow-m
29344
29345    **Owner**: PerfTest Team
29346
29347    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
29348    * **alert threshold**: 2.0
29349    * **apps**: geckoview, fenix, refbrow, chrome-m
29350    * **browser cycles**: 15
29351    * **expected**: pass
29352    * **lower is better**: true
29353    * **page cycles**: 25
29354    * **page timeout**: 60000
29355    * **playback**: mitmproxy-android
29356    * **playback pageset manifest**: mitm6-android-fenix-stackoverflow.manifest
29357    * **playback version**: 8.1.1
29358    * **test url**: `<https://stackoverflow.com/>`__
29359    * **type**: pageload
29360    * **unit**: ms
29361    * **use live sites**: false
29362    * **Test Task**:
29363
29364    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
29365       :widths: 30 15 15 15 15
29366       :header-rows: 1
29367
29368       * - **Test Name**
29369         - mozilla-central
29370         - autoland
29371         - mozilla-release
29372         - mozilla-beta
29373       * - **browsertime-tp6m-fenix-stackoverflow**
29374         - ❌
29375         - ❌
29376         - ❌
29377         - ❌
29378       * - **browsertime-tp6m-fenix-stackoverflow-nofis**
29379         - ❌
29380         - ❌
29381         - ❌
29382         - ❌
29383       * - **browsertime-tp6m-geckoview-stackoverflow**
29384         - ❌
29385         - ❌
29386         - ❌
29387         - ❌
29388       * - **browsertime-tp6m-geckoview-stackoverflow-nofis**
29389         - ❌
29390         - ❌
29391         - ❌
29392         - ❌
29393       * - **browsertime-tp6m-live-fenix-stackoverflow-nofis**
29394         - ❌
29395         - ❌
29396         - ❌
29397         - ❌
29398       * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis**
29399         - ❌
29400         - ❌
29401         - ❌
29402         - ❌
29403       * - **browsertime-tp6m-refbrow-stackoverflow**
29404         - ❌
29405         - ❌
29406         - ❌
29407         - ❌
29408
29409
29410    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
29411       :widths: 30 15 15 15 15
29412       :header-rows: 1
29413
29414       * - **Test Name**
29415         - mozilla-central
29416         - autoland
29417         - mozilla-release
29418         - mozilla-beta
29419       * - **browsertime-tp6m-chrome-m-stackoverflow**
29420         - ❌
29421         - ❌
29422         - ❌
29423         - ❌
29424       * - **browsertime-tp6m-chrome-m-stackoverflow-nofis**
29425         - ❌
29426         - ❌
29427         - ❌
29428         - ❌
29429       * - **browsertime-tp6m-fenix-stackoverflow**
29430         - ❌
29431         - ❌
29432         - ❌
29433         - ❌
29434       * - **browsertime-tp6m-fenix-stackoverflow-nofis**
29435         - ❌
29436         - ❌
29437         - ❌
29438         - ❌
29439       * - **browsertime-tp6m-geckoview-stackoverflow**
29440         - ❌
29441         - ❌
29442         - ❌
29443         - ❌
29444       * - **browsertime-tp6m-geckoview-stackoverflow-nofis**
29445         - ✅
29446         - ✅
29447         - ❌
29448         - ❌
29449       * - **browsertime-tp6m-live-chrome-m-stackoverflow-nofis**
29450         - ❌
29451         - ❌
29452         - ❌
29453         - ❌
29454       * - **browsertime-tp6m-live-fenix-stackoverflow-nofis**
29455         - ❌
29456         - ❌
29457         - ❌
29458         - ❌
29459       * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis**
29460         - ❌
29461         - ❌
29462         - ❌
29463         - ❌
29464       * - **browsertime-tp6m-refbrow-stackoverflow**
29465         - ❌
29466         - ❌
29467         - ❌
29468         - ❌
29469
29470
29471
29472 .. dropdown:: web-de
29473    :class-container: anchor-id-web-de-m
29474
29475    **Owner**: PerfTest Team
29476
29477    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
29478    * **alert threshold**: 2.0
29479    * **apps**: geckoview, fenix, refbrow, chrome-m
29480    * **browser cycles**: 15
29481    * **expected**: pass
29482    * **lower is better**: true
29483    * **page cycles**: 25
29484    * **page timeout**: 60000
29485    * **playback**: mitmproxy-android
29486    * **playback pageset manifest**: mitm7-android-gve-p2-web-de.manifest
29487    * **playback version**: 8.1.1
29488    * **test url**: `<https://web.de/magazine/politik/politologe-glaubt-grossen-koalition-herbst-knallen-33563566>`__
29489    * **type**: pageload
29490    * **unit**: ms
29491    * **use live sites**: false
29492    * **Test Task**:
29493
29494    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
29495       :widths: 30 15 15 15 15
29496       :header-rows: 1
29497
29498       * - **Test Name**
29499         - mozilla-central
29500         - autoland
29501         - mozilla-release
29502         - mozilla-beta
29503       * - **browsertime-tp6m-fenix-web-de**
29504         - ❌
29505         - ❌
29506         - ❌
29507         - ❌
29508       * - **browsertime-tp6m-fenix-web-de-nofis**
29509         - ❌
29510         - ❌
29511         - ❌
29512         - ❌
29513       * - **browsertime-tp6m-geckoview-web-de**
29514         - ❌
29515         - ❌
29516         - ❌
29517         - ❌
29518       * - **browsertime-tp6m-geckoview-web-de-nofis**
29519         - ❌
29520         - ❌
29521         - ❌
29522         - ❌
29523       * - **browsertime-tp6m-live-fenix-web-de-nofis**
29524         - ❌
29525         - ❌
29526         - ❌
29527         - ❌
29528       * - **browsertime-tp6m-live-geckoview-web-de-nofis**
29529         - ❌
29530         - ❌
29531         - ❌
29532         - ❌
29533       * - **browsertime-tp6m-refbrow-web-de**
29534         - ❌
29535         - ❌
29536         - ❌
29537         - ❌
29538
29539
29540    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
29541       :widths: 30 15 15 15 15
29542       :header-rows: 1
29543
29544       * - **Test Name**
29545         - mozilla-central
29546         - autoland
29547         - mozilla-release
29548         - mozilla-beta
29549       * - **browsertime-tp6m-chrome-m-web-de**
29550         - ❌
29551         - ❌
29552         - ❌
29553         - ❌
29554       * - **browsertime-tp6m-chrome-m-web-de-nofis**
29555         - ❌
29556         - ❌
29557         - ❌
29558         - ❌
29559       * - **browsertime-tp6m-fenix-web-de**
29560         - ❌
29561         - ❌
29562         - ❌
29563         - ❌
29564       * - **browsertime-tp6m-fenix-web-de-nofis**
29565         - ❌
29566         - ❌
29567         - ❌
29568         - ❌
29569       * - **browsertime-tp6m-geckoview-web-de**
29570         - ❌
29571         - ❌
29572         - ❌
29573         - ❌
29574       * - **browsertime-tp6m-geckoview-web-de-nofis**
29575         - ✅
29576         - ✅
29577         - ❌
29578         - ❌
29579       * - **browsertime-tp6m-live-chrome-m-web-de-nofis**
29580         - ❌
29581         - ❌
29582         - ❌
29583         - ❌
29584       * - **browsertime-tp6m-live-fenix-web-de-nofis**
29585         - ❌
29586         - ❌
29587         - ❌
29588         - ❌
29589       * - **browsertime-tp6m-live-geckoview-web-de-nofis**
29590         - ❌
29591         - ❌
29592         - ❌
29593         - ❌
29594       * - **browsertime-tp6m-refbrow-web-de**
29595         - ❌
29596         - ❌
29597         - ❌
29598         - ❌
29599
29600
29601
29602 .. dropdown:: wikipedia
29603    :class-container: anchor-id-wikipedia-m
29604
29605    **Owner**: PerfTest Team
29606
29607    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
29608    * **alert threshold**: 2.0
29609    * **apps**: geckoview, fenix, refbrow, chrome-m
29610    * **browser cycles**: 15
29611    * **expected**: pass
29612    * **lower is better**: true
29613    * **page cycles**: 25
29614    * **page timeout**: 60000
29615    * **playback**: mitmproxy-android
29616    * **playback pageset manifest**: mitm6-android-fenix-wikipedia.manifest
29617    * **playback version**: 8.1.1
29618    * **test url**: `<https://en.m.wikipedia.org/wiki/Main_Page>`__
29619    * **type**: pageload
29620    * **unit**: ms
29621    * **use live sites**: false
29622    * **Test Task**:
29623
29624    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
29625       :widths: 30 15 15 15 15
29626       :header-rows: 1
29627
29628       * - **Test Name**
29629         - mozilla-central
29630         - autoland
29631         - mozilla-release
29632         - mozilla-beta
29633       * - **browsertime-tp6m-fenix-wikipedia**
29634         - ❌
29635         - ❌
29636         - ❌
29637         - ❌
29638       * - **browsertime-tp6m-fenix-wikipedia-nofis**
29639         - ❌
29640         - ❌
29641         - ❌
29642         - ❌
29643       * - **browsertime-tp6m-geckoview-wikipedia**
29644         - ❌
29645         - ❌
29646         - ❌
29647         - ❌
29648       * - **browsertime-tp6m-geckoview-wikipedia-nofis**
29649         - ❌
29650         - ❌
29651         - ❌
29652         - ❌
29653       * - **browsertime-tp6m-live-fenix-wikipedia-nofis**
29654         - ❌
29655         - ❌
29656         - ❌
29657         - ❌
29658       * - **browsertime-tp6m-live-geckoview-wikipedia-nofis**
29659         - ❌
29660         - ❌
29661         - ❌
29662         - ❌
29663       * - **browsertime-tp6m-refbrow-wikipedia**
29664         - ❌
29665         - ❌
29666         - ❌
29667         - ❌
29668
29669
29670    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
29671       :widths: 30 15 15 15 15
29672       :header-rows: 1
29673
29674       * - **Test Name**
29675         - mozilla-central
29676         - autoland
29677         - mozilla-release
29678         - mozilla-beta
29679       * - **browsertime-tp6m-chrome-m-wikipedia**
29680         - ❌
29681         - ❌
29682         - ❌
29683         - ❌
29684       * - **browsertime-tp6m-chrome-m-wikipedia-nofis**
29685         - ❌
29686         - ❌
29687         - ❌
29688         - ❌
29689       * - **browsertime-tp6m-fenix-wikipedia**
29690         - ❌
29691         - ❌
29692         - ❌
29693         - ❌
29694       * - **browsertime-tp6m-fenix-wikipedia-nofis**
29695         - ❌
29696         - ❌
29697         - ❌
29698         - ❌
29699       * - **browsertime-tp6m-geckoview-wikipedia**
29700         - ❌
29701         - ❌
29702         - ❌
29703         - ❌
29704       * - **browsertime-tp6m-geckoview-wikipedia-nofis**
29705         - ✅
29706         - ✅
29707         - ❌
29708         - ❌
29709       * - **browsertime-tp6m-live-chrome-m-wikipedia-nofis**
29710         - ❌
29711         - ❌
29712         - ❌
29713         - ❌
29714       * - **browsertime-tp6m-live-fenix-wikipedia-nofis**
29715         - ❌
29716         - ❌
29717         - ❌
29718         - ❌
29719       * - **browsertime-tp6m-live-geckoview-wikipedia-nofis**
29720         - ❌
29721         - ❌
29722         - ❌
29723         - ❌
29724       * - **browsertime-tp6m-refbrow-wikipedia**
29725         - ❌
29726         - ❌
29727         - ❌
29728         - ❌
29729
29730
29731    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
29732       :widths: 30 15 15 15 15
29733       :header-rows: 1
29734
29735       * - **Test Name**
29736         - mozilla-central
29737         - autoland
29738         - mozilla-release
29739         - mozilla-beta
29740       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29741         - ❌
29742         - ❌
29743         - ❌
29744         - ❌
29745       * - **browsertime-tp6-essential-custom-car-wikipedia**
29746         - ❌
29747         - ❌
29748         - ❌
29749         - ❌
29750       * - **browsertime-tp6-essential-firefox-wikipedia**
29751         - ❌
29752         - ❌
29753         - ❌
29754         - ❌
29755       * - **browsertime-tp6-live-firefox-wikipedia**
29756         - ❌
29757         - ❌
29758         - ❌
29759         - ❌
29760
29761
29762    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
29763       :widths: 30 15 15 15 15
29764       :header-rows: 1
29765
29766       * - **Test Name**
29767         - mozilla-central
29768         - autoland
29769         - mozilla-release
29770         - mozilla-beta
29771       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29772         - ❌
29773         - ❌
29774         - ❌
29775         - ❌
29776       * - **browsertime-tp6-essential-custom-car-wikipedia**
29777         - ❌
29778         - ❌
29779         - ❌
29780         - ❌
29781       * - **browsertime-tp6-essential-firefox-wikipedia**
29782         - ❌
29783         - ❌
29784         - ❌
29785         - ❌
29786       * - **browsertime-tp6-live-firefox-wikipedia**
29787         - ❌
29788         - ❌
29789         - ❌
29790         - ❌
29791
29792
29793    .. list-table:: **test-linux1804-64-qr/opt**
29794       :widths: 30 15 15 15 15
29795       :header-rows: 1
29796
29797       * - **Test Name**
29798         - mozilla-central
29799         - autoland
29800         - mozilla-release
29801         - mozilla-beta
29802       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29803         - ❌
29804         - ❌
29805         - ❌
29806         - ❌
29807       * - **browsertime-tp6-essential-custom-car-wikipedia**
29808         - ❌
29809         - ❌
29810         - ❌
29811         - ❌
29812       * - **browsertime-tp6-essential-firefox-wikipedia**
29813         - ❌
29814         - ❌
29815         - ❌
29816         - ❌
29817       * - **browsertime-tp6-live-firefox-wikipedia**
29818         - ❌
29819         - ❌
29820         - ❌
29821         - ❌
29822
29823
29824    .. list-table:: **test-linux1804-64-shippable-qr/opt**
29825       :widths: 30 15 15 15 15
29826       :header-rows: 1
29827
29828       * - **Test Name**
29829         - mozilla-central
29830         - autoland
29831         - mozilla-release
29832         - mozilla-beta
29833       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29834         - ✅
29835         - ✅
29836         - ✅
29837         - ✅
29838       * - **browsertime-tp6-essential-chrome-wikipedia**
29839         - ❌
29840         - ❌
29841         - ❌
29842         - ❌
29843       * - **browsertime-tp6-essential-chromium-wikipedia**
29844         - ❌
29845         - ❌
29846         - ❌
29847         - ❌
29848       * - **browsertime-tp6-essential-custom-car-wikipedia**
29849         - ❌
29850         - ❌
29851         - ❌
29852         - ❌
29853       * - **browsertime-tp6-essential-firefox-wikipedia**
29854         - ✅
29855         - ✅
29856         - ✅
29857         - ✅
29858       * - **browsertime-tp6-live-chrome-wikipedia**
29859         - ❌
29860         - ❌
29861         - ❌
29862         - ❌
29863       * - **browsertime-tp6-live-chromium-wikipedia**
29864         - ❌
29865         - ❌
29866         - ❌
29867         - ❌
29868       * - **browsertime-tp6-live-firefox-wikipedia**
29869         - ❌
29870         - ❌
29871         - ❌
29872         - ❌
29873
29874
29875    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
29876       :widths: 30 15 15 15 15
29877       :header-rows: 1
29878
29879       * - **Test Name**
29880         - mozilla-central
29881         - autoland
29882         - mozilla-release
29883         - mozilla-beta
29884       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29885         - ❌
29886         - ❌
29887         - ❌
29888         - ❌
29889       * - **browsertime-tp6-essential-custom-car-wikipedia**
29890         - ❌
29891         - ❌
29892         - ❌
29893         - ❌
29894       * - **browsertime-tp6-essential-firefox-wikipedia**
29895         - ❌
29896         - ❌
29897         - ❌
29898         - ❌
29899       * - **browsertime-tp6-live-firefox-wikipedia**
29900         - ❌
29901         - ❌
29902         - ❌
29903         - ❌
29904
29905
29906    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
29907       :widths: 30 15 15 15 15
29908       :header-rows: 1
29909
29910       * - **Test Name**
29911         - mozilla-central
29912         - autoland
29913         - mozilla-release
29914         - mozilla-beta
29915       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29916         - ✅
29917         - ✅
29918         - ✅
29919         - ✅
29920       * - **browsertime-tp6-essential-chrome-wikipedia**
29921         - ❌
29922         - ❌
29923         - ❌
29924         - ❌
29925       * - **browsertime-tp6-essential-chromium-wikipedia**
29926         - ❌
29927         - ❌
29928         - ❌
29929         - ❌
29930       * - **browsertime-tp6-essential-custom-car-wikipedia**
29931         - ❌
29932         - ❌
29933         - ❌
29934         - ❌
29935       * - **browsertime-tp6-essential-firefox-wikipedia**
29936         - ✅
29937         - ✅
29938         - ✅
29939         - ✅
29940       * - **browsertime-tp6-live-chrome-wikipedia**
29941         - ❌
29942         - ❌
29943         - ❌
29944         - ❌
29945       * - **browsertime-tp6-live-chromium-wikipedia**
29946         - ❌
29947         - ❌
29948         - ❌
29949         - ❌
29950       * - **browsertime-tp6-live-firefox-wikipedia**
29951         - ❌
29952         - ❌
29953         - ❌
29954         - ❌
29955       * - **browsertime-tp6-live-safari-wikipedia**
29956         - ❌
29957         - ❌
29958         - ❌
29959         - ❌
29960
29961
29962    .. list-table:: **test-windows10-32-qr/opt**
29963       :widths: 30 15 15 15 15
29964       :header-rows: 1
29965
29966       * - **Test Name**
29967         - mozilla-central
29968         - autoland
29969         - mozilla-release
29970         - mozilla-beta
29971       * - **browsertime-tp6-bytecode-firefox-wikipedia**
29972         - ❌
29973         - ❌
29974         - ❌
29975         - ❌
29976       * - **browsertime-tp6-essential-custom-car-wikipedia**
29977         - ❌
29978         - ❌
29979         - ❌
29980         - ❌
29981       * - **browsertime-tp6-essential-firefox-wikipedia**
29982         - ❌
29983         - ❌
29984         - ❌
29985         - ❌
29986       * - **browsertime-tp6-live-firefox-wikipedia**
29987         - ❌
29988         - ❌
29989         - ❌
29990         - ❌
29991
29992
29993    .. list-table:: **test-windows10-32-shippable-qr/opt**
29994       :widths: 30 15 15 15 15
29995       :header-rows: 1
29996
29997       * - **Test Name**
29998         - mozilla-central
29999         - autoland
30000         - mozilla-release
30001         - mozilla-beta
30002       * - **browsertime-tp6-bytecode-firefox-wikipedia**
30003         - ❌
30004         - ❌
30005         - ❌
30006         - ❌
30007       * - **browsertime-tp6-essential-chrome-wikipedia**
30008         - ❌
30009         - ❌
30010         - ❌
30011         - ❌
30012       * - **browsertime-tp6-essential-chromium-wikipedia**
30013         - ❌
30014         - ❌
30015         - ❌
30016         - ❌
30017       * - **browsertime-tp6-essential-custom-car-wikipedia**
30018         - ❌
30019         - ❌
30020         - ❌
30021         - ❌
30022       * - **browsertime-tp6-essential-firefox-wikipedia**
30023         - ❌
30024         - ❌
30025         - ❌
30026         - ❌
30027       * - **browsertime-tp6-live-chrome-wikipedia**
30028         - ❌
30029         - ❌
30030         - ❌
30031         - ❌
30032       * - **browsertime-tp6-live-chromium-wikipedia**
30033         - ❌
30034         - ❌
30035         - ❌
30036         - ❌
30037       * - **browsertime-tp6-live-firefox-wikipedia**
30038         - ❌
30039         - ❌
30040         - ❌
30041         - ❌
30042
30043
30044    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
30045       :widths: 30 15 15 15 15
30046       :header-rows: 1
30047
30048       * - **Test Name**
30049         - mozilla-central
30050         - autoland
30051         - mozilla-release
30052         - mozilla-beta
30053       * - **browsertime-tp6-bytecode-firefox-wikipedia**
30054         - ❌
30055         - ❌
30056         - ❌
30057         - ❌
30058       * - **browsertime-tp6-essential-custom-car-wikipedia**
30059         - ❌
30060         - ❌
30061         - ❌
30062         - ❌
30063       * - **browsertime-tp6-essential-firefox-wikipedia**
30064         - ❌
30065         - ❌
30066         - ❌
30067         - ❌
30068       * - **browsertime-tp6-live-firefox-wikipedia**
30069         - ❌
30070         - ❌
30071         - ❌
30072         - ❌
30073
30074
30075    .. list-table:: **test-windows10-64-qr/opt**
30076       :widths: 30 15 15 15 15
30077       :header-rows: 1
30078
30079       * - **Test Name**
30080         - mozilla-central
30081         - autoland
30082         - mozilla-release
30083         - mozilla-beta
30084       * - **browsertime-tp6-bytecode-firefox-wikipedia**
30085         - ❌
30086         - ❌
30087         - ❌
30088         - ❌
30089       * - **browsertime-tp6-essential-custom-car-wikipedia**
30090         - ❌
30091         - ❌
30092         - ❌
30093         - ❌
30094       * - **browsertime-tp6-essential-firefox-wikipedia**
30095         - ❌
30096         - ❌
30097         - ❌
30098         - ❌
30099       * - **browsertime-tp6-live-firefox-wikipedia**
30100         - ❌
30101         - ❌
30102         - ❌
30103         - ❌
30104
30105
30106    .. list-table:: **test-windows10-64-shippable-qr/opt**
30107       :widths: 30 15 15 15 15
30108       :header-rows: 1
30109
30110       * - **Test Name**
30111         - mozilla-central
30112         - autoland
30113         - mozilla-release
30114         - mozilla-beta
30115       * - **browsertime-tp6-bytecode-firefox-wikipedia**
30116         - ✅
30117         - ✅
30118         - ✅
30119         - ✅
30120       * - **browsertime-tp6-essential-chrome-wikipedia**
30121         - ❌
30122         - ❌
30123         - ❌
30124         - ❌
30125       * - **browsertime-tp6-essential-chromium-wikipedia**
30126         - ❌
30127         - ❌
30128         - ❌
30129         - ❌
30130       * - **browsertime-tp6-essential-custom-car-wikipedia**
30131         - ❌
30132         - ❌
30133         - ❌
30134         - ❌
30135       * - **browsertime-tp6-essential-firefox-wikipedia**
30136         - ✅
30137         - ✅
30138         - ✅
30139         - ✅
30140       * - **browsertime-tp6-live-chrome-wikipedia**
30141         - ❌
30142         - ❌
30143         - ❌
30144         - ❌
30145       * - **browsertime-tp6-live-chromium-wikipedia**
30146         - ❌
30147         - ❌
30148         - ❌
30149         - ❌
30150       * - **browsertime-tp6-live-firefox-wikipedia**
30151         - ❌
30152         - ❌
30153         - ❌
30154         - ❌
30155
30156
30157
30158 .. dropdown:: youtube
30159    :class-container: anchor-id-youtube-m
30160
30161    **Owner**: PerfTest Team
30162
30163    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
30164    * **alert threshold**: 2.0
30165    * **apps**: geckoview, fenix, refbrow, chrome-m
30166    * **browser cycles**: 15
30167    * **expected**: pass
30168    * **lower is better**: true
30169    * **page cycles**: 25
30170    * **page timeout**: 60000
30171    * **playback**: mitmproxy-android
30172    * **playback pageset manifest**: mitm6-android-fenix-youtube.manifest
30173    * **playback version**: 8.1.1
30174    * **test url**: `<https://m.youtube.com>`__
30175    * **type**: pageload
30176    * **unit**: ms
30177    * **use live sites**: false
30178    * **Test Task**:
30179
30180    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
30181       :widths: 30 15 15 15 15
30182       :header-rows: 1
30183
30184       * - **Test Name**
30185         - mozilla-central
30186         - autoland
30187         - mozilla-release
30188         - mozilla-beta
30189       * - **browsertime-tp6m-fenix-youtube**
30190         - ❌
30191         - ❌
30192         - ❌
30193         - ❌
30194       * - **browsertime-tp6m-fenix-youtube-nofis**
30195         - ❌
30196         - ❌
30197         - ❌
30198         - ❌
30199       * - **browsertime-tp6m-geckoview-youtube**
30200         - ❌
30201         - ❌
30202         - ❌
30203         - ❌
30204       * - **browsertime-tp6m-geckoview-youtube-nofis**
30205         - ❌
30206         - ❌
30207         - ❌
30208         - ❌
30209       * - **browsertime-tp6m-live-fenix-youtube-nofis**
30210         - ❌
30211         - ❌
30212         - ❌
30213         - ❌
30214       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
30215         - ❌
30216         - ❌
30217         - ❌
30218         - ❌
30219       * - **browsertime-tp6m-refbrow-youtube**
30220         - ❌
30221         - ❌
30222         - ❌
30223         - ❌
30224
30225
30226    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
30227       :widths: 30 15 15 15 15
30228       :header-rows: 1
30229
30230       * - **Test Name**
30231         - mozilla-central
30232         - autoland
30233         - mozilla-release
30234         - mozilla-beta
30235       * - **browsertime-tp6m-chrome-m-youtube**
30236         - ❌
30237         - ❌
30238         - ❌
30239         - ❌
30240       * - **browsertime-tp6m-chrome-m-youtube-nofis**
30241         - ❌
30242         - ❌
30243         - ❌
30244         - ❌
30245       * - **browsertime-tp6m-fenix-youtube**
30246         - ❌
30247         - ❌
30248         - ❌
30249         - ❌
30250       * - **browsertime-tp6m-fenix-youtube-nofis**
30251         - ❌
30252         - ❌
30253         - ❌
30254         - ❌
30255       * - **browsertime-tp6m-geckoview-youtube**
30256         - ❌
30257         - ❌
30258         - ❌
30259         - ❌
30260       * - **browsertime-tp6m-geckoview-youtube-nofis**
30261         - ✅
30262         - ✅
30263         - ❌
30264         - ❌
30265       * - **browsertime-tp6m-live-chrome-m-youtube-nofis**
30266         - ❌
30267         - ❌
30268         - ❌
30269         - ❌
30270       * - **browsertime-tp6m-live-fenix-youtube-nofis**
30271         - ❌
30272         - ❌
30273         - ❌
30274         - ❌
30275       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
30276         - ❌
30277         - ❌
30278         - ❌
30279         - ❌
30280       * - **browsertime-tp6m-refbrow-youtube**
30281         - ❌
30282         - ❌
30283         - ❌
30284         - ❌
30285
30286
30287    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
30288       :widths: 30 15 15 15 15
30289       :header-rows: 1
30290
30291       * - **Test Name**
30292         - mozilla-central
30293         - autoland
30294         - mozilla-release
30295         - mozilla-beta
30296       * - **browsertime-tp6-firefox-youtube**
30297         - ❌
30298         - ❌
30299         - ❌
30300         - ❌
30301       * - **browsertime-tp6-live-firefox-youtube**
30302         - ❌
30303         - ❌
30304         - ❌
30305         - ❌
30306
30307
30308    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
30309       :widths: 30 15 15 15 15
30310       :header-rows: 1
30311
30312       * - **Test Name**
30313         - mozilla-central
30314         - autoland
30315         - mozilla-release
30316         - mozilla-beta
30317       * - **browsertime-tp6-firefox-youtube**
30318         - ❌
30319         - ❌
30320         - ❌
30321         - ❌
30322       * - **browsertime-tp6-live-firefox-youtube**
30323         - ❌
30324         - ❌
30325         - ❌
30326         - ❌
30327
30328
30329    .. list-table:: **test-linux1804-64-qr/opt**
30330       :widths: 30 15 15 15 15
30331       :header-rows: 1
30332
30333       * - **Test Name**
30334         - mozilla-central
30335         - autoland
30336         - mozilla-release
30337         - mozilla-beta
30338       * - **browsertime-tp6-firefox-youtube**
30339         - ❌
30340         - ❌
30341         - ❌
30342         - ❌
30343       * - **browsertime-tp6-live-firefox-youtube**
30344         - ❌
30345         - ❌
30346         - ❌
30347         - ❌
30348
30349
30350    .. list-table:: **test-linux1804-64-shippable-qr/opt**
30351       :widths: 30 15 15 15 15
30352       :header-rows: 1
30353
30354       * - **Test Name**
30355         - mozilla-central
30356         - autoland
30357         - mozilla-release
30358         - mozilla-beta
30359       * - **browsertime-tp6-chrome-youtube**
30360         - ❌
30361         - ❌
30362         - ❌
30363         - ❌
30364       * - **browsertime-tp6-chromium-youtube**
30365         - ❌
30366         - ❌
30367         - ❌
30368         - ❌
30369       * - **browsertime-tp6-firefox-youtube**
30370         - ✅
30371         - ✅
30372         - ✅
30373         - ✅
30374       * - **browsertime-tp6-live-chrome-youtube**
30375         - ❌
30376         - ❌
30377         - ❌
30378         - ❌
30379       * - **browsertime-tp6-live-chromium-youtube**
30380         - ❌
30381         - ❌
30382         - ❌
30383         - ❌
30384       * - **browsertime-tp6-live-firefox-youtube**
30385         - ❌
30386         - ❌
30387         - ❌
30388         - ❌
30389
30390
30391    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
30392       :widths: 30 15 15 15 15
30393       :header-rows: 1
30394
30395       * - **Test Name**
30396         - mozilla-central
30397         - autoland
30398         - mozilla-release
30399         - mozilla-beta
30400       * - **browsertime-tp6-firefox-youtube**
30401         - ❌
30402         - ❌
30403         - ❌
30404         - ❌
30405       * - **browsertime-tp6-live-firefox-youtube**
30406         - ❌
30407         - ❌
30408         - ❌
30409         - ❌
30410
30411
30412    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
30413       :widths: 30 15 15 15 15
30414       :header-rows: 1
30415
30416       * - **Test Name**
30417         - mozilla-central
30418         - autoland
30419         - mozilla-release
30420         - mozilla-beta
30421       * - **browsertime-tp6-chrome-youtube**
30422         - ❌
30423         - ❌
30424         - ❌
30425         - ❌
30426       * - **browsertime-tp6-chromium-youtube**
30427         - ❌
30428         - ❌
30429         - ❌
30430         - ❌
30431       * - **browsertime-tp6-firefox-youtube**
30432         - ✅
30433         - ✅
30434         - ✅
30435         - ✅
30436       * - **browsertime-tp6-live-chrome-youtube**
30437         - ❌
30438         - ❌
30439         - ❌
30440         - ❌
30441       * - **browsertime-tp6-live-chromium-youtube**
30442         - ❌
30443         - ❌
30444         - ❌
30445         - ❌
30446       * - **browsertime-tp6-live-firefox-youtube**
30447         - ❌
30448         - ❌
30449         - ❌
30450         - ❌
30451       * - **browsertime-tp6-live-safari-youtube**
30452         - ❌
30453         - ❌
30454         - ❌
30455         - ❌
30456
30457
30458    .. list-table:: **test-windows10-32-qr/opt**
30459       :widths: 30 15 15 15 15
30460       :header-rows: 1
30461
30462       * - **Test Name**
30463         - mozilla-central
30464         - autoland
30465         - mozilla-release
30466         - mozilla-beta
30467       * - **browsertime-tp6-firefox-youtube**
30468         - ❌
30469         - ❌
30470         - ❌
30471         - ❌
30472       * - **browsertime-tp6-live-firefox-youtube**
30473         - ❌
30474         - ❌
30475         - ❌
30476         - ❌
30477
30478
30479    .. list-table:: **test-windows10-32-shippable-qr/opt**
30480       :widths: 30 15 15 15 15
30481       :header-rows: 1
30482
30483       * - **Test Name**
30484         - mozilla-central
30485         - autoland
30486         - mozilla-release
30487         - mozilla-beta
30488       * - **browsertime-tp6-chrome-youtube**
30489         - ❌
30490         - ❌
30491         - ❌
30492         - ❌
30493       * - **browsertime-tp6-chromium-youtube**
30494         - ❌
30495         - ❌
30496         - ❌
30497         - ❌
30498       * - **browsertime-tp6-firefox-youtube**
30499         - ❌
30500         - ❌
30501         - ❌
30502         - ❌
30503       * - **browsertime-tp6-live-chrome-youtube**
30504         - ❌
30505         - ❌
30506         - ❌
30507         - ❌
30508       * - **browsertime-tp6-live-chromium-youtube**
30509         - ❌
30510         - ❌
30511         - ❌
30512         - ❌
30513       * - **browsertime-tp6-live-firefox-youtube**
30514         - ❌
30515         - ❌
30516         - ❌
30517         - ❌
30518
30519
30520    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
30521       :widths: 30 15 15 15 15
30522       :header-rows: 1
30523
30524       * - **Test Name**
30525         - mozilla-central
30526         - autoland
30527         - mozilla-release
30528         - mozilla-beta
30529       * - **browsertime-tp6-firefox-youtube**
30530         - ❌
30531         - ❌
30532         - ❌
30533         - ❌
30534       * - **browsertime-tp6-live-firefox-youtube**
30535         - ❌
30536         - ❌
30537         - ❌
30538         - ❌
30539
30540
30541    .. list-table:: **test-windows10-64-qr/opt**
30542       :widths: 30 15 15 15 15
30543       :header-rows: 1
30544
30545       * - **Test Name**
30546         - mozilla-central
30547         - autoland
30548         - mozilla-release
30549         - mozilla-beta
30550       * - **browsertime-tp6-firefox-youtube**
30551         - ❌
30552         - ❌
30553         - ❌
30554         - ❌
30555       * - **browsertime-tp6-live-firefox-youtube**
30556         - ❌
30557         - ❌
30558         - ❌
30559         - ❌
30560
30561
30562    .. list-table:: **test-windows10-64-shippable-qr/opt**
30563       :widths: 30 15 15 15 15
30564       :header-rows: 1
30565
30566       * - **Test Name**
30567         - mozilla-central
30568         - autoland
30569         - mozilla-release
30570         - mozilla-beta
30571       * - **browsertime-tp6-chrome-youtube**
30572         - ❌
30573         - ❌
30574         - ❌
30575         - ❌
30576       * - **browsertime-tp6-chromium-youtube**
30577         - ❌
30578         - ❌
30579         - ❌
30580         - ❌
30581       * - **browsertime-tp6-firefox-youtube**
30582         - ✅
30583         - ✅
30584         - ✅
30585         - ✅
30586       * - **browsertime-tp6-live-chrome-youtube**
30587         - ❌
30588         - ❌
30589         - ❌
30590         - ❌
30591       * - **browsertime-tp6-live-chromium-youtube**
30592         - ❌
30593         - ❌
30594         - ❌
30595         - ❌
30596       * - **browsertime-tp6-live-firefox-youtube**
30597         - ❌
30598         - ❌
30599         - ❌
30600         - ❌
30601
30602
30603
30604 .. dropdown:: youtube-watch
30605    :class-container: anchor-id-youtube-watch-m
30606
30607    **Owner**: PerfTest Team
30608
30609    * **alert on**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
30610    * **alert threshold**: 2.0
30611    * **apps**: geckoview, fenix, refbrow, chrome-m
30612    * **browser cycles**: 15
30613    * **expected**: pass
30614    * **lower is better**: true
30615    * **page cycles**: 25
30616    * **page timeout**: 60000
30617    * **playback**: mitmproxy-android
30618    * **playback pageset manifest**: mitm6-android-fenix-youtube-watch.manifest
30619    * **playback version**: 8.1.1
30620    * **test url**: `<https://www.youtube.com/watch?v=COU5T-Wafa4>`__
30621    * **type**: pageload
30622    * **unit**: ms
30623    * **use live sites**: false
30624    * **Test Task**:
30625
30626    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
30627       :widths: 30 15 15 15 15
30628       :header-rows: 1
30629
30630       * - **Test Name**
30631         - mozilla-central
30632         - autoland
30633         - mozilla-release
30634         - mozilla-beta
30635       * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis**
30636         - ❌
30637         - ❌
30638         - ❌
30639         - ❌
30640       * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis**
30641         - ❌
30642         - ❌
30643         - ❌
30644         - ❌
30645       * - **browsertime-tp6m-live-fenix-youtube-watch-nofis**
30646         - ❌
30647         - ❌
30648         - ❌
30649         - ❌
30650       * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis**
30651         - ❌
30652         - ❌
30653         - ❌
30654         - ❌
30655
30656
30657    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
30658       :widths: 30 15 15 15 15
30659       :header-rows: 1
30660
30661       * - **Test Name**
30662         - mozilla-central
30663         - autoland
30664         - mozilla-release
30665         - mozilla-beta
30666       * - **browsertime-tp6m-essential-chrome-m-youtube-watch-nofis**
30667         - ❌
30668         - ❌
30669         - ❌
30670         - ❌
30671       * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis**
30672         - ❌
30673         - ❌
30674         - ❌
30675         - ❌
30676       * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis**
30677         - ✅
30678         - ✅
30679         - ❌
30680         - ❌
30681       * - **browsertime-tp6m-live-chrome-m-youtube-watch-nofis**
30682         - ❌
30683         - ❌
30684         - ❌
30685         - ❌
30686       * - **browsertime-tp6m-live-fenix-youtube-watch-nofis**
30687         - ❌
30688         - ❌
30689         - ❌
30690         - ❌
30691       * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis**
30692         - ❌
30693         - ❌
30694         - ❌
30695         - ❌
30696
30697
30698
30699
30700 Scenario
30701 --------
30702 Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.
30703
30704 .. dropdown:: idle
30705    :class-container: anchor-id-idle-s
30706
30707    **Owner**: PerfTest Team
30708
30709    * **alert threshold**: 2.0
30710    * **apps**: fenix, geckoview, refbrow
30711    * **expected**: pass
30712    * **lower is better**: true
30713    * **measure**: fakeMeasure
30714    * **page cycles**: 1
30715    * **page timeout**: 1320000
30716    * **scenario time**: 1200000
30717    * **test url**: `<about:blank>`__
30718    * **type**: scenario
30719    * **unit**: scenarioComplete
30720
30721 .. dropdown:: idle-bg
30722    :class-container: anchor-id-idle-bg-s
30723
30724    **Owner**: PerfTest Team
30725
30726    * **alert threshold**: 2.0
30727    * **apps**: fenix, geckoview, refbrow
30728    * **browsertime args**: --browsertime.scenario_time=60000 --browsertime.background_app=false
30729    * **expected**: pass
30730    * **lower is better**: true
30731    * **measure**: fakeMeasure
30732    * **page cycles**: 1
30733    * **page timeout**: 1320000
30734    * **scenario time**: 1200000
30735    * **test url**: `<about:blank>`__
30736    * **type**: scenario
30737    * **unit**: scenarioComplete
30738
30739
30740 Unittests
30741 ---------
30742 These tests aren't used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).
30743
30744 .. dropdown:: amazon
30745    :class-container: anchor-id-amazon-u
30746
30747    **Owner**: PerfTest Team
30748
30749    * **alert on**: fcp, loadtime
30750    * **alert threshold**: 2.0
30751    * **apps**: firefox
30752    * **expected**: pass
30753    * **gecko profile entries**: 14000000
30754    * **gecko profile interval**: 1
30755    * **lower is better**: true
30756    * **page cycles**: 25
30757    * **page timeout**: 60000
30758    * **playback**: mitmproxy
30759    * **playback pageset manifest**: mitm7-linux-firefox-amazon.manifest
30760    * **playback version**: 8.1.1
30761    * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
30762    * **type**: pageload
30763    * **unit**: ms
30764    * **Test Task**:
30765
30766    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
30767       :widths: 30 15 15 15 15
30768       :header-rows: 1
30769
30770       * - **Test Name**
30771         - mozilla-central
30772         - autoland
30773         - mozilla-release
30774         - mozilla-beta
30775       * - **browsertime-tp6m-fenix-amazon**
30776         - ❌
30777         - ❌
30778         - ❌
30779         - ❌
30780       * - **browsertime-tp6m-fenix-amazon-nofis**
30781         - ❌
30782         - ❌
30783         - ❌
30784         - ❌
30785       * - **browsertime-tp6m-geckoview-amazon**
30786         - ❌
30787         - ❌
30788         - ❌
30789         - ❌
30790       * - **browsertime-tp6m-geckoview-amazon-nofis**
30791         - ❌
30792         - ❌
30793         - ❌
30794         - ❌
30795       * - **browsertime-tp6m-live-fenix-amazon-nofis**
30796         - ❌
30797         - ❌
30798         - ❌
30799         - ❌
30800       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
30801         - ❌
30802         - ❌
30803         - ❌
30804         - ❌
30805       * - **browsertime-tp6m-refbrow-amazon**
30806         - ❌
30807         - ❌
30808         - ❌
30809         - ❌
30810
30811
30812    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
30813       :widths: 30 15 15 15 15
30814       :header-rows: 1
30815
30816       * - **Test Name**
30817         - mozilla-central
30818         - autoland
30819         - mozilla-release
30820         - mozilla-beta
30821       * - **browsertime-tp6m-chrome-m-amazon**
30822         - ❌
30823         - ❌
30824         - ❌
30825         - ❌
30826       * - **browsertime-tp6m-chrome-m-amazon-nofis**
30827         - ❌
30828         - ❌
30829         - ❌
30830         - ❌
30831       * - **browsertime-tp6m-fenix-amazon**
30832         - ❌
30833         - ❌
30834         - ❌
30835         - ❌
30836       * - **browsertime-tp6m-fenix-amazon-nofis**
30837         - ❌
30838         - ❌
30839         - ❌
30840         - ❌
30841       * - **browsertime-tp6m-geckoview-amazon**
30842         - ❌
30843         - ❌
30844         - ❌
30845         - ❌
30846       * - **browsertime-tp6m-geckoview-amazon-nofis**
30847         - ✅
30848         - ✅
30849         - ❌
30850         - ❌
30851       * - **browsertime-tp6m-live-chrome-m-amazon-nofis**
30852         - ❌
30853         - ❌
30854         - ❌
30855         - ❌
30856       * - **browsertime-tp6m-live-fenix-amazon-nofis**
30857         - ❌
30858         - ❌
30859         - ❌
30860         - ❌
30861       * - **browsertime-tp6m-live-geckoview-amazon-nofis**
30862         - ❌
30863         - ❌
30864         - ❌
30865         - ❌
30866       * - **browsertime-tp6m-refbrow-amazon**
30867         - ❌
30868         - ❌
30869         - ❌
30870         - ❌
30871
30872
30873    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
30874       :widths: 30 15 15 15 15
30875       :header-rows: 1
30876
30877       * - **Test Name**
30878         - mozilla-central
30879         - autoland
30880         - mozilla-release
30881         - mozilla-beta
30882       * - **browsertime-tp6-bytecode-firefox-amazon**
30883         - ❌
30884         - ❌
30885         - ❌
30886         - ❌
30887       * - **browsertime-tp6-essential-custom-car-amazon**
30888         - ❌
30889         - ❌
30890         - ❌
30891         - ❌
30892       * - **browsertime-tp6-essential-firefox-amazon**
30893         - ❌
30894         - ❌
30895         - ❌
30896         - ❌
30897       * - **browsertime-tp6-live-firefox-amazon**
30898         - ❌
30899         - ❌
30900         - ❌
30901         - ❌
30902
30903
30904    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
30905       :widths: 30 15 15 15 15
30906       :header-rows: 1
30907
30908       * - **Test Name**
30909         - mozilla-central
30910         - autoland
30911         - mozilla-release
30912         - mozilla-beta
30913       * - **browsertime-tp6-bytecode-firefox-amazon**
30914         - ❌
30915         - ❌
30916         - ❌
30917         - ❌
30918       * - **browsertime-tp6-essential-custom-car-amazon**
30919         - ❌
30920         - ❌
30921         - ❌
30922         - ❌
30923       * - **browsertime-tp6-essential-firefox-amazon**
30924         - ❌
30925         - ❌
30926         - ❌
30927         - ❌
30928       * - **browsertime-tp6-live-firefox-amazon**
30929         - ❌
30930         - ❌
30931         - ❌
30932         - ❌
30933
30934
30935    .. list-table:: **test-linux1804-64-qr/opt**
30936       :widths: 30 15 15 15 15
30937       :header-rows: 1
30938
30939       * - **Test Name**
30940         - mozilla-central
30941         - autoland
30942         - mozilla-release
30943         - mozilla-beta
30944       * - **browsertime-tp6-bytecode-firefox-amazon**
30945         - ❌
30946         - ❌
30947         - ❌
30948         - ❌
30949       * - **browsertime-tp6-essential-custom-car-amazon**
30950         - ❌
30951         - ❌
30952         - ❌
30953         - ❌
30954       * - **browsertime-tp6-essential-firefox-amazon**
30955         - ❌
30956         - ❌
30957         - ❌
30958         - ❌
30959       * - **browsertime-tp6-live-firefox-amazon**
30960         - ❌
30961         - ❌
30962         - ❌
30963         - ❌
30964
30965
30966    .. list-table:: **test-linux1804-64-shippable-qr/opt**
30967       :widths: 30 15 15 15 15
30968       :header-rows: 1
30969
30970       * - **Test Name**
30971         - mozilla-central
30972         - autoland
30973         - mozilla-release
30974         - mozilla-beta
30975       * - **browsertime-tp6-bytecode-firefox-amazon**
30976         - ✅
30977         - ✅
30978         - ✅
30979         - ✅
30980       * - **browsertime-tp6-essential-chrome-amazon**
30981         - ❌
30982         - ❌
30983         - ❌
30984         - ❌
30985       * - **browsertime-tp6-essential-chromium-amazon**
30986         - ❌
30987         - ❌
30988         - ❌
30989         - ❌
30990       * - **browsertime-tp6-essential-custom-car-amazon**
30991         - ❌
30992         - ❌
30993         - ❌
30994         - ❌
30995       * - **browsertime-tp6-essential-firefox-amazon**
30996         - ✅
30997         - ✅
30998         - ✅
30999         - ✅
31000       * - **browsertime-tp6-live-chrome-amazon**
31001         - ❌
31002         - ❌
31003         - ❌
31004         - ❌
31005       * - **browsertime-tp6-live-chromium-amazon**
31006         - ❌
31007         - ❌
31008         - ❌
31009         - ❌
31010       * - **browsertime-tp6-live-firefox-amazon**
31011         - ❌
31012         - ❌
31013         - ❌
31014         - ❌
31015       * - **browsertime-tp6-profiling-firefox-amazon**
31016         - ✅
31017         - ❌
31018         - ❌
31019         - ❌
31020
31021
31022    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
31023       :widths: 30 15 15 15 15
31024       :header-rows: 1
31025
31026       * - **Test Name**
31027         - mozilla-central
31028         - autoland
31029         - mozilla-release
31030         - mozilla-beta
31031       * - **browsertime-tp6-bytecode-firefox-amazon**
31032         - ❌
31033         - ❌
31034         - ❌
31035         - ❌
31036       * - **browsertime-tp6-essential-custom-car-amazon**
31037         - ❌
31038         - ❌
31039         - ❌
31040         - ❌
31041       * - **browsertime-tp6-essential-firefox-amazon**
31042         - ❌
31043         - ❌
31044         - ❌
31045         - ❌
31046       * - **browsertime-tp6-live-firefox-amazon**
31047         - ❌
31048         - ❌
31049         - ❌
31050         - ❌
31051
31052
31053    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
31054       :widths: 30 15 15 15 15
31055       :header-rows: 1
31056
31057       * - **Test Name**
31058         - mozilla-central
31059         - autoland
31060         - mozilla-release
31061         - mozilla-beta
31062       * - **browsertime-tp6-bytecode-firefox-amazon**
31063         - ✅
31064         - ✅
31065         - ✅
31066         - ✅
31067       * - **browsertime-tp6-essential-chrome-amazon**
31068         - ❌
31069         - ❌
31070         - ❌
31071         - ❌
31072       * - **browsertime-tp6-essential-chromium-amazon**
31073         - ❌
31074         - ❌
31075         - ❌
31076         - ❌
31077       * - **browsertime-tp6-essential-custom-car-amazon**
31078         - ❌
31079         - ❌
31080         - ❌
31081         - ❌
31082       * - **browsertime-tp6-essential-firefox-amazon**
31083         - ✅
31084         - ✅
31085         - ✅
31086         - ✅
31087       * - **browsertime-tp6-live-chrome-amazon**
31088         - ❌
31089         - ❌
31090         - ❌
31091         - ❌
31092       * - **browsertime-tp6-live-chromium-amazon**
31093         - ❌
31094         - ❌
31095         - ❌
31096         - ❌
31097       * - **browsertime-tp6-live-firefox-amazon**
31098         - ❌
31099         - ❌
31100         - ❌
31101         - ❌
31102       * - **browsertime-tp6-live-safari-amazon**
31103         - ❌
31104         - ❌
31105         - ❌
31106         - ❌
31107       * - **browsertime-tp6-profiling-firefox-amazon**
31108         - ✅
31109         - ❌
31110         - ❌
31111         - ❌
31112
31113
31114    .. list-table:: **test-windows10-32-qr/opt**
31115       :widths: 30 15 15 15 15
31116       :header-rows: 1
31117
31118       * - **Test Name**
31119         - mozilla-central
31120         - autoland
31121         - mozilla-release
31122         - mozilla-beta
31123       * - **browsertime-tp6-bytecode-firefox-amazon**
31124         - ❌
31125         - ❌
31126         - ❌
31127         - ❌
31128       * - **browsertime-tp6-essential-custom-car-amazon**
31129         - ❌
31130         - ❌
31131         - ❌
31132         - ❌
31133       * - **browsertime-tp6-essential-firefox-amazon**
31134         - ❌
31135         - ❌
31136         - ❌
31137         - ❌
31138       * - **browsertime-tp6-live-firefox-amazon**
31139         - ❌
31140         - ❌
31141         - ❌
31142         - ❌
31143
31144
31145    .. list-table:: **test-windows10-32-shippable-qr/opt**
31146       :widths: 30 15 15 15 15
31147       :header-rows: 1
31148
31149       * - **Test Name**
31150         - mozilla-central
31151         - autoland
31152         - mozilla-release
31153         - mozilla-beta
31154       * - **browsertime-tp6-bytecode-firefox-amazon**
31155         - ❌
31156         - ❌
31157         - ❌
31158         - ❌
31159       * - **browsertime-tp6-essential-chrome-amazon**
31160         - ❌
31161         - ❌
31162         - ❌
31163         - ❌
31164       * - **browsertime-tp6-essential-chromium-amazon**
31165         - ❌
31166         - ❌
31167         - ❌
31168         - ❌
31169       * - **browsertime-tp6-essential-custom-car-amazon**
31170         - ❌
31171         - ❌
31172         - ❌
31173         - ❌
31174       * - **browsertime-tp6-essential-firefox-amazon**
31175         - ❌
31176         - ❌
31177         - ❌
31178         - ❌
31179       * - **browsertime-tp6-live-chrome-amazon**
31180         - ❌
31181         - ❌
31182         - ❌
31183         - ❌
31184       * - **browsertime-tp6-live-chromium-amazon**
31185         - ❌
31186         - ❌
31187         - ❌
31188         - ❌
31189       * - **browsertime-tp6-live-firefox-amazon**
31190         - ❌
31191         - ❌
31192         - ❌
31193         - ❌
31194
31195
31196    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
31197       :widths: 30 15 15 15 15
31198       :header-rows: 1
31199
31200       * - **Test Name**
31201         - mozilla-central
31202         - autoland
31203         - mozilla-release
31204         - mozilla-beta
31205       * - **browsertime-tp6-bytecode-firefox-amazon**
31206         - ❌
31207         - ❌
31208         - ❌
31209         - ❌
31210       * - **browsertime-tp6-essential-custom-car-amazon**
31211         - ❌
31212         - ❌
31213         - ❌
31214         - ❌
31215       * - **browsertime-tp6-essential-firefox-amazon**
31216         - ❌
31217         - ❌
31218         - ❌
31219         - ❌
31220       * - **browsertime-tp6-live-firefox-amazon**
31221         - ❌
31222         - ❌
31223         - ❌
31224         - ❌
31225
31226
31227    .. list-table:: **test-windows10-64-qr/opt**
31228       :widths: 30 15 15 15 15
31229       :header-rows: 1
31230
31231       * - **Test Name**
31232         - mozilla-central
31233         - autoland
31234         - mozilla-release
31235         - mozilla-beta
31236       * - **browsertime-tp6-bytecode-firefox-amazon**
31237         - ❌
31238         - ❌
31239         - ❌
31240         - ❌
31241       * - **browsertime-tp6-essential-custom-car-amazon**
31242         - ❌
31243         - ❌
31244         - ❌
31245         - ❌
31246       * - **browsertime-tp6-essential-firefox-amazon**
31247         - ❌
31248         - ❌
31249         - ❌
31250         - ❌
31251       * - **browsertime-tp6-live-firefox-amazon**
31252         - ❌
31253         - ❌
31254         - ❌
31255         - ❌
31256
31257
31258    .. list-table:: **test-windows10-64-shippable-qr/opt**
31259       :widths: 30 15 15 15 15
31260       :header-rows: 1
31261
31262       * - **Test Name**
31263         - mozilla-central
31264         - autoland
31265         - mozilla-release
31266         - mozilla-beta
31267       * - **browsertime-tp6-bytecode-firefox-amazon**
31268         - ✅
31269         - ✅
31270         - ✅
31271         - ✅
31272       * - **browsertime-tp6-essential-chrome-amazon**
31273         - ❌
31274         - ❌
31275         - ❌
31276         - ❌
31277       * - **browsertime-tp6-essential-chromium-amazon**
31278         - ❌
31279         - ❌
31280         - ❌
31281         - ❌
31282       * - **browsertime-tp6-essential-custom-car-amazon**
31283         - ❌
31284         - ❌
31285         - ❌
31286         - ❌
31287       * - **browsertime-tp6-essential-firefox-amazon**
31288         - ✅
31289         - ✅
31290         - ✅
31291         - ✅
31292       * - **browsertime-tp6-live-chrome-amazon**
31293         - ❌
31294         - ❌
31295         - ❌
31296         - ❌
31297       * - **browsertime-tp6-live-chromium-amazon**
31298         - ❌
31299         - ❌
31300         - ❌
31301         - ❌
31302       * - **browsertime-tp6-live-firefox-amazon**
31303         - ❌
31304         - ❌
31305         - ❌
31306         - ❌
31307
31308
31309
31310 .. dropdown:: facebook
31311    :class-container: anchor-id-facebook-u
31312
31313    **Owner**: PerfTest Team
31314
31315    * **alert on**: fcp, loadtime
31316    * **alert threshold**: 2.0
31317    * **apps**: firefox
31318    * **expected**: pass
31319    * **gecko profile entries**: 14000000
31320    * **gecko profile interval**: 1
31321    * **lower is better**: true
31322    * **page cycles**: 25
31323    * **page timeout**: 60000
31324    * **playback**: mitmproxy
31325    * **playback pageset manifest**: mitm7-linux-firefox-facebook.manifest
31326    * **playback version**: 8.1.1
31327    * **test url**: `<https://www.facebook.com>`__
31328    * **type**: pageload
31329    * **unit**: ms
31330    * **Test Task**:
31331
31332    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
31333       :widths: 30 15 15 15 15
31334       :header-rows: 1
31335
31336       * - **Test Name**
31337         - mozilla-central
31338         - autoland
31339         - mozilla-release
31340         - mozilla-beta
31341       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
31342         - ❌
31343         - ❌
31344         - ❌
31345         - ❌
31346       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
31347         - ❌
31348         - ❌
31349         - ❌
31350         - ❌
31351       * - **browsertime-tp6m-live-fenix-facebook-nofis**
31352         - ❌
31353         - ❌
31354         - ❌
31355         - ❌
31356       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
31357         - ❌
31358         - ❌
31359         - ❌
31360         - ❌
31361
31362
31363    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
31364       :widths: 30 15 15 15 15
31365       :header-rows: 1
31366
31367       * - **Test Name**
31368         - mozilla-central
31369         - autoland
31370         - mozilla-release
31371         - mozilla-beta
31372       * - **browsertime-tp6m-essential-chrome-m-facebook-nofis**
31373         - ❌
31374         - ❌
31375         - ❌
31376         - ❌
31377       * - **browsertime-tp6m-essential-fenix-facebook-nofis**
31378         - ❌
31379         - ❌
31380         - ❌
31381         - ❌
31382       * - **browsertime-tp6m-essential-geckoview-facebook-nofis**
31383         - ✅
31384         - ✅
31385         - ❌
31386         - ❌
31387       * - **browsertime-tp6m-live-chrome-m-facebook-nofis**
31388         - ❌
31389         - ❌
31390         - ❌
31391         - ❌
31392       * - **browsertime-tp6m-live-fenix-facebook-nofis**
31393         - ❌
31394         - ❌
31395         - ❌
31396         - ❌
31397       * - **browsertime-tp6m-live-geckoview-facebook-nofis**
31398         - ❌
31399         - ❌
31400         - ❌
31401         - ❌
31402
31403
31404    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
31405       :widths: 30 15 15 15 15
31406       :header-rows: 1
31407
31408       * - **Test Name**
31409         - mozilla-central
31410         - autoland
31411         - mozilla-release
31412         - mozilla-beta
31413       * - **browsertime-tp6-firefox-facebook**
31414         - ❌
31415         - ❌
31416         - ❌
31417         - ❌
31418       * - **browsertime-tp6-live-firefox-facebook**
31419         - ❌
31420         - ❌
31421         - ❌
31422         - ❌
31423
31424
31425    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
31426       :widths: 30 15 15 15 15
31427       :header-rows: 1
31428
31429       * - **Test Name**
31430         - mozilla-central
31431         - autoland
31432         - mozilla-release
31433         - mozilla-beta
31434       * - **browsertime-tp6-firefox-facebook**
31435         - ❌
31436         - ❌
31437         - ❌
31438         - ❌
31439       * - **browsertime-tp6-live-firefox-facebook**
31440         - ❌
31441         - ❌
31442         - ❌
31443         - ❌
31444
31445
31446    .. list-table:: **test-linux1804-64-qr/opt**
31447       :widths: 30 15 15 15 15
31448       :header-rows: 1
31449
31450       * - **Test Name**
31451         - mozilla-central
31452         - autoland
31453         - mozilla-release
31454         - mozilla-beta
31455       * - **browsertime-tp6-firefox-facebook**
31456         - ❌
31457         - ❌
31458         - ❌
31459         - ❌
31460       * - **browsertime-tp6-live-firefox-facebook**
31461         - ❌
31462         - ❌
31463         - ❌
31464         - ❌
31465
31466
31467    .. list-table:: **test-linux1804-64-shippable-qr/opt**
31468       :widths: 30 15 15 15 15
31469       :header-rows: 1
31470
31471       * - **Test Name**
31472         - mozilla-central
31473         - autoland
31474         - mozilla-release
31475         - mozilla-beta
31476       * - **browsertime-tp6-chrome-facebook**
31477         - ❌
31478         - ❌
31479         - ❌
31480         - ❌
31481       * - **browsertime-tp6-chromium-facebook**
31482         - ❌
31483         - ❌
31484         - ❌
31485         - ❌
31486       * - **browsertime-tp6-firefox-facebook**
31487         - ✅
31488         - ✅
31489         - ✅
31490         - ✅
31491       * - **browsertime-tp6-live-chrome-facebook**
31492         - ❌
31493         - ❌
31494         - ❌
31495         - ❌
31496       * - **browsertime-tp6-live-chromium-facebook**
31497         - ❌
31498         - ❌
31499         - ❌
31500         - ❌
31501       * - **browsertime-tp6-live-firefox-facebook**
31502         - ❌
31503         - ❌
31504         - ❌
31505         - ❌
31506
31507
31508    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
31509       :widths: 30 15 15 15 15
31510       :header-rows: 1
31511
31512       * - **Test Name**
31513         - mozilla-central
31514         - autoland
31515         - mozilla-release
31516         - mozilla-beta
31517       * - **browsertime-tp6-firefox-facebook**
31518         - ❌
31519         - ❌
31520         - ❌
31521         - ❌
31522       * - **browsertime-tp6-live-firefox-facebook**
31523         - ❌
31524         - ❌
31525         - ❌
31526         - ❌
31527
31528
31529    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
31530       :widths: 30 15 15 15 15
31531       :header-rows: 1
31532
31533       * - **Test Name**
31534         - mozilla-central
31535         - autoland
31536         - mozilla-release
31537         - mozilla-beta
31538       * - **browsertime-tp6-chrome-facebook**
31539         - ❌
31540         - ❌
31541         - ❌
31542         - ❌
31543       * - **browsertime-tp6-chromium-facebook**
31544         - ❌
31545         - ❌
31546         - ❌
31547         - ❌
31548       * - **browsertime-tp6-firefox-facebook**
31549         - ✅
31550         - ✅
31551         - ✅
31552         - ✅
31553       * - **browsertime-tp6-live-chrome-facebook**
31554         - ❌
31555         - ❌
31556         - ❌
31557         - ❌
31558       * - **browsertime-tp6-live-chromium-facebook**
31559         - ❌
31560         - ❌
31561         - ❌
31562         - ❌
31563       * - **browsertime-tp6-live-firefox-facebook**
31564         - ❌
31565         - ❌
31566         - ❌
31567         - ❌
31568       * - **browsertime-tp6-live-safari-facebook**
31569         - ❌
31570         - ❌
31571         - ❌
31572         - ❌
31573
31574
31575    .. list-table:: **test-windows10-32-qr/opt**
31576       :widths: 30 15 15 15 15
31577       :header-rows: 1
31578
31579       * - **Test Name**
31580         - mozilla-central
31581         - autoland
31582         - mozilla-release
31583         - mozilla-beta
31584       * - **browsertime-tp6-firefox-facebook**
31585         - ❌
31586         - ❌
31587         - ❌
31588         - ❌
31589       * - **browsertime-tp6-live-firefox-facebook**
31590         - ❌
31591         - ❌
31592         - ❌
31593         - ❌
31594
31595
31596    .. list-table:: **test-windows10-32-shippable-qr/opt**
31597       :widths: 30 15 15 15 15
31598       :header-rows: 1
31599
31600       * - **Test Name**
31601         - mozilla-central
31602         - autoland
31603         - mozilla-release
31604         - mozilla-beta
31605       * - **browsertime-tp6-chrome-facebook**
31606         - ❌
31607         - ❌
31608         - ❌
31609         - ❌
31610       * - **browsertime-tp6-chromium-facebook**
31611         - ❌
31612         - ❌
31613         - ❌
31614         - ❌
31615       * - **browsertime-tp6-firefox-facebook**
31616         - ❌
31617         - ❌
31618         - ❌
31619         - ❌
31620       * - **browsertime-tp6-live-chrome-facebook**
31621         - ❌
31622         - ❌
31623         - ❌
31624         - ❌
31625       * - **browsertime-tp6-live-chromium-facebook**
31626         - ❌
31627         - ❌
31628         - ❌
31629         - ❌
31630       * - **browsertime-tp6-live-firefox-facebook**
31631         - ❌
31632         - ❌
31633         - ❌
31634         - ❌
31635
31636
31637    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
31638       :widths: 30 15 15 15 15
31639       :header-rows: 1
31640
31641       * - **Test Name**
31642         - mozilla-central
31643         - autoland
31644         - mozilla-release
31645         - mozilla-beta
31646       * - **browsertime-tp6-firefox-facebook**
31647         - ❌
31648         - ❌
31649         - ❌
31650         - ❌
31651       * - **browsertime-tp6-live-firefox-facebook**
31652         - ❌
31653         - ❌
31654         - ❌
31655         - ❌
31656
31657
31658    .. list-table:: **test-windows10-64-qr/opt**
31659       :widths: 30 15 15 15 15
31660       :header-rows: 1
31661
31662       * - **Test Name**
31663         - mozilla-central
31664         - autoland
31665         - mozilla-release
31666         - mozilla-beta
31667       * - **browsertime-tp6-firefox-facebook**
31668         - ❌
31669         - ❌
31670         - ❌
31671         - ❌
31672       * - **browsertime-tp6-live-firefox-facebook**
31673         - ❌
31674         - ❌
31675         - ❌
31676         - ❌
31677
31678
31679    .. list-table:: **test-windows10-64-shippable-qr/opt**
31680       :widths: 30 15 15 15 15
31681       :header-rows: 1
31682
31683       * - **Test Name**
31684         - mozilla-central
31685         - autoland
31686         - mozilla-release
31687         - mozilla-beta
31688       * - **browsertime-tp6-chrome-facebook**
31689         - ❌
31690         - ❌
31691         - ❌
31692         - ❌
31693       * - **browsertime-tp6-chromium-facebook**
31694         - ❌
31695         - ❌
31696         - ❌
31697         - ❌
31698       * - **browsertime-tp6-firefox-facebook**
31699         - ✅
31700         - ✅
31701         - ✅
31702         - ✅
31703       * - **browsertime-tp6-live-chrome-facebook**
31704         - ❌
31705         - ❌
31706         - ❌
31707         - ❌
31708       * - **browsertime-tp6-live-chromium-facebook**
31709         - ❌
31710         - ❌
31711         - ❌
31712         - ❌
31713       * - **browsertime-tp6-live-firefox-facebook**
31714         - ❌
31715         - ❌
31716         - ❌
31717         - ❌
31718
31719
31720
31721 .. dropdown:: google
31722    :class-container: anchor-id-google-u
31723
31724    **Owner**: PerfTest Team
31725
31726    * **alert on**: fcp, loadtime
31727    * **alert threshold**: 2.0
31728    * **apps**: firefox
31729    * **expected**: pass
31730    * **gecko profile entries**: 14000000
31731    * **gecko profile interval**: 1
31732    * **lower is better**: true
31733    * **page cycles**: 25
31734    * **page timeout**: 60000
31735    * **playback**: mitmproxy
31736    * **playback pageset manifest**: mitm7-linux-firefox-google.manifest
31737    * **playback version**: 8.1.1
31738    * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
31739    * **type**: pageload
31740    * **unit**: ms
31741    * **Test Task**:
31742
31743    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
31744       :widths: 30 15 15 15 15
31745       :header-rows: 1
31746
31747       * - **Test Name**
31748         - mozilla-central
31749         - autoland
31750         - mozilla-release
31751         - mozilla-beta
31752       * - **browsertime-tp6m-essential-fenix-google-nofis**
31753         - ❌
31754         - ❌
31755         - ❌
31756         - ❌
31757       * - **browsertime-tp6m-essential-geckoview-google-nofis**
31758         - ❌
31759         - ❌
31760         - ❌
31761         - ❌
31762       * - **browsertime-tp6m-live-fenix-google-nofis**
31763         - ❌
31764         - ❌
31765         - ❌
31766         - ❌
31767       * - **browsertime-tp6m-live-geckoview-google-nofis**
31768         - ❌
31769         - ❌
31770         - ❌
31771         - ❌
31772
31773
31774    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
31775       :widths: 30 15 15 15 15
31776       :header-rows: 1
31777
31778       * - **Test Name**
31779         - mozilla-central
31780         - autoland
31781         - mozilla-release
31782         - mozilla-beta
31783       * - **browsertime-tp6m-essential-chrome-m-google-nofis**
31784         - ❌
31785         - ❌
31786         - ❌
31787         - ❌
31788       * - **browsertime-tp6m-essential-fenix-google-nofis**
31789         - ❌
31790         - ❌
31791         - ❌
31792         - ❌
31793       * - **browsertime-tp6m-essential-geckoview-google-nofis**
31794         - ✅
31795         - ✅
31796         - ❌
31797         - ❌
31798       * - **browsertime-tp6m-live-chrome-m-google-nofis**
31799         - ❌
31800         - ❌
31801         - ❌
31802         - ❌
31803       * - **browsertime-tp6m-live-fenix-google-nofis**
31804         - ❌
31805         - ❌
31806         - ❌
31807         - ❌
31808       * - **browsertime-tp6m-live-geckoview-google-nofis**
31809         - ❌
31810         - ❌
31811         - ❌
31812         - ❌
31813
31814
31815
31816 .. dropdown:: youtube
31817    :class-container: anchor-id-youtube-u
31818
31819    **Owner**: PerfTest Team
31820
31821    * **alert on**: fcp, loadtime
31822    * **alert threshold**: 2.0
31823    * **apps**: firefox
31824    * **expected**: pass
31825    * **gecko profile entries**: 14000000
31826    * **gecko profile interval**: 1
31827    * **lower is better**: true
31828    * **page cycles**: 25
31829    * **page timeout**: 60000
31830    * **playback**: mitmproxy
31831    * **playback pageset manifest**: mitm7-linux-firefox-youtube.manifest
31832    * **playback version**: 8.1.1
31833    * **test url**: `<https://www.youtube.com>`__
31834    * **type**: pageload
31835    * **unit**: ms
31836    * **Test Task**:
31837
31838    .. list-table:: **test-android-hw-a51-11-0-aarch64-qr/opt**
31839       :widths: 30 15 15 15 15
31840       :header-rows: 1
31841
31842       * - **Test Name**
31843         - mozilla-central
31844         - autoland
31845         - mozilla-release
31846         - mozilla-beta
31847       * - **browsertime-tp6m-fenix-youtube**
31848         - ❌
31849         - ❌
31850         - ❌
31851         - ❌
31852       * - **browsertime-tp6m-fenix-youtube-nofis**
31853         - ❌
31854         - ❌
31855         - ❌
31856         - ❌
31857       * - **browsertime-tp6m-geckoview-youtube**
31858         - ❌
31859         - ❌
31860         - ❌
31861         - ❌
31862       * - **browsertime-tp6m-geckoview-youtube-nofis**
31863         - ❌
31864         - ❌
31865         - ❌
31866         - ❌
31867       * - **browsertime-tp6m-live-fenix-youtube-nofis**
31868         - ❌
31869         - ❌
31870         - ❌
31871         - ❌
31872       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
31873         - ❌
31874         - ❌
31875         - ❌
31876         - ❌
31877       * - **browsertime-tp6m-refbrow-youtube**
31878         - ❌
31879         - ❌
31880         - ❌
31881         - ❌
31882
31883
31884    .. list-table:: **test-android-hw-a51-11-0-aarch64-shippable-qr/opt**
31885       :widths: 30 15 15 15 15
31886       :header-rows: 1
31887
31888       * - **Test Name**
31889         - mozilla-central
31890         - autoland
31891         - mozilla-release
31892         - mozilla-beta
31893       * - **browsertime-tp6m-chrome-m-youtube**
31894         - ❌
31895         - ❌
31896         - ❌
31897         - ❌
31898       * - **browsertime-tp6m-chrome-m-youtube-nofis**
31899         - ❌
31900         - ❌
31901         - ❌
31902         - ❌
31903       * - **browsertime-tp6m-fenix-youtube**
31904         - ❌
31905         - ❌
31906         - ❌
31907         - ❌
31908       * - **browsertime-tp6m-fenix-youtube-nofis**
31909         - ❌
31910         - ❌
31911         - ❌
31912         - ❌
31913       * - **browsertime-tp6m-geckoview-youtube**
31914         - ❌
31915         - ❌
31916         - ❌
31917         - ❌
31918       * - **browsertime-tp6m-geckoview-youtube-nofis**
31919         - ✅
31920         - ✅
31921         - ❌
31922         - ❌
31923       * - **browsertime-tp6m-live-chrome-m-youtube-nofis**
31924         - ❌
31925         - ❌
31926         - ❌
31927         - ❌
31928       * - **browsertime-tp6m-live-fenix-youtube-nofis**
31929         - ❌
31930         - ❌
31931         - ❌
31932         - ❌
31933       * - **browsertime-tp6m-live-geckoview-youtube-nofis**
31934         - ❌
31935         - ❌
31936         - ❌
31937         - ❌
31938       * - **browsertime-tp6m-refbrow-youtube**
31939         - ❌
31940         - ❌
31941         - ❌
31942         - ❌
31943
31944
31945    .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
31946       :widths: 30 15 15 15 15
31947       :header-rows: 1
31948
31949       * - **Test Name**
31950         - mozilla-central
31951         - autoland
31952         - mozilla-release
31953         - mozilla-beta
31954       * - **browsertime-tp6-firefox-youtube**
31955         - ❌
31956         - ❌
31957         - ❌
31958         - ❌
31959       * - **browsertime-tp6-live-firefox-youtube**
31960         - ❌
31961         - ❌
31962         - ❌
31963         - ❌
31964
31965
31966    .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
31967       :widths: 30 15 15 15 15
31968       :header-rows: 1
31969
31970       * - **Test Name**
31971         - mozilla-central
31972         - autoland
31973         - mozilla-release
31974         - mozilla-beta
31975       * - **browsertime-tp6-firefox-youtube**
31976         - ❌
31977         - ❌
31978         - ❌
31979         - ❌
31980       * - **browsertime-tp6-live-firefox-youtube**
31981         - ❌
31982         - ❌
31983         - ❌
31984         - ❌
31985
31986
31987    .. list-table:: **test-linux1804-64-qr/opt**
31988       :widths: 30 15 15 15 15
31989       :header-rows: 1
31990
31991       * - **Test Name**
31992         - mozilla-central
31993         - autoland
31994         - mozilla-release
31995         - mozilla-beta
31996       * - **browsertime-tp6-firefox-youtube**
31997         - ❌
31998         - ❌
31999         - ❌
32000         - ❌
32001       * - **browsertime-tp6-live-firefox-youtube**
32002         - ❌
32003         - ❌
32004         - ❌
32005         - ❌
32006
32007
32008    .. list-table:: **test-linux1804-64-shippable-qr/opt**
32009       :widths: 30 15 15 15 15
32010       :header-rows: 1
32011
32012       * - **Test Name**
32013         - mozilla-central
32014         - autoland
32015         - mozilla-release
32016         - mozilla-beta
32017       * - **browsertime-tp6-chrome-youtube**
32018         - ❌
32019         - ❌
32020         - ❌
32021         - ❌
32022       * - **browsertime-tp6-chromium-youtube**
32023         - ❌
32024         - ❌
32025         - ❌
32026         - ❌
32027       * - **browsertime-tp6-firefox-youtube**
32028         - ✅
32029         - ✅
32030         - ✅
32031         - ✅
32032       * - **browsertime-tp6-live-chrome-youtube**
32033         - ❌
32034         - ❌
32035         - ❌
32036         - ❌
32037       * - **browsertime-tp6-live-chromium-youtube**
32038         - ❌
32039         - ❌
32040         - ❌
32041         - ❌
32042       * - **browsertime-tp6-live-firefox-youtube**
32043         - ❌
32044         - ❌
32045         - ❌
32046         - ❌
32047
32048
32049    .. list-table:: **test-macosx1015-64-nightlyasrelease-qr/opt**
32050       :widths: 30 15 15 15 15
32051       :header-rows: 1
32052
32053       * - **Test Name**
32054         - mozilla-central
32055         - autoland
32056         - mozilla-release
32057         - mozilla-beta
32058       * - **browsertime-tp6-firefox-youtube**
32059         - ❌
32060         - ❌
32061         - ❌
32062         - ❌
32063       * - **browsertime-tp6-live-firefox-youtube**
32064         - ❌
32065         - ❌
32066         - ❌
32067         - ❌
32068
32069
32070    .. list-table:: **test-macosx1015-64-shippable-qr/opt**
32071       :widths: 30 15 15 15 15
32072       :header-rows: 1
32073
32074       * - **Test Name**
32075         - mozilla-central
32076         - autoland
32077         - mozilla-release
32078         - mozilla-beta
32079       * - **browsertime-tp6-chrome-youtube**
32080         - ❌
32081         - ❌
32082         - ❌
32083         - ❌
32084       * - **browsertime-tp6-chromium-youtube**
32085         - ❌
32086         - ❌
32087         - ❌
32088         - ❌
32089       * - **browsertime-tp6-firefox-youtube**
32090         - ✅
32091         - ✅
32092         - ✅
32093         - ✅
32094       * - **browsertime-tp6-live-chrome-youtube**
32095         - ❌
32096         - ❌
32097         - ❌
32098         - ❌
32099       * - **browsertime-tp6-live-chromium-youtube**
32100         - ❌
32101         - ❌
32102         - ❌
32103         - ❌
32104       * - **browsertime-tp6-live-firefox-youtube**
32105         - ❌
32106         - ❌
32107         - ❌
32108         - ❌
32109       * - **browsertime-tp6-live-safari-youtube**
32110         - ❌
32111         - ❌
32112         - ❌
32113         - ❌
32114
32115
32116    .. list-table:: **test-windows10-32-qr/opt**
32117       :widths: 30 15 15 15 15
32118       :header-rows: 1
32119
32120       * - **Test Name**
32121         - mozilla-central
32122         - autoland
32123         - mozilla-release
32124         - mozilla-beta
32125       * - **browsertime-tp6-firefox-youtube**
32126         - ❌
32127         - ❌
32128         - ❌
32129         - ❌
32130       * - **browsertime-tp6-live-firefox-youtube**
32131         - ❌
32132         - ❌
32133         - ❌
32134         - ❌
32135
32136
32137    .. list-table:: **test-windows10-32-shippable-qr/opt**
32138       :widths: 30 15 15 15 15
32139       :header-rows: 1
32140
32141       * - **Test Name**
32142         - mozilla-central
32143         - autoland
32144         - mozilla-release
32145         - mozilla-beta
32146       * - **browsertime-tp6-chrome-youtube**
32147         - ❌
32148         - ❌
32149         - ❌
32150         - ❌
32151       * - **browsertime-tp6-chromium-youtube**
32152         - ❌
32153         - ❌
32154         - ❌
32155         - ❌
32156       * - **browsertime-tp6-firefox-youtube**
32157         - ❌
32158         - ❌
32159         - ❌
32160         - ❌
32161       * - **browsertime-tp6-live-chrome-youtube**
32162         - ❌
32163         - ❌
32164         - ❌
32165         - ❌
32166       * - **browsertime-tp6-live-chromium-youtube**
32167         - ❌
32168         - ❌
32169         - ❌
32170         - ❌
32171       * - **browsertime-tp6-live-firefox-youtube**
32172         - ❌
32173         - ❌
32174         - ❌
32175         - ❌
32176
32177
32178    .. list-table:: **test-windows10-64-nightlyasrelease-qr/opt**
32179       :widths: 30 15 15 15 15
32180       :header-rows: 1
32181
32182       * - **Test Name**
32183         - mozilla-central
32184         - autoland
32185         - mozilla-release
32186         - mozilla-beta
32187       * - **browsertime-tp6-firefox-youtube**
32188         - ❌
32189         - ❌
32190         - ❌
32191         - ❌
32192       * - **browsertime-tp6-live-firefox-youtube**
32193         - ❌
32194         - ❌
32195         - ❌
32196         - ❌
32197
32198
32199    .. list-table:: **test-windows10-64-qr/opt**
32200       :widths: 30 15 15 15 15
32201       :header-rows: 1
32202
32203       * - **Test Name**
32204         - mozilla-central
32205         - autoland
32206         - mozilla-release
32207         - mozilla-beta
32208       * - **browsertime-tp6-firefox-youtube**
32209         - ❌
32210         - ❌
32211         - ❌
32212         - ❌
32213       * - **browsertime-tp6-live-firefox-youtube**
32214         - ❌
32215         - ❌
32216         - ❌
32217         - ❌
32218
32219
32220    .. list-table:: **test-windows10-64-shippable-qr/opt**
32221       :widths: 30 15 15 15 15
32222       :header-rows: 1
32223
32224       * - **Test Name**
32225         - mozilla-central
32226         - autoland
32227         - mozilla-release
32228         - mozilla-beta
32229       * - **browsertime-tp6-chrome-youtube**
32230         - ❌
32231         - ❌
32232         - ❌
32233         - ❌
32234       * - **browsertime-tp6-chromium-youtube**
32235         - ❌
32236         - ❌
32237         - ❌
32238         - ❌
32239       * - **browsertime-tp6-firefox-youtube**
32240         - ✅
32241         - ✅
32242         - ✅
32243         - ✅
32244       * - **browsertime-tp6-live-chrome-youtube**
32245         - ❌
32246         - ❌
32247         - ❌
32248         - ❌
32249       * - **browsertime-tp6-live-chromium-youtube**
32250         - ❌
32251         - ❌
32252         - ❌
32253         - ❌
32254       * - **browsertime-tp6-live-firefox-youtube**
32255         - ❌
32256         - ❌
32257         - ❌
32258         - ❌
32259
32260
32261
32262