Impressum raptor.rst
Interaktion und Portierbarkeitunbekannt
|
|
Untersuchungsergebnis.rst Download desUnknown {[0] [0] [0]}
######
Raptor
######
Raptor is a performance-testing framework for running browser pageload and browser benchmar k tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview.
- Contact: Dave Hunt [:davehunt]
- Source code: :searchfox:`testing/raptor`
- Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop.
Locally, Raptor can be invoked with the following command:
::
./mach raptor
.. toctree::
:titlesonly:
browsertime
debugging
contributing
raptor-metrics
.. contents::
:depth: 2
:local:
Raptor tests
************
The following documents all testing we have for Raptor.
Benchmarks
----------
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests <browsertime.html#updating-benchmark-tests>`_.
.. dropdown:: ares6
:class-container: anchor-id-ares6-b
* Command to Run Locally
.. code-block::
./mach raptor -t ares6
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/ares6.toml#16`
* **lower is better**: true
* **page cycles**: 4
* **page timeout**: 270000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-ares6**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-ares6**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-ares6**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-ares6**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-ares6**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: assorted-dom
:class-container: anchor-id-assorted-dom-b
* Command to Run Locally
.. code-block::
./mach raptor -t assorted-dom
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#16`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/assorted-dom
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **screen capture**: true
* **sparse checkout**: true
* **test url**: `<http://\<host\>:\<port\>/assorted/driver.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-assorted-dom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-assorted-dom**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-assorted-dom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-assorted-dom**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-assorted-dom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: jetstream2
:class-container: anchor-id-jetstream2-b
* Command to Run Locally
.. code-block::
./mach raptor -t jetstream2
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#17`
* **lower is better**: false
* **page cycles**: 4
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/JetStream2
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **subtest lower is better**: false
* **subtest unit**: score
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/jetstream2.toml#17`
* **lower is better**: false
* **page cycles**: 4
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/JetStream2
* **repository revision**: 6acd3f58f12dbd71cf4743666cad305862681630
* **sparse checkout**: true
* **subtest lower is better**: false
* **subtest unit**: score
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: jetstream3
:class-container: anchor-id-jetstream3-b
* Command to Run Locally
.. code-block::
./mach raptor -t jetstream3
**Owner**: :jandem and spidermonkey team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, safari-tp, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **expose chrome trace**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/jetstream3-desktop.toml#17`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 2000000
* **repository**: https://github.com/webkit/jetstream
* **repository revision**: 3967678fa8ab98d847ab33cf3728dba726fa854b
* **subtest alert threshold**: 5.0
* **subtest lower is better**: true
* **subtest unit**: ms
* **suite name**: JetStream3.0
* **support class**: jetstream3.py
* **test script**: jetstream3.js
* **test url**: `<http://\<host\>:\<port\>/>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream3-fenix-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-tp-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
**Owner**: :jandem and spidermonkey team
* **alert threshold**: 2.0
* **apps**: chrome-m, cstm-car-m, fenix
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/jetstream3-mobile.toml#22`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 2000000
* **preferences**: dom.max_script_run_time=0
* **repository**: https://github.com/webkit/jetstream
* **repository revision**: 3967678fa8ab98d847ab33cf3728dba726fa854b
* **subtest alert threshold**: 5.0
* **subtest lower is better**: true
* **subtest unit**: ms
* **suite name**: JetStream3.0
* **support class**: jetstream3.py
* **test script**: jetstream3.js
* **test url**: `<http://\<host\>:\<port\>/>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream3-fenix-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-tp-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream3**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: matrix-react-bench
:class-container: anchor-id-matrix-react-bench-b
* Command to Run Locally
.. code-block::
./mach raptor -t matrix-react-bench
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#17`
* **lower is better**: true
* **page cycles**: 30
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/matrix-react-bench
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/matrix_demo.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: motionmark-1-3
:class-container: anchor-id-motionmark-1-3-b
* Command to Run Locally
.. code-block::
./mach raptor -t motionmark-1-3
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **expose chrome trace**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#13`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: MotionMark
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=pan style='color: green'>30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#12`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: MotionMark
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=pan style='color: green'>30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: motionmark-htmlsuite-1-3
:class-container: anchor-id-motionmark-htmlsuite-1-3-b
* Command to Run Locally
.. code-block::
./mach raptor -t motionmark-htmlsuite-1-3
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **expose chrome trace**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#29`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: HTML suite
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=pan style='color: green'>30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#28`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: HTML suite
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=pan style='color: green'>30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: speedometer2
:class-container: anchor-id-speedometer2-b
* Command to Run Locally
.. code-block::
./mach raptor -t speedometer2
**Owner**: SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, safari-tp, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile features**: stackwalk,js,cpu,processcpu,nomarkerstacks
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 600000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
**Owner**: SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile features**: stackwalk,js,cpu,processcpu,nomarkerstacks
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#19`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 420000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer2**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: speedometer3
:class-container: anchor-id-speedometer3-b
* Command to Run Locally
.. code-block::
./mach raptor -t speedometer3
**Owner**: Performance Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, safari-tp, custom-car
* **benchmark port**: 62763
* **browser cycles**: 5
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile features**: stackwalk,js,cpu,processcpu,nomarkerstacks
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#21`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 600000
* **subtest lower is better**: true
* **subtest unit**: ms
* **support class**: speedometer3.py
* **test script**: speedometer3.js
* **test url**: `<http://\<host\>:\<port\>/Speedometer3/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-lt-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-lt-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-tp-speedometer3**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
**Owner**: Performance Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m
* **benchmark port**: 62763
* **browser cycles**: 5
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile features**: stackwalk,js,cpu,processcpu,nomarkerstacks
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
* **host from parent**: false
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#21`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 420000
* **subtest lower is better**: true
* **subtest unit**: ms
* **support class**: speedometer3.py
* **test script**: speedometer3.js
* **test url**: `<http://\<host\>:\<port\>/Speedometer3/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-lt-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-lt-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1500-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-tp-speedometer3**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-hw-ref/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-speedometer3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-speedometer3-nv**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: stylebench
:class-container: anchor-id-stylebench-b
* Command to Run Locally
.. code-block::
./mach raptor -t stylebench
**Owner**: :emilio and Layout Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/stylebench.toml#16`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 140000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/StyleBench/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-stylebench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-stylebench**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-stylebench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-stylebench**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-stylebench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-stylebench**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: sunspider
:class-container: anchor-id-sunspider-b
* Command to Run Locally
.. code-block::
./mach raptor -t sunspider
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/sunspider.toml#10`
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 55000
* **test url**: `<http://\<host\>:\<port\>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-sunspider**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-sunspider**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-sunspider**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-sunspider**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-sunspider**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-sunspider**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: twitch-animation
:class-container: anchor-id-twitch-animation-b
* Command to Run Locally
.. code-block::
./mach raptor -t twitch-animation
**Owner**: :jrmuizel
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/twitch-animation.toml#16`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2000000
* **perfstats**: false
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/twitch-animation
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/index.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-twitch-animation**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: unity-webgl
:class-container: anchor-id-unity-webgl-b
* Command to Run Locally
.. code-block::
./mach raptor -t unity-webgl
**Owner**: :jgilbert and Graphics(gfx) Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/unity-webgl-desktop.toml#15`
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 420000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/unity-webgl
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-refbrow**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-unity-webgl-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-refbrow**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
**Owner**: :jgilbert and Graphics(gfx) Team
* **alert threshold**: 2.0
* **apps**: geckoview, refbrow, fenix, chrome-m
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/unity-webgl-mobile.toml#14`
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 420000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/unity-webgl
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-refbrow**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-unity-webgl-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-unity-webgl-mobile-refbrow**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-unity-webgl**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-unity-webgl**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-unity-webgl**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-godot
:class-container: anchor-id-wasm-godot-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-godot
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-godot.toml#11`
* **lower is better**: true
* **newtab per cycle**: true
* **page cycles**: 5
* **page timeout**: 120000
* **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-godot**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-godot**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-safari-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-godot**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-godot-baseline
:class-container: anchor-id-wasm-godot-baseline-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-godot-baseline
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-godot-baseline.toml#14`
* **lower is better**: true
* **newtab per cycle**: true
* **page cycles**: 5
* **page timeout**: 120000
* **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
* **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-godot-optimizing
:class-container: anchor-id-wasm-godot-optimizing-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-godot-optimizing
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-godot-optimizing.toml#14`
* **lower is better**: true
* **newtab per cycle**: true
* **page cycles**: 5
* **page timeout**: 120000
* **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
* **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-misc
:class-container: anchor-id-wasm-misc-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-misc
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-misc.toml#15`
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 1200000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/wasm-misc
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-misc**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-misc**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-chrome-wasm-misc**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-misc-baseline
:class-container: anchor-id-wasm-misc-baseline-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-misc-baseline
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-misc-baseline.toml#14`
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 1200000
* **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/wasm-misc
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: wasm-misc-optimizing
:class-container: anchor-id-wasm-misc-optimizing-b
* Command to Run Locally
.. code-block::
./mach raptor -t wasm-misc-optimizing
**Owner**: :lth and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/wasm-misc-optimizing.toml#14`
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 1200000
* **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/wasm-misc
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **sparse checkout**: true
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: webaudio
:class-container: anchor-id-webaudio-b
* Command to Run Locally
.. code-block::
./mach raptor -t webaudio
**Owner**: :padenot and Media Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/webaudio.toml#10`
* **lower is better**: true
* **page cycles**: 5
* **page timeout**: 360000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-webaudio**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-webaudio**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-webaudio**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-webaudio**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-webaudio**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-webaudio**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-av1-sfr
:class-container: anchor-id-youtube-playback-av1-sfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-av1-sfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#24`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-av1-sfr**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-av1-sfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-av1-sfr**
- ✅
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-1080p30
:class-container: anchor-id-youtube-playback-h264-1080p30-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-1080p30
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#28`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p30**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-1080p60
:class-container: anchor-id-youtube-playback-h264-1080p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-1080p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#34`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-1080p60**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-720p60
:class-container: anchor-id-youtube-playback-h264-720p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-720p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m
* **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#82`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **support class**: browsertime_benchmark.py
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=38&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-full-1080p30
:class-container: anchor-id-youtube-playback-h264-full-1080p30-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-full-1080p30
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#40`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-full-1080p60
:class-container: anchor-id-youtube-playback-h264-full-1080p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-full-1080p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#55`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-h264-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-h264-sfr
:class-container: anchor-id-youtube-playback-h264-sfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-h264-sfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#70`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-geckoview-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-refbrow-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-geckoview-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-refbrow-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-hfr
:class-container: anchor-id-youtube-playback-hfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-hfr
**Owner**: PerfTest Team
* **alert on**: `H2641080p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__, `H264720p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#74`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-hfr**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-refbrow-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-hfr-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-refbrow-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-hfr**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-v9-1080p30
:class-container: anchor-id-youtube-playback-v9-1080p30-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-v9-1080p30
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#96`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p30**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-v9-1080p60
:class-container: anchor-id-youtube-playback-v9-1080p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-v9-1080p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#102`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-1080p60**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-v9-full-1080p30
:class-container: anchor-id-youtube-playback-v9-full-1080p30-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-v9-full-1080p30
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#108`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p30**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-v9-full-1080p60
:class-container: anchor-id-youtube-playback-v9-full-1080p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-v9-full-1080p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#123`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-firefox-youtube-playback-v9-full-1080p60**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-vp9-720p60
:class-container: anchor-id-youtube-playback-vp9-720p60-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-vp9-720p60
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m
* **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#89`
* **lower is better**: true
* **page cycles**: 20
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **support class**: browsertime_benchmark.py
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=6&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-vp9-sfr
:class-container: anchor-id-youtube-playback-vp9-sfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-vp9-sfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#138`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-mobile-fenix-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-widevine-h264-sfr
:class-container: anchor-id-youtube-playback-widevine-h264-sfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-widevine-h264-sfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#142`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-h264-sfr**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-widevine-hfr
:class-container: anchor-id-youtube-playback-widevine-hfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-widevine-hfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#156`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-hfr**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: youtube-playback-widevine-vp9-sfr
:class-container: anchor-id-youtube-playback-widevine-vp9-sfr-b
* Command to Run Locally
.. code-block::
./mach raptor -t youtube-playback-widevine-vp9-sfr
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, geckoview, fenix, refbrow, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1000
* **gecko profile threads**: MediaPlayback
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#170`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 2700000
* **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
* **subtest lower is better**: true
* **subtest unit**: score
* **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
* **type**: benchmark
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-clang-trunk/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-firefox-youtube-playback-widevine-vp9-sfr**
- ❌
- ❌
- ❌
- ❌
Custom
------
Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.
.. dropdown:: addMab1
:class-container: anchor-id-addMab1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMab1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small ArrayBuffers to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#50`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMab1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMab1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMab1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMab1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMab1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addMabN
:class-container: anchor-id-addMabN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMabN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small ArrayBuffers to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#54`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMabN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMabN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMabN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMabN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMabN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addMar1
:class-container: anchor-id-addMar1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMar1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small Arrays to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#58`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMar1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMar1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMar1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMar1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMar1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addMarN
:class-container: anchor-id-addMarN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMarN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small Arrays to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#62`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMarN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMarN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMarN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMarN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMarN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addMbl1
:class-container: anchor-id-addMbl1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMbl1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small Blobs to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#66`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMbl1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMbl1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMbl1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMbl1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMbl1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addMblN
:class-container: anchor-id-addMblN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addMblN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send many small Blobs to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#70`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMblN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMblN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addMblN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addMblN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addMblN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkAB1
:class-container: anchor-id-addkAB1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkAB1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#74`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkAB1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkAB1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkAB1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkAB1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAB1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkABN
:class-container: anchor-id-addkABN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkABN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#78`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkABN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkABN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkABN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkABN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkABN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkAR1
:class-container: anchor-id-addkAR1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkAR1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#82`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkAR1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkAR1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkAR1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkAR1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkAR1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkARN
:class-container: anchor-id-addkARN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkARN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large JS Arrays to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#86`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkARN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkARN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkARN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkARN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkARN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkBL1
:class-container: anchor-id-addkBL1-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkBL1
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large Blobs to IndexedDB in one transaction
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#90`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkBL1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkBL1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkBL1**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkBL1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBL1**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: addkBLN
:class-container: anchor-id-addkBLN-c
* Command to Run Locally
.. code-block::
./mach raptor -t addkBLN
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Use add API to send a couple of large Blobs to IndexedDB independently
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#94`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_write.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkBLN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkBLN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-addkBLN**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-addkBLN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-addkBLN**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: browsertime
:class-container: anchor-id-browsertime-c
* Command to Run Locally
.. code-block::
./mach raptor -t browsertime
**Owner**: PerfTest Team
**Description**: Used to run vanilla browsertime tests through raptor. For example: `./mach raptor -t browsertime --browsertime-arg url=https://www.sitespeed.io --browsertime-arg iterations=3`
* **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__
* **alert threshold**: 2.0
* **apps**: firefox
* **browser cycles**: 1
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-custom.toml#17`
* **lower is better**: true
* **measure**: fnbpaint, fcp, dcf, loadtime
* **page cycles**: 1
* **page timeout**: 60000
* **playback**: mitmproxy
* **playback pageset manifest**: null.manifest
* **playback version**: 12.2.1
* **support class**: browsertime_pageload.py
* **test script**: None
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
.. dropdown:: connect
:class-container: anchor-id-connect-c
* Command to Run Locally
.. code-block::
./mach raptor -t connect
**Owner**: Network Team
**Description**: Verifies that connection time on a pageload is zero when a speculative connection has first been made
* **alert change type**: absolute
* **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__
* **alert threshold**: 10.0
* **apps**: firefox
* **browser cycles**: 3
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-speculative.toml#18`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: speculative-connect.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculative-firefox-connect**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: constant-regression
:class-container: anchor-id-constant-regression-c
* Command to Run Locally
.. code-block::
./mach raptor -t constant-regression
**Owner**: PerfTest Team
**Description**: Generates a constant value that can be changed to induce a regression.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, geckoview, fenix
* **browser cycles**: 1
* **browsertime args**: --browsertime.constant_value=1500
* **custom data**: true
* **expected**: pass
* **fore window**: 1
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-regression-test.toml#23`
* **lower is better**: true
* **max back window**: 3
* **min back window**: 2
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest unit**: ms
* **test script**: constant_regression_test.js
* **test summary**: flatten
* **test url**: `<None>`__
* **type**: pageload
* **unit**: score
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-regression-tests-firefox-constant-regression**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-regression-tests-firefox-constant-regression**
- ❌
- ✅
- ❌
- ❌
.. dropdown:: dns-multi
:class-container: anchor-id-dns-multi-c
* Command to Run Locally
.. code-block::
./mach raptor -t dns-multi
**Owner**: Network Team
**Description**: Tests multi-domain DNS lookup and pageload performance via native DNS.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#16`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_multi_domain_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-dns-multi**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-dns-multi-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-dns-multi**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-dns-multi-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-multi**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: dns-native
:class-container: anchor-id-dns-native-c
* Command to Run Locally
.. code-block::
./mach raptor -t dns-native
**Owner**: Network Team
**Description**: Tests DNS lookup time via native DNS.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#51`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-dns-native**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-dns-native-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-dns-native**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-dns-native-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-dns-native**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: getkeyrng
:class-container: anchor-id-getkeyrng-c
* Command to Run Locally
.. code-block::
./mach raptor -t getkeyrng
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Measures the speed of key-range based reads of IndexedDB
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#98`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **support class**: browsertime_pageload.py
* **test script**: indexeddb_getkeyrange.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-getkeyrng**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-getkeyrng**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-getkeyrng**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-getkeyrng**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-getkeyrng**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: h2-download
:class-container: anchor-id-h2-download-c
* Command to Run Locally
.. code-block::
./mach raptor -t h2-download
**Owner**: Network Team
**Description**: Measures HTTP/2 download throughput with a local server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, custom-car
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h2_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#38`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **support class**: network_bench.py
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: h2-upload
:class-container: anchor-id-h2-upload-c
* Command to Run Locally
.. code-block::
./mach raptor -t h2-upload
**Owner**: Network Team
**Description**: Measures HTTP/2 file upload throughput with a local server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, custom-car
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#34`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **support class**: network_bench.py
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h2-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: h3-download
:class-container: anchor-id-h3-download-c
* Command to Run Locally
.. code-block::
./mach raptor -t h3-download
**Owner**: Network Team
**Description**: Measures HTTP/3 download throughput with a local server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, custom-car
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h3_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#28`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **support class**: network_bench.py
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-download**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-download-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: h3-upload
:class-container: anchor-id-h3-upload-c
* Command to Run Locally
.. code-block::
./mach raptor -t h3-upload
**Owner**: Network Team
**Description**: Measures HTTP/3 file upload throughput with a local server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, custom-car
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#24`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **support class**: network_bench.py
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-chrome-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-network-bench-firefox-h3-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: idb-open-few-par
:class-container: anchor-id-idb-open-few-par-c
* Command to Run Locally
.. code-block::
./mach raptor -t idb-open-few-par
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Measures opening a few IndexedDB databases in parallel
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#36`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_open.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-par**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: idb-open-few-seq
:class-container: anchor-id-idb-open-few-seq-c
* Command to Run Locally
.. code-block::
./mach raptor -t idb-open-few-seq
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Measures opening a few IndexedDB databases in sequence
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#40`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_open.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-few-seq**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: idb-open-many-par
:class-container: anchor-id-idb-open-many-par-c
* Command to Run Locally
.. code-block::
./mach raptor -t idb-open-many-par
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Measures opening many IndexedDB databases in parallel
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=1
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#28`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_open.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-par**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: idb-open-many-seq
:class-container: anchor-id-idb-open-many-seq-c
* Command to Run Locally
.. code-block::
./mach raptor -t idb-open-many-seq
**Owner**: DOM Lifecycle, Workers and Storage Team
**Description**: Measures opening many IndexedDB databases in sequence
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=0
* **custom data**: true
* **expected**: pass
* **gecko profile entries**: 131072000
* **gecko profile features**: js,stackwalk,cpu,memory
* **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#32`
* **lower is better**: true
* **measure**: cpuTime
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm8-linux-firefox-example.manifest
* **subtest unit**: ms
* **test script**: indexeddb_open.js
* **test summary**: flatten
* **test url**: `<https://www.example.com>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-chrome-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-indexeddb-firefox-idb-open-many-seq**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: prefetch
:class-container: anchor-id-prefetch-c
* Command to Run Locally
.. code-block::
./mach raptor -t prefetch
**Owner**: Network Team, Performance Team
**Description**: Speculation Rules prefetch test: clicks a link on a landing page whose inline speculationrules script (moderate eagerness) prefetches the target during hover, so a prefetch-capable browser serves the navigation from the prefetch cache.
* **alert threshold**: 10.0
* **apps**: firefox, chrome
* **browser cycles**: 1
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-speculation-rules.toml#13`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **support class**: speculation_rules.py
* **test script**: speculation-rules-prefetch.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-chrome-prefetch**
- ❌
- ✅
- ❌
- ❌
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-speculation-rules-firefox-prefetch**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: process-switch
:class-container: anchor-id-process-switch-c
* Command to Run Locally
.. code-block::
./mach raptor -t process-switch
**Owner**: PerfTest Team
**Description**: Measures process switch time
* **accept zero vismet**: true
* **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__
* **alert threshold**: 2.0
* **apps**: firefox, chrome
* **browser cycles**: 25
* **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-process-switch.toml#20`
* **lower is better**: true
* **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
* **page cycles**: 25
* **page timeout**: 60000
* **playback**: mitmproxy
* **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest
* **playback version**: 5.1.1
* **support class**: browsertime_pageload.py
* **test script**: process_switch.js
* **test url**: `<https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: false
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-custom-firefox-process-switch**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: sample-python-support
:class-container: anchor-id-sample-python-support-c
* Command to Run Locally
.. code-block::
./mach raptor -t sample-python-support
**Owner**: PerfTest Team
**Description**: A sample test that uses a python support file to modify the test command.
* **alert threshold**: 2.0
* **apps**: firefox
* **browser cycles**: 1
* **browsertime args**: --browsertime.constant_value={replace-with-constant-value}
* **custom data**: true
* **expected**: pass
* **fore window**: 1
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-sample-python-support.toml#22`
* **lower is better**: true
* **max back window**: 3
* **min back window**: 2
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest unit**: ms
* **support class**: sample_python_support.py
* **test script**: constant_regression_test.js
* **test summary**: flatten
* **test url**: `<None>`__
* **type**: pageload
* **unit**: score
* **use live sites**: true
.. dropdown:: throttled
:class-container: anchor-id-throttled-c
* Command to Run Locally
.. code-block::
./mach raptor -t throttled
**Owner**: Network Team
**Description**: Pageload test using a throttled network environment
* **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__
* **alert threshold**: 2.0
* **apps**: firefox
* **browser cycles**: 3
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-throttled-pageload.toml#17`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: throttled_pageload.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-throttled-firefox-throttled**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: tp6-bench
:class-container: anchor-id-tp6-bench-c
* Command to Run Locally
.. code-block::
./mach raptor -t tp6-bench
**Owner**: PerfTest Team
**Description**: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, chromium, safari
* **browser cycles**: 1
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-tp6-bench.toml#19`
* **lower is better**: true
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **playback**: mitmproxy
* **playback pageset manifest**: None
* **playback version**: 8.1.1
* **subtest unit**: ms
* **support class**: browsertime_tp6_bench.py
* **test script**: browsertime_tp6_bench.js
* **test summary**: flatten
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-pageload-benchmark-firefox-tp6-bench**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-cira
:class-container: anchor-id-trr-cira-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-cira
**Owner**: Network Team
**Description**: Tests DNS lookup time on a CIRA TRR server.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#23`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cira**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-cloudf
:class-container: anchor-id-trr-cloudf-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-cloudf
**Owner**: Network Team
**Description**: Tests DNS lookup time on a Cloudflare TRR server.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#30`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-cloudf**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-cloudf-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-cloudf-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-cloudf**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-comcas
:class-container: anchor-id-trr-comcas-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-comcas
**Owner**: Network Team
**Description**: Tests DNS lookup time on a Comcast TRR server.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#37`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-comcas**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-multi
:class-container: anchor-id-trr-multi-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-multi
**Owner**: Network Team
**Description**: Tests multi-domain DNS lookup and pageload performance on a Cloudflare TRR server.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#44`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_multi_domain_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-multi**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-multi-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-multi**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-multi-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-multi**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-next
:class-container: anchor-id-trr-next-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-next
**Owner**: Network Team
**Description**: Tests DNS lookup time on a NextDNS TRR server.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#58`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-next**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-next-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-next**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-next-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-next**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-w-cira
:class-container: anchor-id-trr-w-cira-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-w-cira
**Owner**: Network Team
**Description**: Tests DNS lookup time on a CIRA TRR server, with the TRR connection warmed up.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#65`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-cira**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-w-clou
:class-container: anchor-id-trr-w-clou-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-w-clou
**Owner**: Network Team
**Description**: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#72`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-w-clou**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-w-clou-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-w-clou-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-clou**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-w-comc
:class-container: anchor-id-trr-w-comc-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-w-comc
**Owner**: Network Team
**Description**: Tests DNS lookup time on a Comcast TRR server, with the TRR connection warmed up.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#79`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-comc**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: trr-w-next
:class-container: anchor-id-trr-w-next-c
* Command to Run Locally
.. code-block::
./mach raptor -t trr-w-next
**Owner**: Network Team
**Description**: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up.
* **alert threshold**: 2.0
* **apps**: firefox,fenix
* **browser cycles**: 3
* **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
* **cold**: true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#86`
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **test script**: trr_performance.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: ms
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-w-next**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-w-next-nofis**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-m-fenix-trr-w-next**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-trr-performance-m-fenix-trr-w-next-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ✅
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-trr-performance-firefox-trr-w-next**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: upload
:class-container: anchor-id-upload-c
* Command to Run Locally
.. code-block::
./mach raptor -t upload
**Owner**: Network Team
**Description**: Measures HTTP/2 file upload throughput with a remote server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:false --chrome.args disable-quic
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-upload.toml#16`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-chrome-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-upload-firefox-upload**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-chrome-upload**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-upload-firefox-upload**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-upload-safari-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: upload-h3
:class-container: anchor-id-upload-h3-c
* Command to Run Locally
.. code-block::
./mach raptor -t upload-h3
**Owner**: Network Team
**Description**: Measures HTTP/3 file upload throughput with a remote server
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **browser cycles**: 1
* **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:true
* **custom data**: true
* **expected**: pass
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-upload.toml#31`
* **lower is better**: false
* **output timeout**: 2000000
* **page cycles**: 1
* **page timeout**: 1800000
* **subtest lower is better**: false
* **subtest name filters**: tests/,iterations/
* **subtest unit**: mbps
* **test script**: network_bench.js
* **test url**: `<None>`__
* **type**: pageload
* **unit**: mbps
* **use live sites**: true
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-chrome-upload-h3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-upload-firefox-upload-h3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-chrome-upload-h3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-upload-firefox-upload-h3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-upload-safari-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-upload-firefox-upload-h3**
- ❌
- ❌
- ❌
- ❌
.. dropdown:: ve-av1-q
:class-container: anchor-id-ve-av1-q-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-q
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p video in quality mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#22`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-q**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-q**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-q**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-q**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-q**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-av1-q-cam
:class-container: anchor-id-ve-av1-q-cam-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-q-cam
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p camera input in quality mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#82`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **preferences**: media.navigator.permission.disabled=true media.navigator.streams.fake=true media.getusermedia.camera.fake.force=true media.autoplay.default=0
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&sources=camera&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-q-cam**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-q-cam**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-q-cam**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-cam**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-av1-q-i420
:class-container: anchor-id-ve-av1-q-i420-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-q-i420
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p I420 input in quality mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#52`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30&pixelFormats=I420>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-q-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-q-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-q-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-q-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-q-i420**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-q-i420**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-av1-rt
:class-container: anchor-id-ve-av1-rt-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-rt
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p video in real-time mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#19`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-rt**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-rt**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-rt**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-rt**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-rt**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-av1-rt-cam
:class-container: anchor-id-ve-av1-rt-cam-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-rt-cam
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p camera input in real-time mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#73`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **preferences**: media.navigator.permission.disabled=true media.navigator.streams.fake=true media.getusermedia.camera.fake.force=true media.autoplay.default=0
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&sources=camera&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-rt-cam**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-rt-cam**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-rt-cam**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-cam**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-av1-rt-i420
:class-container: anchor-id-ve-av1-rt-i420-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-av1-rt-i420
**Owner**: :chunmin and Media Team
**Description**: Measures AV1 encoding performance for 1080p I420 input in real-time mode.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#49`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30&pixelFormats=I420>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-linux2404-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-rt-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-rt-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-linux2404-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-av1-rt-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-av1-rt-i420**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-av1-rt-i420**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-av1-rt-i420**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-q
:class-container: anchor-id-ve-h264-q-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-q
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 1080p video in quality mode using AVC format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#28`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-h264-q**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-q-cam
:class-container: anchor-id-ve-h264-q-cam-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-q-cam
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 1080p camera input in quality mode using AVC format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#100`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **preferences**: media.navigator.permission.disabled=true media.navigator.streams.fake=true media.getusermedia.camera.fake.force=true media.autoplay.default=0
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&sources=camera&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-h264-q-cam**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-cam**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-q-i420
:class-container: anchor-id-ve-h264-q-i420-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-q-i420
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 1080p I420 input in quality mode using AVC format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#58`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30&pixelFormats=I420>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-h264-q-i420**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-i420**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-q-sd
:class-container: anchor-id-ve-h264-q-sd-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-q-sd
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 480p video in quality mode using AVC format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#34`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-chrome-ve-h264-q-sd**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-custom-car-ve-h264-q-sd**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-h264-q-sd**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-q-sd-cam
:class-container: anchor-id-ve-h264-q-sd-cam-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-q-sd-cam
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 480p camera input in quality mode using AVC format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#118`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **preferences**: media.navigator.permission.disabled=true media.navigator.streams.fake=true media.getusermedia.camera.fake.force=true media.autoplay.default=0
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&sources=camera&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-webcodecs-safari-ve-h264-q-sd-cam**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-windows11-64-24h2/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-webcodecs-firefox-ve-h264-q-sd-cam**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: ve-h264-rt
:class-container: anchor-id-ve-h264-rt-c
* Command to Run Locally
.. code-block::
./mach raptor -t ve-h264-rt
**Owner**: :chunmin and Media Team
**Description**: Measures H264-baseline encoding performance for 1080p video in real-time mode using Annex B format.
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: :searchfox:`testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#25`
* **lower is better**: true
* **page cycles**: 3
* **page timeout**: 360000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/webcodecs
* **repository revision**: 8fd150ac2ede429d5a927e25c04159e57760ac81
* **sparse checkout**: true
* **support class**: browsertime_benchmark.py
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42 | |