Quelle raptor.rst
Sprache: unbekannt
|
|
Quellsprache: Binärcode.rst aufgebrochen in jeweils 16 ZeichenUnknown {[0] [0] [0]}zum Wurzelverzeichnis wechseln
######
Raptor
######
Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview.
- Contact: Dave Hunt [:davehunt]
- Source code: https://searchfox.org/mozilla-central/source/testing/raptor
- Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop.
Locally, Raptor can be invoked with the following command:
::
./mach raptor
.. toctree::
:titlesonly:
browsertime
debugging
contributing
raptor-metrics
.. contents::
:depth: 2
:local:
Raptor tests
************
The following documents all testing we have for Raptor.
Benchmarks
----------
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests <browsertime.html#updating-benchmark-tests>`_.
.. dropdown:: ares6
:class-container: anchor-id-ares6-b
* Command to Run Locally
.. code-block::
./mach raptor -t ares6
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/ares6.toml#16>`__
* **lower is better**: true
* **page cycles**: 4
* **page timeout**: 270000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-ares6**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-ares6**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-ares6**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-ares6**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-ares6**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: assorted-dom
:class-container: anchor-id-assorted-dom-b
* Command to Run Locally
.. code-block::
./mach raptor -t assorted-dom
**Owner**: PerfTest Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#15>`__
* **lower is better**: true
* **page cycles**: 1
* **page timeout**: 60000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/assorted-dom
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **screen capture**: true
* **test url**: `<http://\<host\>:\<port\>/assorted/driver.html?raptor>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-assorted-dom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-assorted-dom**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-assorted-dom**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-assorted-dom**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-assorted-dom**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: jetstream2
:class-container: anchor-id-jetstream2-b
* Command to Run Locally
.. code-block::
./mach raptor -t jetstream2
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2.toml#16>`__
* **lower is better**: false
* **page cycles**: 4
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/JetStream2
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **subtest lower is better**: false
* **subtest unit**: score
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#16>`__
* **lower is better**: false
* **page cycles**: 4
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/JetStream2
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **subtest lower is better**: false
* **subtest unit**: score
* **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-jetstream2-fenix-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-jetstream2**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-jetstream2**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-jetstream2**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: matrix-react-bench
:class-container: anchor-id-matrix-react-bench-b
* Command to Run Locally
.. code-block::
./mach raptor -t matrix-react-bench
**Owner**: :jandem and SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile interval**: 1
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#16>`__
* **lower is better**: true
* **page cycles**: 30
* **page timeout**: 2000000
* **repository**: https://github.com/mozilla/perf-automation
* **repository path**: benchmarks/matrix-react-bench
* **repository revision**: 61332db584026b73e37066d717a162825408c36b
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/matrix_demo.html>`__
* **type**: benchmark
* **unit**: ms
* **Test Task**:
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-matrix-react-bench**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-matrix-react-bench**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: motionmark-1-3
:class-container: anchor-id-motionmark-1-3-b
* Command to Run Locally
.. code-block::
./mach raptor -t motionmark-1-3
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **expose chrome trace**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#13>`__
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: MotionMark
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#12>`__
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: MotionMark
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-1-3**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: motionmark-htmlsuite-1-3
:class-container: anchor-id-motionmark-htmlsuite-1-3-b
* Command to Run Locally
.. code-block::
./mach raptor -t motionmark-htmlsuite-1-3
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, custom-car
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **expose chrome trace**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#29>`__
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: HTML suite
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
**Owner**: Graphics Team
* **alert threshold**: 2.0
* **apps**: fenix, geckoview, chrome-m, cstm-car-m
* **browser cycles**: 1
* **cold**: true
* **expected**: pass
* **expose browser profiler**: true
* **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
* **host from parent**: false
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#28>`__
* **lower is better**: false
* **page cycles**: 1
* **page timeout**: 600000
* **repository**: https://github.com/webkit/motionmark
* **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
* **subtest lower is better**: false
* **subtest unit**: score
* **suite name**: HTML suite
* **support class**: motionmark-1-3.py
* **test script**: motionmark-1-3.js
* **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-linux1804-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. list-table:: **test-macosx1400-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-nightlyasrelease/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-macosx1470-64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-nightlyasrelease-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-windows11-64-shippable-qr/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3**
- ✅
- ✅
- ❌
- ❌
.. dropdown:: speedometer
:class-container: anchor-id-speedometer-b
* Command to Run Locally
.. code-block::
./mach raptor -t speedometer
**Owner**: SpiderMonkey Team
* **alert threshold**: 2.0
* **apps**: firefox, chrome, safari, safari-tp, custom-car
* **expected**: pass
* **expose browser profiler**: true
* **gather cpuTime**: true
* **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
* **gecko profile interval**: 1
* **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread
* **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19>`__
* **lower is better**: false
* **page cycles**: 5
* **page timeout**: 600000
* **subtest lower is better**: true
* **subtest unit**: ms
* **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
* **type**: benchmark
* **unit**: score
* **Test Task**:
.. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer-mobile-chrome-m**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
- ✅
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
- ✅
- ✅
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-a55-14-0-aarch64/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-geckoview-nofis**
- ❌
- ❌
- ❌
- ❌
.. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt**
:widths: 30 15 15 15 15
:header-rows: 1
* - **Test Name**
- mozilla-central
- autoland
- mozilla-release
- mozilla-beta
* - **browsertime-benchmark-speedometer-mobile-chrome-m**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis**
- ❌
- ❌
- ❌
- ❌
* - **browsertime-benchmark-speedometer-mobile-fenix**
- ❌
- ❌
- ❌
- ❌
--> --------------------
--> maximum size reached
--> --------------------
[ Verzeichnis aufwärts0.294unsichere Verbindung
]
|
2026-03-28
|
