1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 02:41:11 +01:00
Commit Graph

127 Commits

Author SHA1 Message Date
Joe Savage
f05a64ef95 workloads/googlemaps: Add googlemaps workload 2018-06-20 17:23:49 +01:00
Sergei Trofimov
35f644ba76 workloads/chrome: fix docs
- Escape asterisk (otherwise, it is interpreted as "open emphasis")
- Use monospace formatting for paths.
- Trim to 79 columns wide
2018-06-20 17:01:48 +01:00
Marc Bonnici
b85665fa12 workloads/androbench: Fix directory structure
Correct the location of the UiAutomator code from `adobereader` to
`androbench`.
2018-06-20 16:39:07 +01:00
Marc Bonnici
d6c853ce59 workloads: Fix incorrect attribute name
Correct setting of attribute `clean_assets` to `cleanup_assets`
2018-06-20 14:39:40 +01:00
Joe Savage
9e9c84958d workloads/chrome: Add chrome workload 2018-06-18 12:04:25 +01:00
Sergei Trofimov
67631cfa6d workloads: add apache benchmark
Add a benchmark that load-tests Apache server installed on the target.
2018-06-18 10:55:44 +01:00
Joe Savage
915465c744 workloads/gmail: Add offline mode 2018-06-18 10:51:32 +01:00
scott
ce6ea663a3 Youtube: Updating to reflect changes in accessing options menu 2018-06-14 15:08:09 +01:00
Sergei Trofimov
d64ab6f099 workloads: add deepbench
Add automation for Baidu's DeepBench benchmark for deep learning
operations.
2018-06-14 12:31:43 +01:00
scott
503005ba5f Googleplaybooks: Adding support for night reading dialogues.
Certain devices present a night time reading popup alert when opening the books workload.
This can throw off the workload so I've added a function to check for this and dismiss if neccessary.
2018-06-12 22:54:43 +01:00
Sergei Trofimov
b3de85455a Add support for Python 3
Add support for running under Python 3, while maintaining compatibility
with Python 2.

See http://python-future.org/compatible_idioms.html for more details
behind these changes.
2018-06-07 14:48:40 +01:00
Sergei Trofimov
ec9605603e workloads/openssl: save binary's hash and version
Store the hash and the version of the openssl executable used by the
workload in the result metadata.
2018-05-25 10:21:06 +01:00
Sergei Trofimov
2ff06af632 fw/execution: record resource hashes in metadata
As part of resolving a resource, record its MD5 hash in the output
metadata. In order to enable this, resource resolution is now done via
the context, rather than directly via the ResourceResolver (in order not
to introduce a context dependency in the Gui object, context now
emulates the resolver interface).
2018-05-25 10:21:06 +01:00
Sergei Trofimov
ffdb6235c9 workloads: add openssl
Add a workload that runs openssl's speed command to benchmark the
performance of various openssl algorithms.
2018-05-23 14:51:54 +01:00
Marc Bonnici
04fe3768af doc: Misc fixes
Fix typos, formatting and irrelevant information.
2018-05-21 10:26:28 +01:00
Marc Bonnici
52b2df427e doc/show_cmd: Reword description and add settings option 2018-05-21 10:26:28 +01:00
Sergei Trofimov
b1b2131b0c doc: fix build warnings 2018-05-18 10:32:08 +01:00
scott
3f7f0b38f5 PCMark: Porting to WA3 2018-05-15 16:09:38 +01:00
Marc Bonnici
6754ecd6d7 wa/workloads: Update to consistently use timeout parameter 2018-05-14 17:07:49 +01:00
Marc Bonnici
a23c896647 wa/workloads: Update to use threads parameter
Update workloads to use `threads` parameter to try and keep
configuration more consistent across workloads.
2018-05-14 17:07:49 +01:00
Marc Bonnici
47ec0c7720 workloads/meabo: Update parameter names to be more consistent
Rename `nrow` and `ncol` to `num_rows` and `num_cols` respectively to be
more consistent with the other parameter names.
2018-05-14 17:07:49 +01:00
Marc Bonnici
6f5fca36df wa/workloads: Change to use 'loops' parameter.
Change to consistently use 'loops' parameter instead of 'iterations'
etc.
2018-05-14 17:07:49 +01:00
Marc Bonnici
8d7d32d180 wa/workloads: Update to use new cpu_mask type
Update workloads that allow for specifying which cpus to be ran on to
all use the same interface while maintaining backwards compatibility with
the existing configuration options.
2018-05-14 17:07:49 +01:00
Marc Bonnici
f4b47bf65a Fix typos 2018-04-30 09:14:11 +01:00
Sascha Bischoff
99f8efbaf5 workloads/stress-ng: Port stress-ng from WA2
stress-ng will stress test a computer system in various selectable
ways.  It was designed to exercise various physical subsystems of a
computer as well as the various operating system kernel interfaces.
2018-04-27 16:29:33 +01:00
Sascha Bischoff
7c1ed6487b workload/rt-app: Better JSON processing error reporting
The rt-app workload parses the rt-app JSON file in order to override
some options (specifically duration). Previously, if the JSON was
syntactically incorrect, an uninformative ValueError was raised. Now
we raise a ConfigError with appropriate message prompting the user to
fix the file.
2018-04-27 15:47:18 +01:00
sergei Trofimov
b8343e545b workloads: add meabo
Add automation for meabo micro-benchmark.
2018-04-25 17:16:53 +01:00
Sergei Trofimov
f326cd26de workloads: add sysbench
Port sysbench workload from WA2.

sysbench is a modular, cross-platform and multi-threaded benchmark tool
for evaluating OS parameters that are important for a system running a
database under intensive load.
2018-04-16 11:52:02 +01:00
Javi Merino
3fe7305c6e workloads: add recentfling
Port recentfling from WA2.

Fixes #705.
2018-04-06 16:56:58 +01:00
Marc Bonnici
8fa32cfd9d workloads/hwuitest: Do not try to process output if none present.
If the workload is abnormally terminated and no output is collected do
not attempt to process the output.
2018-04-06 09:55:25 +01:00
Marc Bonnici
4260139a7c workloads/rt_app: Do not try to process output if none present.
If the workload is abnormally terminated and no output is collected do
not attempt to process the output.
2018-04-06 09:55:25 +01:00
Sergei Trofimov
5a67aabcbd workloads: Add manual workload
Port manual workload from WA2. This workload allows using WA to
configure and instrument the target, while letting the user perform
arbitrary actions in place of running a fixed workload.
2018-04-05 10:17:44 +01:00
Vincent Guittot
33cfb7bae2 rt-app: fix description
since Linaro's modification have been merged in upstream version,
we can remove this comment

Signed-off-by: Vincent Guittot <vincent.guittot@linaro.org>
2018-04-03 08:36:36 +01:00
Marc Bonnici
120ea20ea0 workloads/dhrystone: Fix crash if workload did not complete
Only try to process output from the workload if it is available.
2018-03-26 14:08:33 +01:00
Marc Bonnici
7464010677 workloads/geekbench: Fix formatting
Add missing newline to description in order to display correctly in
the show command and remove extra spaces.
2018-03-21 15:37:55 +00:00
Marc Bonnici
5e4a9311f2 workloads/gmail: Fix attaching files
Ensure the workload uses the passed working directory for attaching
images instead of a hard coded name and allow for finding of the attach
button by description as well as name.
2018-03-16 07:57:00 +00:00
Sergei Trofimov
2b7d1de9f1 workloads: add hwuitest
Port automation for hwuitest (Android's libhwui microbenchmark) from
WA2.
2018-03-15 17:42:25 +00:00
Marc Bonnici
758abedd1f workloads/antutu: Fix location of AndroidManifest.xml 2018-03-15 12:33:17 +00:00
Marc Bonnici
6742c5c8ad workloads/antutu: Allow for unsupported tests
Not all benchmarks are available on all phones and will report "Not
supported" To allow for this update the regexes and if not a valid score
set any unsupported results to 'NaN'
2018-03-15 12:33:17 +00:00
Marc Bonnici
811dfbe5af workloads/exoplayer: Fix splitting of format in incorrect location
Split the desired format outside of for loop as this may not be
executed.
2018-03-14 15:51:03 +00:00
scott
cfe4c18b71 Speedometer: Adding in the missing build files 2018-03-13 14:20:13 +00:00
scott
cb958d668e Androbench: Adding missing build files 2018-03-13 14:20:03 +00:00
scott
f5a00bf4fd Antutu: Adding the missing build files 2018-03-13 14:19:47 +00:00
Sergei Trofimov
5ed5b6f819 workloads: add jankbench
Add automation for Google's jankbench workload.
2018-03-12 17:46:14 +00:00
Marc Bonnici
d253fd07e6 workloads/templerun2: Add missing package name 2018-03-08 11:46:40 +00:00
Sergei Trofimov
d20422ac15 workloads/rt-app: only initialize once
Only initialize/finalize once per run to avoid reinstalling the binary
and recreating the working directory needlessly.
2018-03-08 11:18:12 +00:00
scott
b204e9c22a Antutu: New antutu workload for the 7.0.4 version 2018-03-08 10:17:13 +00:00
scott
7e0e7456a9 Androbench: Migrating to WA3 and modifying to extract results instead of taking a screenshot 2018-03-08 10:16:27 +00:00
scott
87541c647a Speedometer: Creating a wa3 speedometer workload 2018-03-08 10:16:02 +00:00
Sascha Bischoff
e82fa48826 rt-app: remove requirement for rooted device
We remove the requirement for rt-app to run on a rooted device as this
does not appear to be required. We make sure that we run the workload
from a directory where we have write permissions by first changing the
directory before executing the workload (in_directory argument of
invoke).

In the case that the device is rooted, we run rt-app as
root. Otherwise, we simply run the workload.
2018-03-01 15:42:20 +00:00