1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 10:51:13 +01:00
Commit Graph

83 Commits

Author SHA1 Message Date
Marc Bonnici
d253fd07e6 workloads/templerun2: Add missing package name 2018-03-08 11:46:40 +00:00
Sergei Trofimov
d20422ac15 workloads/rt-app: only initialize once
Only initialize/finalize once per run to avoid reinstalling the binary
and recreating the working directory needlessly.
2018-03-08 11:18:12 +00:00
scott
b204e9c22a Antutu: New antutu workload for the 7.0.4 version 2018-03-08 10:17:13 +00:00
scott
7e0e7456a9 Androbench: Migrating to WA3 and modifying to extract results instead of taking a screenshot 2018-03-08 10:16:27 +00:00
scott
87541c647a Speedometer: Creating a wa3 speedometer workload 2018-03-08 10:16:02 +00:00
Sascha Bischoff
e82fa48826 rt-app: remove requirement for rooted device
We remove the requirement for rt-app to run on a rooted device as this
does not appear to be required. We make sure that we run the workload
from a directory where we have write permissions by first changing the
directory before executing the workload (in_directory argument of
invoke).

In the case that the device is rooted, we run rt-app as
root. Otherwise, we simply run the workload.
2018-03-01 15:42:20 +00:00
Sascha Bischoff
39925d3f79 rt-app: redirect stdout to stderr
By default rt-app writes to stderr, not to stdout. Therefore, if we
only sample the stdout, we get no output from the workload itself.

With this change, we redirect stderr to stdout to allow us to get the
workload output.
2018-03-01 15:42:20 +00:00
Sergei Trofimov
bbbe1c7814 workloads/hackbench: rename param duration -> timeout
Rename the parameter to better reflect its usage.
2018-02-22 08:41:04 +00:00
Marc Bonnici
a52187a114 workloads/rt_app: Fix incorrect reference to context.result
Fix `context.result` to `context.output` leftover from WA2
2018-02-16 14:43:52 +00:00
Sergei Trofimov
2158dd047e workloads/hackbench: fix target_binary
Set target_binary as a class, rather than instance, attribute. This
happens only only once per run, and setting it as instance attribute the
first time, makes it unavailable for subsequent instances of the same
workload.
2018-02-15 10:14:40 +00:00
Sergei Trofimov
3dbba732f0 workloads/hackbench: fixes
- Only install/uninstall the executable once per run
- Add results file as a raw artifact
2018-02-14 11:48:07 +00:00
Sergei Trofimov
ea64630f57 workloads/rt-app: fix
Change "pull_file" to "pull" when exacting results. "pull_file" was WA2
API which somehow got missed.
2018-02-14 11:46:30 +00:00
Sergei Trofimov
2a712cd3bb workloads: add hackbench
Add hackbench kernel scheduler benchmark, which is part of the Linux
rt-tests suite. See:

	https://git.kernel.org/pub/scm/linux/kernel/git/clrkwllms/rt-tests.git/tree/src/hackbench/hackbench.8
2018-02-14 11:13:05 +00:00
scott
d616d30ee1 Geekbench: Updating result processing to handle GB5 files 2018-02-14 09:29:56 +00:00
Sergei Trofimov
0d225dc128 workloads/exoplayer: add view
Add view for the workload, so that SurfaceFlinger frame data can be
collected for it.
2018-02-09 12:30:51 +00:00
scott
6e946a53dd Updating Geekbench workload to support the latest versions of both the standard and corporate application 2018-02-09 12:17:27 +00:00
Sergei Trofimov
ff5e5821d0 workloads/exoplayer: handle no orig rotation
Do not attempt to reset rotation in teardown if target did not specify
it before workload execution.
2018-02-08 15:01:03 +00:00
Marc Bonnici
fbf1bbb1cf workloads/exoplayer: Update supported versions
Adds '2.5' and '2.6' to the supported versions of the workload.
2018-02-08 14:58:39 +00:00
Marc Bonnici
5f1145a41f workloads/exoplayer: Prepend file format to downloaded filepath
Always prepend the format for the file into the downloaded filepath to
ensure matching is correctly performed. Previously the ogg file did not
specify this causing it to be re-downloaded for each run.
2018-02-08 14:58:39 +00:00
Marc Bonnici
019e5da79e workloads/thechase: Port workload to WA3
Updated default view to run on Android N
2018-02-01 14:27:45 +00:00
Marc Bonnici
2699bceba3 workloads/googleslides: Fix unable to locate image on chromebook 2018-01-31 19:16:51 +00:00
Marc Bonnici
cba773b5e6 workloads/gmail: Fix to use passed working directory parameter
In devlib the default working directory has changed causing the workload
to look in the wrong directory, now the workload should use the passed
working directory and extract the relevant name from there.
2018-01-31 19:16:51 +00:00
Marc Bonnici
cf39d6c8d3 workloads/memcpy: Fix typos 2018-01-15 15:42:26 +00:00
Marc Bonnici
4b8d8d62c5 workloads/memcpy: Adds once decorators to workload
Ensure that the binary is only installed and uninstalled only once for
this workload.
2018-01-15 15:42:26 +00:00
Patrick Bellasi
b0262e5103 Exoplayer: Add support for Landscape mode
To improve reproducibility of tests, it could help to ensure that the
same screen orientation is used on media playback.
This adds a new workload parameter which allows to ensure a LANDSCAPE
mode, which can be useful to better represent video playback scenarios.
When not enforced by the agenda, we enforce a PORTRAIT orientation.

Signed-off-by: Patrick Bellasi <patrick.bellasi@arm.com>
2018-01-15 13:52:11 +00:00
Marc Bonnici
987f4ec4f1 wa: Rename update_results reference to update_output
To be consistant with the rename of output_processors, old references
to `update_results` have now been changed to `update_output`.
2018-01-15 10:24:03 +00:00
Sergei Trofimov
fabdcc5e30 workloads: port shellscript workload from WA2
Port shellscript workload that allows running an arbitrary shellscript
as a WA workload from WA2.
2018-01-10 09:16:44 +00:00
Marc Bonnici
d4f78afc30 workloads/rt-app: Port workload from WA2 2018-01-08 10:40:36 +00:00
Marc Bonnici
b1a15b3458 workloads/angrybirds_rio: Add missing package name 2018-01-08 10:34:51 +00:00
Sascha Bischoff
45738dfffe workloads/dhrystone: Remove trailing whitespace 2017-12-08 10:46:29 +00:00
Sascha Bischoff
3544b716d2 workloads/dhrystone: do initialize/finalize once per run
Add in the "once" decorator for the initialize and finalize methods to
ensure that they only run once per run.
2017-12-08 10:46:29 +00:00
Sergei Trofimov
4069e37f6b workloads/dhrystone: fix run with num loops and delay
Fix output when running for a specified number of loops (rather than
duration) and adding delay to threads. Previously, the output for the
last thread was not printed due to a missing check for a negative
duration.
2017-12-08 09:39:40 +00:00
Brendan Jackman
aa2abd16a3 Run autoflake to remove unused imports & variables 2017-12-07 15:37:49 +00:00
Sergei Trofimov
7796dabe90 framework: remove wa.framework.plugin.Artifact
Remove wa.framework.plugin.Artifact and associated references. The name
of the class clashes with the class from output and can potentially
cause confusion.

The original intention for this was to be an "expected artifact
descriptor" of sorts that plugins can specify for validation purposes,
but that functionality was never implemented. Given that the framework
has undergone significant changes since this was implemented, it's not
clear that this is the best way to go about the original goal.

Therefore remove this for now.
2017-12-06 16:25:54 +00:00
Marc Bonnici
0f28a07476 framework/workload: Rename ReventWorkload to ApkReventWorkload
To reflect that the current implementation of ReventWorkload uses an APK
file on the device the name has been changed appropriately and the
relevant workloads have been updated.
2017-11-30 17:17:18 +00:00
Marc Bonnici
07aa56f3bd GooglePhotos: Remove unnecessary method parameter 2017-11-28 08:12:31 +00:00
Marc Bonnici
b42a6a67af Gmail: Port Gmail Workload from WA2 2017-11-28 08:12:31 +00:00
Marc Bonnici
0786c25db5 GooglePlayBooks: Add support for applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
247650141b GooglePhotos: Add support for applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
e61ba8ed84 AdobeReader: Add support for Applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
9f8cf2a40e Applaunch: Port workload from WA2
The report_results parameter has been removed as the parsing functionality
is now performed by the `uxperf` processor therefore to report the
results of the application launch time ensure the processor has been
enabled.
2017-11-28 08:12:31 +00:00
Sergei Trofimov
7cd2982b31 workloads/uxperf: change message format
Do not concatenate start/stop markers to the action string with a '_',
delimit them with a space instead. This will make easier to parse the
message afterwards.
2017-11-24 14:30:09 +00:00
Marc Bonnici
612646606d GoogleSlides: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Marc Bonnici
7aa50779e6 GooglePlayPhotos: Ported workload from WA 2017-11-15 14:47:36 +00:00
Marc Bonnici
57677e7e6c GooglePlayBooks: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Marc Bonnici
af3dda1b28 AdobeReader: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Brendan Jackman
200aa84d0b exoplayer: Add an ogg format option 2017-10-31 09:11:04 +00:00
Brendan Jackman
d749fe0f8e exoplayer: call validate from init_resources 2017-10-31 09:11:04 +00:00
Brendan Jackman
df2ae3c451 exoplayer: Add metric for dropped frames 2017-10-31 09:11:04 +00:00
Brendan Jackman
b17a0d30c0 exoplayer: Add exoplayer workload
This is based heavily on a combination of WA2's video workload and LISA's
exoplayer workload.
2017-10-31 09:11:04 +00:00