1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 10:51:13 +01:00
Commit Graph

76 Commits

Author SHA1 Message Date
Sergei Trofimov
bbbe1c7814 workloads/hackbench: rename param duration -> timeout
Rename the parameter to better reflect its usage.
2018-02-22 08:41:04 +00:00
Marc Bonnici
a52187a114 workloads/rt_app: Fix incorrect reference to context.result
Fix `context.result` to `context.output` leftover from WA2
2018-02-16 14:43:52 +00:00
Sergei Trofimov
2158dd047e workloads/hackbench: fix target_binary
Set target_binary as a class, rather than instance, attribute. This
happens only only once per run, and setting it as instance attribute the
first time, makes it unavailable for subsequent instances of the same
workload.
2018-02-15 10:14:40 +00:00
Sergei Trofimov
3dbba732f0 workloads/hackbench: fixes
- Only install/uninstall the executable once per run
- Add results file as a raw artifact
2018-02-14 11:48:07 +00:00
Sergei Trofimov
ea64630f57 workloads/rt-app: fix
Change "pull_file" to "pull" when exacting results. "pull_file" was WA2
API which somehow got missed.
2018-02-14 11:46:30 +00:00
Sergei Trofimov
2a712cd3bb workloads: add hackbench
Add hackbench kernel scheduler benchmark, which is part of the Linux
rt-tests suite. See:

	https://git.kernel.org/pub/scm/linux/kernel/git/clrkwllms/rt-tests.git/tree/src/hackbench/hackbench.8
2018-02-14 11:13:05 +00:00
scott
d616d30ee1 Geekbench: Updating result processing to handle GB5 files 2018-02-14 09:29:56 +00:00
Sergei Trofimov
0d225dc128 workloads/exoplayer: add view
Add view for the workload, so that SurfaceFlinger frame data can be
collected for it.
2018-02-09 12:30:51 +00:00
scott
6e946a53dd Updating Geekbench workload to support the latest versions of both the standard and corporate application 2018-02-09 12:17:27 +00:00
Sergei Trofimov
ff5e5821d0 workloads/exoplayer: handle no orig rotation
Do not attempt to reset rotation in teardown if target did not specify
it before workload execution.
2018-02-08 15:01:03 +00:00
Marc Bonnici
fbf1bbb1cf workloads/exoplayer: Update supported versions
Adds '2.5' and '2.6' to the supported versions of the workload.
2018-02-08 14:58:39 +00:00
Marc Bonnici
5f1145a41f workloads/exoplayer: Prepend file format to downloaded filepath
Always prepend the format for the file into the downloaded filepath to
ensure matching is correctly performed. Previously the ogg file did not
specify this causing it to be re-downloaded for each run.
2018-02-08 14:58:39 +00:00
Marc Bonnici
019e5da79e workloads/thechase: Port workload to WA3
Updated default view to run on Android N
2018-02-01 14:27:45 +00:00
Marc Bonnici
2699bceba3 workloads/googleslides: Fix unable to locate image on chromebook 2018-01-31 19:16:51 +00:00
Marc Bonnici
cba773b5e6 workloads/gmail: Fix to use passed working directory parameter
In devlib the default working directory has changed causing the workload
to look in the wrong directory, now the workload should use the passed
working directory and extract the relevant name from there.
2018-01-31 19:16:51 +00:00
Marc Bonnici
cf39d6c8d3 workloads/memcpy: Fix typos 2018-01-15 15:42:26 +00:00
Marc Bonnici
4b8d8d62c5 workloads/memcpy: Adds once decorators to workload
Ensure that the binary is only installed and uninstalled only once for
this workload.
2018-01-15 15:42:26 +00:00
Patrick Bellasi
b0262e5103 Exoplayer: Add support for Landscape mode
To improve reproducibility of tests, it could help to ensure that the
same screen orientation is used on media playback.
This adds a new workload parameter which allows to ensure a LANDSCAPE
mode, which can be useful to better represent video playback scenarios.
When not enforced by the agenda, we enforce a PORTRAIT orientation.

Signed-off-by: Patrick Bellasi <patrick.bellasi@arm.com>
2018-01-15 13:52:11 +00:00
Marc Bonnici
987f4ec4f1 wa: Rename update_results reference to update_output
To be consistant with the rename of output_processors, old references
to `update_results` have now been changed to `update_output`.
2018-01-15 10:24:03 +00:00
Sergei Trofimov
fabdcc5e30 workloads: port shellscript workload from WA2
Port shellscript workload that allows running an arbitrary shellscript
as a WA workload from WA2.
2018-01-10 09:16:44 +00:00
Marc Bonnici
d4f78afc30 workloads/rt-app: Port workload from WA2 2018-01-08 10:40:36 +00:00
Marc Bonnici
b1a15b3458 workloads/angrybirds_rio: Add missing package name 2018-01-08 10:34:51 +00:00
Sascha Bischoff
45738dfffe workloads/dhrystone: Remove trailing whitespace 2017-12-08 10:46:29 +00:00
Sascha Bischoff
3544b716d2 workloads/dhrystone: do initialize/finalize once per run
Add in the "once" decorator for the initialize and finalize methods to
ensure that they only run once per run.
2017-12-08 10:46:29 +00:00
Sergei Trofimov
4069e37f6b workloads/dhrystone: fix run with num loops and delay
Fix output when running for a specified number of loops (rather than
duration) and adding delay to threads. Previously, the output for the
last thread was not printed due to a missing check for a negative
duration.
2017-12-08 09:39:40 +00:00
Brendan Jackman
aa2abd16a3 Run autoflake to remove unused imports & variables 2017-12-07 15:37:49 +00:00
Sergei Trofimov
7796dabe90 framework: remove wa.framework.plugin.Artifact
Remove wa.framework.plugin.Artifact and associated references. The name
of the class clashes with the class from output and can potentially
cause confusion.

The original intention for this was to be an "expected artifact
descriptor" of sorts that plugins can specify for validation purposes,
but that functionality was never implemented. Given that the framework
has undergone significant changes since this was implemented, it's not
clear that this is the best way to go about the original goal.

Therefore remove this for now.
2017-12-06 16:25:54 +00:00
Marc Bonnici
0f28a07476 framework/workload: Rename ReventWorkload to ApkReventWorkload
To reflect that the current implementation of ReventWorkload uses an APK
file on the device the name has been changed appropriately and the
relevant workloads have been updated.
2017-11-30 17:17:18 +00:00
Marc Bonnici
07aa56f3bd GooglePhotos: Remove unnecessary method parameter 2017-11-28 08:12:31 +00:00
Marc Bonnici
b42a6a67af Gmail: Port Gmail Workload from WA2 2017-11-28 08:12:31 +00:00
Marc Bonnici
0786c25db5 GooglePlayBooks: Add support for applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
247650141b GooglePhotos: Add support for applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
e61ba8ed84 AdobeReader: Add support for Applaunch 2017-11-28 08:12:31 +00:00
Marc Bonnici
9f8cf2a40e Applaunch: Port workload from WA2
The report_results parameter has been removed as the parsing functionality
is now performed by the `uxperf` processor therefore to report the
results of the application launch time ensure the processor has been
enabled.
2017-11-28 08:12:31 +00:00
Sergei Trofimov
7cd2982b31 workloads/uxperf: change message format
Do not concatenate start/stop markers to the action string with a '_',
delimit them with a space instead. This will make easier to parse the
message afterwards.
2017-11-24 14:30:09 +00:00
Marc Bonnici
612646606d GoogleSlides: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Marc Bonnici
7aa50779e6 GooglePlayPhotos: Ported workload from WA 2017-11-15 14:47:36 +00:00
Marc Bonnici
57677e7e6c GooglePlayBooks: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Marc Bonnici
af3dda1b28 AdobeReader: Ported workload from WA2 2017-11-15 14:47:36 +00:00
Brendan Jackman
200aa84d0b exoplayer: Add an ogg format option 2017-10-31 09:11:04 +00:00
Brendan Jackman
d749fe0f8e exoplayer: call validate from init_resources 2017-10-31 09:11:04 +00:00
Brendan Jackman
df2ae3c451 exoplayer: Add metric for dropped frames 2017-10-31 09:11:04 +00:00
Brendan Jackman
b17a0d30c0 exoplayer: Add exoplayer workload
This is based heavily on a combination of WA2's video workload and LISA's
exoplayer workload.
2017-10-31 09:11:04 +00:00
Sascha Bischoff
9b58662ae7 workloads/dhrystone: Fix taskset
Was invoking busybox in a hardcoded way, and was not using
self.target.busybox. Updated to use the correct version.
2017-10-26 12:34:35 +01:00
Brendan Jackman
74bf1a82e0 geekbench: Allow on unrooted when disable_update_result 2017-10-25 19:38:40 +01:00
Brendan Jackman
a08d6262ba geekbench: Use root to pull results XML file
This is required, I don't know why this was working before. Maybe only tested
after people had run 'adb root'?
2017-10-25 19:15:46 +01:00
Brendan Jackman
b36316c900 workloads/geekbench: Add requires_network attribute 2017-10-18 11:50:30 +01:00
Sergei Trofimov
0d54c5f070 workloads: add memcpy workload
Ported memcpy workload from WA2.
2017-10-06 15:04:02 +01:00
Brendan Jackman
6d6fc25e40 geekbench: Fix use of WA3 APIs
Seem I cherry-picked the geekbench workload from my WIP branch
without testing properly, and missed a fixup commit. Here's the
content of that commit, which fixes some missing updates from WA2 ->
WA3 APIs.
2017-10-06 14:51:50 +01:00
Brendan Jackman
b18db64be1 youtube_playback: Add youtube_playback workload
This is a very simple workload that just aims to allow collecting
instrumentation data on purely the video decoding aspect of Youtube.
2017-10-06 10:31:41 +01:00