1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-01-19 04:21:17 +00:00

158 Commits

Author SHA1 Message Date
Marc Bonnici
75f3080c9b workloads: Use uninstall method instead of uninstall_executable
For workloads that support Linux targets do not use
`uninstall_executable` as this is not available, instead use `uninstall` as
other targets should be able to determine the appropriate uninstallation
method.
2018-10-05 10:10:43 +01:00
Marc Bonnici
75c0e40bb0 workloads/androbench: Fix extracting results with small resolutions
Previously the workload assumed that all the scores were visible on a
single screen however for devices with smaller displays the results need
to scrolled.
2018-10-03 14:33:09 +01:00
Qais Yousef
e73b299fbe pcmark: update uiautomation to fix Android-Q breakage
A new popup appears when running pcmark on android Q that complains
about the app being built for an older version of android.

Since this popup will be temporary, the fix has to make sure not to
break in the future when this popup disappears or when the test is ran
on a compatible version of android.

To achieve this, we attempt to dismiss the popup and if we timeout we
silently carry on with the test assuming no popup will appear.

Signed-off-by: Qais Yousef <qais.yousef@arm.com>
2018-10-01 16:12:05 +01:00
scott
9a4a90e0a6 GFXBench: New workload
Creating a new workload to execute the following tests on GFXBench.

* Car Chase
* Car Chase Offscreen
* Manhattan 3.1
* 1080p Manhattan 3.1 Offscreen
* 1440p Manhattan 3.1 Offscreen
* Tessellation
* Tessellation Offscreen
2018-09-25 17:27:58 +01:00
scott
8ba602cf83 Googlephotos: Updating to work with latest version
Updating the googlephotos workload to work with app version 4.0.0.212659618
2018-09-25 10:50:03 +01:00
scott
ccaca3d6d8 Speedometer: Extending teardown function
Some devices throw errors if too many browser tabs are open. Have
added a method to close down the tabs in the teardown function.
2018-09-20 10:26:34 +01:00
Marc Bonnici
ca03f21f46 workloads/jankbench: Update to clear logcat using devlib
Leftover code from WA2 meant that logcat was cleared on the device by
the workload directly instead of using devlib, this caused issues if logcat was
still being cleared from other areas of the code.
2018-09-10 13:30:59 +01:00
Marc Bonnici
59e29de285 workloads/jankbench: Replace errors during decoding
When running jankbench invalid bytes can be read from the device causing
decoding in the monitor to fail, now replace any invalid sequences.
2018-09-10 13:30:59 +01:00
scott
0440c41266 Googleslides: Updating the workload to support the new range of huawei devices 2018-09-06 18:01:24 +01:00
scott
4c4fd2a267 Gmail: Minor change to allow workload to run correctly on Huawei devices 2018-09-05 14:01:01 +01:00
Marc Bonnici
5afc96dc4d workloads/pcmark: Fix reading results in python3
Ensure that the results file is decoded when using python3.
2018-08-14 13:39:04 +01:00
Marc Bonnici
039758948e workloads/androbench: Update uiauto apk with fix 2018-07-11 17:32:08 +01:00
Marc Bonnici
86dcfbf595 workloads/androbench: Fix Formatting 2018-07-10 15:57:18 +01:00
Marc Bonnici
1b58390ff5 workloads/androbench: Fix for devices running Android 8.1
On some devices running Android 8.1 the start benchmark button was
failing to be clicked, this is a workaround to click on the coordinates
of the button instead of the UiObject iteslf.
2018-07-10 15:57:18 +01:00
Sergei Trofimov
c410d2e1a1 I lint, therefore I am
Implement fixes for the most recent pylint version.
2018-07-09 15:59:40 +01:00
Marc Bonnici
925bc8b719 wa: pep8 fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
9b2bc1369c wa/workloads: pylint fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
6e94cbd36b wa/workloads: pep8 fixes 2018-07-06 14:39:41 +01:00
Sergei Trofimov
8878cc20d4 Update copyright headers.
- Add copyright headers to files that did not already have them
- Update the year to the last year the file was modified in files with
  existing headers.
2018-07-04 16:33:31 +01:00
Marc Bonnici
c9ff15ca53 wa/workloads: Fix missing imports 2018-07-04 16:33:08 +01:00
Marc Bonnici
60b37995e0 workloads/jankbench: Update to check if running in a container.
Instead of using the os to determine whether the screen state should
be checked, use target flag to see if running inside a container.
2018-07-02 10:59:18 +01:00
scott
68e7fc0b99 workloads: fix mongoperf
Mongoperf currently has a non-ASCII character in the file that causes a failure.

This commit rewords the description to remove the incriminating character.
2018-07-02 10:02:01 +01:00
Marc Bonnici
edfbee291b workloads/jankbench: Fix typo in method name
Fix incorrect method name.
2018-06-29 17:25:09 +01:00
Marc Bonnici
04cbf51a15 workloads/jankbench: Fix screen state for ChromeOS
We cannot currently determine the screen state from cannot android
containter so only check on android systems.
2018-06-29 17:25:09 +01:00
Marc Bonnici
d016318a32 workloads: Bump known working version of workloads. 2018-06-29 14:46:16 +01:00
Sergei Trofimov
c69a0f69e6 workloads: add mongoperf
Add a workload that runs mongoperf benchmark that measures I/O
performance on a MongoDB server. This workload assumes that mongoperf
is already installed.
2018-06-29 12:39:36 +01:00
Sergei Trofimov
d3872716ed workloads/deepbench: lengthen timeout
Lengthen timeout for gemm and conv tests to be the same as for sparse
test. While the former two usually take a lot less time, their execution
time will vary significantly depending on the target and the runtime
environment (e.g. cpu frequencies might be forced to lowest values).
2018-06-27 10:24:57 +01:00
Sergei Trofimov
3c0f1968c5 workloads/apache: fix for Python 3
urllib2 does not exist in Python 3, and its methods have been moved into
urllib.request. Use future library to create aliases that work across
both 2 and 3.
2018-06-26 09:55:29 +01:00
Sergei Trofimov
af95b5c990 workloads/lmbench: doc fix
Add missing blank lines around the URL indent block.
2018-06-25 17:11:47 +01:00
scott
29174912dd workloads: add lmbench
Add a workload for lat_mem_rd and bw_mem tests of LMbench benchmark, a suite of
portable ANSI/C microbenchmarks for UNIX/POSIX.

This is a port of corresponding workload from WA2.
2018-06-25 14:52:22 +01:00
scott
3b322a36c9 Speedometer: Changing workload to use Speedometer 2.0 by default 2018-06-22 14:55:39 +01:00
Joe Savage
f05a64ef95 workloads/googlemaps: Add googlemaps workload 2018-06-20 17:23:49 +01:00
Sergei Trofimov
35f644ba76 workloads/chrome: fix docs
- Escape asterisk (otherwise, it is interpreted as "open emphasis")
- Use monospace formatting for paths.
- Trim to 79 columns wide
2018-06-20 17:01:48 +01:00
Marc Bonnici
b85665fa12 workloads/androbench: Fix directory structure
Correct the location of the UiAutomator code from `adobereader` to
`androbench`.
2018-06-20 16:39:07 +01:00
Marc Bonnici
d6c853ce59 workloads: Fix incorrect attribute name
Correct setting of attribute `clean_assets` to `cleanup_assets`
2018-06-20 14:39:40 +01:00
Joe Savage
9e9c84958d workloads/chrome: Add chrome workload 2018-06-18 12:04:25 +01:00
Sergei Trofimov
67631cfa6d workloads: add apache benchmark
Add a benchmark that load-tests Apache server installed on the target.
2018-06-18 10:55:44 +01:00
Joe Savage
915465c744 workloads/gmail: Add offline mode 2018-06-18 10:51:32 +01:00
scott
ce6ea663a3 Youtube: Updating to reflect changes in accessing options menu 2018-06-14 15:08:09 +01:00
Sergei Trofimov
d64ab6f099 workloads: add deepbench
Add automation for Baidu's DeepBench benchmark for deep learning
operations.
2018-06-14 12:31:43 +01:00
scott
503005ba5f Googleplaybooks: Adding support for night reading dialogues.
Certain devices present a night time reading popup alert when opening the books workload.
This can throw off the workload so I've added a function to check for this and dismiss if neccessary.
2018-06-12 22:54:43 +01:00
Sergei Trofimov
b3de85455a Add support for Python 3
Add support for running under Python 3, while maintaining compatibility
with Python 2.

See http://python-future.org/compatible_idioms.html for more details
behind these changes.
2018-06-07 14:48:40 +01:00
Sergei Trofimov
ec9605603e workloads/openssl: save binary's hash and version
Store the hash and the version of the openssl executable used by the
workload in the result metadata.
2018-05-25 10:21:06 +01:00
Sergei Trofimov
2ff06af632 fw/execution: record resource hashes in metadata
As part of resolving a resource, record its MD5 hash in the output
metadata. In order to enable this, resource resolution is now done via
the context, rather than directly via the ResourceResolver (in order not
to introduce a context dependency in the Gui object, context now
emulates the resolver interface).
2018-05-25 10:21:06 +01:00
Sergei Trofimov
ffdb6235c9 workloads: add openssl
Add a workload that runs openssl's speed command to benchmark the
performance of various openssl algorithms.
2018-05-23 14:51:54 +01:00
Marc Bonnici
04fe3768af doc: Misc fixes
Fix typos, formatting and irrelevant information.
2018-05-21 10:26:28 +01:00
Marc Bonnici
52b2df427e doc/show_cmd: Reword description and add settings option 2018-05-21 10:26:28 +01:00
Sergei Trofimov
b1b2131b0c doc: fix build warnings 2018-05-18 10:32:08 +01:00
scott
3f7f0b38f5 PCMark: Porting to WA3 2018-05-15 16:09:38 +01:00
Marc Bonnici
6754ecd6d7 wa/workloads: Update to consistently use timeout parameter 2018-05-14 17:07:49 +01:00