sascha/workload-automation
1
0
Fork 0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-02-23 05:18:41 +00:00
Code Issues Releases Wiki Activity
2,038 Commits 5 Branches 16 Tags
Commit Graph

253 Commits

Author SHA1 Message Date
scott
ccaca3d6d8 Speedometer: Extending teardown function 
Some devices throw errors if too many browser tabs are open. Have
added a method to close down the tabs in the teardown function.
 2018-09-20 10:26:34 +01:00
Marc Bonnici
ca03f21f46 workloads/jankbench: Update to clear logcat using devlib 
Leftover code from WA2 meant that logcat was cleared on the device by
the workload directly instead of using devlib, this caused issues if logcat was
still being cleared from other areas of the code.
 2018-09-10 13:30:59 +01:00
Marc Bonnici
59e29de285 workloads/jankbench: Replace errors during decoding 
When running jankbench invalid bytes can be read from the device causing
decoding in the monitor to fail, now replace any invalid sequences.
 2018-09-10 13:30:59 +01:00
scott
0440c41266 Googleslides: Updating the workload to support the new range of huawei devices 2018-09-06 18:01:24 +01:00
scott
4c4fd2a267 Gmail: Minor change to allow workload to run correctly on Huawei devices 2018-09-05 14:01:01 +01:00
Marc Bonnici
5afc96dc4d workloads/pcmark: Fix reading results in python3 
Ensure that the results file is decoded when using python3.
 2018-08-14 13:39:04 +01:00
Marc Bonnici
039758948e workloads/androbench: Update uiauto apk with fix 2018-07-11 17:32:08 +01:00
Marc Bonnici
86dcfbf595 workloads/androbench: Fix Formatting 2018-07-10 15:57:18 +01:00
Marc Bonnici
1b58390ff5 workloads/androbench: Fix for devices running Android 8.1 
On some devices running Android 8.1 the start benchmark button was
failing to be clicked, this is a workaround to click on the coordinates
of the button instead of the UiObject iteslf.
 2018-07-10 15:57:18 +01:00
Sergei Trofimov
c410d2e1a1 I lint, therefore I am 
Implement fixes for the most recent pylint version.
 2018-07-09 15:59:40 +01:00
Marc Bonnici
925bc8b719 wa: pep8 fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
9b2bc1369c wa/workloads: pylint fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
6e94cbd36b wa/workloads: pep8 fixes 2018-07-06 14:39:41 +01:00
Sergei Trofimov
8878cc20d4 Update copyright headers. 
- Add copyright headers to files that did not already have them
- Update the year to the last year the file was modified in files with
  existing headers.
 2018-07-04 16:33:31 +01:00
Marc Bonnici
c9ff15ca53 wa/workloads: Fix missing imports 2018-07-04 16:33:08 +01:00
Marc Bonnici
60b37995e0 workloads/jankbench: Update to check if running in a container. 
Instead of using the os to determine whether the screen state should
be checked, use target flag to see if running inside a container.
 2018-07-02 10:59:18 +01:00
scott
68e7fc0b99 workloads: fix mongoperf 
Mongoperf currently has a non-ASCII character in the file that causes a failure.

This commit rewords the description to remove the incriminating character.
 2018-07-02 10:02:01 +01:00
Marc Bonnici
edfbee291b workloads/jankbench: Fix typo in method name 
Fix incorrect method name.
 2018-06-29 17:25:09 +01:00
Marc Bonnici
04cbf51a15 workloads/jankbench: Fix screen state for ChromeOS 
We cannot currently determine the screen state from cannot android
containter so only check on android systems.
 2018-06-29 17:25:09 +01:00
Marc Bonnici
d016318a32 workloads: Bump known working version of workloads. 2018-06-29 14:46:16 +01:00
Sergei Trofimov
c69a0f69e6 workloads: add mongoperf 
Add a workload that runs mongoperf benchmark that measures I/O
performance on a MongoDB server. This workload assumes that mongoperf
is already installed.
 2018-06-29 12:39:36 +01:00
Sergei Trofimov
d3872716ed workloads/deepbench: lengthen timeout 
Lengthen timeout for gemm and conv tests to be the same as for sparse
test. While the former two usually take a lot less time, their execution
time will vary significantly depending on the target and the runtime
environment (e.g. cpu frequencies might be forced to lowest values).
 2018-06-27 10:24:57 +01:00
Sergei Trofimov
3c0f1968c5 workloads/apache: fix for Python 3 
urllib2 does not exist in Python 3, and its methods have been moved into
urllib.request. Use future library to create aliases that work across
both 2 and 3.
 2018-06-26 09:55:29 +01:00
Sergei Trofimov
af95b5c990 workloads/lmbench: doc fix 
Add missing blank lines around the URL indent block.
 2018-06-25 17:11:47 +01:00
scott
29174912dd workloads: add lmbench 
Add a workload for lat_mem_rd and bw_mem tests of LMbench benchmark, a suite of
portable ANSI/C microbenchmarks for UNIX/POSIX.

This is a port of corresponding workload from WA2.
 2018-06-25 14:52:22 +01:00
scott
3b322a36c9 Speedometer: Changing workload to use Speedometer 2.0 by default 2018-06-22 14:55:39 +01:00
Joe Savage
f05a64ef95 workloads/googlemaps: Add googlemaps workload 2018-06-20 17:23:49 +01:00
Sergei Trofimov
35f644ba76 workloads/chrome: fix docs 
- Escape asterisk (otherwise, it is interpreted as "open emphasis")
- Use monospace formatting for paths.
- Trim to 79 columns wide
 2018-06-20 17:01:48 +01:00
Marc Bonnici
b85665fa12 workloads/androbench: Fix directory structure 
Correct the location of the UiAutomator code from `adobereader` to
`androbench`.
 2018-06-20 16:39:07 +01:00
Marc Bonnici
d6c853ce59 workloads: Fix incorrect attribute name 
Correct setting of attribute `clean_assets` to `cleanup_assets`
 2018-06-20 14:39:40 +01:00
Joe Savage
9e9c84958d workloads/chrome: Add chrome workload 2018-06-18 12:04:25 +01:00
Sergei Trofimov
67631cfa6d workloads: add apache benchmark 
Add a benchmark that load-tests Apache server installed on the target.
 2018-06-18 10:55:44 +01:00
Joe Savage
915465c744 workloads/gmail: Add offline mode 2018-06-18 10:51:32 +01:00
scott
ce6ea663a3 Youtube: Updating to reflect changes in accessing options menu 2018-06-14 15:08:09 +01:00
Sergei Trofimov
d64ab6f099 workloads: add deepbench 
Add automation for Baidu's DeepBench benchmark for deep learning
operations.
 2018-06-14 12:31:43 +01:00
scott
503005ba5f Googleplaybooks: Adding support for night reading dialogues. 
Certain devices present a night time reading popup alert when opening the books workload.
This can throw off the workload so I've added a function to check for this and dismiss if neccessary.
 2018-06-12 22:54:43 +01:00
Sergei Trofimov
b3de85455a Add support for Python 3 
Add support for running under Python 3, while maintaining compatibility
with Python 2.

See http://python-future.org/compatible_idioms.html for more details
behind these changes.
 2018-06-07 14:48:40 +01:00
Sergei Trofimov
ec9605603e workloads/openssl: save binary's hash and version 
Store the hash and the version of the openssl executable used by the
workload in the result metadata.
 2018-05-25 10:21:06 +01:00
Sergei Trofimov
2ff06af632 fw/execution: record resource hashes in metadata 
As part of resolving a resource, record its MD5 hash in the output
metadata. In order to enable this, resource resolution is now done via
the context, rather than directly via the ResourceResolver (in order not
to introduce a context dependency in the Gui object, context now
emulates the resolver interface).
 2018-05-25 10:21:06 +01:00
Sergei Trofimov
ffdb6235c9 workloads: add openssl 
Add a workload that runs openssl's speed command to benchmark the
performance of various openssl algorithms.
 2018-05-23 14:51:54 +01:00
Marc Bonnici
04fe3768af doc: Misc fixes 
Fix typos, formatting and irrelevant information.
 2018-05-21 10:26:28 +01:00
Marc Bonnici
52b2df427e doc/show_cmd: Reword description and add settings option 2018-05-21 10:26:28 +01:00
Sergei Trofimov
b1b2131b0c doc: fix build warnings 2018-05-18 10:32:08 +01:00
scott
3f7f0b38f5 PCMark: Porting to WA3 2018-05-15 16:09:38 +01:00
Marc Bonnici
6754ecd6d7 wa/workloads: Update to consistently use timeout parameter 2018-05-14 17:07:49 +01:00
Marc Bonnici
a23c896647 wa/workloads: Update to use threads parameter 
Update workloads to use `threads` parameter to try and keep
configuration more consistent across workloads.
 2018-05-14 17:07:49 +01:00
Marc Bonnici
47ec0c7720 workloads/meabo: Update parameter names to be more consistent 
Rename `nrow` and `ncol` to `num_rows` and `num_cols` respectively to be
more consistent with the other parameter names.
 2018-05-14 17:07:49 +01:00
Marc Bonnici
6f5fca36df wa/workloads: Change to use 'loops' parameter. 
Change to consistently use 'loops' parameter instead of 'iterations'
etc.
 2018-05-14 17:07:49 +01:00
Marc Bonnici
8d7d32d180 wa/workloads: Update to use new cpu_mask type 
Update workloads that allow for specifying which cpus to be ran on to
all use the same interface while maintaining backwards compatibility with
the existing configuration options.
 2018-05-14 17:07:49 +01:00
Marc Bonnici
f4b47bf65a Fix typos 2018-04-30 09:14:11 +01:00