1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 19:01:15 +01:00
Commit Graph

180 Commits

Author SHA1 Message Date
Marc Bonnici
536fc7eb92 workloads/stress_ng: Update to use WA's yaml wrapper 2019-03-04 15:50:13 +00:00
Marc Bonnici
1415f61e36 workloads/chrome: Fix for tablet devices
Some tablet devices use an alternate tab switching method due to the
larger screen space. Add support for adding new tabs via the menu
instead of via the tab switcher.
2019-02-08 14:32:58 +00:00
Marc Bonnici
6ab1ae74a6 wa/apk_workloads: Update to not specify a default apk version.
No longer specify a default version to allow any available apks to be
detected and then choose the appropriate automation based on the
detected version.
Refactor to support new supported_versions attribute and since APK
resolution needs to have happened before setting uiauto parameter
move assignments to ``initialize``.
2019-02-08 13:56:55 +00:00
Marc Bonnici
a2087ea467 workloads/manual: Fix incorrect attribute used to access target 2019-01-30 15:46:54 +00:00
Marc Bonnici
8770888685 workloads/googleslides: Misc Fixes:
- Move the slide editing test into the main runWorkload instead of
setup.
- On some devices the folder picker has changed layout so add support for
navigating.
- Add support for differently capitalized splash buttons.
- Add workaround for adding a new slide if click the button doesn't work
the first time.
2018-12-21 14:26:55 +00:00
Marc Bonnici
755417f139 workloads/speedometer: Misc Fixes
- Fix formatting
- Skip teardown automation if elements are not present on some devices
instead of failing the workload.
- Give extra time for start button to appear as some devices can be slow
to load.
2018-12-21 14:26:55 +00:00
Marc Bonnici
ba4004db5f workloads/googlemaps: Fix for alternative layouts.
Add additional check for text based directions button as id can be
missing on some devices and allow for skipping the view steps stage for
large screen devices which do not require this step.
2018-12-21 14:26:55 +00:00
Marc Bonnici
87ac9c6ab3 workloads/androbench: Fix extracting benchmark results
On some devices the entire results page fits on one screen and does not
present a scrollable element, therefore only attempt to scroll if
available.
2018-12-21 14:26:55 +00:00
Marc Bonnici
d3d5ca9154 workloads/glbench: Port workload to WA3 2018-11-23 17:24:41 +00:00
Marc Bonnici
285bc2cd0b workloads/gfxbench: Move test selection into setup phase
Previously the configuration of the tests was performed in the run stage
instead of the setup.
2018-11-20 10:10:19 +00:00
Marc Bonnici
0d9dbe8845 workloads/gfxbench: Fix clicking on select tests
The X coordinate was miscalculated when attempting to load the test
selection menu.
2018-11-20 10:10:19 +00:00
Marc Bonnici
c89ea9875e workloads/gfxbench: Fix parameter description 2018-11-20 10:10:19 +00:00
Marc Bonnici
e4283729c1 workloads/gfxbenchmark: Fix score matching
On some devices the score string obtained can contain extra characters.
Only use the numerical values from the score when converting, otherwise
if not found set the result to 'NaN'.
2018-11-20 10:10:19 +00:00
scott
3bd8f033d5 workloads: Updating geekbench to support v4.3.1
v4.3.1 has made a minor change to the run cpu benchmark element.
Refactoring to support both the new and previous elements.
2018-11-15 15:56:09 +00:00
Marc Bonnici
ea1d4e9071 workloads/gfxbench: Do not clear package data on launch
By clearing the application data each time the workload is run this
forces the required assets to be re-installed each time. As the
workload is not affected by persistent state do not perform the
clearing.
2018-11-15 07:54:43 +00:00
Marc Bonnici
1b4fc68542 workloads/gfxbench: Fix formatting 2018-11-13 13:06:54 +00:00
Marc Bonnici
e40517ab95 workloads/gfxbench: Fix not detecting missing asset popup
Add check for a differently worded popup informing that assets are
missing.
2018-11-13 13:06:54 +00:00
Marc Bonnici
6b04cbffd2 worklods: Fix whitespace 2018-10-24 10:34:44 +01:00
Marc Bonnici
dead312ff7 workloads/uiauto: Update workloads to dismiss android version warning
Update workloads that use uiautomator and can display a warning about
using an old version of the app to dismiss the popup if present.
2018-10-24 10:34:44 +01:00
Lisa Nguyen
8f6b1a7fae workloads/vellamo: Close warning popup message to run on Android Q
While attempting to run vellamo on Android Q, a popup warning with
the message, "This app was built for an older version of Android and may not
work properly. Try checking for updates, or contact the developer." would
appear, causing the workload to halt.

Close the popup warning before dismissing EULA and executing the remaining
steps to run vellamo.

Tested with vellamo apk version 3.2.4.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
2018-10-23 10:17:45 +01:00
Marc Bonnici
7dce0fb208 workloads/jankbench: Ensure logcat monitor thread is terminated
Previously the LogcatRunMonitor left the logcat process running in the
background causing issues with concurrent accesses. Now ensure the thread
terminates correctly.
2018-10-12 13:41:21 +01:00
Marc Bonnici
93ffe0434c workloads/meabo: Support python 3
Ensure output is encoded correctly if running with python 3
2018-10-05 10:10:43 +01:00
Marc Bonnici
75f3080c9b workloads: Use uninstall method instead of uninstall_executable
For workloads that support Linux targets do not use
`uninstall_executable` as this is not available, instead use `uninstall` as
other targets should be able to determine the appropriate uninstallation
method.
2018-10-05 10:10:43 +01:00
Marc Bonnici
75c0e40bb0 workloads/androbench: Fix extracting results with small resolutions
Previously the workload assumed that all the scores were visible on a
single screen however for devices with smaller displays the results need
to scrolled.
2018-10-03 14:33:09 +01:00
Qais Yousef
e73b299fbe pcmark: update uiautomation to fix Android-Q breakage
A new popup appears when running pcmark on android Q that complains
about the app being built for an older version of android.

Since this popup will be temporary, the fix has to make sure not to
break in the future when this popup disappears or when the test is ran
on a compatible version of android.

To achieve this, we attempt to dismiss the popup and if we timeout we
silently carry on with the test assuming no popup will appear.

Signed-off-by: Qais Yousef <qais.yousef@arm.com>
2018-10-01 16:12:05 +01:00
scott
9a4a90e0a6 GFXBench: New workload
Creating a new workload to execute the following tests on GFXBench.

* Car Chase
* Car Chase Offscreen
* Manhattan 3.1
* 1080p Manhattan 3.1 Offscreen
* 1440p Manhattan 3.1 Offscreen
* Tessellation
* Tessellation Offscreen
2018-09-25 17:27:58 +01:00
scott
8ba602cf83 Googlephotos: Updating to work with latest version
Updating the googlephotos workload to work with app version 4.0.0.212659618
2018-09-25 10:50:03 +01:00
scott
ccaca3d6d8 Speedometer: Extending teardown function
Some devices throw errors if too many browser tabs are open. Have
added a method to close down the tabs in the teardown function.
2018-09-20 10:26:34 +01:00
Marc Bonnici
ca03f21f46 workloads/jankbench: Update to clear logcat using devlib
Leftover code from WA2 meant that logcat was cleared on the device by
the workload directly instead of using devlib, this caused issues if logcat was
still being cleared from other areas of the code.
2018-09-10 13:30:59 +01:00
Marc Bonnici
59e29de285 workloads/jankbench: Replace errors during decoding
When running jankbench invalid bytes can be read from the device causing
decoding in the monitor to fail, now replace any invalid sequences.
2018-09-10 13:30:59 +01:00
scott
0440c41266 Googleslides: Updating the workload to support the new range of huawei devices 2018-09-06 18:01:24 +01:00
scott
4c4fd2a267 Gmail: Minor change to allow workload to run correctly on Huawei devices 2018-09-05 14:01:01 +01:00
Marc Bonnici
5afc96dc4d workloads/pcmark: Fix reading results in python3
Ensure that the results file is decoded when using python3.
2018-08-14 13:39:04 +01:00
Marc Bonnici
039758948e workloads/androbench: Update uiauto apk with fix 2018-07-11 17:32:08 +01:00
Marc Bonnici
86dcfbf595 workloads/androbench: Fix Formatting 2018-07-10 15:57:18 +01:00
Marc Bonnici
1b58390ff5 workloads/androbench: Fix for devices running Android 8.1
On some devices running Android 8.1 the start benchmark button was
failing to be clicked, this is a workaround to click on the coordinates
of the button instead of the UiObject iteslf.
2018-07-10 15:57:18 +01:00
Sergei Trofimov
c410d2e1a1 I lint, therefore I am
Implement fixes for the most recent pylint version.
2018-07-09 15:59:40 +01:00
Marc Bonnici
925bc8b719 wa: pep8 fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
9b2bc1369c wa/workloads: pylint fixes 2018-07-06 14:39:41 +01:00
Marc Bonnici
6e94cbd36b wa/workloads: pep8 fixes 2018-07-06 14:39:41 +01:00
Sergei Trofimov
8878cc20d4 Update copyright headers.
- Add copyright headers to files that did not already have them
- Update the year to the last year the file was modified in files with
  existing headers.
2018-07-04 16:33:31 +01:00
Marc Bonnici
c9ff15ca53 wa/workloads: Fix missing imports 2018-07-04 16:33:08 +01:00
Marc Bonnici
60b37995e0 workloads/jankbench: Update to check if running in a container.
Instead of using the os to determine whether the screen state should
be checked, use target flag to see if running inside a container.
2018-07-02 10:59:18 +01:00
scott
68e7fc0b99 workloads: fix mongoperf
Mongoperf currently has a non-ASCII character in the file that causes a failure.

This commit rewords the description to remove the incriminating character.
2018-07-02 10:02:01 +01:00
Marc Bonnici
edfbee291b workloads/jankbench: Fix typo in method name
Fix incorrect method name.
2018-06-29 17:25:09 +01:00
Marc Bonnici
04cbf51a15 workloads/jankbench: Fix screen state for ChromeOS
We cannot currently determine the screen state from cannot android
containter so only check on android systems.
2018-06-29 17:25:09 +01:00
Marc Bonnici
d016318a32 workloads: Bump known working version of workloads. 2018-06-29 14:46:16 +01:00
Sergei Trofimov
c69a0f69e6 workloads: add mongoperf
Add a workload that runs mongoperf benchmark that measures I/O
performance on a MongoDB server. This workload assumes that mongoperf
is already installed.
2018-06-29 12:39:36 +01:00
Sergei Trofimov
d3872716ed workloads/deepbench: lengthen timeout
Lengthen timeout for gemm and conv tests to be the same as for sparse
test. While the former two usually take a lot less time, their execution
time will vary significantly depending on the target and the runtime
environment (e.g. cpu frequencies might be forced to lowest values).
2018-06-27 10:24:57 +01:00
Sergei Trofimov
3c0f1968c5 workloads/apache: fix for Python 3
urllib2 does not exist in Python 3, and its methods have been moved into
urllib.request. Use future library to create aliases that work across
both 2 and 3.
2018-06-26 09:55:29 +01:00