1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-01-19 04:21:17 +00:00

948 Commits

Author SHA1 Message Date
Brendan Jackman
0656e61bc2 Geekbench: Add support for Corporate version
The Corporate version is a specialised version of Geekbench. It has
different package names and does not require dismissing a EULA. The
new corporate version is added as a distinct
benchmark ("geekbench-corporate" vs "geekbench").

Note that this changes the wait-for-results UiAutomator snippet from
looking for "Running Benchmarks..." to "*Running*". This is because
the version I've tested updates the text widget with the name of each
benchmark phase as it is run. However I don't know if this is a
feature of the Corporate version or simply of Geekbench 4.1.0.
2017-07-04 18:05:20 +01:00
setrofim
4d7ef408c9 Merge pull request #429 from bjackman/remove-cpufreq-interactive
trace-cmd: remove cpufreq_interactive from default events
2017-07-04 13:23:33 +01:00
Brendan Jackman
a533680e49 trace-cmd: remove cpufreq_interactive from default events
The interactive governor isn't standard any more (and was
Android-only anyway). Remove this default so you don't get errors for
kernels that don't support it.
2017-07-04 12:15:18 +01:00
Sergei Trofimov
4ddb6f44fc geekbench: correct v3 version number
Current APK discovery rules will match against full APK version string,
so must be "3.0.0" rather than just "3".
2017-07-03 17:50:44 +01:00
Sergei Trofimov
1238cb71f0 ssh: raise correct error on EOF
Raise DeviceError, rather than TargetError, on EOF inside ssh_get_shell.
This is a fix for an issue introduced by a devlib backport in 51db53d9.
2017-07-03 11:01:11 +01:00
Sergei Trofimov
11859af894 AndroidDevice: more robust getprop parsing
Ran into a development target on which one of the values in getprop
output contained a new line. Updating getprop parsing logic to handle
such cases by switching to a regex.
2017-06-28 17:05:47 +01:00
Sergei Trofimov
52a07160b9 acmecape: echo command that is going to be used 2017-06-28 11:49:20 +01:00
Sergei Trofimov
a47d6c6521 ApkWorkload: only uninstall if package is already installed
Attempting to uninstall an non-existing package will result in an error.
So, when replace=True for install_apk(), only attempt to uninstall if
the package is already present on the target.
2017-06-22 14:31:25 +01:00
Anthony Barbier
e42099851b Fixed missing comma in list 2017-06-21 16:41:12 +01:00
Sergei Trofimov
486494f1f2 cpustates: workaround for disabled cpuidle
Add "no_idle" parameter to work around the problem where cores are
reported to be in "unknown" state if there are no cpuidle transitions in
the trace. If this parameter is set, cpustates will assume cores are
active without waiting for an idle transition.
2017-06-21 15:30:43 +01:00
Sergei Trofimov
4f09c3118a Revert "cpustates: fix idle state assumption on freq transition"
This reverts commit 9bd745b347ef1a18a8b46a07cf5fa6dd3af642f8.

When a frequency is changed on a core, cpufreq reports a frequency
transition for all cores in the frequency domain. This means it is not
safe to assume a core is not idling just because there is a frequency
transition reported for it (that just means that there is at least one
core on that frequency domain that is not idling). Moreover, the
transitions are always reported in the same order so there is no way to
infer which core triggered it.
2017-06-21 14:13:24 +01:00
setrofim
b6b1b259dc Merge pull request #410 from setrofim/acmecape
instrumetnation: add support for BayLibre ACME cape
2017-06-21 09:30:47 +01:00
marcbonnici
f1b63b239c Merge pull request #415 from setrofim/master
cpustates: fix idle state assumption on freq transition
2017-06-20 16:03:36 +01:00
setrofim
797cb3c9ea Merge pull request #414 from marcbonnici/uiauto_install
AndroidWorkload: Uninstall uiauto apks before reinstalling
2017-06-20 15:58:42 +01:00
Sergei Trofimov
9bd745b347 cpustates: fix idle state assumption on freq transition
If a frequency transition is observed before an idle state can be
established, assume idle state is -1 (i.e. the core is running). This
will ensure correct stats for platforms with disabled cpuidle.
2017-06-20 15:48:51 +01:00
Marc Bonnici
9f3ecd3715 AndroidWorkload: Uninstall uiauto apks before reinstalling
Due to the fact that uiauto apk files built on different machines will
be signed with different keys, adb will fail to overwrite a previous
version even when set to replace. This commit now will uninstall the
previous uiauto apk file if present before attempting to install the new
version.
2017-06-20 15:19:19 +01:00
Michael McGeagh
4010618631 Skype: Change timeout value for endcall
New override function added which uses uiAutoTimeout if no timeout value
has been specified.
Checking against the endcall button now uses this method.

Tested on a Huawei Mate 8 Device with just core 0 enabled (slowing it
down enough that the previous timeout of 0.5s caused the workload to
fail)
2017-06-20 15:01:05 +01:00
setrofim
1168c1ada8 Merge pull request #412 from marcbonnici/googleslides
GoogleSlides and Books Fixes
2017-06-20 10:35:09 +01:00
Marc Bonnici
8b7db92ab8 Googleslides: Fixes images not being found on some chromebooks.
On some chromebooks the "images" tab does not appear when attempting to
insert an image, instead the desired image needs to be found via local
storage.
2017-06-20 10:04:13 +01:00
Marc Bonnici
088102a81d GooglePlayBooks: Fixes
Updated to add in workarounds for cases where the workload would fail to
find elements correctly.
2017-06-19 16:33:49 +01:00
Sergei Trofimov
87ce1fd0ae instrumentation: add support for BayLibre ACME cape
Add an instrument for collecting power and energy from BayLibre
ACME cape probe.
2017-06-16 11:32:14 +01:00
Marc Bonnici
4fac39ada9 GoogleSlides: Fixed bug where settings could not be opened
For some reason although the settings element could be found, clicking
on it did not have the desired effect, to solve this the element has
been found as a UiObject2 instead.
2017-06-15 17:22:57 +01:00
setrofim
81fa5fdf81 Merge pull request #411 from bjackman/gfxinfo-ignore-extra-fields
fps: Ignore additional fields in gfxinfo frame data
2017-06-15 15:47:03 +01:00
Brendan Jackman
2702731532 fps: Ignore additional fields in gfxinfo frame data
Some versions of Android include additional fields in gfinxo which we
don't care about. The existing fields have the same order, so simply
ignore the extra ones.
2017-06-15 15:20:12 +01:00
Marc Bonnici
8acebe12bd Workload: Increased default uiautomator workload timeout
After the upgrade to uiauto2 some workloads seem to take slightly longer
than previously.
2017-06-15 11:23:38 +01:00
Anthony Barbier
ff67ed1697 Replaced active_cpus by online_cpus in common/linux/device.py 2017-06-14 14:25:17 +01:00
Sergei Trofimov
51db53d979 ssh: Back-port ssh_get_shell from devlib
This back-ports ssh_get_shell implementation from devlib. It includes
the following changes:

- original_prompt for Telnet verison of the connection can now be passed
  as an argument.
- Multiple attempts to connect with a timeout.
- Some additional implementation to the tty, including setting the size.
2017-06-13 09:14:26 +01:00
Marc Bonnici
8e94b79ed8 LinuxDevice: Now raises an error if trying to hotplug all cores.
Previously this would try to automatically enable an additional core to ensure
that all cores were not hot-plugged, however it would do this unnecessarily if
another core that wasn't the first of its types was already online.
2017-06-12 17:56:06 +01:00
Marc Bonnici
37d99e4a5d LinuxDevice: Remove duplicate method and rename for consistency
These function were duplicated of each other so one has been removed and the
remaining methods renamed for consistency with WA terminology and the relevant
calls updated.
2017-06-12 17:27:21 +01:00
Marc Bonnici
64574b1d4c EntryPoint: Fixes local package being used over system level
Due to a local file named 'signal.py' this was being imported instead of the system level 'signal' package. This commit ensures the the system level is used instead.
2017-06-09 11:10:44 +01:00
setrofim
3653e1b507 Merge pull request #403 from marcbonnici/uiauto2
Uiauto2 - Fixes
2017-06-08 17:52:38 +01:00
Marc Bonnici
e62262dbb3 Uiauto2 Workloads: Fixes applaunch bug in androind N
In order to workaround an bug in applaunch running on android N, all of the
workloads have been updated to the latest gradle build system, the timeout in
the baseclass has been changed from a TimeUnit to a regualr long and a
duplicately declared parameter bundle has been removed.
2017-06-08 16:55:47 +01:00
Marc Bonnici
18e47c89c5 Skype: Fixes launch command for intrumented testing.
Without specifying user `-3' for the launch command, the application is by default
attempted to be launched with permissions that are only grantable to system
apps.
2017-06-08 16:55:41 +01:00
Anthony Barbier
260e9563b3 Convert TERM signals into INT to allow WA to exit cleanly 2017-06-08 14:09:15 +01:00
Marc Bonnici
b64c615e8e Uiauto2: Fixes leftover references to .uiautoapk 2017-06-08 11:23:45 +01:00
Marc Bonnici
242cf7e33a Revert "Android Device: Add force flag to install_apk"
This reverts commit 5d8305cfdc3f15635d50dfd295f3df6370c8a48d.
2017-06-05 17:00:40 +01:00
Marc Bonnici
cc641e8dac UiautoWorkloads: Updated to use apk files for uiautoamtion tests. 2017-06-05 17:00:40 +01:00
Marc Bonnici
bb17590689 ResourceGetter: Updated to check if an apk is a uiautomation test apk.
The getter now checks the apk package name to distinguish between a regular
android apk and a uiautomator apk.
2017-06-05 17:00:40 +01:00
Marc Bonnici
4ce38fcd55 Revert "ResourceGetters: Added support for finding uiautoapk files."
This reverts commit b948d28c6296cbeb57060d66415f3948887feced.
2017-06-05 16:55:47 +01:00
Marc Bonnici
bf694ffdf1 Revert "AndroidResource: Add a UiautoApk resource type."
This reverts commit bc6af25366aacf394f96b5a93008109904a89e93.
2017-06-05 16:55:47 +01:00
Marc Bonnici
b36e0061e1 AndroidWorkload: Updated to use an 'APK' file instead of a 'uiautoapk' 2017-06-05 16:55:47 +01:00
Marc Bonnici
526ad15c01 AndroidResource: Updated APKFile to add support for uiautomator tests.
In newer versions of adb, files cannot be installed unless they use the
`.apk` extension therefore we need to be able to distinguish between
regular apks and instrumented test files.
2017-06-05 16:55:38 +01:00
Sergei Trofimov
0694ab6792 LinuxDevice: rename get_number_of_online_cpus arg
Renamed "c" to "core", as that gets passed as a keyword argument inside
get_runtime_parameters().
2017-06-01 14:29:19 +01:00
setrofim
2fd7614d97 Merge pull request #392 from marcbonnici/uiauto2
Upgrading to UiAutomator2
2017-05-31 11:22:45 +01:00
Sergei Trofimov
c86ce64408 utils/trace_cmd: add parsers for more sched events
Added parsers for sched_wakeup(_new) and sched_stat_* events that have
non-standard text.
2017-05-31 10:42:55 +01:00
Marc Bonnici
d6909c5e6a PowerUtils: Pylint Fix 2017-05-31 10:36:38 +01:00
Marc Bonnici
55e140f20a Caffeinemark: Updated to Uiautomator2 2017-05-31 10:36:38 +01:00
Marc Bonnici
0c7a7e4dca BenchmarkPi: Updated to uiautomator2 2017-05-31 10:36:38 +01:00
Marc Bonnici
a7ed00d9ed Googleslides: Add workaround for opening navigation drawer
On Android N running under the instrumentation uiautomator appears to have
trouble retrieving the root node for the home screen of google slides. Therefore
we open the navigation drawer via a swipe which allows the node to be found again.
2017-05-31 10:36:38 +01:00
Marc Bonnici
89aa3e1208 GoogleSlides: Updated to uiautomator2
The latest version of uiautomator2 seems to have an issue with google slides not
being able to interact with any elements on the slide therefore we are using a
slightly older version which doesn't have this issue.
2017-05-31 10:36:38 +01:00