1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-03-14 22:58:34 +00:00

621 Commits

Author SHA1 Message Date
James Hartley
5d0f676033 More fixes to Reader/Gmail/Photos to improve reliability across devices 2016-05-05 22:22:10 +01:00
johnrchrdsn
44f99dcc79 Merge pull request #4 from jimboatarm/develop
Fixes for Reader/Gmail/Photos
2016-05-05 11:32:52 +01:00
James Hartley
d77b29165f Fixes for Reader/Gmail/Photos
Check in missing UiAutomation .class files
Fix generation and deletion of dump sys logs including renaming to a standard [test tag]_[test number].log format
Improved Reader to run across a range of devices with subtlety different layouts and views
2016-05-05 11:21:31 +01:00
jimboatarm
4dce709cd1 Merge pull request #2 from jimboatarm/googlephotos
Googlephotos productivity workload
2016-05-04 13:21:53 +01:00
John Richardson
31cf06b62a Extended BaseUiAutomation and UxPerfUiAutomation
Moved common functionality to base classes for code reuse. Refactored
googlephotos, reader and gmail workloads to take advantage of the new
base class methods and removed total test time metric.

New methods for BaseUiAutomation:
uiDeviceVertPinchIn, uiDeviceVertPinchOut

New methods for UxPerfUiAutomation:
uiObjectVertPinchTest, writeResultsToFile, startDumpsysSurfaceFlinger,
startDumpsysSurfaceFlinger, startDumpsysGfxInfo, stopDumpsysGfxInfo

New class for UxPerfUiAutomation:
GestureTestParams
2016-05-04 11:56:06 +01:00
John Richardson
c2a68074be Googlephotos productivity workload
A new workload to perform standard productivity tasks within
Googlephotos. Each user event/step is timed and reported back as a
metric. Dumpsys also captures SurfaceFlinger logs for each event for
post analysis.
2016-05-04 11:49:04 +01:00
James Hartley
e1827ffde2 Tidy up Reader timing instrumentation and fix build error 2016-05-03 18:16:17 +01:00
James Hartley
091e1054ab Fix Gmail workload to run across more devices
Changes to deal with subtle differences in layouts between tablets and handsets.
Stop pushing files to he Camera directory for test purposes.
2016-05-03 18:14:59 +01:00
James Hartley
8e66616159 Add clickUiObject to BaseUiAutomation
Convenience method to click on o UiObject and throw an exception if the view does not change within a specified timeout.
2016-05-03 18:13:03 +01:00
James Hartley
73a54103e1 Update Gmail workload to attached images to sample email
Adds 5 image files to the email before sending.
2016-04-28 21:36:05 +01:00
James Hartley
b0d0a19bf0 Reader productivity workload
A new workload to perform standard productivity tasks within Reader. Each user event/step is timed and reported back as a metric.  Dumpsys also captures SurfaceFlinger logs for each event for post analysis.
2016-04-28 13:13:36 +01:00
James Hartley
cc2280a317 Gmail productivity workload
A new workload to perform standard productivity tasks within Gmail.  Each user event/step is timed and reported back as a metric.
2016-04-28 13:03:03 +01:00
James Hartley
d01f338a1d Add UxPerfUiAutomation class
This extends on BaseUiAutomation to include Ux performance instrumentation and UiAutomation convenience classes.

Todo - extend the create workload infrastructure to allow you to create a new UxPerfUiAutomation workload.
2016-04-28 13:00:02 +01:00
James Hartley
5702a145ef Extend uiauto build script to copy all dependant classes
This allows the addition of more uiauto related classes beyond BaseUiAutomation.
2016-04-28 11:45:49 +01:00
James Hartley
16ba611789 Add more convenience methods to BaseUiAutomation.
These additions make it easier to get UiObjects and perform UiDevice based gestures when writing UiAutomation workloads
2016-04-26 17:54:49 +01:00
James Hartley
73c8ca86a3 Update BaseUiAutomator class to API level 18
The change will allow us to use UiAutomator methods introduced in API 18, such as resourceId.
As a consequence of the change all dependent uiauto workloads have been incremented also.

Tested by rebuilding all uiautomator workloads. They were not run on devices.
2016-04-26 17:50:29 +01:00
setrofim
6c4d88ff57 Merge pull request #147 from setrofim/master
create command: fix example parameter name in templates
2016-04-20 14:45:16 +01:00
Sergei Trofimov
a40542d57b create command: fix example parameter name in templates
Parameter name in workload templates updated to be a valid identifier.
2016-04-20 14:43:07 +01:00
Sergei Trofimov
697aefc7bb ApkWorkload: clear app data on failed uninstall.
If uninstall fails, "pm clear" should be called to make sure that the
next time the app is launched it starts from a known state (which would
normally be ensured by the uninstall).
2016-04-19 16:43:42 +01:00
Sergei Trofimov
8bc71bb810 ApkWorkload: report correct apk verison on failed install
It's possible that there is already a version of an app on target that
differs form the version of the apk on the host. In such cases, WA will
usually try to uninstall the target version and install the host
version.

It's possible that the uninstall may fail. If that happens, it will be
reported as a warning but workload exectuion will proceed with the
target version. In this case, apk_version would have already been set to
that of the host apk. This change ensures that the APK version is
correctly set to the target version (the one that actually ran).
2016-04-19 16:33:37 +01:00
Sebastian Goscik
91210f26e9 RunCommand: WA no longer runs with no workloads specs
Previously if no worklaod specs were loaded, WA would still start instruments
and then go immediately to the teardown stage. This no longer happens.
2016-04-19 16:32:53 +01:00
Sergei Trofimov
44a49db04d glbcorp: pep8 fix
Added a missing blank line between method declaration and class
attribute definitions.
2016-04-15 16:39:24 +01:00
setrofim
0bfa4bff3c Merge pull request #142 from ep1cman/master
glbench updates
2016-04-14 16:41:26 +01:00
Sebastian Goscik
73aa590056 glbench: renamed start_activity to launch_package
To match changes made in: ff5f48b7e70117dc4161f2bd986438450f73cc16
2016-04-14 16:36:37 +01:00
Sebastian Goscik
985b249a24 glbench: Fixed ending regex
Updated the regex that detected the end of the benchmark to match the new
logcat format.
2016-04-14 16:36:37 +01:00
Sebastian Goscik
f5e138bed0 Merge pull request #141 from setrofim/master
boostrap: nicer error messages on config parasing.
2016-04-14 16:22:10 +01:00
Sergei Trofimov
b6c0e2e4fd boostrap: nicer error messages on config parasing.
- handle ValueError as well as SyntaxError from config parser
- Report source file in the error message
2016-04-14 16:18:31 +01:00
Sebastian Goscik
df8ef6be6b Merge pull request #133 from mcgeagh/uxperf
CpuUtilisationTimeline added. This now will generate cpu utilisation …
2016-04-14 14:05:58 +01:00
Michael McGeagh
8a3186e1c8 CpuUtilisationTimeline added. This now will generate cpu utilisation based on frequencies and a number of samples
Fixed error in percentage when frequency is 'None'. Now default to 0 in these cases

cpu_utilisation is now a separate parameter in cpustate. Now generates a floating point number representing the utilisation based on the maximum frequency of the capture. No longer performs averaging of values, this can be done as a post-processing step

cpu utilisation now based on the max cpu freq per core, not max captured freq overall
2016-04-14 14:03:28 +01:00
Sebastian Goscik
68043f2a52 Merge pull request #138 from mcgeagh/fps-allviews
fps: Can now process multiple 'view' attributes
2016-04-14 13:57:28 +01:00
Michael McGeagh
95bbce77a2 fps: Can now process multiple 'view' attributes 2016-04-14 13:12:39 +01:00
Sebastian Goscik
ec85f9f8a0 Merge pull request #140 from setrofim/master
ApkWorkload: add package verison to the result as a classifer.
2016-04-14 11:35:49 +01:00
Sergei Trofimov
82e4998092 Deprecating apk_version instrument. 2016-04-14 11:33:54 +01:00
Sergei Trofimov
48259d872b ApkWorkload: add package verison to the result as a classifer. 2016-04-14 11:23:39 +01:00
setrofim
8d13e1f341 Merge pull request #128 from ep1cman/glbench_logcat_fix
glbench: Fixed updated logcat format
2016-04-13 16:46:09 +01:00
Sebastian Goscik
33ef949507 Merge pull request #135 from mcgeagh/fps-fix
Only check for crashed content if crash_check is true.
2016-04-11 13:38:18 +01:00
Michael McGeagh
68714e0e55 fps: Only check for crashed content if crash_check is true. 2016-04-11 12:01:12 +01:00
setrofim
9ee1666a76 Merge pull request #131 from ep1cman/master
SysfsExtractor & Busybox fixes
2016-04-07 10:31:31 +01:00
Sebastian Goscik
8dcdc9afe1 busybox: Rebuilt busybox binaries to prefer applets over system binaries
Busybox will now prefer to use its own built in applets before it tries
using the system binaries so that we are always running commands as expected.
2016-04-07 10:29:13 +01:00
Sebastian Goscik
724f6e590e SysfsExtractor: Now performs tar and gzip separately
On some devices there were permissions issues when trying to tar and gzip
the temp-fs in one command. These two steps are now done separately.
2016-04-07 10:29:13 +01:00
Sebastian Goscik
507090515b Merge pull request #134 from jimboatarm/master
Fix to install APKs with whitespace in their path name
2016-04-06 10:56:58 +01:00
James Hartley
1dfbe9e44c Fix to install APKs with whitespace in their path name 2016-04-06 10:53:08 +01:00
setrofim
d303ab2b50 Merge pull request #132 from ep1cman/artem
ADB 1.0.35 support
2016-04-05 16:05:16 +01:00
Sebastian Goscik
b17ae78d6b adb_shell: Now handles return codes from ADB
As of ADB 1.0.35/Android N, it will return the exit code of the command that it runs
This code handles this scenario as before WA treated a return code from ADB as an
error with ADB.
2016-04-05 15:53:41 +01:00
Sergei Trofimov
391b0b01fc pylint/pep8 fixes
- android/workload: emoved an extra bank line between methods
- trace_cmd: define member attribute inside __init__
- adb_shell: ignore pylint warning about too many branches in this case
2016-04-05 11:36:39 +01:00
setrofim
20861f0ee4 Merge pull request #130 from jimboatarm/master
Fix for packages without launch activities
2016-04-05 11:00:50 +01:00
James Hartley
ff5f48b7e7 Fix for packages without launch activities
If the package has no defined launch activity you must call the
activity manager in a different way.
2016-04-05 10:24:42 +01:00
Sebastian Goscik
9a301175b0 glbench: Fixed updated logcat format
The old results looked like:
I/TfwActivity(30824):    "description": "",
I/TfwActivity(30824):    "elapsed_time": 62070,
I/TfwActivity(30824):    "error": "NOERROR",

The new format is:
04-04 11:38:04.144  1410  1410 I TfwActivity:    "description": "",
04-04 11:38:04.144  1410  1410 I TfwActivity:    "elapsed_time": 62009,
04-04 11:38:04.144  1410  1410 I TfwActivity:    "error": "NOERROR",
2016-04-04 17:33:48 +01:00
setrofim
712c79020d Merge pull request #126 from ep1cman/master
ResourceResolver: Show version number when resource wasn't found.
2016-03-30 11:05:21 +01:00
Sebastian Goscik
12dfbef76b ResourceResolver: Show version number when resource wasn't found.
If the ResourceResolver was looking for a specific version of a
resource and could not find it, this version number is now shown
in the error message.
2016-03-30 11:01:35 +01:00