sascha/workload-automation
1
0
Fork 0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-03-14 22:58:34 +00:00
Code Issues Releases Wiki Activity
720 Commits 5 Branches 16 Tags
Commit Graph

720 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
muendelezaji
1396c5404f Simplify metric collection 2016-05-04 09:34:44 +01:00
James Hartley
e1827ffde2 Tidy up Reader timing instrumentation and fix build error 2016-05-03 18:16:17 +01:00
James Hartley
091e1054ab Fix Gmail workload to run across more devices 
Changes to deal with subtle differences in layouts between tablets and handsets.
Stop pushing files to he Camera directory for test purposes.
 2016-05-03 18:14:59 +01:00
James Hartley
8e66616159 Add clickUiObject to BaseUiAutomation 
Convenience method to click on o UiObject and throw an exception if the view does not change within a specified timeout.
 2016-05-03 18:13:03 +01:00
muendelezaji
c65878fee4 Formatting change 2016-05-03 17:01:46 +01:00
muendelezaji
915023dfd7 Add basic instrumentation for call times 
- Also, extend UxPerfUiAutomation instead of BaseUiAutomation
 2016-05-03 16:59:46 +01:00
muendelezaji
055da519d2 Add Skype workload 
- Makes a video or voice call - actions and accounts to use
  have to be specified in agenda. See template-agenda
- Instrumentation to follow soon
 2016-05-03 14:42:17 +01:00
muendelezaji
afa580af63 ApkWorkload extension support 
- Allow disabling main activity launch in setup (required for some apps)
- Parameterise clear data on reset (default behaviour unchanged)
 2016-05-03 14:25:15 +01:00
James Hartley
73a54103e1 Update Gmail workload to attached images to sample email 
Adds 5 image files to the email before sending.
 2016-04-28 21:36:05 +01:00
James Hartley
b0d0a19bf0 Reader productivity workload 
A new workload to perform standard productivity tasks within Reader. Each user event/step is timed and reported back as a metric.  Dumpsys also captures SurfaceFlinger logs for each event for post analysis.
 2016-04-28 13:13:36 +01:00
James Hartley
cc2280a317 Gmail productivity workload 
A new workload to perform standard productivity tasks within Gmail.  Each user event/step is timed and reported back as a metric.
 2016-04-28 13:03:03 +01:00
James Hartley
d01f338a1d Add UxPerfUiAutomation class 
This extends on BaseUiAutomation to include Ux performance instrumentation and UiAutomation convenience classes.

Todo - extend the create workload infrastructure to allow you to create a new UxPerfUiAutomation workload.
 2016-04-28 13:00:02 +01:00
James Hartley
5702a145ef Extend uiauto build script to copy all dependant classes 
This allows the addition of more uiauto related classes beyond BaseUiAutomation.
 2016-04-28 11:45:49 +01:00
James Hartley
16ba611789 Add more convenience methods to BaseUiAutomation. 
These additions make it easier to get UiObjects and perform UiDevice based gestures when writing UiAutomation workloads
 2016-04-26 17:54:49 +01:00
James Hartley
73c8ca86a3 Update BaseUiAutomator class to API level 18 
The change will allow us to use UiAutomator methods introduced in API 18, such as resourceId.
As a consequence of the change all dependent uiauto workloads have been incremented also.

Tested by rebuilding all uiautomator workloads. They were not run on devices.
 2016-04-26 17:50:29 +01:00
setrofim
6c4d88ff57 Merge pull request #147 from setrofim/master 
create command: fix example parameter name in templates
 2016-04-20 14:45:16 +01:00
Sergei Trofimov
a40542d57b create command: fix example parameter name in templates 
Parameter name in workload templates updated to be a valid identifier.
 2016-04-20 14:43:07 +01:00
Sergei Trofimov
697aefc7bb ApkWorkload: clear app data on failed uninstall. 
If uninstall fails, "pm clear" should be called to make sure that the
next time the app is launched it starts from a known state (which would
normally be ensured by the uninstall).
 2016-04-19 16:43:42 +01:00
Sergei Trofimov
8bc71bb810 ApkWorkload: report correct apk verison on failed install 
It's possible that there is already a version of an app on target that
differs form the version of the apk on the host. In such cases, WA will
usually try to uninstall the target version and install the host
version.

It's possible that the uninstall may fail. If that happens, it will be
reported as a warning but workload exectuion will proceed with the
target version. In this case, apk_version would have already been set to
that of the host apk. This change ensures that the APK version is
correctly set to the target version (the one that actually ran).
 2016-04-19 16:33:37 +01:00
Sebastian Goscik
91210f26e9 RunCommand: WA no longer runs with no workloads specs 
Previously if no worklaod specs were loaded, WA would still start instruments
and then go immediately to the teardown stage. This no longer happens.
 2016-04-19 16:32:53 +01:00
Sergei Trofimov
44a49db04d glbcorp: pep8 fix 
Added a missing blank line between method declaration and class
attribute definitions.
 2016-04-15 16:39:24 +01:00
setrofim
0bfa4bff3c Merge pull request #142 from ep1cman/master 
glbench updates
 2016-04-14 16:41:26 +01:00
Sebastian Goscik
73aa590056 glbench: renamed start_activity to launch_package 
To match changes made in: ff5f48b7e70117dc4161f2bd986438450f73cc16
 2016-04-14 16:36:37 +01:00
Sebastian Goscik
985b249a24 glbench: Fixed ending regex 
Updated the regex that detected the end of the benchmark to match the new
logcat format.
 2016-04-14 16:36:37 +01:00
Sebastian Goscik
f5e138bed0 Merge pull request #141 from setrofim/master 
boostrap: nicer error messages on config parasing.
 2016-04-14 16:22:10 +01:00
Sergei Trofimov
b6c0e2e4fd boostrap: nicer error messages on config parasing. 
- handle ValueError as well as SyntaxError from config parser
- Report source file in the error message
 2016-04-14 16:18:31 +01:00
Sebastian Goscik
df8ef6be6b Merge pull request #133 from mcgeagh/uxperf 
CpuUtilisationTimeline added. This now will generate cpu utilisation …
 2016-04-14 14:05:58 +01:00
Michael McGeagh
8a3186e1c8 CpuUtilisationTimeline added. This now will generate cpu utilisation based on frequencies and a number of samples 
Fixed error in percentage when frequency is 'None'. Now default to 0 in these cases

cpu_utilisation is now a separate parameter in cpustate. Now generates a floating point number representing the utilisation based on the maximum frequency of the capture. No longer performs averaging of values, this can be done as a post-processing step

cpu utilisation now based on the max cpu freq per core, not max captured freq overall
 2016-04-14 14:03:28 +01:00
Sebastian Goscik
68043f2a52 Merge pull request #138 from mcgeagh/fps-allviews 
fps: Can now process multiple 'view' attributes
 2016-04-14 13:57:28 +01:00
Michael McGeagh
95bbce77a2 fps: Can now process multiple 'view' attributes 2016-04-14 13:12:39 +01:00
Sebastian Goscik
ec85f9f8a0 Merge pull request #140 from setrofim/master 
ApkWorkload: add package verison to the result as a classifer.
 2016-04-14 11:35:49 +01:00
Sergei Trofimov
82e4998092 Deprecating apk_version instrument. 2016-04-14 11:33:54 +01:00
Sergei Trofimov
48259d872b ApkWorkload: add package verison to the result as a classifer. 2016-04-14 11:23:39 +01:00
setrofim
8d13e1f341 Merge pull request #128 from ep1cman/glbench_logcat_fix 
glbench: Fixed updated logcat format
 2016-04-13 16:46:09 +01:00
Sebastian Goscik
33ef949507 Merge pull request #135 from mcgeagh/fps-fix 
Only check for crashed content if crash_check is true.
 2016-04-11 13:38:18 +01:00
Michael McGeagh
68714e0e55 fps: Only check for crashed content if crash_check is true. 2016-04-11 12:01:12 +01:00
setrofim
9ee1666a76 Merge pull request #131 from ep1cman/master 
SysfsExtractor & Busybox fixes
 2016-04-07 10:31:31 +01:00
Sebastian Goscik
8dcdc9afe1 busybox: Rebuilt busybox binaries to prefer applets over system binaries 
Busybox will now prefer to use its own built in applets before it tries
using the system binaries so that we are always running commands as expected.
 2016-04-07 10:29:13 +01:00
Sebastian Goscik
724f6e590e SysfsExtractor: Now performs tar and gzip separately 
On some devices there were permissions issues when trying to tar and gzip
the temp-fs in one command. These two steps are now done separately.
 2016-04-07 10:29:13 +01:00
Sebastian Goscik
507090515b Merge pull request #134 from jimboatarm/master 
Fix to install APKs with whitespace in their path name
 2016-04-06 10:56:58 +01:00
James Hartley
1dfbe9e44c Fix to install APKs with whitespace in their path name 2016-04-06 10:53:08 +01:00
setrofim
d303ab2b50 Merge pull request #132 from ep1cman/artem 
ADB 1.0.35 support
 2016-04-05 16:05:16 +01:00
Sebastian Goscik
b17ae78d6b adb_shell: Now handles return codes from ADB 
As of ADB 1.0.35/Android N, it will return the exit code of the command that it runs
This code handles this scenario as before WA treated a return code from ADB as an
error with ADB.
 2016-04-05 15:53:41 +01:00
Sergei Trofimov
391b0b01fc pylint/pep8 fixes 
- android/workload: emoved an extra bank line between methods
- trace_cmd: define member attribute inside __init__
- adb_shell: ignore pylint warning about too many branches in this case
 2016-04-05 11:36:39 +01:00
setrofim
20861f0ee4 Merge pull request #130 from jimboatarm/master 
Fix for packages without launch activities
 2016-04-05 11:00:50 +01:00
James Hartley
ff5f48b7e7 Fix for packages without launch activities 
If the package has no defined launch activity you must call the
activity manager in a different way.
 2016-04-05 10:24:42 +01:00
Sebastian Goscik
9a301175b0 glbench: Fixed updated logcat format 
The old results looked like:
I/TfwActivity(30824):    "description": "",
I/TfwActivity(30824):    "elapsed_time": 62070,
I/TfwActivity(30824):    "error": "NOERROR",

The new format is:
04-04 11:38:04.144  1410  1410 I TfwActivity:    "description": "",
04-04 11:38:04.144  1410  1410 I TfwActivity:    "elapsed_time": 62009,
04-04 11:38:04.144  1410  1410 I TfwActivity:    "error": "NOERROR",
 2016-04-04 17:33:48 +01:00
setrofim
712c79020d Merge pull request #126 from ep1cman/master 
ResourceResolver: Show version number when resource wasn't found.
 2016-03-30 11:05:21 +01:00
Sebastian Goscik
12dfbef76b ResourceResolver: Show version number when resource wasn't found. 
If the ResourceResolver was looking for a specific version of a
resource and could not find it, this version number is now shown
in the error message.
 2016-03-30 11:01:35 +01:00
Sebastian Goscik
b1f607ef70 Merge pull request #125 from setrofim/master 
trace-cmd fixes
 2016-03-24 18:13:16 +00:00