1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-03-16 07:38:53 +00:00

167 Commits

Author SHA1 Message Date
jimboatarm
cd3d08dae9 Merge pull request #14 from jimboatarm/fudge
Fix timing instrumentation logs for Skype and GooglePhotos
2016-05-11 12:07:32 +01:00
muendelezaji
e0cbc55013 Update ant build scripts for existing workloads 2016-05-11 09:39:27 +01:00
James Hartley
cbfcf6eaba Fix timing instrumentation logs for Skype and GooglePhotos
Bring both workloads in line with the standard way of regex searching the instrumentation logs.
2016-05-10 18:20:47 +01:00
James Hartley
60c94a79bd More robust way of checking image is attached in Gmail
Waiting for the attached image icon to disappear is more reliable than waiting for the new view to appear on some 2-1 devices.
2016-05-10 15:49:51 +01:00
James Hartley
35a0953858 Fix googlephotos crashes on certain devices
On one particular devices polling for the navigate image button fails.  Waiting for it to exist works successfully.
2016-05-10 15:40:30 +01:00
James Hartley
adf272fa1b Fix Reader workload crash when asked for local file access
Certain devices will ask for local file access permissions immediately on app launch.
2016-05-10 15:21:28 +01:00
James Hartley
a0e3bafbf0 Group the create new Gmail instrumentation timings and fix for sendMail
Adding the prefix will group these timings together when the logs are post processed.

On some devices the conversation view is minimised when creating a new mail so no longer check for the Navigate button, just check the send view has disappeared.
2016-05-10 15:09:16 +01:00
jimboatarm
6fa953d5b4 Merge pull request #11 from jimboatarm/skype-viewnames
Added skype views/activities/context names for use with wa's FPS inst…
2016-05-10 14:43:06 +01:00
Michael McGeagh
d87c20b594 Added views/activities/context for use with wa's FPS instrumentation layer 2016-05-10 14:15:06 +01:00
Michael McGeagh
f4941d1956 Added skype views/activities/context names for use with wa's FPS instrumentation layer 2016-05-10 13:59:11 +01:00
John Richardson
c8fa9a23cf Move confirmAccess method to UxPerfUiAutomation
Move confirmAccess method out of reader and skype workloads into
UxPerfUiAutomation base class for code reuse.

Amend project properties for reader workload to use SDK version 18.

Update jar files appropriately.
2016-05-09 17:30:39 +01:00
jimboatarm
163e358bf3 Merge pull request #8 from jimboatarm/develop
Fixes for Reader/Gmail/Skype
2016-05-09 15:03:30 +01:00
James Hartley
92e4d41f69 Fixes for Reader/Gmail/Skype
Yet more subtle changes to allow them to run on more devices.
2016-05-09 14:56:25 +01:00
John Richardson
72351dbc18 Remove TAG from log names
Remove TAG prefix from log file names. Add uxperf_ prefix to TAG for
consistency between workloads.
2016-05-09 14:12:01 +01:00
John Richardson
2bee9f4f66 Modify googlephotos after reliability testing
Improve workload  description in __init__.py.
Add saveAndReturn convenience method.
Remove confirmLocalFileAccess method.
2016-05-09 11:15:36 +01:00
John Richardson
3b898125b0 Merging master into googlephotos 2016-05-06 22:36:48 +01:00
John Richardson
16551a5d3f Extend Googlephotos workload
Extend workload to add crop and rotation testing to UI automation.
Add SurfaceFlinger dumps whilst performing editing operations.
2016-05-06 22:31:41 +01:00
James Hartley
26443f66cc Fix for Skype on particular devices and updated jar files
Some devices issue a pop up to confirm local file access which needs to be handled.
2016-05-05 23:40:59 +01:00
James Hartley
c624979caa Merge commit 'cde0b12c5dda9cc7d8d0ae5421df4a03f65a0df3' into develop 2016-05-05 23:39:34 +01:00
James Hartley
5d0f676033 More fixes to Reader/Gmail/Photos to improve reliability across devices 2016-05-05 22:22:10 +01:00
muendelezaji
cde0b12c5d Changes after review of pull #5
- Use superclass writeToFile - improved to accept generic Map collections
- Change timer results format to one more in line with the rest
2016-05-05 20:07:51 +01:00
muendelezaji
f648cbe614 Merge remote-tracking branch 'upstream/master' into wl-skype 2016-05-05 18:46:33 +01:00
muendelezaji
f210757424 Change workload name to skype 2016-05-05 18:45:44 +01:00
muendelezaji
4f5fdd6439 Changes after review pull of #5 2016-05-05 16:48:03 +01:00
muendelezaji
01568d8184 Minor fixes
Parse boolean from parameters
Pull up TextView class string into constant
2016-05-05 12:31:54 +01:00
James Hartley
d77b29165f Fixes for Reader/Gmail/Photos
Check in missing UiAutomation .class files
Fix generation and deletion of dump sys logs including renaming to a standard [test tag]_[test number].log format
Improved Reader to run across a range of devices with subtlety different layouts and views
2016-05-05 11:21:31 +01:00
muendelezaji
636194be3f Increase wait timeout for views 2016-05-04 17:57:24 +01:00
muendelezaji
366925c5c5 gfxinfo and SurfaceFlinger instrumentation
Also added workload description
2016-05-04 16:59:33 +01:00
John Richardson
31cf06b62a Extended BaseUiAutomation and UxPerfUiAutomation
Moved common functionality to base classes for code reuse. Refactored
googlephotos, reader and gmail workloads to take advantage of the new
base class methods and removed total test time metric.

New methods for BaseUiAutomation:
uiDeviceVertPinchIn, uiDeviceVertPinchOut

New methods for UxPerfUiAutomation:
uiObjectVertPinchTest, writeResultsToFile, startDumpsysSurfaceFlinger,
startDumpsysSurfaceFlinger, startDumpsysGfxInfo, stopDumpsysGfxInfo

New class for UxPerfUiAutomation:
GestureTestParams
2016-05-04 11:56:06 +01:00
John Richardson
c2a68074be Googlephotos productivity workload
A new workload to perform standard productivity tasks within
Googlephotos. Each user event/step is timed and reported back as a
metric. Dumpsys also captures SurfaceFlinger logs for each event for
post analysis.
2016-05-04 11:49:04 +01:00
muendelezaji
1396c5404f Simplify metric collection 2016-05-04 09:34:44 +01:00
James Hartley
e1827ffde2 Tidy up Reader timing instrumentation and fix build error 2016-05-03 18:16:17 +01:00
James Hartley
091e1054ab Fix Gmail workload to run across more devices
Changes to deal with subtle differences in layouts between tablets and handsets.
Stop pushing files to he Camera directory for test purposes.
2016-05-03 18:14:59 +01:00
muendelezaji
c65878fee4 Formatting change 2016-05-03 17:01:46 +01:00
muendelezaji
915023dfd7 Add basic instrumentation for call times
- Also, extend UxPerfUiAutomation instead of BaseUiAutomation
2016-05-03 16:59:46 +01:00
muendelezaji
055da519d2 Add Skype workload
- Makes a video or voice call - actions and accounts to use
  have to be specified in agenda. See template-agenda
- Instrumentation to follow soon
2016-05-03 14:42:17 +01:00
James Hartley
73a54103e1 Update Gmail workload to attached images to sample email
Adds 5 image files to the email before sending.
2016-04-28 21:36:05 +01:00
James Hartley
b0d0a19bf0 Reader productivity workload
A new workload to perform standard productivity tasks within Reader. Each user event/step is timed and reported back as a metric.  Dumpsys also captures SurfaceFlinger logs for each event for post analysis.
2016-04-28 13:13:36 +01:00
James Hartley
cc2280a317 Gmail productivity workload
A new workload to perform standard productivity tasks within Gmail.  Each user event/step is timed and reported back as a metric.
2016-04-28 13:03:03 +01:00
James Hartley
73c8ca86a3 Update BaseUiAutomator class to API level 18
The change will allow us to use UiAutomator methods introduced in API 18, such as resourceId.
As a consequence of the change all dependent uiauto workloads have been incremented also.

Tested by rebuilding all uiautomator workloads. They were not run on devices.
2016-04-26 17:50:29 +01:00
Sergei Trofimov
44a49db04d glbcorp: pep8 fix
Added a missing blank line between method declaration and class
attribute definitions.
2016-04-15 16:39:24 +01:00
Sebastian Goscik
73aa590056 glbench: renamed start_activity to launch_package
To match changes made in: ff5f48b7e70117dc4161f2bd986438450f73cc16
2016-04-14 16:36:37 +01:00
Sebastian Goscik
985b249a24 glbench: Fixed ending regex
Updated the regex that detected the end of the benchmark to match the new
logcat format.
2016-04-14 16:36:37 +01:00
Sebastian Goscik
9a301175b0 glbench: Fixed updated logcat format
The old results looked like:
I/TfwActivity(30824):    "description": "",
I/TfwActivity(30824):    "elapsed_time": 62070,
I/TfwActivity(30824):    "error": "NOERROR",

The new format is:
04-04 11:38:04.144  1410  1410 I TfwActivity:    "description": "",
04-04 11:38:04.144  1410  1410 I TfwActivity:    "elapsed_time": 62009,
04-04 11:38:04.144  1410  1410 I TfwActivity:    "error": "NOERROR",
2016-04-04 17:33:48 +01:00
Sebastian Goscik
50353d0b8f Merge pull request #122 from Sticklyman1936/lmbench_update
lmbench: Tidied up the code and improved stability
2016-03-24 16:26:52 +00:00
Sascha Bischoff
2eca77fb02 sysbench: use device busybox binary
Use the full path to busybox on the target device as opposed to
assuming it is found on the path.
2016-03-24 16:21:01 +00:00
Sascha Bischoff
3de5b5fe0b lmbench: Tidied up the code and improved stability
This patch tidies up the benchmark code to bring it in line with the
style used in Workload Automation in general. Additionally, the
results from sub-benchmarks are now directly written to a file on the
device as opposed to processing the standard output/error from the
benchmark, which was error prone.
2016-03-24 10:20:32 +00:00
Sergei Trofimov
3043506d86 applaunch: pass the location of busybox into the script
applaunch creates and deploys an auxilary script in order to collect
precise timings. This script invoked busybox with the assumption that it
is in PATH.

Since recent changes mean that it is no longer deployed to /system/bin,
the busybox in not found. With this commit, the full path to busybox
will be passed into the script's template.
2016-03-23 16:28:18 +00:00
Sebastian Goscik
3531dd6d07 dhyrstone: Fixed arm64 binary
It was dynamically linked, its is now statically linked
2016-03-15 14:38:18 +00:00
Sebastian Goscik
11184750ec dhrystone: Updated executable resolution
Previously it was just using the binary in the dhrystone folder.
Now it uses WA's resource resolution to use the correct ABI.
2016-03-09 14:54:39 +00:00