1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 19:01:15 +01:00
Commit Graph

1674 Commits

Author SHA1 Message Date
Marc Bonnici
92cf132cf2 fw/target/info: Implement TargetInfo structures as Podable
Ensure that the various data structures used to store target information
now have a serialization versions.
2018-12-07 08:46:12 +00:00
Marc Bonnici
4ff7e4aab0 utils/serializer: Add Podable Mix-in class
Add a new mix-in class for classes that are serialized to PODs, the aim
of this class is to provide a way to ensure that both the original data
version and the current serialization version are known. When attempting
to de-serialize a POD the serialization version will be compared to the
latest version in WA if not matching will call the appropriate method to
upgrade the pod to a known structure state populating any missing fields
with a sensible default or converting the existing data to the new
format.
2018-12-07 08:46:12 +00:00
Marc Bonnici
e0ffd84239 fw/output: Ensure that Event message is converted to a string
Explicitly convert the passed message into a string as this is expected when
generating a event summary, otherwise splitting can fail.
2018-12-04 15:15:47 +00:00
Marc Bonnici
d3d5ca9154 workloads/glbench: Port workload to WA3 2018-11-23 17:24:41 +00:00
Marc Bonnici
88f708abf5 target/descriptor: Update default sudo command format
Due to changes introduced in devlib https://github.com/ARM-software/devlib/pull/339
the command placeholder should no longer be in quote so remove them from
the default value.
2018-11-21 15:07:25 +00:00
Marc Bonnici
bb282eb19c wa: Remove reference to devlibs escaping methods
As part of https://github.com/ARM-software/devlib/pull/339 the escaping
method are being removed in favour of using `quote` from `pipes` so
also make reflecting changes here.
2018-11-21 15:07:25 +00:00
Marc Bonnici
285bc2cd0b workloads/gfxbench: Move test selection into setup phase
Previously the configuration of the tests was performed in the run stage
instead of the setup.
2018-11-20 10:10:19 +00:00
Marc Bonnici
0d9dbe8845 workloads/gfxbench: Fix clicking on select tests
The X coordinate was miscalculated when attempting to load the test
selection menu.
2018-11-20 10:10:19 +00:00
Marc Bonnici
c89ea9875e workloads/gfxbench: Fix parameter description 2018-11-20 10:10:19 +00:00
Marc Bonnici
e4283729c1 workloads/gfxbenchmark: Fix score matching
On some devices the score string obtained can contain extra characters.
Only use the numerical values from the score when converting, otherwise
if not found set the result to 'NaN'.
2018-11-20 10:10:19 +00:00
Marc Bonnici
a2eb6e96e2 commands/process: Fix initialization of ProcessContext ordering
Ensure that that ProcessContext is initialized before attempting to
initialize any of the output processors.
2018-11-19 10:17:53 +00:00
scott
3bd8f033d5 workloads: Updating geekbench to support v4.3.1
v4.3.1 has made a minor change to the run cpu benchmark element.
Refactoring to support both the new and previous elements.
2018-11-15 15:56:09 +00:00
Marc Bonnici
ea1d4e9071 workloads/gfxbench: Do not clear package data on launch
By clearing the application data each time the workload is run this
forces the required assets to be re-installed each time. As the
workload is not affected by persistent state do not perform the
clearing.
2018-11-15 07:54:43 +00:00
Marc Bonnici
cc0cfaafe3 fw/workload: Add attribute to control if package data should be cleared.
Allow specifying that the package data should not be cleared
before starting the workload.
2018-11-15 07:54:43 +00:00
Marc Bonnici
1b4fc68542 workloads/gfxbench: Fix formatting 2018-11-13 13:06:54 +00:00
Marc Bonnici
e40517ab95 workloads/gfxbench: Fix not detecting missing asset popup
Add check for a differently worded popup informing that assets are
missing.
2018-11-13 13:06:54 +00:00
Sergei Trofimov
ce94638436 fw/target: record page size as part of TargetInfo
Record target.page_size_kb as part of target info.
2018-11-02 12:11:00 +00:00
Sergei Trofimov
d1fba957b3 fw/target: add versioning to TargetInfo
Add format_version class attribute to TargetInfo to track format
changes. This is checked when deserializing from POD to catch format
changes between cached and obtained TargetInfo's.
2018-11-02 12:11:00 +00:00
Marc Bonnici
17bb0083e5 doc/installation: Update installation instructions
Update the instructions for installing WA from git not to use
pip as this method does not process dependency_links correctly and
results in an incompatible version of devlib being installed.
2018-10-25 10:32:28 +01:00
Marc Bonnici
c4ad7467e0 doc: Fix formatting and typo 2018-10-25 10:32:28 +01:00
Marc Bonnici
2f75261567 doc: Add WA icon to documentation 2018-10-25 10:32:28 +01:00
Marc Bonnici
281eb6adf9 output_processors/postgresql: Refactor and fix uploading duplication
Previously run level artifacts would be added with a particular job_id,
and updated artifacts would be stored as new objects each time. Refactor
to remove unnecessary instance variables, only provide a job_id when
required and add an update capability for largeobjects to ensure this
does not happen.
2018-10-24 10:42:28 +01:00
Marc Bonnici
576df80379 output_processors/postgres: Move logging message
Print the debug message warning about writing a large object to the
database before writing the object.
2018-10-24 10:42:28 +01:00
Marc Bonnici
f2f210c37f utils/postgres_convert: PEP8 fix
Remove unused local variable.
2018-10-24 10:34:44 +01:00
Marc Bonnici
6b04cbffd2 worklods: Fix whitespace 2018-10-24 10:34:44 +01:00
Marc Bonnici
dead312ff7 workloads/uiauto: Update workloads to dismiss android version warning
Update workloads that use uiautomator and can display a warning about
using an old version of the app to dismiss the popup if present.
2018-10-24 10:34:44 +01:00
Marc Bonnici
7632ee8288 fw/uiauto: Add method to baseclass to dismiss android version popup
In Android Q a popup will be displayed warning if the application has
not been designed for the latest version of android. This has currently been
dealt with on a per workload basis however this is a common popup so
add a method to dismiss the popup if present to the base class.
2018-10-24 10:34:44 +01:00
Lisa Nguyen
8f6b1a7fae workloads/vellamo: Close warning popup message to run on Android Q
While attempting to run vellamo on Android Q, a popup warning with
the message, "This app was built for an older version of Android and may not
work properly. Try checking for updates, or contact the developer." would
appear, causing the workload to halt.

Close the popup warning before dismissing EULA and executing the remaining
steps to run vellamo.

Tested with vellamo apk version 3.2.4.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
2018-10-23 10:17:45 +01:00
syltaylor
f64aaf64a0 tools/revent: recording timestamp fix
- force cast start/end timestamps to uint64_t to correct recording format issue on 32bit devices (i.e. 4 bytes timespec tv_sec written on 8 bytes memory slot)
2018-10-15 09:48:02 +01:00
Marc Bonnici
7dce0fb208 workloads/jankbench: Ensure logcat monitor thread is terminated
Previously the LogcatRunMonitor left the logcat process running in the
background causing issues with concurrent accesses. Now ensure the thread
terminates correctly.
2018-10-12 13:41:21 +01:00
Marc Bonnici
375a36c155 utils/log: Ensure to convert all arguments to strings
Ensure that all arguments provided for an Exception are converted to
stings before attempting to join them for debug information.
2018-10-09 15:26:53 +01:00
Marc Bonnici
7c3054b54b commands/run: Update run output with final run config
The RunInfo object in the run output is initally created before the
config has been fully parsed therefore attributes for the project and
run name are never updated, once the config has been finalized make sure
to update the relavant information.
2018-10-09 15:26:53 +01:00
Sergei Trofimov
98727bce30 utils/revent: recording parser fixes
- change magic string literal to a b'' string so that the comparison
  works in python 3
- expand timestamp tuples (struct.unpack always returns a tuple) before
  attempting to cast to float.
2018-10-08 17:46:35 +01:00
Marc Bonnici
93ffe0434c workloads/meabo: Support python 3
Ensure output is encoded correctly if running with python 3
2018-10-05 10:10:43 +01:00
Marc Bonnici
75f3080c9b workloads: Use uninstall method instead of uninstall_executable
For workloads that support Linux targets do not use
`uninstall_executable` as this is not available, instead use `uninstall` as
other targets should be able to determine the appropriate uninstallation
method.
2018-10-05 10:10:43 +01:00
Marc Bonnici
75c0e40bb0 workloads/androbench: Fix extracting results with small resolutions
Previously the workload assumed that all the scores were visible on a
single screen however for devices with smaller displays the results need
to scrolled.
2018-10-03 14:33:09 +01:00
Qais Yousef
e73b299fbe pcmark: update uiautomation to fix Android-Q breakage
A new popup appears when running pcmark on android Q that complains
about the app being built for an older version of android.

Since this popup will be temporary, the fix has to make sure not to
break in the future when this popup disappears or when the test is ran
on a compatible version of android.

To achieve this, we attempt to dismiss the popup and if we timeout we
silently carry on with the test assuming no popup will appear.

Signed-off-by: Qais Yousef <qais.yousef@arm.com>
2018-10-01 16:12:05 +01:00
scott
9a4a90e0a6 GFXBench: New workload
Creating a new workload to execute the following tests on GFXBench.

* Car Chase
* Car Chase Offscreen
* Manhattan 3.1
* 1080p Manhattan 3.1 Offscreen
* 1440p Manhattan 3.1 Offscreen
* Tessellation
* Tessellation Offscreen
2018-09-25 17:27:58 +01:00
scott
8ba602cf83 Googlephotos: Updating to work with latest version
Updating the googlephotos workload to work with app version 4.0.0.212659618
2018-09-25 10:50:03 +01:00
Marc Bonnici
891ef60f4d configuration: Add support for section groups
Now allows for specifying a `group` value for each section which will
cross product the sections within that group with the sections in each
other group. Additionally classifiers will automatically be added to
each job spec with the relevant group information.
2018-09-24 10:17:26 +01:00
Marc Bonnici
6632223ac5 output_processors: Move variable initialization to __init__
In the case of a failure in the initialization of one output_processor the
remaining `initialize` methods may not get called causing variables to
not be initialized correctly.
2018-09-21 15:06:30 +01:00
Marc Bonnici
5dcac0c8ef output_processors/postgres: Do not process output if not connected
Only try to process the run output if the processor is connected to a
database.
2018-09-21 15:06:30 +01:00
Marc Bonnici
9a9a2c0742 commands/create: Add version check for Postgres Server
The 'jsonB' datatype was only added in v9.4 so ensure that the Postgres
server to is running this or later and inform the user if this is not
the case.
2018-09-21 15:06:30 +01:00
Marc Bonnici
57aa5ca588 fw/version: Add developement tag to version number 2018-09-21 15:06:30 +01:00
Marc Bonnici
fb42d11a83 setup: Update devlib dependency version number
Ensure that a sufficiently up to date version of devlib is installed and
enable of installing directly from github to satisfy the requirements.
2018-09-21 15:06:30 +01:00
Marc Bonnici
fce506eb02 instruments/misc: Fix typo 2018-09-21 15:06:30 +01:00
Marc Bonnici
a1213cf84e commands/create: Use class name rather than user supplied name
Use the actual name of the plugin instead of the user supplied value,
for consistency and ensure that duplicate entries cannot be specified.
2018-09-21 15:06:30 +01:00
Marc Bonnici
a7d0b6fdbd target/descriptor: Do not convert the module list to strings
Change the type of the `modules` to `list` so that additional
configuration can be supplied to individual modules as a dict of values.
2018-09-21 15:06:30 +01:00
Marc Bonnici
f5fed26758 doc/device_setup: Fix typo 2018-09-21 15:06:30 +01:00
Marc Bonnici
7d01258bce fw/target/manager: Do no finalize target if not instantiated
In the case of an error occurring during target initialization do not
try and check for disconnecting upon finalizing.
2018-09-21 15:06:30 +01:00