1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-01-18 20:11:20 +00:00

1012 Commits

Author SHA1 Message Date
Marc Bonnici
e1e5d466a2 version: Version Bump to 2.7.0 2018-07-06 14:44:08 +01:00
Aníbal Limón
1b0799bcc5 wlauto/utils/ssh.py: Fix set terminal window size
Ensure that the terminal window size is set to 500x200, if not long
commands (prompt + command > 80 chars) will fail because the pexpect
search to match the command string in order to get the result and the
command is wrapped to first 80 chars.

For example, when check a file and executes:

...
if [ -f '/sys/kernel/debug/sched_features' ]; then echo 1; else echo 0; fi
...
File
\"/usr/local/lib/python2.7/dist-packages/wlauto/common/linux/device.py\",
line 228, in get_properties
if self.is_file(propfile):
File
\"/usr/local/lib/python2.7/dist-packages/wlauto/common/linux/device.py\",
line 215, in is_file
return boolean(output.split()[-1])  # pylint: disable=maybe-no-member

IndexError(list index out of range)
...

In order to fix this scenario enables checkwinsize in the shell and use
stty to set the new terminal window size.

Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2018-04-16 14:16:06 +01:00
Javi Merino
ea22bc062e recentfling: Add the ability to specify the device_name
Not all devices are supported by recentfling, but there is usually a
device that is supported and has a similar screensize.  Let the
recentfling workload specify the device to let us run it on more
devices.
2018-03-29 11:29:32 +01:00
Marc Bonnici
ba6889ea7f android/workload: Move parameter from GameWorkload to ApkWorkload Class
In addition to `GameWorkloads` some benchmarks also download additional
data upon initialisation. Moving this parameter to the `ApkWorkload`
parent class allows all APK based workloads to indicate that their data
should not be cleared prior to running the workload.
2018-02-08 15:02:42 +00:00
Jose Marinho
9a9e8395cf instrumentation/fps: Fix spaces in SurfaceFlinger.
When parsing the SurfaceFlinger list output spaces were used as
separators. Some view names have spaces enclosed.
This would lead to views with spaces in their names not being correctly
detected and as a consequence the fps stats not collected.
2018-02-02 13:52:48 +00:00
Marc Bonnici
0995e57689 instrumentation/fps: Allow measuring of views containing spaces
Ensure the view name is passed in quotes to allow for views containing
spaces.
2018-02-01 12:28:00 +00:00
Marc Bonnici
7c920f953c resource_getters: Add support for matching apks via package name
Allows distinguishing between apks based on the package name specified
in the workload.
2018-01-23 13:08:39 +00:00
Marc Bonnici
e5417e5b7f resource_getters: Change ExtensionAssetGetter to look in local env
Previously `ExtensionAssetGetter` subclassed `DependencyFileGetter`,
 commit 6e7087ee88b34af453e20f0d8dda95438c72a8fb changed its
functionality to use a cached location instead of the local resource
location. This commit changes the `ExtensionAssetGetter` to subclass
`EnvironmentDependencyGetter` so it checks the local resource location
again.
2018-01-17 18:32:22 +00:00
Sergei Trofimov
d295b7d92d external/revent: make inlines static
Add "static" qualifier to inline functions. This avoids linking errors
when compiling without -O flags. The "static" forces the inlining as
described here:

https://gcc.gnu.org/onlinedocs/gcc/Inline.html
2017-12-04 11:17:24 +00:00
Sergei Trofimov
e33245ac72 external/revent: replace bzero with memset
Replace calls to bzero with equivalent calls to memset, as bzero is
deprecated and may not be supported by all tool chains.
2017-11-30 17:52:54 +00:00
Yingshiuan Pan
57a8e62be9 util/android, get_apk_versions: try to find 'aapt' in $PATH as well
Some Linux distro provide android build-tools in packages, we should also try
to find 'aapt' in $PATH if it cannot be found in $ANDROID_HOME.
2017-11-28 09:14:50 +00:00
Sergei Trofimov
7ce1044eff trace-cmd: Update armeabi binary to LSB version.
The armeabi version of trac-cmd binary was erroniously built as
MSB which pervented it from being used.
2017-11-06 16:24:57 +00:00
setrofim
5a70ab8534 Merge pull request #513 from jimboatarm/androbench_update
Androbench: Updating Versions
2017-10-11 15:36:08 +01:00
scott
486c0c6887 Androbench: Updating Versions
Updating the workload to work with version 5.0 of the Androbench application.
2017-10-11 15:22:22 +01:00
Sergei Trofimov
3d80e4ef34 applaunch: do not attempt to uninstall uiauto apk
applaunch  users the UI automation of the guest workload to detect
launch completion. However, the guest's automaiton apk is pushed to the
target and loaded via DexLoader; it is never actually installed;
therefore, it should not be uninstalled when running guest's teardown.
2017-09-21 16:53:13 +01:00
Sergei Trofimov
39bc8eae20 gmail: add missing import 2017-09-21 15:25:58 +01:00
Sergei Trofimov
b312bf317d utils/ipython: handle nbconvert import
nbconvert has been split into a separate package and is installed as a
dependency for Jupyter rather than IPython. Add a proper import guard
to prevent issues for those that don't need ipython_converter
functionality, and set the appropriate error message for those that do.
2017-09-14 08:35:41 +01:00
Sergei Trofimov
a3d042e054 utils/ssh: fix telnet connection
This fixes the ability to connect over telnet rather than SSH which was
broken by commit 51db53d9

	 ssh: Back-port ssh_get_shell from devlib
2017-09-13 11:22:29 +01:00
setrofim
afe3c16908 Merge pull request #472 from bjackman/config-example-update
config_example: Update comment on available devices
2017-09-05 15:33:56 +01:00
Brendan Jackman
6266edad6f ipython: Add support for IPython 5
This does not seem to require any change beyond incrementing the
recognised version number.
2017-09-05 14:55:59 +01:00
Brendan Jackman
64426601fe ipynb_exporter: Use file_path to allow '~' in path parameters 2017-09-05 14:55:58 +01:00
Brendan Jackman
cea39a6193 utils/types: Add file_path type
This can be used to allow extension parameters that are paths to use
'~' to refer to the home directory.
2017-09-05 14:55:56 +01:00
Brendan Jackman
c952b2f0d4 config_example: Update comment on available devices 2017-09-05 12:23:37 +01:00
Sergei Trofimov
cdc7c96cdf spec2000: fix cpumask for generic
spec2000 expects binaries to be optimised for particular cores and uses
Device's core_names to figure out which cores the benchmark should run
on.

There is one special case, which is "generic", which is not optimised
for a particular uarch. cpumask for this was resolved the same way,
failing the lookup, resulting in the invalid mask 0x0.

To fix this, "generic" is now handled by specifying the mask for all
available CPUs.
2017-08-22 15:38:27 +01:00
setrofim
2f683e59d2 Merge pull request #465 from marcbonnici/FPS_Fix
Fps fix
2017-08-17 11:00:02 +01:00
setrofim
a1c19b55b8 Merge pull request #467 from marcbonnici/documentation
Documentation Update
2017-08-16 16:35:07 +01:00
Marc Bonnici
4c0d3f8d20 Bootstrap: Fixes not using newly created config files
If the $WA_USER_DIRECTORY folder is not present on the users
system it is automatically created and a default config.py file
created. Previously this newly created file would not be loaded into
WA causing it to crash.
2017-08-16 16:24:38 +01:00
Marc Bonnici
8dcf1ba6a5 Bootstrap: Make sure that _env_root is an absolute path
If the environment variable $WA_USER_DIRECTORY is not set `_env_root`
is automatically generated from the path expansion of `~`. In some cases
if a home directory is not avaliable for the user this may result in an empty
string. This commit ensure that '_env_root' is still an absolute path
using the current working directory.
2017-08-16 16:24:13 +01:00
Marc Bonnici
081358769d Workload/Manual: Update "view" parameter description 2017-08-15 10:34:37 +01:00
Marc Bonnici
10a614ff04 Workload/Manual: Adds package parameter to workload
Adds the `package` parameter to allow the workload to be used
with the gfxinfo method of collecting data for the FPS instrument.
2017-08-15 10:34:37 +01:00
Marc Bonnici
58a8ea9051 Instrumentation/FPS: Fixes attribute checking
Previously only the requirements for using SurfaceFlinger were checked,
regardless of the FPS method being used.
This commit now only ensure that a `View` attribute is present when
using SurfaceFlinge and a `package` name is available if using gfxinfo
otherwise falling back to SurfaceFlinger.
2017-08-15 10:22:59 +01:00
Waleed El-Geresy
cd0863d7fa revent.py: Fix handling of zero-event files
Previously the try clause worked to catch StopIteration exceptions correctly,
however upon catching the exception, another statment which set self._duration
to (last.time - first.time) was being run regardless, which defeated the point
of the try clause.

This has been fixed by introducing an else clause to contain said statement.
2017-08-11 16:58:44 +01:00
Sergei Trofimov
362e93c4cb revent: fix playback timing
This fixes an issue introduced by commit 5965956

	revent: fix off-by-one in replay

This moved the updating of the current event to the beginning of the
body of the loop, after the check of the while loop to prevent attempting
to assign past the end of array. The problem is that one the conditions
in the check relies on the event being updated, so it need to happen
before that part of the loop condition check.

This move event update back to the end of the loop body, but it moves
the array bounds check from the while loop condition into the body, just
before the update but after the counter is incremented. This should
satisfy both, the counter being bounds checked before it is used, and
the event being updated to the next one to be played before the timing
check in the loop condition.
2017-08-09 17:50:54 +01:00
Waleed El-Geresy
f35c444ddb generic_linux: Remove forbidden chars from device_model
Fix for Chromebook Plus and possibly other devices - removes forbidden
characters from the device_model such as the null character which was
causing a problem with getters getting file names including device_model.
2017-08-09 14:18:38 +01:00
Waleed El-Geresy
e35d0f2959 wa record: Update -h description for ReventWorkload
Added information pertaining to the new .teardown file and several
rewordings.
2017-08-09 14:18:38 +01:00
Waleed El-Geresy
6d9a03ad8f ReventWorkload: Move class to linux and add features
The ReventWorkload class has been moved to the linux directory and
two new features have been added: the option to run an idle workload
and the option to specify a .teardown revent file as well as a .setup file
which runs in the eponymous stage.
2017-08-09 14:18:38 +01:00
Sascha Bischoff
8cf4c259c0 gem5: fixed a typo
Changed "self.longdelay" to "self.long_delay".
2017-08-08 16:34:52 +01:00
setrofim
77bb14331f Merge pull request #456 from marcbonnici/param_dict_fix
Types: Fix parameter dict get method
2017-08-08 08:28:04 +01:00
setrofim
dd8843d24a Merge pull request #455 from marcbonnici/documentation
Documentation fixes
2017-08-04 16:20:35 +01:00
Marc Bonnici
16b302679a workloads/appshare: Fixes missing new line in doc string 2017-08-04 16:12:22 +01:00
Marc Bonnici
f9db0a3798 workloads/rt-app: Fixes typos 2017-08-04 16:12:20 +01:00
Marc Bonnici
548eb99bdc workloads/rt-app: Removed absoulte path in documentation
Removed dynamically populated existing configs path from doc string as
this is also used to generate the online documentation and therefore should
not be an absolute path.
2017-08-04 16:11:53 +01:00
marcbonnici
f4669e2b20 Merge pull request #454 from jimboatarm/scojac01-updated-workloads
AdobeReader: Updated to handle latest version
2017-08-04 13:08:29 +01:00
scott
0578f26bc7 AdobeReader: Updated to handle latest version
The workload has been updated to handle the latest version
which no longer has the welcome view page. This has been
done so in a way that still provides backwards compatibility
to previous versions.
2017-08-04 10:16:14 +01:00
setrofim
12230da959 Merge pull request #445 from jimboatarm/scojac01-updated-workloads
Reworking the Gmail and GooglePlayBooks workloads to work with the la…
2017-08-03 10:00:19 +01:00
scott
afa2e307cc Gmail: Updated to work with Android 7
Android 7 no longer has the broadcast functions which
mean we have to refresh our image directory another way.
We are now using Google Photos to do this but only if the
current method is unable to find the correct test images.
2017-08-03 09:56:47 +01:00
scott
d662498ea8 GooglePlayBooks: Updated workload to work with the latest version
GooglePlayBooks UI has changed significantly in the latest
version. This includes extra dialog boxes upon first use
which need to be handled.
2017-08-03 09:56:47 +01:00
Sergei Trofimov
596595698d revent: fix off-by-one in replay
Update idx and ev to the next event after the while check (which makes
sure that the next index is within bounds) to avoid a potential
access-past-end-of-array.
2017-08-02 17:52:04 +01:00
Sergei Trofimov
be3c91b131 Device: raise RuntimeError in _check_ready
Previously, a AttributeError has been raised. This causes issues when
attempting to access some properties that rely on invoking commands on
the device. The error would get swallowed up in Python attribute
resolution machinery, resulting in an error claiming a missing
attribute.

For example, for AndroidDevice, "abi" is a property that internally
calls getprop(), which executes on the device, and thus requires a
connection. If attempting to access device.abi before device.connect()
has been invoked, the following sequence takes place

1. Caller tries to access attribute "abi" of device, which resolves to
   the device.abi property defined in the class.
2. device.abi calls device.getprop()
3. ...which calls device.execute()
4. ...which calls device._check_ready()
5. device._check_ready() raises AttributeError('device not ready.')
6. That gets propagated all the way up to 1., which gets interpreted
   as attribute not being found.
7. Since AndroidDevice defines a __getattr__(), that gets called next
8. __getattr__() looks for a loaded Device module that has an "abi"
   attribute. Since there isn't one, it raises AttributeError('abi').

The result is that the error reports a missing "abi" attribute, rather
than "device not ready", leading to some fun debugging.

Raising RuntimeError (which more appropriate for the circumstances
anyway) does not trigger __getattr__, so the correct error message is
reported to the user. The text of the message has also been adjusted to
make it clearer what has likely gone wrong.
2017-08-02 13:39:55 +01:00
Sergei Trofimov
6da0550b98 utils/trace_cmd: expect ': ' in task name
': ' is used as the delimiter for the different parts of of the event
line; unfortunately, it is also a valid character sequence to appear in
a task name.

This change attempts to perform the event line split correctly by
ensuring that the cpu id is present in the first part.
2017-07-24 09:31:31 +01:00