1
0
mirror of https://github.com/ARM-software/workload-automation.git synced 2025-07-06 15:13:34 +01:00
Commit Graph

1685 Commits

Author SHA1 Message Date
1c60f47440 commands/record: Fix record command description.
All stages are now optional for recording however the record description
has not been updated to reflect this.
2018-06-25 18:19:30 +01:00
df076c68da templates: Add parameter example to UiAutomator template.
Add additional information to the UiAutomator template for retrieving
parameters.
2018-06-25 18:19:30 +01:00
d3cb350461 commands/templates: Update to add optional setup_rerun method 2018-06-25 18:19:30 +01:00
e672fbed32 doc/execution_model: Add details about optional setup_rerun method 2018-06-25 18:19:30 +01:00
185548d13b doc/signal_dispatch: Update diagram to incorporate new signals
Add new signals to diagram and fix incorrect labels.
2018-06-25 18:19:30 +01:00
03235d0b59 doc: output API restructure part 2
- move TargetInfo and RunInfo docs into the new output API doc
- remove the old developer_reference/APIs.rst as obsolete
- Update output API tag reference to point to the new doc
2018-06-25 17:11:47 +01:00
275c243764 doc: add output API docs
- Add a reference tag for metadata
- Remove doc/source/api from .gitignore -- this is no longer
  auto-generated.
- Add a top-level "index" for the API documentation.
- Add output API documentation.
- Remove the output API example file, as its contents is now part of the
  output API docs.
2018-06-25 17:11:47 +01:00
c400591759 doc: update glossary
Add a few more terms that have special meaning in the context of WA to
the glossary.
2018-06-25 17:11:47 +01:00
af95b5c990 workloads/lmbench: doc fix
Add missing blank lines around the URL indent block.
2018-06-25 17:11:47 +01:00
29174912dd workloads: add lmbench
Add a workload for lat_mem_rd and bw_mem tests of LMbench benchmark, a suite of
portable ANSI/C microbenchmarks for UNIX/POSIX.

This is a port of corresponding workload from WA2.
2018-06-25 14:52:22 +01:00
687d09cd53 utils/types: fix typos 2018-06-25 14:14:00 +01:00
c255576fd7 fw/core: Allow for a user_directory to be specified using ~
Previously if a path for the `user_directory` was specified using `~`
this would not be expanded causing issues due to incorrect path joining.
2018-06-25 13:45:43 +01:00
3ecc46b662 fw/exec: ensure correct state on early abort
Ensure the serialized state gets written out in case of early abort
(before the run has been fully initialized and job execution has
started), and  that the appropriate final output is generated.

This requires that ExecutionContext is created much earlier (in order
for postamble to be possible), and that KeyboardInteruptException is
caught and handled properly by the Executor.
2018-06-22 18:04:16 +01:00
d0dd6c1e04 fw/exec: context: add write_job_specs
Add a method to encapsulate the writing of ConfigManager's job specs
into run_output.
2018-06-22 18:04:16 +01:00
861dff75d4 fw/exec: context: add write_output()
Add a convenience method for invoking write_info(), write_state(), and
write_result() of run_output. This will make it easier to call it from
multiple places.
2018-06-22 18:04:16 +01:00
1b498fa42d fw/exec: context: make target_info a property
TargetManger.get_target_info() gets invoked twice: first on context
creation, and then a second lime shortly afterwards to populate
RunOutput. Change target_info attribute inside the context to be a
property that redirects to run_output. This will allow the context to be
created earlier, before a target connection  is available.
2018-06-22 18:04:16 +01:00
6486378c89 commands/run: add run.log as an Artifact
Add run.log as an Artifact to the output, once it has been created.
Every file outsize of __meta (excepting result.json) should have an
associated artifact to describe it.
2018-06-22 18:04:16 +01:00
8da911e9d5 fw/target: add initialize() to TargetManger
Add explicit initialization to TargetManger in order to separate the
creation of the TargetManger form connection to the target.
2018-06-22 18:04:16 +01:00
3b322a36c9 Speedometer: Changing workload to use Speedometer 2.0 by default 2018-06-22 14:55:39 +01:00
ae0b7c9894 output_processor/sqlite: Fix typo in function name
Correct the word connecton to connection.
2018-06-22 09:53:19 +01:00
f05a64ef95 workloads/googlemaps: Add googlemaps workload 2018-06-20 17:23:49 +01:00
35f644ba76 workloads/chrome: fix docs
- Escape asterisk (otherwise, it is interpreted as "open emphasis")
- Use monospace formatting for paths.
- Trim to 79 columns wide
2018-06-20 17:01:48 +01:00
b85665fa12 workloads/androbench: Fix directory structure
Correct the location of the UiAutomator code from `adobereader` to
`androbench`.
2018-06-20 16:39:07 +01:00
d6c853ce59 workloads: Fix incorrect attribute name
Correct setting of attribute `clean_assets` to `cleanup_assets`
2018-06-20 14:39:40 +01:00
0f2bd28284 fw/output: record wa/devlib version in output
Add wa and devlib versions to RunOutput's metadata on creation. They
already get logged, but this will make them readily accessible to
scripts and output processors.
2018-06-20 10:04:18 +01:00
7cb9f05bbe commands/revent: Add dummy method to LightContext
Add a dummy method to the LightContext to satisfy the API as we
do not record metadata when performing revent recordings.
2018-06-19 18:36:23 +01:00
9f06950fb1 fw/target: account for platform_target_defaults
When iterating over PLATFORMS tuples, account for the
platform_target_defaults introduced by 7470fb5ee.

Also, correct the tuple description in the comments.
2018-06-19 11:23:12 +01:00
578d2d3a16 utils/serializer: Handle empty file extensions
The ValueError does not given enough information in the case of an empty file
extension. Add a special case to handle files with no extension and
prompt the user.
2018-06-18 20:46:56 +01:00
88731fe489 command/revent: Fix resolver call
Call resolver's get() method, rather than get_resource(), incorrectly
introduced in the previous commit. Also add get() alias to the context
to allow it to be used as a resolver.
2018-06-18 17:47:44 +01:00
4a06c13738 commands/revent: add get_resource to LightContext
Since 2ff06af63, resources are obtained via context.get_resource, rather
than context.resolve.get_resource. LightContext used by the record
command was not updated to implement that method. This fixes the issue
2018-06-18 15:16:02 +01:00
9e9c84958d workloads/chrome: Add chrome workload 2018-06-18 12:04:25 +01:00
67631cfa6d workloads: add apache benchmark
Add a benchmark that load-tests Apache server installed on the target.
2018-06-18 10:55:44 +01:00
915465c744 workloads/gmail: Add offline mode 2018-06-18 10:51:32 +01:00
6cc1ac147c framework/workload: Add rerun infrastructure 2018-06-18 10:51:32 +01:00
dfa55c1322 commands/list: add "augmentations" and "all"
Allow specifying "augmentations" and "all" as the plugin kind to lost.
In the case of of the former, instruments and output processors get
listed. In the case of the latter, every plugin kind gets listed.
2018-06-15 12:09:23 +01:00
bab5f89283 commands/list: add blank line at the end 2018-06-15 12:09:23 +01:00
0d0bfdf6c7 setup.py: bump pandas min version 2018-06-15 10:53:32 +01:00
21784d1351 command/process: write job_output result
Write job_output result to make sure the serialized version gets
updated.
2018-06-15 10:53:32 +01:00
bcbde9a197 fw/entrypoint: log devlib version
Log devlib version alongside WA version.
2018-06-15 08:58:39 +01:00
26c38d3ae3 Implement PEP396
Add __version__, as per PEP396. Additionally, add __full_version__ which
contains the get commit ID, if available.
2018-06-15 08:58:39 +01:00
c93a1f5deb setup.py: add commit to install version
Add the git commit ID to the installed version, if available.
2018-06-15 08:58:39 +01:00
7941b712c5 docs/user_guide: Fix wa create example command 2018-06-14 15:59:16 +01:00
ce6ea663a3 Youtube: Updating to reflect changes in accessing options menu 2018-06-14 15:08:09 +01:00
488bd57659 framework/version: Redirect git stderr output
Add an stderr argument to redirect errors ('fatal not a git repository'
is the most common) to PIPE so that errors do not output to STDOUT.
2018-06-14 15:07:18 +01:00
71a32dd724 framework/command: Fix subparsers in Python3
Make subcommands required arguments in the ComplexCommand class, which
is used by the 'wa create' command.
2018-06-14 15:06:50 +01:00
6ee40c2170 utils/types: implement __ne__ for level
This should have been handled by the @total_ordering decorator, but
isn't due to

        https://bugs.python.org/issue25732

(briefly, total_ordering is back-ported from Python 3, where the base
object provides the default implementation of __ne__ based on __eq__, so
total_ordering did not override it; this, however does not happen in
Python 2).

Also update unit tests to catch this edge case.
2018-06-14 15:04:56 +01:00
64f9cf79e4 utils/diff: fix diff_interrupt_files on Python 2
During Python 3 migration, the izip call inside diff_interrupt_files has
been replaced with a zip call (zip returning an iterator in Python 3).
Import zip from builtins to ensure that it also produces an iterator in
Python 2.

Also fix the associated unit test by importing the correct function.
2018-06-14 15:04:56 +01:00
d64ab6f099 workloads: add deepbench
Add automation for Baidu's DeepBench benchmark for deep learning
operations.
2018-06-14 12:31:43 +01:00
7470fb5ee9 Add target-params to Platform Tuple
Added support for specifying target parameters in the Platform tuple.
2018-06-14 12:06:33 +01:00
7fb85261da instruments/serialmon: Add an instrument to monitor serial traffic
This instrument will log serial traffic to a file. The idea is to
assist with debugging development boards, as otherwise there is a
chance that crash reports, for example, are lost when the device is
reset by WA.

It logs the pre-run and post-run traffic to preamble_serial.log and
postamble_serial.log , respectively, in the top-level output
directory. Serial logs for each workload are stored in the appropriate
workload directory as serial.log.

As we are tying up the serial port, we stop the logging when the
device is reset to allow board such as the Arm Juno to be reset via
the serial connection.
2018-06-13 14:36:46 +01:00