mirror of
https://github.com/ARM-software/workload-automation.git
synced 2025-02-21 12:28:44 +00:00
doc: Add agenda user reference documentation.
This commit is contained in:
parent
50f06388be
commit
e80feef486
148
doc/source/user_reference/agenda.rst
Normal file
148
doc/source/user_reference/agenda.rst
Normal file
@ -0,0 +1,148 @@
|
|||||||
|
.. _agenda-reference:
|
||||||
|
|
||||||
|
Agenda
|
||||||
|
------
|
||||||
|
|
||||||
|
|
||||||
|
An agenda can be thought of as defining an experiment as it specifies what is to
|
||||||
|
be done during a Workload Automation run. This includes which workloads will be
|
||||||
|
run, with what configuration and which augmentations will be enabled, etc.
|
||||||
|
|
||||||
|
Agenda syntax is designed to be both succinct and expressive and are written
|
||||||
|
using YAML notation.
|
||||||
|
|
||||||
|
There are three valid top level entries which are: ``"config"``, ``"workloads"``,
|
||||||
|
``"sections"``.
|
||||||
|
|
||||||
|
|
||||||
|
config
|
||||||
|
^^^^^^^
|
||||||
|
|
||||||
|
This section is used to provide overall configuration for WA and its run. The
|
||||||
|
``config`` section of an agenda will be merged with any other configuration
|
||||||
|
files provided (including the default config file) and merged with the most
|
||||||
|
specific configuration taking precedence.
|
||||||
|
|
||||||
|
Within this section there are multiple distinct types of configuration that can be
|
||||||
|
provided.
|
||||||
|
|
||||||
|
Run Config
|
||||||
|
~~~~~~~~~~
|
||||||
|
|
||||||
|
The first is to configure the behaviour of WA and how a run as a
|
||||||
|
whole will behave. The most common that you may want to specify are:
|
||||||
|
|
||||||
|
- :confval:`device` - The name of the 'device' that you wish to perform the run
|
||||||
|
on. This name is a combination of a devlib
|
||||||
|
`Platform <http://devlib.readthedocs.io/en/latest/platform.html>`_ and
|
||||||
|
`Target <http://devlib.readthedocs.io/en/latest/target.html>`_.
|
||||||
|
To see the available options please use ``wa list targets``.
|
||||||
|
- :confval:`device_config` - The is a dict mapping allowing you to configure
|
||||||
|
which target to connect to (e.g. ``host`` for an SSH connection or ``device``
|
||||||
|
to specific an ADB name) as well as configure other options for the device for
|
||||||
|
example the ``working_directory`` or the list of ``modules`` to be loaded onto
|
||||||
|
the device.
|
||||||
|
|
||||||
|
For more information and a full list of these configuration options please see
|
||||||
|
:ref:`Run Configuration <run-configuration>`.
|
||||||
|
|
||||||
|
Meta Configuration
|
||||||
|
~~~~~~~~~~~~~~~~~~
|
||||||
|
|
||||||
|
The next type of configuration options are the `"Meta Configuration"` options
|
||||||
|
(for a full list please see :ref:`here <meta-configuration>`) and these are used
|
||||||
|
to configure the behaviour of WA framework itself, for example directory
|
||||||
|
locations to be used or logging configuration.
|
||||||
|
|
||||||
|
|
||||||
|
Plugins
|
||||||
|
~~~~~~~
|
||||||
|
You can also use this section to supply configuration for specific plugins, such
|
||||||
|
as augmentations, workloads, resource getters etc. To do this the plugin name
|
||||||
|
you wish to configure should be provided as an entry in this section and should
|
||||||
|
contain a mapping of configuration options to their desired settings. If
|
||||||
|
configuration is supplied for a plugin that is not currently enabled then it will
|
||||||
|
simply be ignored. This allows for plugins to be temporarily removed
|
||||||
|
without also having to remove their configuration, or to provide a set of
|
||||||
|
defaults for a plugin which can then be overridden.
|
||||||
|
|
||||||
|
Some plugins provide global aliases which can set one or more configuration
|
||||||
|
options at once, and these can also bee specified here. For example specifying
|
||||||
|
the entry ``remote_assets_url`` with a corresponding value will set the URL the
|
||||||
|
http resource getter will attempt to search for any missing assets at.
|
||||||
|
|
||||||
|
|
||||||
|
augmentations
|
||||||
|
"""""""""""""
|
||||||
|
As mentioned above this section should be used to configure augmentations, both
|
||||||
|
to specify which should be enabled and disabled and also to provide any relevant
|
||||||
|
configuration. The ``"augmentation"`` entry, if present, should be a list of
|
||||||
|
augmentations that should be enabled (or if prefixed with a ``~``, disabled).
|
||||||
|
|
||||||
|
.. note:: While augmentations can be enabled and disabled on a per workload
|
||||||
|
basis, they cannot yet be re-configured part way through a run and the
|
||||||
|
configuration provided as part of an agenda config section or separate
|
||||||
|
config file will be used for all jobs in a WA run.
|
||||||
|
|
||||||
|
workloads
|
||||||
|
"""""""""
|
||||||
|
In addition to configuring individual workloads both in the ``workloads`` and
|
||||||
|
``sections`` entries you can also provide configuration at this level which will
|
||||||
|
apply globally in the same style mentioned below. Any configuration provided
|
||||||
|
here will be overridden if specified again in subsequent sections.
|
||||||
|
|
||||||
|
|
||||||
|
workloads
|
||||||
|
^^^^^^^^^
|
||||||
|
|
||||||
|
Here you can specify a list of workloads to be ran. If you wish to run a
|
||||||
|
workload with all default values then you can specify the workload name directly
|
||||||
|
as an entry, otherwise a dict mapping should be provided. Any settings provided
|
||||||
|
here will be the most specific and therefore override any other more generalised
|
||||||
|
configuration for that particular workload spec. The valid entries are as
|
||||||
|
follows:
|
||||||
|
|
||||||
|
- :confval:`workload_name` (Mandatory) - The name of the workload to be ran
|
||||||
|
- :confval:`iterations` - Specify how many iterations the workload should be ran
|
||||||
|
- :confval:`label` - Similar to IDs but do not have the uniqueness restriction.
|
||||||
|
If specified, labels will be used by some output processors instead of (or in
|
||||||
|
addition to) the workload name. For example, the csv output processor will put
|
||||||
|
the label in the "workload" column of the CSV file.
|
||||||
|
- :confval:`augmentations` - The instruments and output processors to enable (or
|
||||||
|
disabled using a ~) during this workload.
|
||||||
|
- :confval:`classifiers` Classifiers allow you to tag metrics from this workload
|
||||||
|
spec which are often used to help identify what runtime parameters were used
|
||||||
|
when post processing results.
|
||||||
|
- :confval:`workload_parameters` [*workload_params*] - Any parameters to
|
||||||
|
configure that particular workload in a dict form.
|
||||||
|
|
||||||
|
.. note:: You can see available parameters for a given workload with the
|
||||||
|
:ref:`show command <show-command>`.
|
||||||
|
|
||||||
|
- :confval:`runtime_parameters` [*runtime_parms*] - A dict mapping of any
|
||||||
|
runtime parameters that should be set for the device for that particular
|
||||||
|
workload. For available parameters please see :ref:`runtime parameters
|
||||||
|
<runtime-parameters>`.
|
||||||
|
|
||||||
|
.. note:: Unless specified elsewhere these configurations will not be
|
||||||
|
undone once the workload has finished. I.e. if the frequency of a
|
||||||
|
core is changed it will remain at that frequency until otherwise
|
||||||
|
changed.
|
||||||
|
|
||||||
|
.. note:: There is also a shorter ``params`` alias available, however this alias will be
|
||||||
|
interpreted differently depending on whether it is used in workload
|
||||||
|
entry, in which case it will be interpreted as ``workload_params``, or
|
||||||
|
at global config or section (see below) level, in which case it will
|
||||||
|
be interpreted as ``runtime_params``.
|
||||||
|
|
||||||
|
|
||||||
|
sections
|
||||||
|
^^^^^^^^
|
||||||
|
|
||||||
|
Sections are used for for grouping sets of configuration together in order to
|
||||||
|
reduce the need for duplicated configuration (for more information please see
|
||||||
|
:ref:`here <sections>`). Each section specified will be applied for each entry
|
||||||
|
in the ``workloads`` section. The valid configuration entries are the same
|
||||||
|
as the ``"workloads"`` section as mentioned above, except you can
|
||||||
|
additionally specify a "workloads" entry which can be provided with the same
|
||||||
|
configuration entries as the ``"workloads"`` top level entry.
|
@ -4,6 +4,12 @@
|
|||||||
Configuration
|
Configuration
|
||||||
=============
|
=============
|
||||||
|
|
||||||
|
.. include:: user_reference/agenda.rst
|
||||||
|
|
||||||
|
---------------------
|
||||||
|
|
||||||
|
.. _run-configuration:
|
||||||
|
|
||||||
Run Configuration
|
Run Configuration
|
||||||
------------------
|
------------------
|
||||||
In addition to specifying run execution parameters through an agenda, the
|
In addition to specifying run execution parameters through an agenda, the
|
||||||
@ -17,10 +23,16 @@ Workload Automation by specifying an additional configuration file using
|
|||||||
``--config`` option. Variables with specific names will be picked up by the
|
``--config`` option. Variables with specific names will be picked up by the
|
||||||
framework and used to modify the behaviour of Workload automation.
|
framework and used to modify the behaviour of Workload automation.
|
||||||
|
|
||||||
|
---------------------
|
||||||
|
|
||||||
.. _available_settings:
|
.. _available_settings:
|
||||||
|
|
||||||
.. include:: run_config/Run_Configuration.rst
|
.. include:: run_config/Run_Configuration.rst
|
||||||
|
|
||||||
|
---------------------
|
||||||
|
|
||||||
|
.. _meta-configuration:
|
||||||
|
|
||||||
Meta Configuration
|
Meta Configuration
|
||||||
------------------
|
------------------
|
||||||
|
|
||||||
@ -30,6 +42,7 @@ attach context to results.
|
|||||||
|
|
||||||
.. include:: run_config/Meta_Configuration.rst
|
.. include:: run_config/Meta_Configuration.rst
|
||||||
|
|
||||||
|
---------------------
|
||||||
|
|
||||||
.. _envvars:
|
.. _envvars:
|
||||||
|
|
||||||
|
Loading…
x
Reference in New Issue
Block a user