sascha/workload-automation
1
0
Fork 0
mirror of https://github.com/ARM-software/workload-automation.git synced 2024-10-06 19:01:15 +01:00
Code Issues Releases Wiki Activity
1,022 Commits 4 Branches 16 Tags 180 MiB
773bf26ff2
Commit Graph

266 Commits

Author SHA1 Message Date
Pawan Bathe
8513304aeb python sqlite3 to remove host/DUT dependencies + other changes 2015-08-19 21:53:50 +05:30
Pawan Bathe
e38c87f258 Fix pylint errors 2015-08-18 01:28:09 +05:30
Pawan Bathe
03a9470007 Fixed issue reported by pep8 checkers 2015-08-18 01:09:45 +05:30
Pawan Bathe
2d8b8ba799 moved UiAutomator code to java, and removed not required python code for device interfacing 2015-08-18 00:46:48 +05:30
Pawan Bathe
e4ee496bc9 Use sqllite3 instead of sqllite to remove host dependencies and result unit in proper format 2015-08-17 23:20:30 +05:30
Pawan Bathe
1cf60c2615 Results format 2015-08-15 02:39:45 +05:30
Pawan Bathe
c3d8128ff3 Androbench Storage Benchmark Workload Addition 2015-08-15 02:10:08 +05:30
Sergei Trofimov
0703db05cf rt-app: relaxing timeouts. 2015-08-12 11:53:29 +01:00
Lisa Nguyen
25e53c2abc iozone: Add license information 
Add license information for the iozone binaries.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-08-11 14:07:26 -07:00
Lisa Nguyen
0acbcc9f95 Add iozone workload 
Initial commit of the iozone workload.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-08-10 13:13:17 -07:00
Sergei Trofimov
e38bd942a8 bbench: fixed to work when binaries_directory is not in path. 2015-07-17 15:38:47 +01:00
Sergei Trofimov
2d3be33bb0 Added target_config option to telemetry 2015-07-14 11:26:17 +01:00
Sergei Trofimov
a72ae92ece stream: pylint/pep8 fixes. 2015-07-09 08:23:20 +01:00
Lisa Nguyen
255e6c1545 stream: Add initialize and finalize functions 
Add initalize and finalize functions in the stream workload
in addition to simplifying code.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-07-08 11:16:13 -07:00
Lisa Nguyen
c733ecad98 Add stream workload 
Initial commit of the stream workload to measure
memory bandwidth.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-07-07 11:12:28 -07:00
Sergei Trofimov
a27768fe21 rt-app: do not unintall at then end by default 
rt-app workload will no longer uninstall the executable at the
end of the run by default. A parameter can be used to re-enabed the
uninstall.
 2015-06-30 15:54:58 +01:00
Bobby Batacharia
5c53f394cb Initial commit of lmbench workload 
Remove unused includes
 2015-06-29 22:55:56 +01:00
Sergei Trofimov
967f9570e2 manhattan: fixing syntax error introduced by previous commit 2015-06-29 17:57:41 +01:00
Sergei Trofimov
19d6ce5486 manhattan: chaning run_timemout into a parameter and upping default to 10mins 2015-06-29 17:55:43 +01:00
Sergei Trofimov
642da319d4 linpack-cli: setting run timeout based on array size 2015-06-19 09:47:49 +01:00
Sergei Trofimov
a6e9525264 Adding command line version of linpack benchmark. 2015-06-19 09:42:16 +01:00
Sergei Trofimov
c6ede56942 rt-app: added taskset_mask parameter 2015-06-18 15:21:12 +01:00
Sergei Trofimov
0b29bda206 rt-app: removed ftrace check 
trace-cmd seems to work fine with "ftrace: true" in the config, so
removing the check that prevented both from being enabled.
 2015-06-17 10:14:08 +01:00
Sergei Trofimov
042da24e7d antutu: updating result parsing to handle Android M logcat output 
Looks like M formats logcat output with some extra ":"'s which was
screwing up the old parsing logic.
 2015-06-17 09:46:11 +01:00
Sergei Trofimov
e7fae25821 list command: can now filter results by supported platform 
Added -p option to the list command. This alows filtering results by
supported platforms, e.g.

	wa list workloads -p linux

Also adding missing supported_platforms attribute to various extensions.
If an extension does not have this attribute, the assumption is that it
is supported by all available platforms.
 2015-06-16 12:49:07 +01:00
Sergei Trofimov
15e854b8f1 telemetry: fix the doc so they no longer say it must be installed 
WA will now fetch it automatically
 2015-06-16 11:10:50 +01:00
Sergei Trofimov
d775be25f7 Removing total_tasks "metric" form rt-app, as reported as a classifier. 2015-06-15 13:07:49 +01:00
Sergei Trofimov
8dc4321deb Adding rt-app workload 2015-06-15 12:04:00 +01:00
Sergei Trofimov
67896dfd86 energy_model: adding dhrystone support 
- updated energy_model to accept dhrystone as well as sysbench as
  the workload
- added "threads" parameter to sysbench (basically, an alias for
  "num_threads") to be consistent with dhrystone
- added "taskset_mask" parameter to dhrystone to allow pinning
  it to specific cores.
 2015-06-11 10:10:36 +01:00
Vasilis Flouris
88ba8e3ba7 Fixes result result processing bug in sysbench 2015-06-09 18:25:30 +01:00
Vasilis Flouris
88c304292f comment correction 2015-06-05 13:00:59 +01:00
Sergei Trofimov
f59da723fb list_or: chaniging how list_or_* functions work and adding a generic list_or 
list_or_* functions (e.g. list_or_string) will now always return a list,
however will accept lists or indivitual values. Also added a list_or()
generator function, similar to what already exists for list_of().
 2015-06-01 15:31:25 +01:00
Sergei Trofimov
a9ab67990a sysbench: updating to work on unrooted Android devices. 2015-06-01 12:21:51 +01:00
Sergei Trofimov
578dfb3d99 telemetry: fixing "test" parameter description. 2015-06-01 10:08:26 +01:00
Sergei Trofimov
506ed57ca6 fix: telemetry: ignore all return codes 
Telemetry seems to return random values as return code, so completely
ignore them and don't treat any values as errors.
 2015-05-27 17:25:17 +01:00
Sergei Trofimov
260616711f removing unused variable. 2015-05-26 09:29:59 +01:00
Sergei Trofimov
b9a8f6155c telemetry: remove obsolete metrics. 2015-05-15 14:09:53 +01:00
Sergei Trofimov
512bacc1be Adding classifiers to metrics and updating csv and telemetry to take advantage of them 
- Adding "classifiers" field to Metric objects. This is a dict mapping
  classifier names (arbitrary strings) to corresponding values for that
  specific metrics. This is to allow extensions to add
  extension-specific annotations to metric that could be handled in a
  generic way (e.g. by result processors).
- Updating telemetry workload to add classifiers for the url and internal
  iteration (or "time") for a particular result.
- Updating csv result processor with the option to use classifiers to
  add columns to results.csv (either using all classifiers found, or
  only for the specific ones listed).
 2015-05-14 15:15:32 +01:00
Sergei Trofimov
ee63cbde62 telemetry: automatically download if necessary 
If run_benchmark_path isn't specified, Telemetry zip archive will be
downloaded and extracted into dependencies.
 2015-05-13 14:33:13 +01:00
Sergei Trofimov
e7b58c72ac telemetry: added fps extraction 
Also fixed text that mistakenly referred to "run_benchmarks" (plural) as
the name of the script.
 2015-05-13 14:05:15 +01:00
Sergei Trofimov
48cced2ff9 antutu: robustness fixes for v5 multi-times executions 
- added slight delays to ensure more precise navigation
- handle dialogs that occasionally pop up when re-running tests
 2015-05-12 14:29:24 +01:00
Sergei Trofimov
57d3b80e85 power_loadtest: kill any already-running autotest instances during setup 2015-05-12 14:27:04 +01:00
Sergei Trofimov
cbd2c6727f Adding ChromeOS power_LoadTest 2015-05-12 11:34:30 +01:00
Sergei Trofimov
a4bff161aa idle: updated to work on Linux devices. 2015-05-11 12:12:41 +01:00
Sergei Trofimov
62593987f4 sysbench workload updates. 
- added the ability to run based on time, rather than number of
  requests.
- added a parameter to taskset to specific core(s).

Conflicts:
	wlauto/workloads/sysbench/__init__.py
 2015-05-11 12:12:40 +01:00
Sergei Trofimov
57972a56af geekbench: upping run time out. 
Run timeout was been hit on very slow systems.
 2015-05-07 11:55:37 +01:00
Sergei Trofimov
67ad4a63e4 antutu: multi-times playback fix [part 2] 
A "please rate me" dialog occasionally pops but when returning to the
initial screen (when re-running the test). The check to dismiss it
wasn't being done at the right time, so it was still preventing
mutli-times execution. This commit resolves that issue.
 2015-05-07 10:48:26 +01:00
Vasilis Flouris
f504fc8791 A fix for spec2000 to align with device API changes 2015-05-06 17:02:48 +01:00
Sergei Trofimov
09d0736d3b antutu: fixing multi-times playback for v5 
"times" parameter didn't work properly for version 5 because an extra
back button press was required due to UI changes from previous versions.
This commit adds the button press.
 2015-05-06 12:56:58 +01:00
Sergei Trofimov
6824f045fd telemetry: adding support for Android devices 
Also, adding missing copyright header.
 2015-05-05 12:24:53 +01:00
Sergei Trofimov
1993007d49 telemetry: relaxing the initial validation check 
It seems valid install may return values other than 0xff00. Relaxing the
check to consider anything above 0xff to be valid.
 2015-05-05 08:17:43 +01:00
Sergei Trofimov
50c8c4da34 pep8: minor fixes in hackbench and ebizzy 2015-04-28 08:30:43 +01:00
setrofim
dcea921907 Merge pull request #17 from lisatn/ebizzy-workload 
Add ebizzy workload
 2015-04-28 08:27:08 +01:00
setrofim
0beb3fc3a2 Merge pull request #18 from lisatn/hackbench_workload 
Hackbench workload
 2015-04-28 08:26:58 +01:00
Lisa Nguyen
1633d91331 hackbench: Clean regex code and add run_timeout parameter 
Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-04-27 14:42:25 -07:00
Lisa Nguyen
d126d56e98 Add ebizzy workload 
Add ebizzy to allow users to run a workload resembling common
web server application workloads.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-04-27 12:53:17 -07:00
Sergei Trofimov
698240b6e0 telemetry: copy generated trace files into WA output 
If trace files have been generated during a telemetry run (e.g.
--profiler=trace was enabled), copy them into wa_output and extract
them.
 2015-04-27 15:50:59 +01:00
Lisa Nguyen
4cff2a52c0 Add hackbench workload 
Add hackbench to run tests on the Linux scheduler.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-04-26 13:12:08 -07:00
Sergei Trofimov
aef7f52f96 telemetry: ignore errors in dividuation subtests. 
check_output will ignore error code 1 returned by telemetry execution,
as this happens when individiual sub-tests and partial results may, and
should, still be extracted.
 2015-04-21 15:12:48 +01:00
Sergei Trofimov
399c9f82c3 telemetry: handle scalar values correctly. 
The result regex in telemetry workload has been updated to capture lines
reproting single value results.
 2015-04-21 13:19:21 +01:00
Sergei Trofimov
c0bb30e12d Fixing overall score generation in telemetry 
Updating overall score generation function to handle zero values.
 2015-04-16 13:00:59 +01:00
Sergei Trofimov
ee626fd36e Adding telemetry workload. 
This workload executes tests from Google's Telemetry browser test
framework. Currently, only ChromeOS devices are supported.
 2015-04-15 18:40:30 +01:00
Lisa Nguyen
e37bf90da7 sysbench: Fix spelling, descriptions, and error message 
Make the WorkloadError() message clearer if the sysbench
binary cannot be found on the device and host.

Also make trivial fixes to improve descriptions and fix
spelling errors.

Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
 2015-04-10 08:22:01 +01:00
Sergei Trofimov
678efa72e1 Fixing sysbench workload 
- Updated sysbench binary to a statically linked verison
- Added missing LICENSE file for the sysbench binary
- Removed Android browser launch and shutdown from workload (now runs on both
  Linux and Android)
- Updated update_result to work with the new binary
- Added missing descriptions for parameters
- Added file_test_mode parameter -- this is a mandatory argumet if test is
  fileio
- Added cmd_params parameter to pass options directily to sysbench invocation
 2015-03-25 10:31:02 +00:00
Sergei Trofimov
3e0c8aa83b glb_corporate: clear logcat in Monitor's __init__ to prevent getting results from previous run. 2015-03-16 09:36:32 +00:00
Sergei Trofimov
a747ec7e4c Initial commit of open source Workload Automation. 2015-03-10 13:09:31 +00:00