blob: b2d984e212e27af2d4a024404d47286893067d74 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
|
# Visual Data Analysis
The parameter and NFP filters from [Textual Data Analysis](analysis-textual.md) apply here as well.
## Raw Data Visualization
There are two ways of visualizing all measured data independent of their parameters:
* `--boxplot-unparam PREFIX` writes boxplots of all observations to PREFIX(name)-(attribute).pdf and combined boxplots to PREFIX(name).pdf.
These may be helpful to see which observations are stable and which show a lot of variance, possibly due to the influence of parameters.
By default, the boxplots are also shown interactively; use `--non-interactive` to display that.
* `--plot-unparam=name:attribute:ylabel` plots all observations of name/attribute in the order in which they were observed.
Useful to identify trends (especially when the parameter variation scheme is known as well) and interference.
The plot is shown interactively, but not written to the filesystem.
## LaTeX TikZ/PGF raw data visualization
`--export-pgf-unparam PREFIX` writes measurement index, attribute value,
and parameter values to PREFIX(name)-(attribute).txt.
This is essentially `--boxplot-unparam` for TikZ/PGF.
## Influence of a single Non-Functional Property on a Performance Attribute
Assume that we want to see how the number of requested UPMEM DPUs (`n_dpus`)
influences the latency of its `dpu_alloc` call (`latency_dpu_alloc_us`). In
dfatool terms, this means that we want to visualize the influence of the
parameter (or NFP) `n_dpus` on the attribute `latency_dpu_alloc_us`.
`--plot-param 'NMC reconfiguration:latency_dpu_alloc_us:n_dpus'` does just
that. "NMC reconfiguration" is the benchmark key, followed by attribute and
parameter name. It shows each distinct configuration (parameter/NFP value) in
a different colour. Combining it with `--filter-param` and `--ignore-param`
may help de-clutter the plot.
dfatool will additionally plot the predicted performance for each distinct
configuration as a solid line. The plot is saved to (name)-(attribute)-(parameter).pdf
and shown interactively unless `--non-interactive` has been specified.
|
