| Age | Commit message (Collapse) | Author |
|---|
|
|
|
|
|
|
|
The idea is that one results document represents a test of one
particular commit. Then it contains the results of all the tests run
against that commit. I think it makes more sense to restructure the
pgbench results to be like:
{
"pgbench": {
"ro": {
"results at a scale factor": {
"number of clients": {
"std": 4389.727756305762,
"metric": 41390.590287,
"median": 43137.716637,
"results": [
{
... pgbench results of a test ...
}
...
]
},
....
},
"rw": {
... read write test results ...
},
... other tests results
}
|
|
Between the benchmark and collector modules, it's not clear who might
have created the output directory first. Leave a warning in the
benchmark modules for now, otherwise don't let it prevent the tests from
running.
|
|
The output directory is used for the cwd when executing pgbench so that
the output files are saved in the results directory.
|
|
The idea is to keep things simple by having a directory of results per
test, and to have each directory with a consistently named results
files.
|
|
It has some things that are not in the sysctl information. Like
hardware architecture.
|
|
Keep the json results document small by saving log information
externally. This include:
* postgres log
* pgbench output
* sar output
|
|
The env parameter to call() was clearing the PATH environment to only
have the postgres binary install path. Modify only the PATH
environment.
|
|
|
|
|
|
|
|
|
|
|
|
Originally the results were collected into a JSON format, which is
not very convenient when running ad-hoc benchmarks.
|
|
Before doing any heavy-lifting, check existence of directories,
binaries and some other sanity checks.
|
|
Instead of configuration hardcoded into the perffrarm-client.py
script, move it into a separate settings.py file, and allow
override using settings_local.py (not required).
Also somewhat improve the benchmark configurations by allowing
specifying number of runs, durations etc. in the configuration
file (instead of using default parameter values).
|
|
|
