summaryrefslogtreecommitdiff
path: root/client/benchmarks
AgeCommit message (Collapse)Author
2018-08-12Upload test results to from client to web serverMark Wong
2018-07-18Save postgres branch, commit, and settings in results jsonMark Wong
2018-06-01Fix calculation of metrics for pgbench resultsMark Wong
2018-02-10Refactor pgbench results outputMark Wong
The idea is that one results document represents a test of one particular commit. Then it contains the results of all the tests run against that commit. I think it makes more sense to restructure the pgbench results to be like: { "pgbench": { "ro": { "results at a scale factor": { "number of clients": { "std": 4389.727756305762, "metric": 41390.590287, "median": 43137.716637, "results": [ { ... pgbench results of a test ... } ... ] }, .... }, "rw": { ... read write test results ... }, ... other tests results }
2018-02-04Move results directory check to start of clientMark Wong
Between the benchmark and collector modules, it's not clear who might have created the output directory first. Leave a warning in the benchmark modules for now, otherwise don't let it prevent the tests from running.
2018-01-30Set cwd when running pgbenchMark Wong
The output directory is used for the cwd when executing pgbench so that the output files are saved in the results directory.
2018-01-05Always write results of a test to results.jsonMark Wong
The idea is to keep things simple by having a directory of results per test, and to have each directory with a consistently named results files.
2018-01-05Capture uname informationMark Wong
It has some things that are not in the sysctl information. Like hardware architecture.
2018-01-05Stop storing log files as jsonMark Wong
Keep the json results document small by saving log information externally. This include: * postgres log * pgbench output * sar output
2018-01-05Fix use of env in call()Mark Wong
The env parameter to call() was clearing the PATH environment to only have the postgres binary install path. Modify only the PATH environment.
2017-12-19Saved timestamp from test startMark Wong
2017-08-04Fix check for csv flagMark Wong
2017-08-04Fix handling of csv optionMark Wong
2017-08-04pep8 coding styleMark Wong
2017-02-27also add CSV output to pgbenchTomas Vondra
2017-02-27add support for collecting results into simple CSV fileTomas Vondra
Originally the results were collected into a JSON format, which is not very convenient when running ad-hoc benchmarks.
2017-02-27Check configuration before running any benchmarksTomas Vondra
Before doing any heavy-lifting, check existence of directories, binaries and some other sanity checks.
2017-02-27Rework the perffarm client configuration.Tomas Vondra
Instead of configuration hardcoded into the perffrarm-client.py script, move it into a separate settings.py file, and allow override using settings_local.py (not required). Also somewhat improve the benchmark configurations by allowing specifying number of runs, durations etc. in the configuration file (instead of using default parameter values).
2017-02-27Import initial version of the clientTomas Vondra