maas-base/docs/user-guide/benchmarking.md

Benchmarking

MaaS-Base can run benchmarks against running model instances. Benchmarks are executed by workers in a dedicated benchmark container image, with results and logs stored on the worker.

Prerequisites

• A model instance is running and healthy.

Create Benchmark

1. Go to the Benchmarks page.
2. Click the Add Benchmark.
3. Select an instance and fill in the configurations.
4. Click the Save button.

View Benchmark Results

1. Go to the Benchmarks page.
2. Find the benchmark you want to view.
3. Click the benchmark name to view the results and configurations snapshot.

Export Benchmark Results

1. Go to the Benchmarks page.
2. Find the benchmark you want to export.
3. Select one or more benchmark runs to export.
4. Click the Export button to download the results.

Edit Benchmark

1. Go to the Benchmarks page.
2. Find the benchmark you want to edit.
3. Click the Edit button in the Operations column.
4. Modify the name, description as needed.
5. Click the Save button.

Delete Benchmark

1. Go to the Benchmarks page.
2. Find the benchmark you want to delete.
3. Click the Delete button in the Operations column.
4. Confirm the deletion.