Apache-2.0
  1. 01
    smoke

    1 task
  2. 02
    standard

    4 task
  3. 03
    full

    5 task

01 —

01

02

03

04

80%
10%
5%
5%

02 —

  1. 01

  2. 02

  3. 03

  4. 04

03 —

04 —

05 —

localagent-benchmark
$ python3 benchmark.py doctor
$ python3 benchmark.py list
$ python3 benchmark.py case validate
$ python3 benchmark.py run --profile smoke \
    --models MODEL_NAME --thinking off
$ python3 dashboard.py

06 —