File size: 678 Bytes
116524e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
# Benchmark Scripts

Scripts for running ACE benchmarks and analyzing results.

## Scripts

- `run_benchmark.py` - CLI to run ACE benchmarks with train/test splits
- `analyze_ace_results.py` - Analyze benchmark results
- `explain_ace_performance.py` - Generate explanations for ACE performance patterns

## Usage

```bash

# List available benchmarks

uv run python scripts/run_benchmark.py list



# Run ACE evaluation

uv run python scripts/run_benchmark.py simple_qa --limit 50



# Compare baseline vs ACE

uv run python scripts/run_benchmark.py simple_qa --limit 50 --compare

```

See [benchmarks/README.md](../benchmarks/README.md) for full documentation.