logic-engine / scripts /README.md
ghostdrive1's picture
Upload folder using huggingface_hub
116524e verified
|
Raw
History Blame Contribute Delete
678 Bytes
# Benchmark Scripts
Scripts for running ACE benchmarks and analyzing results.
## Scripts
- `run_benchmark.py` - CLI to run ACE benchmarks with train/test splits
- `analyze_ace_results.py` - Analyze benchmark results
- `explain_ace_performance.py` - Generate explanations for ACE performance patterns
## Usage
```bash
# List available benchmarks
uv run python scripts/run_benchmark.py list
# Run ACE evaluation
uv run python scripts/run_benchmark.py simple_qa --limit 50
# Compare baseline vs ACE
uv run python scripts/run_benchmark.py simple_qa --limit 50 --compare
```
See [benchmarks/README.md](../benchmarks/README.md) for full documentation.