Blog Post··6 min read
Designing Safety Benchmarks for LLMs: What Makes an Eval Good
Most safety benchmarks are gameable, distribution-shifted, or measure the wrong thing. Here's what separates a rigorous safety evaluation from a checkbox.
Tag: benchmarking
Blog Post··6 min read
Designing Safety Benchmarks for LLMs: What Makes an Eval Good
Most safety benchmarks are gameable, distribution-shifted, or measure the wrong thing. Here's what separates a rigorous safety evaluation from a checkbox.