Semantic Accuracy
/ semantic-accuracy /
Why it matters
Fluency is cheap; correctness is not. Evals must judge whether answers are right in meaning, or agents get rewarded for sounding confident.
Related — Testing & Simulation
/ semantic-accuracy /
Why it matters
Fluency is cheap; correctness is not. Evals must judge whether answers are right in meaning, or agents get rewarded for sounding confident.
Related — Testing & Simulation
