Tag: AI Benchmarks
Browse our exclusive articles!
MARCH Benchmark: Advancing Ambiguity in Multi-hop Inference
Discover MARCH, a new benchmark evaluating ambiguity interpretation in multi-hop inference, highlighting AI challenges and the CLARION framework.
MERRIN: Benchmark for Multimodal AI Search in Noisy Web
Discover MERRIN, a benchmark testing AI agents on multimodal evidence retrieval and reasoning in noisy web environments with complex search queries.
DeEscalWild: Benchmark for Automated Police De-Escalation Training
DeEscalWild offers a real-world dataset to train Small Language Models for effective, scalable police de-escalation simulations and safer community interac...
Evaluating LLM Reasoning in Coding Tasks with CodeRQ-Bench
Discover CodeRQ-Bench, the first benchmark to evaluate large language model reasoning in coding tasks, improving assessment beyond output correctness.
Filtered Reasoning Score: Assessing LLM Reasoning Quality
Discover the Filtered Reasoning Score (FRS) to evaluate large language models' reasoning quality beyond accuracy using top-confident traces.