Tag: LLM evaluation
Browse our exclusive articles!
Evaluating LLMs on 1M-Token Contexts for Classical Chinese
Explore LLM performance on 1M-token context windows with retrieval and multi-hop reasoning in classical Chinese texts. Key insights on model accuracy and d...
NeuroState-Bench: Benchmarking Commitment Integrity in LLMs
Discover NeuroState-Bench, a human-calibrated benchmark assessing commitment integrity in LLM agent profiles for reliable multi-turn task performance.
Evaluating Legal Reasoning with LEGIT Issue Tree Rubrics
Discover how LEGIT dataset and legal issue tree rubrics improve AI legal reasoning evaluation with expert annotations and structured argument trees.
Can Coding Agents Reproduce Computational Materials Science?
Explore how coding agents perform in reproducing findings in computational materials science using the new AutoMat benchmark.
ARMOR 2025: Benchmarking Military Safety for Large Language Models
Discover ARMOR 2025, a benchmark designed to evaluate large language models' safety and compliance with military legal and ethical standards.