Tag: AI benchmarking
Browse our exclusive articles!
CODS 2025 AssetOpsBench Challenge Results & Insights
Explore key results and analysis from the CODS 2025 AssetOpsBench Challenge on multi-agent orchestration and industrial AI performance.
GSM-SEM: Robust Framework for Semantic Benchmark Variants
Discover GSM-SEM, a framework generating semantically diverse benchmark variants to improve AI model evaluation and reduce memorization bias.
Scalable Framework for Interpretable LLM Evaluation
Discover a scalable, interpretable framework using Item Response Theory to accurately evaluate large language models beyond average accuracy.
PostEDA-Bench: Benchmarking AI for Circuit Design PPA & DRC
Discover PostEDA-Bench, a hierarchical benchmark for evaluating AI in circuit design, focusing on PPA convergence and DRC fixing performance.
Metacognitive Monitoring in 33 Frontier LLMs: Domain Insights
Explore domain-level metacognitive monitoring in 33 top LLMs, revealing key performance variations across benchmarks and model families.