Tag: LLM evaluation
Browse our exclusive articles!
IndustryBench: Benchmarking LLMs for Safe Industrial QA
Discover IndustryBench, a benchmark evaluating large language models on safety and accuracy in industrial procurement QA across multiple languages.
MathlibPR: Benchmarking Merge-Readiness in Math Libraries
Discover MathlibPR, a benchmark evaluating LLMs' ability to assess pull request merge-readiness in formal mathematical libraries like Mathlib.
Scalable Framework for Interpretable LLM Evaluation
Discover a scalable, interpretable framework using Item Response Theory to accurately evaluate large language models beyond average accuracy.
IntentGrasp Benchmark: Boosting Intent Understanding in LLMs
Discover IntentGrasp, a benchmark evaluating and improving intent understanding in LLMs with Intentional Fine-Tuning for better AI-human interaction.
Evaluating LLM Web Generation: Single-File HTML Test
A longitudinal study comparing GPT, Gemini, Grok, and Claude in single-file HTML generation with social reach tracking and performance analysis.