Tag: AI evaluation
Browse our exclusive articles!
Failure-Focused Evaluation for Trilingual Public AI Agents
Discover PSA-Eval, a failure-centered framework improving runtime evaluation of deployed trilingual public-space AI agents for enhanced reliability.
Bias Mitigation in LLM Judges: Effective Strategies Tested
Explore key bias types in LLM judge models and discover the most effective strategies to reduce bias in AI evaluation pipelines.
BLAST: Benchmarking LLMs for ASP Code Generation
Discover BLAST, a novel framework to benchmark large language models' accuracy in generating ASP code with unique semantic metrics.
Evaluating Generative AI as Pluralist Sociotechnical Systems
Explore a pluralist framework for evaluating generative AI, focusing on sociotechnical interactions, values, and responsible benchmarks beyond static measu...
MedSkillAudit: Audit Framework for Medical AI Agent Skills
MedSkillAudit offers a domain-specific audit framework ensuring reliability and quality of AI agent skills in medical research.