Tag: AI evaluation
Browse our exclusive articles!
Agent-Based AI Evaluation: Log Scores & Power-Law Insights
Explore how logarithmic scores and power-law patterns improve reliability in agent-based AI evaluations with persona-driven judges.
Security Challenges in LLM-as-a-Judge Systems Explained
Explore key security risks and defenses in LLM-as-a-Judge systems with our comprehensive analysis and future research directions.
PSPA-Bench: Benchmark for Personalized Smartphone GUI Agents
Discover PSPA-Bench, a benchmark evaluating personalized smartphone GUI agents with 12,855+ instructions across 22 apps for real-world user workflows.
SciVisAgentBench: Benchmark for Scientific Visualization AI
Discover SciVisAgentBench, a benchmark for evaluating AI agents in scientific data analysis and visualization with expert-crafted cases and robust metrics.
Emergence WebVoyager: Standardizing Web Agent Evaluation
Discover Emergence WebVoyager, a benchmark for consistent, transparent evaluation of AI web agents, improving reliability and reproducibility in real-world...