Tag: agent benchmarking
Browse our exclusive articles!
RARE: Redundancy-Aware Evaluation for Similar Document Retrieval
Discover RARE, a framework improving retrieval evaluation for high-similarity corpora in finance, legal, and patents by tracking redundancy effectively.
TabularMath: Enhancing Math Reasoning Over Tables with LLMs
Explore TabularMath, a benchmark improving large language models' math reasoning over complex tabular data in real-world scenarios.
VEFX-Bench: Benchmarking AI Video Editing Quality
Discover VEFX-Bench, a comprehensive benchmark and dataset for evaluating AI-driven video editing and visual effects with human-annotated quality metrics.
UniEditBench: Cost-Effective Benchmark for Image & Video Editing
UniEditBench offers a unified, cost-effective benchmark for evaluating image and video editing with distilled multimodal language models.
ReactBench: Benchmarking Structural Reasoning in MLLMs
ReactBench evaluates MLLMs' structural reasoning on complex chemical reaction diagrams, revealing key performance gaps in topological understanding.