Tag: AI efficiency
Browse our exclusive articles!
QCFuse: Efficient Query-Centric Cache Fusion for RAG
Discover QCFuse, a query-centric cache fusion system that boosts RAG inference efficiency by 40% while maintaining accuracy in large language models.
How Computer Environments Boost Agentic Intelligence in LLMs
Discover how computer environments enhance agentic intelligence and efficiency in large language models, improving performance across diverse AI tasks.
SpecQuant: Ultra-Low-Bit Quantization for Large Language Models
Discover SpecQuant's spectral decomposition and adaptive truncation for efficient ultra-low-bit quantization in LLMs, boosting speed and reducing memory us...
MoBiE: Fast, Efficient Mixture of Binary Experts Inference
Discover MoBiE, a breakthrough in efficient inference for Mixture-of-Experts models using post-training quantization to boost speed and reduce memory.
Evo-L2S: Efficient Multi-Objective Model Merging
Discover Evo-L2S, a multi-objective evolutionary merging framework that boosts reasoning model efficiency and accuracy while reducing output length.