Tag: AI acceleration
Browse our exclusive articles!
Accelerating Multimodal Models with Hardware & Software
Discover hardware and software techniques to boost multimodal foundation models' efficiency, performance, and adaptability in AI applications.
Google Launches TPU v8 Chips for Advanced AI Era
Discover Google's new TPU v8-1 and v8-2 chips designed to boost AI training and real-time inference for smarter, faster applications.
Boost Generative AI Inference with Amazon SageMaker G7e
Accelerate generative AI on Amazon SageMaker using powerful G7e instances with NVIDIA RTX PRO 6000 GPUs for unmatched performance and cost efficiency.
SpecBranch: Boosting LLM Speed with Hybrid Speculative Decoding
Discover SpecBranch, a novel hybrid speculative decoding method that improves large language model inference speed by up to 4.5× with rollback-aware branch...
ECHO: Fast Speculative Decoding for High-Concurrency LLMs
ECHO boosts large language model inference with elastic speculative decoding and sparse gating, achieving up to 5.35x speedup in high-concurrency scenarios...