Tag: deep learning
Browse our exclusive articles!
Diversity-Aware Reverse KL Divergence for LLM Distillation
Explore Diversity-aware Reverse KL Divergence (DRKL) to improve large language model distillation with better performance and output diversity.
QUEST: Robust Query-Modulated Spherical Attention in Transformers
Discover QUEST, a stable and robust query-modulated spherical attention method enhancing Transformer training and performance across domains.
Epileptic Seizure Detection Using GCN on EEG Frequency Bands
Detect epileptic seizures accurately using graph convolutional neural networks on EEG frequency bands with advanced feature analysis.
Self-Routing: Parameter-Free Expert Routing for MoE Models
Discover Self-Routing, a parameter-free expert routing method that boosts MoE model efficiency by using hidden states without a learned router.
AI-Driven Optimization for Sheet Metal Forming Design
Discover how AI enhances sheet metal forming by optimizing design parameters, reducing costs, and cutting environmental impact efficiently.