Tag: transformer models
Browse our exclusive articles!
Data Augmentation for Transformer Models in NGSS AI Scoring
Improve AI scoring of NGSS scientific explanations using data augmentation and resampling to tackle class imbalance in transformer-based models.
BEAT: Efficient Tokenization for Symbolic Music Generation
Discover BEAT, a novel tokenization method using uniform temporal steps to enhance symbolic music generation quality and coherence.
Local Linearity Enables Optimal Activation Steering in LLMs
Discover how local linearity in LLMs allows model-based linear optimal control for precise activation steering and improved AI alignment during inference.
FP16 Divergence in KV-Cached Autoregressive Inference Explained
Explore the causes and impacts of systematic FP16 divergence in KV-cached transformer inference and its effects on model accuracy and stability.
Causal Evidence of Hallucination Dynamics in Transformer Models
Explore causal evidence revealing asymmetric attractor dynamics causing hallucination in transformer language models and how prompt encoding influences out...