Tag: low-rank adaptation
Browse our exclusive articles!
Bayesian-LoRA: Probabilistic Adaptation for Large Language Models
Discover Bayesian-LoRA, a probabilistic low-rank adaptation method that improves calibration and uncertainty in large language models with minimal paramete...
Polynomial Expansion Rank Adaptation for Efficient Fine-Tuning
Discover Polynomial Expansion Rank Adaptation (PERA) to enhance low-rank fine-tuning with high-order interactions for better large language model performan...
LoRA-DA: Data-Aware Initialization for Efficient LoRA
Discover LoRA-DA, a data-aware initialization method boosting low-rank adaptation with faster convergence and improved accuracy in parameter-efficient fine...
TalkLoRA: Efficient Communication in Low-Rank Adaptation for LLMs
Discover TalkLoRA, a communication-aware low-rank adaptation method that boosts efficiency and stability in large language model fine-tuning.
FLeX: Efficient Multilingual Code Generation with LoRA
Discover FLeX, a Fourier-based low-rank expansion method for efficient multilingual code generation using LoRA and optimized fine-tuning.