Rank
Concept
A hyperparameter in LoRA that controls the dimensionality of the decomposed matrices, impacting the reduction in trainable parameters. Lower ranks drastically reduce parameters while maintaining performance.
Mentioned in 1 video
A hyperparameter in LoRA that controls the dimensionality of the decomposed matrices, impacting the reduction in trainable parameters. Lower ranks drastically reduce parameters while maintaining performance.
