Pre-Publication V2. The process of further training a pre-trained foundational model on a smaller, task-specific dataset to adapt its behavior for a defined application, domain, or style. Fine-tuning preserves the broad capabilities of the base model while improving performance on targeted tasks. Implementations range from full parameter updates to parameter-efficient methods such as LoRA. See also Custom Model: LoRA, Custom Model: Supervised Fine-Tune.
Deliberation Summary:
Question on the relationship between this term and foundational model.
Pre-Publication V1. The process of further training a pre-trained foundational model on a smaller, task-specific dataset to adapt its behavior for a defined application, domain, or style. Fine-tuning preserves the broad capabilities of the base model while improving performance on targeted tasks. Implementations range from full parameter updates to parameter-efficient methods such as LoRA. See also Custom Model: LoRA, Custom Model: Supervised Fine-Tune.