ylliX - Online Advertising Network

A brief summary of language model finetuning

Fine-tuning techniques: The term โ€œfine tuningโ€ refers to further training a pretrained model. In the case of LLMs, this means that we take a pretrained foundation model and train it some more. But, there are so many different ways that this training can be done, which makes the concept of fine tuning incredibly vague. This […]