Blog Post··5 min read
Loss Functions: What You Optimize Is What You Get
The loss function is the specification. Everything the model learns is in service of minimizing it. Here's the math behind every major loss used in LLM training and fine-tuning.
Tag: loss-functions
Blog Post··5 min read
Loss Functions: What You Optimize Is What You Get
The loss function is the specification. Everything the model learns is in service of minimizing it. Here's the math behind every major loss used in LLM training and fine-tuning.