Tag: synthetic-data

Blog Post·2024-06-19·7 min read

Synthetic Data for Alignment: Curation, Quality Filtering, and Self-Critique

Human annotation doesn't scale to the data volumes modern alignment requires. Synthetic data — generated by LLMs, filtered, and refined — has become the dominant approach. Here's how it's done and where it breaks down.

alignment synthetic-data sft data-curation llm-training

Blog Post·2024-06-19·7 min read

Synthetic Data for Alignment: Curation, Quality Filtering, and Self-Critique

alignment synthetic-data sft data-curation llm-training