If AI's So Good, Why Can't It Make Its Own Data?

Can a neural network write its own data and skyrocket past GPT-4? In today's video, we dissect the brand-new “Self-Adapting Language Models” paper (SEAL), where an LLM fabricates synthetic data, tunes LoRA adapters, and after just two rounds, outperforms much larger models on SQuAD and ARC.