Autodata: An agentic data scientist to create high quality synthetic data

Very important Meta paper brings Autodata, an agentic data scientist to create high quality synthetic data. The main result is that agent-made data usually trained models better than standard synthetic data, and in legal tasks a trained 4B model beat a much larger 397B baseline. Treats synthetic data generation as a job for an agentic data scientist, not a prompt template. “Agentic Self-Instruct,” makes AI agents generate and meta-optimize synthetic training and evaluation data, improving performance over classical synthetic data methods across CS, legal, and math benchmarks. Autodata’s loop is simple: generate an example, let a weak model and a strong model try it, judge the results, then revise the recipe until the example sits in the useful zone. This is the best idea in the paper: difficulty is not a virtue by itself. A task should not just be “hard”; it should be hard in a way that teaches the weaker model something. If the weak model always gets it right, there is nothing to learn; if it always gets zero, there is also nothing to learn. --- The direction feels important because it reframes synthetic data from bulk imitation into curriculum design. The next frontier may not be models writing more examples, but models learning what makes an example worth learning from. ---- Link – arxiv. org/abs/2606.25996v1 Title: "Autodata: An agentic data scientist to create high quality synthetic data"