Sáp nhập mô hình tiến hóa Sakana AI

Sakana AI was founded by Llion Jones, a co-author of the Transformer paper Attention Is All You Need, and David Ha. Sakana means fish in Japanese, reflecting the company’s interest in nature-inspired collective intelligence. Its Evolutionary Model Merge work explores automated combinations of pretrained foundation models. The method represents candidate merge recipes, evaluates resulting models on chosen tasks, and uses evolutionary optimization to refine candidates. Sakana’s publication describes parameter-space merging and layer-wise model composition experiments; findings are tied to the tested models and benchmarks. The company also develops other research systems, including The AI Scientist, a multi-agent system for automating parts of scientific research. These efforts are distinct projects. Reusing pretrained weights can avoid a full from-scratch training run, but it still requires compatible inputs, compute for search and evaluation, and careful testing for quality and inherited limitations. Sakana’s separate AI Scientist system is described in its own paper as generating research ideas, code, experiments, visualizations, and papers with a simulated review process; this is distinct from evolutionary model merging.