GPT-Verlauf

The 2018 work combined unsupervised language-model pretraining with supervised adaptation to language-understanding tasks. Its contribution concerned how a broadly pretrained transformer could support multiple downstream tasks with task-specific fine-tuning. The 2019 GPT-2 report examined language models as unsupervised multitask learners. It studied whether a next-token language model could perform tasks described through text without a separate training procedure for each task. The research framing matters: a result on a particular evaluation does not imply that every task is solved. The 2020 GPT-3 work emphasized few-shot evaluation. Examples were included in the input context, allowing the model to attempt a task without a gradient update for that individual task during the reported evaluation. This is different from fine-tuning model parameters on a labeled dataset. Keep research names, model versions, and products distinct. Chat interfaces, retrieval, tools, and later adaptation can change how a system behaves beyond its base language model. Historical results should be read with their datasets, prompts, evaluation settings, and limitations. They are evidence of a particular experiment rather than timeless measurements of current products.