PANDUAN Perusahaan

OpenAI o1 dan o3 Model Penalaran Dijelaskan

OpenAI o1 dan o3 adalah model penalaran yang menggunakan komputasi waktu tes tambahan untuk mengerjakan soal multi-langkah dalam matematika, sains, dan pengkodean sebelum menjawab.

Dengarkan panduan iniDiceritakan oleh AI · ~7 min

Di halaman ini8 menit baca
  1. Poin-poin utama
  2. Menyelam Lebih Dalam
  3. Seeing what test-time compute buys on one problem set
  4. Implementasi Dunia Nyata
  5. Penjelasan Model Penalaran OpenAI o1 dan o3 Masa Depan
  6. Mempraktikkannya
  7. Sumber dan bacaan lebih lanjut
  8. Terus Menjelajah
  9. Pertanyaan yang sering diajukan

Poin-poin utama

  1. OpenAI o1, released in September 2024, was trained with reinforcement learning to produce a hidden chain of thought before answering.
  2. OpenAI reported o1 averaged 74% on AIME 2024 with one attempt, compared with 12% for GPT-4o.
  3. Reasoning models improve with more test-time compute, either by thinking longer per answer or by sampling many answers and choosing among them.
  4. o3 and o4-mini, released in April 2025, could use web search, Python and image tools inside their reasoning process.
  5. Hidden reasoning tokens are billed as output tokens, so reasoning models usually cost more and respond more slowly than chat models.
  6. OpenAI's PersonQA tests, reported by TechCrunch, found o3 hallucinated more often than o1, showing that longer reasoning does not guarantee accuracy.

Menyelam Lebih Dalam

OpenAI o1 and o3 are the first two generations of what OpenAI called its o-series, or reasoning models. Like earlier GPT models they are large language models: neural networks trained to predict the next token, a word or word fragment, of text. The difference is in what happens before the answer. A reasoning model first generates a long internal chain of thought, a running scratchpad of intermediate steps, checks and false starts, and only then writes its visible reply. OpenAI's announcement of o1 summarized the idea as a model that thinks before it answers. The thinking is produced as reasoning tokens, which OpenAI's API documentation says are not shown to developers but still take up room in the context window and are billed as output tokens.

The chain of thought is not just prompted; it is trained. OpenAI says o1 was trained with a large-scale reinforcement learning (RL) algorithm, a method in which a model tries many attempts and is rewarded for good outcomes rather than shown the correct text to copy. Through RL, according to the September 2024 announcement, the model learned to break hard steps into simpler ones, notice and correct its own mistakes, and switch strategies when an approach was failing. The company reported that o1's performance improved smoothly with more RL training compute and with more test-time compute, meaning more time spent thinking per question. That second axis was the headline: accuracy could be bought at inference time as well as by building a bigger model.

The timeline is short. OpenAI released o1-preview and o1-mini on 12 September 2024, followed by the full o1 in December 2024 alongside a system card describing its safety testing. On 20 December 2024 it previewed o3, and the ARC Prize Foundation published results for that preview on ARC-AGI-1, a puzzle benchmark designed to test novel pattern reasoning. o3-mini, a smaller and cheaper model aimed at science, math and coding, launched on 31 January 2025 and became the first reasoning model offered to free ChatGPT users. The full o3 and the smaller o4-mini arrived on 16 April 2025, and o3-pro followed for Pro subscribers in June 2025. OpenAI has since moved on: its posts now note that o1 is deprecated and that o3 and o4-mini are no longer available in ChatGPT and are deprecated in the API, with newer GPT-series reasoning models taking their place.

The published numbers explain the attention. On the 2024 AIME, a qualifying exam for the USA Mathematical Olympiad, OpenAI reported GPT-4o solved 12% of problems on average, while o1 averaged 74% with a single attempt, 83% with a majority vote over 64 samples, and 93% when re-ranking 1,000 samples with a learned scoring function. On Codeforces programming contests o1 reached the 89th percentile, and on GPQA Diamond, a set of graduate-level science questions, OpenAI said o1 was the first model to exceed the PhD experts it recruited for comparison. For o3, OpenAI reported 20% fewer major errors than o1 on difficult real-world tasks in external expert evaluations, and the ARC Prize Foundation reported the December 2024 preview scored 75.7% on its semi-private ARC-AGI-1 set at about $26 per task, and 87.5% using roughly 172 times more compute.

o3 also changed how reasoning connects to tools. OpenAI said o3 and o4-mini were trained with RL to decide when and how to use tools such as web search, a Python interpreter and image generation, and could chain several tool calls inside one reasoning process. They were also the first OpenAI models to put images into the chain of thought, cropping or rotating a picture mid-reasoning. With a Python interpreter, OpenAI reported o4-mini reached 99.5% on AIME 2025 on a single attempt, while cautioning that tool-assisted scores should not be compared with scores without tools.

Compared with a standard chat model, a reasoning model trades speed and cost for accuracy on problems with checkable answers. OpenAI's own human preference tests found o1-preview strongly preferred for data analysis, coding and math but not preferred on some natural language tasks such as writing. Compared with open alternatives, DeepSeek-R1, released in January 2025 and later published in Nature, showed that similar reasoning behavior, including self-reflection and verification, could emerge from reinforcement learning without human-written reasoning examples, and its authors described the training method publicly, whereas OpenAI has not published the o-series architecture or training recipe.

The limitations are well documented. The raw chain of thought is hidden: OpenAI chose to show users only a model-written summary, citing user experience, competitive advantage and the goal of monitoring the unaltered reasoning for problems such as manipulation. More thinking does not guarantee more truth. TechCrunch, citing OpenAI's o3 system card, reported that on OpenAI's PersonQA test of facts about people o3 hallucinated in 33% of answers and o4-mini in 48%, against 16% for o1, and the nonprofit lab Transluce found o3 sometimes claimed to have run code it could not have run. Benchmark context matters too: the ARC Prize Foundation noted that the o3 it tested had been trained on part of the ARC public training set and was not the same version later released.

In practice, reasoning models cost more per answer than chat models because every hidden reasoning token is billed. OpenAI's documentation recommends reserving at least 25,000 tokens for reasoning and output when starting out, warns that a response can run out of room before any visible text appears, and offers a reasoning effort setting and a cap on output tokens to control spending. Latency ranges from seconds to minutes. For simple lookups or casual writing, a faster non-reasoning model is usually the better fit.

03Contoh yang berhasil

Seeing what test-time compute buys on one problem set

  1. Pick 15 problems with exact numeric answers, such as a past AIME exam, so every answer can be checked automatically.

  2. Ask a reasoning model each question once at low reasoning effort and record accuracy, latency and the reasoning token count reported in the API usage field.

  3. Repeat at high reasoning effort and compare: accuracy usually rises, and reasoning tokens, cost and latency rise with it.

  4. For a parallel approach, sample each question 8 times at medium effort and take the most common answer as a majority vote.

  5. Compute cost per correct answer for each setting by multiplying total tokens by the published price and dividing by the number correct.

  6. Repeat the whole test with a non-reasoning chat model as a baseline.

Apa yang ditunjukkannya

A small table of accuracy, latency and cost per correct answer for each setting. It should show the pattern OpenAI reported for o1, accuracy rising with test-time compute, and make the price of that gain concrete.

Implementasi Dunia Nyata

Solving AIME 2024 competition math: OpenAI reported o1 averaged 74% of problems with one sample, against 12% for GPT-4o, and 93% when re-ranking 1,000 samples.

Competitive programming: a model fine-tuned from o1 scored 213 points at the 2024 International Olympiad in Informatics under contest rules, placing in the 49th percentile.

Multi-step research in ChatGPT with o3, which OpenAI said could search the web, run Python on uploaded data and generate charts, chaining tool calls in a single answer.

Reading blurry whiteboard photos or hand-drawn diagrams with o3 and o4-mini, which OpenAI said could crop, zoom and rotate images as part of their reasoning.

Tuning cost and latency in the API with o3-mini's three reasoning effort settings, low, medium and high, so simple requests think briefly and hard ones think longer.

Penjelasan Model Penalaran OpenAI o1 dan o3 Masa Depan

OpenAI described o3 as pushing an additional order of magnitude of compute into both RL training and inference-time reasoning while still seeing gains, and it has since folded reasoning into newer GPT-series models rather than a separate o-series line. Several questions remain open. The hallucination results reported for o3 and o4-mini in April 2025 show that longer reasoning can raise confident errors on factual questions, and the cause is not settled. Chain-of-thought monitoring, which OpenAI cited as a reason to keep reasoning hidden but unaltered, depends on the chain staying faithful to the model's actual computation, which is an active research topic. Benchmarks are saturating: the ARC Prize Foundation called ARC-AGI-1 saturating in 2024 and launched the harder ARC-AGI-2, on which it said early o3 data pointed to under 30% even at high compute. Open-weight work that began with DeepSeek-R1 in January 2025 has made reasoning training reproducible outside OpenAI, so cost per correct answer, not only peak scores, is becoming the main point of comparison.

Mempraktikkannya

Mengapa itu penting

  • Strategi vendor. Peta jalan vendor memengaruhi fitur apa yang dapat dibangun tim Anda selanjutnya.
  • Biaya dan anggaran. Persyaratan komersial dan opsi penerapan memengaruhi biaya dan risiko jangka panjang.
  • Risiko dan keselamatan. Insentif perusahaan membentuk standar produk, postur keselamatan, dan keterbukaan.

Hati-hati

  • Pengumuman peluncuran mungkin melampaui stabilitas alur kerja produksi sebenarnya.
  • Penetapan harga API atau perubahan kebijakan dapat mematahkan asumsi dalam sekejap.
  • Ketergantungan pada vendor tunggal meningkatkan biaya lock-in dan migrasi.

Langkah selanjutnya

  1. Evaluasi penyedia menggunakan tugas dan kumpulan data Anda sendiri.
  2. Tinjau persyaratan privasi, keamanan, dan hukum sebelum integrasi.
  3. Pertahankan rencana cadangan di seluruh model atau vendor.
  4. Pantau catatan rilis agar perubahan peta jalan tidak mengejutkan tim.

Sumber dan bacaan lebih lanjut

  1. OpenAILearning to reason with LLMs
  2. OpenAIIntroducing OpenAI o3 and o4-mini
  3. OpenAIOpenAI o3-mini
  4. OpenAI API documentationReasoning models
  5. arXiv (OpenAI)OpenAI o1 System Card
  6. ARC Prize FoundationOpenAI o3 Breakthrough High Score on ARC-AGI-Pub
  7. TechCrunchOpenAI's new reasoning AI models hallucinate more
  8. arXiv (published in Nature, 2025)DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Terus Menjelajah

Buletin gratis

Dapatkan pengarahan AI harian

Tiga cerita AI terverifikasi setiap pagi hari kerja, ditulis dalam bahasa Inggris sederhana. Gratis selamanya, tanpa iklan.

Satu email setiap hari kerja. Berhenti berlangganan dalam satu klik. Kami tidak pernah menjual atau membagikan alamat Anda.

Uji diri Anda sendiri

Take the OpenAI o1 and o3 Reasoning Models Explained quiz

Umpan balik instan untuk setiap jawaban, dan sertifikat yang dapat dibagikan dengan ID yang dapat diverifikasi setelah Anda lulus kursus.

Mulai kuis

Mendukung pendidikan AI gratis. AI Understanding adalah organisasi nirlaba 501(c)(3) — tanpa iklan, tanpa paywall, selamanya. Berikan sumbangan

Pertanyaan yang sering diajukan

What is OpenAI o1 and o3 Reasoning Models Explained?

OpenAI o1 dan o3 adalah model penalaran yang menggunakan komputasi waktu tes tambahan untuk mengerjakan soal multi-langkah dalam matematika, sains, dan pengkodean sebelum menjawab.

What does OpenAI’s o-series documentation say the models use before returning a final answer?

OpenAI describes internal reasoning tokens, but this does not mean users receive a complete human-readable reasoning transcript.

What does OpenAI say is part of the o1 series training approach?

OpenAI describes reinforcement learning as part of o1 training for complex reasoning; avoid generalizing the specific training disclosure to every later model.

What does inference-time compute scaling mean for reasoning models?

OpenAI describes additional reasoning computation, but measured gains depend on the task and may increase token use or latency.

How should a reported benchmark score for an OpenAI reasoning model be interpreted?

Scores depend on model version, reasoning effort, benchmark setup, and evaluation harness; do not generalize one number to all tasks or versions.

Why might internal reasoning tokens affect API cost even when users do not see them?

OpenAI documentation explains that reasoning tokens consume output tokens and context capacity even when not shown in the final response.