InayofuataMwongozo unaofuata
Kumbukumbu ya Wakala wa Episodic na Semantic
Kiufundi
MWONGOZO wa Kiufundi
Wakala wa Minecraft wa Voyager na Maktaba ya Ustadi
Voyager ni wakala wa Minecraft anayeendeshwa na LLM ambaye hujifunza maktaba ya ustadi inayoweza kutumika tena, na kuiruhusu kutatua kazi mpya kupitia mafunzo ya maisha yote badala ya kuanza kutoka mwanzo kila wakati.
Sikiliza mwongozo huuInaonyeshwa na AI · ~7 min
Katika ukurasa huudk 8 kusoma
Mambo muhimu ya kuchukua
- Voyager is a 2023 Minecraft agent that uses GPT-4 to write, test and store reusable JavaScript skills without fine-tuning any model.
- Its three parts are an automatic curriculum, an iterative prompting loop with self-verification, and an embedding-indexed skill library.
- Voyager found 3.3 times more unique items and unlocked tech-tree tiers up to 15.3 times faster than ReAct, Reflexion and AutoGPT baselines.
- Removing self-verification cut discovered items by 73 percent, and a random curriculum cut them by 93 percent, in the paper's ablations.
- Storing skills as code outside the model lets an agent add abilities without overwriting old ones.
Dive ya kina
A skill-library agent is an AI agent that saves successful behaviors as reusable units, usually small programs, and retrieves them later instead of solving every problem from scratch. Voyager is the best-known example. It was introduced in the paper 'Voyager: An Open-Ended Embodied Agent with Large Language Models' by Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi 'Jim' Fan and Anima Anandkumar, posted to arXiv on 25 May 2023, with authors from NVIDIA, Caltech, UT Austin, Stanford and other universities. The authors describe it as the first large-language-model-powered lifelong learning agent in Minecraft, meaning it keeps acquiring skills over a long session without a human setting goals.
Minecraft suits this research because it is open-ended. A player starts with nothing, gathers wood, crafts tools, mines stone and iron, and eventually reaches diamond tools, a sequence called the tech tree. There is no single score to maximize. Voyager does not see pixels or press keys. It controls the game through Mineflayer, a JavaScript library for Minecraft bots, on top of the MineDojo research framework. Its actions are programs: GPT-4 writes JavaScript functions that call Mineflayer commands such as mining a block or crafting an item.
Voyager has three components that run in a loop. The first is an automatic curriculum. GPT-4 receives the agent's inventory, equipment, nearby blocks, biome, time of day and lists of completed and failed tasks, and proposes the next task under the overall goal of discovering as many diverse things as possible. If the agent is in a desert, it might learn to harvest sand and cactus before iron. The second is the iterative prompting mechanism. GPT-4 writes a program for the task, the program runs, and three kinds of feedback come back: in-game messages, for example a note that a stone shovel cannot be crafted until two more sticks are available, JavaScript error traces, and a verdict from a second GPT-4 instance acting as a critic that checks whether the task succeeded. The code is revised with that feedback, for up to four rounds, before the curriculum moves on.
The third component is the skill library. When the critic confirms success, the program is stored. Its key is an embedding, a numeric vector capturing meaning, of a short description of the program written by GPT-3.5 and embedded with OpenAI's text-embedding-ada-002. When a new task arrives, Voyager embeds the task plus a GPT-3.5 suggestion for solving it, and retrieves the five most similar stored skills to place in GPT-4's prompt. New programs can call old ones, so a function like crafting an iron pickaxe can reuse smelting and stick-crafting skills. Because skills are saved code rather than changed model weights, learning a new skill cannot overwrite an old one, which the authors present as a way around catastrophic forgetting.
The paper's results are large relative to its baselines, which were prompting agents adapted to the same setup: ReAct, which interleaves reasoning and actions; Reflexion, which adds self-reflection; and AutoGPT, a popular autonomous task loop. Voyager obtained 3.3 times more unique items, traveled 2.3 times longer distances, and unlocked the wooden, stone and iron tool tiers 15.3, 8.5 and 6.4 times faster in prompting iterations. ReAct and Reflexion unlocked no tier within 160 iterations. In a new world with an empty inventory, Voyager solved all four unseen tasks (diamond pickaxe, golden sword, lava bucket, compass) in three of three trials each, while the baselines solved none within 50 iterations. Ablations showed that replacing the automatic curriculum with a random one cut discovered items by 93 percent, removing self-verification cut them by 73 percent, and using GPT-3.5 instead of GPT-4 for code produced 5.7 times fewer unique items.
The comparison with other agent designs clarifies what is new. Reinforcement learning agents for Minecraft learn low-level control from rewards or videos and adjust neural network weights; Voyager uses a frozen model through an API and learns only by accumulating text and code. Pure prompting agents such as ReAct reason and act step by step but keep no durable library, so each episode starts fresh. Later Minecraft agents took other routes: JARVIS-1, posted in November 2023, uses a multimodal memory of past experience with pixel-level perception and reports completing over 200 tasks. The common thread is that memory outside the model weights lets an agent improve with experience.
The limitations are spelled out in the paper. GPT-4 was 15 times more expensive than GPT-3.5 at the time, yet weaker models could not write good enough code. The agent sometimes gets stuck, and the critic occasionally misjudges success, for example failing to treat spider string as proof of beating a spider. The curriculum can hallucinate impossible goals such as a 'copper sword', and the code writer sometimes uses invalid game logic, such as burning cobblestone as fuel, or calls functions that do not exist. Voyager also depends on Mineflayer's high-level text interface, so it sidesteps the hard perception and motor-control problems that physical robots face.
Running Voyager yourself requires Python 3.9 or later, Node.js 16.13 or later, a Minecraft Java installation with specific Fabric mods (tested on version 1.19), and an OpenAI API key with GPT-4 access, according to the GitHub repository. Saved skill libraries can be reloaded to run new tasks without relearning.
03Mfano uliofanya kazi
Tracing how Voyager learns to craft an iron pickaxe
Start with an inventory holding a stone pickaxe, a furnace, sticks and four raw iron, as in an example from the paper.
The curriculum reads this state and proposes 'Smelt 4 raw iron' as the next task, then later 'Craft 1 iron pickaxe'.
For the pickaxe, Voyager asks GPT-3.5 how to craft one, embeds the task and answer, and retrieves the top five skills such as smelting iron ingots and crafting sticks.
GPT-4 writes a craftIronPickaxe function that calls those skills and Mineflayer's crafting primitive.
The program runs; if the game reports missing sticks or the code throws an error, that message goes back into the prompt for a revised program.
A separate GPT-4 critic checks the new inventory, confirms an iron pickaxe is present and returns success.
The function is stored under an embedding of its description, ready to be called by later skills such as mining diamonds.
Nini inaonyesha
The library now contains a verified, readable craftIronPickaxe program that composes earlier skills. A learner can check the trace by confirming each step's input and output: the state fed to the curriculum, the five retrieved skills, the error feedback, and the critic's success flag.
Utekelezaji wa Ulimwengu Halisi
In the original experiments, Voyager discovered 63 unique Minecraft items within 160 prompting iterations, 3.3 times as many as the ReAct, Reflexion and AutoGPT baselines it was compared against.
Voyager was the only tested method to reach diamond tools on the Minecraft tech tree, succeeding in one of three runs at about 102 prompting iterations.
Researchers reuse the open-source MineDojo/Voyager code, MIT licensed, to load a saved skill library into a fresh world and solve a new task such as crafting a compass.
Plugging Voyager's learned skill library into AutoGPT let AutoGPT solve unseen tasks such as a golden sword and a compass that it failed without the library.
Anthropic's Agent Skills, announced in October 2025, package instructions and scripts as folders that Claude loads on demand, a human-authored relative of Voyager's code-based skill library.
Mustakabali wa Wakala wa Voyager Minecraft na Maktaba ya Ustadi
The Voyager paper itself names cost, stuck runs, critic mistakes and hallucinated tasks or functions as open issues, and it frames its method as compatible with gradient-based controllers such as video-pretrained models, provided they expose a code interface. Work since then has extended the memory idea in different directions, for example JARVIS-1's multimodal memory in late 2023. Outside games, the skill-library pattern has moved into commercial agent tooling. Anthropic's October 2025 post on Agent Skills describes folders of instructions and scripts that an agent loads only when relevant, and says the company hopes to let agents create, edit and evaluate such skills themselves, which would close the loop Voyager demonstrated. Open questions include how to verify that a self-written skill is safe before reuse, how to prune or repair a library as it grows, and how well retrieval holds up with thousands of skills. The same post warns that malicious or untrusted skills could cause data exfiltration, so auditing reusable skills is an active practical concern.
Kuiweka katika vitendo
Kwa nini ni muhimu
- Gharama na bajeti. Maamuzi ya usanifu huendesha utendaji na gharama ya uendeshaji kwa miaka.
- Maamuzi ya wazi zaidi. Elimu ya kiufundi husaidia timu kuchagua safu sahihi, sio tu mpya zaidi.
- Udhibiti wa ubora. Chaguo bora za uhandisi hupunguza matukio ya kuaminika katika uzalishaji.
Jihadharini na
- Kuboresha kiwango kimoja kunaweza kuficha udhaifu mkubwa wa mfumo.
- Gharama za miundombinu na matengenezo mara nyingi hupunguzwa.
- Mapengo ya usalama na uonekanaji yanaweza kukua kadiri mifumo inavyozidi kuwa ngumu.
Hatua zinazofuata
- Bainisha muda, ubora na malengo ya gharama kabla ya utekelezaji.
- Benchmark chini ya mzigo halisi na hali ya data.
- Ufuatiliaji wa ala kwa makosa, kuteleza, na athari za mtumiaji.
- Tayarisha njia za urejeshaji na majibu ya matukio kabla ya kuongeza ukubwa.
Vyanzo na kusoma zaidi
- arXivVoyager: An Open-Ended Embodied Agent with Large Language Models
- MineDojoVoyager project page
- GitHubMineDojo/Voyager
- arXiv (ICLR 2023)ReAct: Synergizing Reasoning and Acting in Language Models
- arXivJARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models
- AnthropicEquipping agents for the real world with Agent Skills
Endelea Kuchunguza
Jarida halali
Pata taarifa ya kila siku ya AI
Hadithi tatu za AI zilizothibitishwa kila asubuhi ya wiki, zimetengenezwa kwa Kiingereza rahisi. Bila malipo daima, hakuna matangazo.
Barua pepe moja kila siku ya wiki. Jiondoe kwa bonyeza moja. Hatutauza au kushiriki anwani yako.
Jijaribu mwenyewe
Take the Voyager Minecraft Agent and Skill Library quiz
Maoni ya haraka juu ya kila jibu, na cheti kinachoweza kushirikishwa na kitambulisho kinachoweza kuthibitishwa baada ya kupita kozi.
Changia elimu ya AI bila malipo. AI Understanding ni 501(c)(3) isiyo na faida — hakuna matangazo, hakuna kizuizi cha malipo, daima. Toa mchango
Maswali yanayoulizwa mara kwa mara
What is Voyager Minecraft Agent and Skill Library?
Voyager ni wakala wa Minecraft anayeendeshwa na LLM ambaye hujifunza maktaba ya ustadi inayoweza kutumika tena, na kuiruhusu kutatua kazi mpya kupitia mafunzo ya maisha yote badala ya kuanza kutoka mwanzo kila wakati.
Je, Voyager inaboresha vipi uwezo wake kwa wakati?
Voyager hujifunza bila masasisho ya upinde rangi: huhifadhi ujuzi uliothibitishwa kama msimbo na hujenga ujuzi mpya kutoka kwa wa zamani, kwa hivyo uwezo huchanganyika katika muktadha.
Ustadi wa Voyager unawakilishwa katika hali gani?
Kila ujuzi ni kijisehemu cha msimbo kinachoweza kutekelezeka ambacho hutoa vitendo kwa Minecraft bot, na kufanya ujuzi kukimbia na kutungwa.
Je, ni jukumu gani la mtaala wa kiotomatiki wa Voyager?
Mtaala wa kiotomatiki unapendekeza kazi zinazozidi kuwa changamoto zinazolingana na hali ya sasa ya wakala, kuendesha uchunguzi usio na mwisho.
Je, Voyager hupataje ujuzi unaofaa inapokabiliwa na kazi mpya?
Ujuzi huonyeshwa kwa upachikaji wa maelezo yao ya lugha asilia, kwa hivyo ujuzi unaofaa kisemantiki hupatikana kama vizuizi vya ujenzi kwa kazi mpya.
Je, kitanzi cha uhamasishaji cha Voyager hufanya nini wakati msimbo uliotolewa haufaulu?
Voyager hutekeleza msimbo wake, hutazama makosa ya utekelezaji na maoni ya hali ya mchezo, na kuhimiza mtindo kurekebisha msimbo, na kurudia hadi ujuzi ufanye kazi.
Endelea kujifunza
Miongozo inayohusiana
Miongozo zaidi imechaguliwa kwa mada hii