概述
The company says LTM-2-mini supports up to 100 million tokens, which can place substantially more cross-file code and documentation in one context; capacity alone does not guarantee correct reasoning over an entire codebase.
深入探讨
Magic AI is a startup developing an AI software engineer rather than only autocomplete. In its August 2024 research update, the company described LTM models, including LTM-2-mini, with a context window of up to 100 million tokens; its analogy is roughly 10 million lines of code or about 750 novels. This is a model capacity claim, not evidence that the model can correctly understand every codebase or complete every project-wide task. The update also describes a Google Cloud partnership for supercomputer development and funding announced at that time. Magic introduced HashHop as a controlled evaluation using random, incompressible hash pairs and chained lookups to test retrieval at long context lengths. Results on that constructed task measure those retrieval and chaining tasks; they do not prove arbitrary code comprehension or performance on every real repository.
现实世界的实施
Providing a large repository or selected subset as context for questions about cross-file relationships, then checking the answer against source code.
Drafting a refactor that touches related files for a developer to review and test.
Supplying code, documentation, and logs together when investigating a bug whose cause may span files.
Summarizing a selected repository context as an onboarding aid, with links or references for follow-up.
Magic AI 长上下文代码模型的未来
Longer contexts can allow developers to supply more code, documentation, and task details together. Reliable multi-file work still depends on retrieval, reasoning accuracy, tool execution, and verification. Future systems should be evaluated on representative codebases and tasks, including whether they find relevant distant files and make changes that pass tests, rather than being judged by context size alone.
付诸实践
为什么这很重要
- 供应商策略. 供应商路线图会影响您的团队接下来可以构建的功能。
- 成本与预算. 商业条款和部署选项会影响长期成本和风险。
- 风险与安全. 公司激励措施塑造了产品默认、安全态势和开放性。
留意
- 发布公告可能会超过实际生产工作流程的稳定性。
- API 定价或政策转变可能会在一夜之间打破假设。
- 单一供应商依赖性增加了锁定和迁移成本。
后续步骤
- 使用您自己的任务和数据集评估提供商。
- 在集成之前查看隐私、安全和法律条款。
- 维护跨模型或供应商的后备计划。
- 监控发行说明，以便路线图的更改不会让团队感到意外。
不断探索
常见问题
What is Magic AI Long-Context Code Models?
Magic AI is a startup developing long-context models for software-development tasks. The company says LTM-2-mini supports up to 100 million tokens, which can place substantially more cross-file code and documentation in one context; capacity alone does not guarantee correct reasoning over an entire codebase.
What software-development direction has Magic said it is pursuing?
Magic describes its work as developing AI for software engineering. This is a company goal; it does not guarantee that a model can correctly handle every codebase.
What maximum context capacity did Magic announce for LTM-2-mini in August 2024?
Magic’s August 2024 report announced a context window of up to 100 million tokens for LTM-2-mini. Context capacity is distinct from accuracy on a task.
What does Magic use HashHop to evaluate?
Magic designed HashHop as a controlled random-hash retrieval and chaining benchmark. It reduces semantic cues but does not establish broad code understanding.
为什么 Naive Transformer Attention 对于 1 亿个 token 的上下文来说是一个问题？
标准注意力的成本随着序列长度的平方而增长，因此如果没有更好的算法，很长的上下文会非常昂贵。
2024 年 Magic 与哪家公司合作建造超级计算机？
Magic 宣布与 Google Cloud 合作，在 Nvidia 硬件上构建超级计算机。