Back to News
InnovationAI Understanding briefing

IBTimes reports Tencent open-sources Hy4, a 770B model with a 1M-token context

International Business Times reports that Tencent has released Hy4, a sparse Mixture-of-Experts model with 770 billion total parameters, about 49 billion active per token and a context window exceeding one million tokens. Tencent says it was trained around real-world tasks, but those performance claims have not…

By 6 min readRead the primary source
AI-generated editorial illustration: Editorial illustration of a sparse AI model represented by a translucent block divided into many compartments, with a few compartments highlighted above orderly stacks of unmarked paper representing long technical and business materials; no identifiable people or text. Created for “IBTimes reports Tencent open-sources Hy4, a 770B model with a 1M-token context.”
The short version

International Business Times reports that Tencent has released Hy4, a sparse Mixture-of-Experts model with 770 billion total parameters, about 49 billion active per token and a context window exceeding one million tokens. Tencent says it was trained around real-world tasks, but those performance claims have not…

What happened

International Business Times reports that Tencent’s Hunyuan team released Hy4 preview as an open-source Mixture-of-Experts model. The model has 770 billion total parameters but activates approximately 49 billion for each token, and Tencent says it supports more than one million tokens of context. The outlet reports that Tencent made Hy4 available through Hugging Face and integrated it into WorkBuddy, CodeBuddy and Yuanbao, with access through Tencent Cloud TokenHub and OpenRouter. Tencent says Hy4 was developed using task data from software engineering, game development, finance and security teams. The source also reports that Tencent cautions the preview may overthink or repeatedly verify answers, producing longer response times.

International Business Times reports that Tencent released Hy4 preview on August 28, describing it as a 770-billion-parameter Mixture-of-Experts model. In this architecture, the total parameter count represents the model’s overall capacity, while only a subset is used for each token. The outlet says Hy4 activates approximately 49 billion parameters per token, meaning its headline size should not be compared directly with a dense model that computes all 770 billion parameters for every piece of input.

According to International Business Times, Tencent’s Hunyuan team built Hy4 across 78 layers with 256 routed experts and one shared expert. The source reports that Tencent’s documentation describes the model as having more than one million tokens of context. That capacity is intended to let a system process unusually large inputs, such as software repositories, extended research material or collections of business documents, although the article does not independently test whether Hy4 can consistently use all of that information accurately.

The outlet reports that Tencent says Hy4 was trained with task data collected from colleagues in software engineering, game development, finance and security. That makes the release’s stated focus different from a launch centered only on public benchmark scores: Tencent is presenting the model as a system designed for workplace productivity. International Business Times says Tencent claims top-tier performance among open-source models on these real-world productivity tasks, but the article provides no independent replication, detailed methodology or full comparative results.

International Business Times reports that Hy4 is available through Hugging Face and is integrated into Tencent’s WorkBuddy, CodeBuddy and Yuanbao products. The source also says developers can access it through Tencent Cloud TokenHub and OpenRouter. Tencent is reported to be offering free access through WorkBuddy and CodeBuddy for two weeks after launch, while the earlier Hy3 model remains free through September 30. These distribution channels make testing easier, but the source does not establish the model’s licensing terms, hardware requirements, service limits or availability in every region.

Source details: ibtimes.sg

Why it matters

Hy4 is a consequential model release because it combines open weights, a very large sparse architecture and an unusually long advertised context window. If the model can handle long repositories, research material and business records reliably at practical cost, it could broaden access to capabilities currently associated with closed or expensive systems. The central claims about performance, efficiency and usefulness remain Tencent’s claims reported by International Business Times, not independently established results.

The release matters first because it could reduce the gap between a model’s total capacity and the resources needed for each individual request. A sparse model can distribute specialized knowledge among experts while routing each token to only part of the network. In principle, that can offer more capacity than a similarly costly dense model, but the article does not provide independent measurements showing that Hy4 is cheaper or faster in real deployments. Routing, memory, hardware and serving software can all affect the practical cost.

The reported context window is potentially useful for work that depends on relationships spread across a large body of material. A coding assistant might need to inspect unfamiliar files across a repository; an analyst might need to reconcile conflicting figures; and a researcher might need to connect evidence across lengthy sources. However, the ability to accept more tokens is not the same as the ability to retrieve, weigh and reason over them. International Business Times reports the advertised capacity but does not independently verify long-context accuracy or resistance to distraction.

Tencent’s reported use of internal workplace data also raises a useful question about how models acquire practical competence. Training on examples from engineering, finance, game development and security could expose the system to tasks that public benchmarks represent poorly. It could also make the model reflect Tencent’s workflows, terminology and assumptions. The source gives no information about the composition, consent, privacy protections or external representativeness of that data, so the significance of the training approach remains uncertain.

Open release and product integration together could make Hy4 more consequential than a model announcement alone. Developers can obtain weights or try hosted access, while ordinary users may encounter the model through Tencent products. That creates more opportunities for outside evaluation and experimentation. It also means that claims about quality, safety and reliability may affect real users before independent testing is complete. The article supplies no evidence about deployment scale, user safeguards, incident rates or performance in high-stakes settings.

What to watch next

The important tests are independent comparisons of Hy4 with other open models, including quality, latency, memory use, hardware requirements and cost at different context lengths. Researchers and developers should also examine how often the model overthinks, whether long-context performance degrades as inputs grow, and whether its internal-workflow training transfers to organizations with different data and procedures. The source does not establish licensing terms, safety evaluations, data provenance, or broad production reliability.

Independent evaluations should compare Hy4 with other open-weight models under matched conditions rather than relying on total parameter counts. Useful measurements would include coding success on unfamiliar repositories, factuality on long documents, retrieval across million-token inputs, latency, memory consumption and total cost. Tencent’s claims about top-tier productivity performance will remain provisional until researchers can inspect the tasks and reproduce the comparisons.

The model’s documented tendency to overthink or repeatedly verify answers deserves close attention. International Business Times reports Tencent’s warning that this behavior can lengthen response times. Further testing should determine whether the extra checking improves correctness, merely delays answers, or appears selectively on certain task types. The practical trade-off will depend on whether users can control reasoning depth, impose time limits or monitor the model’s work.

The availability claims should be examined alongside licensing and infrastructure details. Open weights can make experimentation possible, but a model of this scale may still require substantial memory, specialized hardware or quantization to run locally. The source does not say what license governs the weights, what hardware Tencent recommends, whether hosted endpoints apply rate limits, or whether the full advertised context is available through every listed product and API.

Safety and governance questions are also unresolved. The source says security personnel contributed to task-data collection, but it does not report a safety evaluation, red-team findings, data-provenance review or protections against misuse. Researchers should test prompt injection, sensitive-information handling, cyber-related capabilities and behavior under conflicting instructions before treating Hy4 as suitable for consequential work. Any reported advantage from an early third-party coding test should be treated cautiously because the source provides no named evaluator, methodology or independently reproducible result.

Related guides & quizzes

AI Models ExplainedChatGPT & LLMsTransformersAI TrainingTest what you know — try a free AI quizLook up an AI term in our glossary
Found this useful?