Back to News
ProductAI Understanding briefing

AWS adds India-only cross-Region inference for OpenAI GPT-5.6 on Bedrock

Amazon Bedrock now routes OpenAI GPT-5.6 Terra and Luna requests between AWS Regions in Mumbai and Hyderabad, allowing customers to scale inference while keeping prompts and outputs within India, according to AWS.

By 5 min read
Primary-source image accompanying AWS adds India-only cross-Region inference for OpenAI GPT-5.6 on Bedrock
The short version

Amazon Bedrock now routes OpenAI GPT-5.6 Terra and Luna requests between AWS Regions in Mumbai and Hyderabad, allowing customers to scale inference while keeping prompts and outputs within India, according to AWS.

What happened

AWS says Amazon Bedrock now supports India geographic cross-Region inference for OpenAI GPT-5.6 Terra and Luna. Requests can be routed between the Mumbai and Hyderabad AWS Regions based on capacity, while remaining within India. Both models accept text and image input, produce text output, and offer a 1-million-token context window.

AWS announced that Amazon Bedrock supports OpenAI GPT-5.6 Terra and Luna through India geographic cross-Region inference profiles. The two profile IDs identified in the post are in.openai.gpt-5.6-terra and in.openai.gpt-5.6-luna. The source says customers can invoke the models from either the Asia Pacific (Mumbai) Region, ap-south-1, or the Asia Pacific (Hyderabad) Region, ap-south-2. Bedrock then selects the destination India Region according to available capacity.

The announcement describes cross-Region inference primarily as a capacity mechanism. Instead of tying an application to the capacity of one Region, the profile permits requests to use a broader pool of compute across the two listed India Regions. AWS says this is intended to help maintain throughput and consistent performance during traffic peaks. The source provides no benchmark data, service-level guarantee, latency comparison, or independent assessment showing how much performance improves.

The GPT-5.6 models described in the post accept text and image inputs and return text. Each has a 1-million-token context window, which AWS says can support long documents, large code bases, and workloads combining text and images in a single request. The models can be called through the OpenAI Responses API, OpenAI-compatible Chat Completions, or Amazon Bedrock’s Converse API. AWS also documents use through the Bedrock console playground and says existing OpenAI SDK clients can be pointed at the Bedrock endpoint.

The post includes operational details for deployment. Billing and quota consumption are tracked against the account in the source Region, while CloudWatch and CloudTrail entries are recorded there. AWS says the India profiles use the bedrock-runtime endpoint, where Bedrock features such as Guardrails, intelligent prompt routing, and cross-Region inference are available. Existing workloads using the bedrock-mantle endpoint remain supported, but customers must use bedrock-runtime to adopt the India geographic profiles.

Read the source: aws.amazon.com

Why it matters

The change targets organizations that need India data residency while also needing access to pooled cloud capacity. It could simplify deployment for workloads involving long documents, large code bases, mixed text-and-image inputs, retrieval systems, and AI agents. The source does not provide independent performance measurements, pricing, or evidence of customer adoption.

The practical significance is concentrated in data residency and capacity management. AWS says requests using the India geographic profiles are routed only between Mumbai and Hyderabad, so prompts and generated outputs may move between those two Regions but remain within the country. For organizations whose policies or sectoral obligations require Indian processing, that offers a different deployment option from a global inference profile that may send requests to supported commercial AWS Regions worldwide.

The feature may be relevant to financial-services, healthcare, and public-sector organizations, which AWS explicitly identifies as examples of customers with local data-processing requirements. The source does not establish that any regulator, customer, or independent auditor has approved the arrangement. It also does not explain how an organization should determine whether its own legal, contractual, or security requirements are satisfied by regional processing alone.

The model capabilities described by AWS could make the profiles useful for applications that repeatedly submit large context windows, including document extraction, code analysis, retrieval-augmented generation, and agent workloads. Prompt caching is supported under the India profiles, and AWS says cached reads are billed at a 90 percent discount compared with uncached input tokens. That is an AWS pricing claim in the source, not an independently verified estimate of total application savings; actual costs will depend on usage, cache behavior, output volume, and other services.

Centralized monitoring may also reduce administrative work. AWS says invocation counts, token counts, latency, throttles, and errors are published per inference profile, while CloudTrail records an inferenceRegion field showing whether a request was processed in Mumbai or Hyderabad. This could help customers audit geographic routing without correlating logs across Regions. The announcement does not state whether these controls provide complete visibility into every downstream processing or support function outside the model-inference path.

What to watch next

Organizations will need to verify regional availability, pricing, quotas, latency, retention terms, and IAM configuration before production use. India-only profiles differ from Bedrock’s global profiles, which can route GPT-5.6 requests to AWS Regions worldwide. AWS also says content flagged by abuse-detection classifiers may be retained for offline detection despite its default zero-data-retention model.

The first issue to verify is actual availability and capacity. AWS directs customers to its regional model-availability documentation and says routing depends on capacity, but the post does not publish quotas, expected latency, uptime targets, or a comparison with single-Region inference. Production teams should test their own workloads, especially large multimodal requests and traffic spikes, before assuming that cross-Region routing will deliver a particular performance level.

Data handling requires careful reading of the exceptions. AWS describes Amazon Bedrock as using a zero-data-retention model by default, meaning inputs and outputs are not ordinarily stored. However, the source says content flagged by automated abuse-detection classifiers for certain models, including GPT-5.6, is retained for offline abuse detection. The announcement does not specify the retention period, the classification criteria, the handling process, or the scope of access, so those details remain important unknowns for sensitive deployments.

Security and access configuration may be a deployment constraint. AWS says IAM roles must be granted access to the inference profile, the foundation model in the source Region, and the foundation model in each destination Region. Organizations using Service Control Policies must allow both ap-south-1 and ap-south-2; blocking either can cause cross-Region inference to fail. Teams will also need to check whether their identity provider, credential process, API-key approach, and existing network controls support the documented configuration.

Finally, customers should distinguish India geographic profiles from global profiles. AWS says global profiles support GPT-5.6 models including Sol, Terra, and Luna but may route requests worldwide for maximum capacity. The India profiles are the relevant option for keeping inference within the country. The source does not state whether all model features, parameters, pricing tiers, or future variants will be available identically in both routing modes, making ongoing documentation checks necessary.

Related guides & quizzes

ChatGPT & LLMsAI Models ExplainedAI AgentsTest what you know — try a free AI quizLook up an AI term in our glossary
Found this useful?