Run Claude Code with SAP Generative AI Hub Models

In Part 1 we built an Envoy Proxy that attaches an OAuth 2.0 JWT and rewrites request paths so they match SAP AI Core’s inference-endpoint schema for OpenAI models.

In this follow-up we will:

• Add support for Anthropic models to the Envoy configuration.
• Use the Anthropic Python SDK to call the Sonnet-4.5 model hosted in AI Core.
• Configure Claude Code so it can generate code with the same model.

Using the OpenAI SDK to Access GPT Models Hosted in SAP AI Core

This is the Part 1 of a series describing how to use Envoy Proxy to create an API layer to access models from AI Core using native SDKs of LLM providers, such as OpenAI, Anthropic, and Google.

First, we use the OpenAI Python API library to work directly with an LLM in AI Core and then apply the same approach to connect the LibreChat UI, creating a powerful personal AI assistant.