Route OpenAI SDK traffic through Envoy to SAP AI Core
Using the OpenAI SDK to Access GPT Models Hosted in SAP AI Core
This is the Part 1 of a series describing how to use Envoy Proxy to create an API layer to access models from AI Core using native SDKs of LLM providers, such as OpenAI, Anthropic, and Google.
First, we use the OpenAI Python API library to work directly with an LLM in AI Core and then apply the same approach to connect the LibreChat UI, creating a powerful personal AI assistant.