Typed Open AI Chat & Ollama APIs in 11 Languages
Introducing AI Server - an OSS Self Hosted Gateway for running LLM, Ollama, Media and Comfy UI APIs
This episode covers AI Server's OpenAiChatCompletion
API - an OpenAI compatible Chat API with ChatGPT and
other LLMs like Ollama, the benefit of which allows developers to use its Typed DTOs and ServiceStack
generic Service Clients to call any Open AI Chat compatible API directly, in all of ServiceStack's
11 supported popular programming languages.
This allows developers to easily integrate typed access to different LLMs into their applications. Instructions are provided for each language demonstrating how to install necessary packages, download DTOs, and send API requests.