Professional version
- Load balancing support
- Error rescue
- Cache mode
- Monitoring
- Context management
LLM-client is a lightweight JavaScript library that provides a unified REST API interface for interacting with various language models (Ollama, ChatGPT, Mistral, etc.). It abstracts provider-specific details into modular plugins, offering a simple and consistent way to integrate multiple LLM services into your applications.
Features
- No external dependencies
- Easy to use
- Supports both streaming and non-streaming requests
- Simplified context management
- Ollama,Ollama cloud, OpenAI, Anthropic, Google, MistralAI...
