ReliableGPT

ReliableGPT is a product developed by Berri AI. It is designed to provide 100% uptime and reliability from OpenAI. The product is hosted on GitHub and is part of a suite of tools offered by Berri AI to help users take their Language Learning Model (LLM) applications to production.

• ReliableGPT ensures 100% uptime and reliability from OpenAI.
• It is designed to handle Rate Limit, Timeout, API, and Key Errors.
• The product is part of Berri AI's suite of tools, which are designed to work with various LLM APIs using the OpenAI format.

• ReliableGPT offers a fallback strategy for handling failed requests.
• It can retry with an alternate model or a larger context window model for Context Window Errors.
• It can send a Cached Response using semantic similarity.
• It can retry with a fallback API key for Invalid API Key errors.
• It provides alerting features to update users on spikes in errors.

ReliableGPT is used to ensure that customer requests to an LLM app do not fail. It is particularly useful when a request to an LLM app fails, as ReliableGPT handles it by retrying with an alternate model, retrying with a larger context window model for Context Window Errors, sending a Cached Response (using semantic similarity), or retrying with a fallback API key for Invalid API Key errors.

BerriAI offers a free, Pro, and Enterprise plan with varying amounts of apps, requests, and other features. However, specific pricing details for ReliableGPT are not available in the search results.