At AnswerRocket, we believe in providing a platform that is truly LLM-agnostic. Today, we are excited to announce our integration of Google Gemini and Anthropic Claude large language models (LLMs) into our GenAI analytics platform. This new development empowers enterprises with unprecedented flexibility and control over their AI assistants, allowing them to tailor their analytics tools to their unique business needs.
Models supported now include:
- OpenAI: GPT-4o, GPT-4o mini
- Google: Gemini Flash, Gemini Pro (models with function-calling support)
- Anthropic: Claude 3.5 Sonnet, Claude 3 Opus
The Power of LLM Choice
AnswerRocket’s model-agnostic approach ensures that businesses have the freedom to select the best tool for each job. By supporting a wide range of LLMs, we provide companies more options in an ever-evolving AI landscape. This means you can balance speed, cost, and model capabilities as new LLMs enter the market, ensuring your AI strategy remains agile and future-proof.
Working with LLMs in AnswerRocket
1. Unmatched Flexibility in LLM Configuration
With our latest updates, configuring your AI environment is both robust and customizable. You can now choose from a variety of LLMs from Google, Anthropic, and OpenAI to create the perfect AI assistant for any use case. Our platform allows you to set up API configurations for each LLM to meet your specific needs. This includes adjusting key parameters like input and output token limits, ensuring costs are kept under control while optimizing performance, especially when handling lengthy or complex data threads. You can also adjust additional settings such as frequency penalties and presence penalties directly within AnswerRocket, giving you total control over your AI’s behavior.
2. Easily bring your own keys for any supported LLM
Adding a new LLM API key to your AnswerRocket environment for a supported model is a straightforward process. Our platform’s user-friendly interface guides you through each step, from selecting a new model to configuring its settings. This easy integration ensures that your analytics environment remains up-to-date with the latest AI advancements, allowing you to leverage the newest capabilities as they become available.
3. Switching From One LLM to Another
It’s easy to switch from one LLM to another to see how different models interpret and respond to your data. This capability is especially beneficial for companies looking to validate model performance, ensure accuracy, and optimize their choice of LLMs for specific analytical tasks. AnswerRocket makes it simple to perform a regression test when changing models. Our built-in evaluation capabilities enable you to confidently move to production with a new models when the assistant is ready.
Here we can see differences in the narratives produced by OpenAI GPT-4o and Gemini 1.5-pro for the same question:
4. Mixing and Matching LLM Models for Optimal Performance
One of the most powerful features of our platform is the ability to mix and match LLMs within a single environment. By combining models, businesses can achieve a more nuanced analysis, utilizing the strengths of different LLMs to tackle complex data scenarios. For example, you might use one model to power the chat experience and another to compose the narratives that accompany your analyses.
Responsible AI with Built-in Safeguards
AnswerRocket is committed to responsible AI. Our platform uses foundation models with built-in safeguards to prevent biases and promote fairness, allowing you to customize these safeguards according to your specific ethical standards. AnswerRocket built-in testing and evaluation tools simplify rigorous validation of every AI assistant, allowing you to ensure a high standard of performance and accountability.
Unlock New Potential with AnswerRocket
Whether you’re a developer, analyst, or business user, AnswerRocket offers the tools you need to customize your AI environment. Use our Skill Studio to create purpose-built AI assistants, leverage our comprehensive integration options, and unlock the full potential of your data with tailored LLM configurations. With AnswerRocket, the power of AI is truly at your fingertips.
Ready to see how AnswerRocket can revolutionize your analytics? Book a demo today!
