Rocky AI capabilities
Rocky AI’s current core capabilities are Root Cause & User Impact Analysis for failing checks and test results. Read more about Rocky AI Root Cause Analysis in the resolve section. We are planning more capabilities for Rocky AI across the Detect, Communicate and Resolve categories.Getting Started with Rocky AI
To get started with Rocky AI follow these steps:- Make sure Rocky AI is enabled in its settings page.
- Now look for Rocky AI buttons and options in the Checkly web interface.
AI invocations
Every AI analysis — whether triggered automatically or manually — counts as one invocation against your plan’s quota. If the same analysis result is pushed to multiple alert channels, it is still counted as a single invocation. When your invocation quota is reached, no overages are charged. Invocations refresh at the start of your next billing cycle. You can monitor your current usage and configure automatic analysis in the AI settings.By default, Rocky AI automatically analyzes every new error group, which consumes invocations. You can disable automatic analysis in the AI settings to only use invocations for manual analyses.
Data Privacy and Security
- All AI features are designed to operate on the data you provide or the data generated by your checks. This data is already stored in Checkly, and we do not send any additional data to third-party AI providers.
- Any provided environment secrets are scrubbed before being sent to the AI provider.
- We do not train any custom models on your data.
- Any data used by the AI features is processed in real-time and not stored for future training.
Built-in and Custom Models
By default, Checkly uses OpenAI’s GPT-5.1 model for AI features. However, you can also bring your own model (BYOM) and provider to Checkly. To do this, you need to set up a custom AI provider in the AI settings screen.The Bring Your Own Model (BYOM) feature is available for Enterprise customers only.