[AO] Test scenarios for the new threshold rule #161237
Labels
Team: Actionable Observability - DEPRECATED
For Observability Alerting and SLOs use "Team:obs-ux-management", for AIops "Team:obs-knowledge"
v8.10.0
📝 Summary
We want to have good test coverage for the new threshold rule. In this ticket, we cover scenarios that we want to implement for this new rule.
We need to cover AAD fields as much as possible for all scenarios. We can ignore checking all the fields.
Test location
https://github.com/elastic/kibana/tree/main/x-pack/test/alerting_api_integration/observability/custom_threshold_rule
We also need to consider testing permission. We can use different permissions for different scenarios and not add another scenario for it.
🧾 Scenario 1 - Conditions and fields types
-- Verifying if the reason was generated in the correct field format
-- Make sure to at least have one for document count and one for max/min/average/... (When we add percentile and rate, we need to cover them separately too)
🧾 Scenario 2 - No data
🧾 Scenario 3 - Missing group
🧾 Scenario 4 - Grouping
-- Make sure that the context for the group is preserved correctly in the AAD (like host.ip)
-- Possibly validate multiple contextual fields with different value types (like keyword, long, array, single value)
-- Make sure the number of generated alerts matches the number of groups
-- It would also be good to check the tags field, it should consist of source and rule tags
🧾 Scenario 5 - Filtering
🧾 Scenario 6 - Equation
✅ Acceptance Criteria
⚙️ Implementation tickets
The text was updated successfully, but these errors were encountered: