Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: Cypress Actions with prebuilt rules #105791

Closed
FrankHassanabad opened this issue Jul 15, 2021 · 2 comments
Closed

Failing test: Cypress Actions with prebuilt rules #105791

FrankHassanabad opened this issue Jul 15, 2021 · 2 comments
Assignees
Labels
blocker bug Fixes for quality problems that affect the customer experience failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Detections and Resp Security Detection Response Team v7.14.0 v7.15.0 v8.0.0

Comments

@FrankHassanabad
Copy link
Contributor

FrankHassanabad commented Jul 15, 2021

We started seeing flake on this test only in 7.x:
#105700

It might have to do with a missing backport or something else, but we are skipping 7.x with it to start and then will do a skip also on master, then do an unskip off of master and try to re-backport yet again.

PR which synced the other two branches even though this only fails on 7.x we want to add stability to v7.14.0 by skipping this test. v7.14.0 has been passing up to now though.

Notice that this doesn't fail on 7.14 or master even though we also skipped there. We also tried to increase the timeout without that working for us at 5 minutes:

[2021-07-15T15:14:50.682Z]      │ proc [cypress]   1) Actions with prebuilt rules
[2021-07-15T15:14:50.682Z]      │ proc [cypress]        Deletes and recovers one rule:
[2021-07-15T15:14:50.682Z]      │ proc [cypress]      AssertionError: Timed out retrying after 300000ms: Expected to find element: `[data-test-subj="reloadPrebuiltRulesBtn"]`, but never found it.
[2021-07-15T15:14:50.682Z]      │ proc [cypress]       at Context.eval (http://localhost:61181/__cypress/tests?p=cypress/integration/detection_rules/prebuilt_rules.spec.ts:19079:89)
[2021-07-15T15:14:50.682Z]      │ proc [cypress] 
[2021-07-15T15:14:50.682Z]      │ proc [cypress]   2) Actions with prebuilt rules
[2021-07-15T15:14:50.682Z]      │ proc [cypress]        Deletes and recovers more than one rule:
[2021-07-15T15:14:50.682Z]      │ proc [cypress]      AssertionError: Timed out retrying after 300000ms: Expected to find element: `[data-test-subj="reloadPrebuiltRulesBtn"]`, but never found it.
[2021-07-15T15:14:50.682Z]      │ proc [cypress]       at Context.eval (http://localhost:61181/__cypress/tests?p=cypress/integration/detection_rules/prebuilt_rules.spec.ts:19098:89)
@FrankHassanabad FrankHassanabad added the bug Fixes for quality problems that affect the customer experience label Jul 15, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 15, 2021
@FrankHassanabad FrankHassanabad added the Team:Detections and Resp Security Detection Response Team label Jul 15, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 15, 2021
@FrankHassanabad FrankHassanabad self-assigned this Jul 15, 2021
@FrankHassanabad FrankHassanabad added failed-test A test failure on a tracked branch, potentially flaky-test v8.0.0 v7.15.0 v7.14.0 skipped-test labels Jul 15, 2021
@FrankHassanabad FrankHassanabad changed the title flake test Actions with prebuilt rules Jul 15, 2021
@FrankHassanabad FrankHassanabad changed the title Actions with prebuilt rules Failing Test: Actions with prebuilt rules Jul 15, 2021
@FrankHassanabad FrankHassanabad changed the title Failing Test: Actions with prebuilt rules Failing test: Actions with prebuilt rules Jul 15, 2021
@FrankHassanabad FrankHassanabad changed the title Failing test: Actions with prebuilt rules Failing test: Cypress Actions with prebuilt rules Jul 15, 2021
@FrankHassanabad
Copy link
Contributor Author

Root cause was found here and backported:
#105790

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker bug Fixes for quality problems that affect the customer experience failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Detections and Resp Security Detection Response Team v7.14.0 v7.15.0 v8.0.0
Projects
None yet
Development

No branches or pull requests

2 participants