CI Failure (TimeoutError(None)) in ManyPartitionsTest.test_many_partitions_compacted

[michael-redpanda]

https://buildkite.com/redpanda/vtools/builds/8047#0188a456-d37f-4920-9f18-6235fd222b27

Module: rptest.scale_tests.many_partitions_test
Class:  ManyPartitionsTest
Method: test_many_partitions_compacted

test_id:    rptest.scale_tests.many_partitions_test.ManyPartitionsTest.test_many_partitions_compacted
status:     FAIL
run time:   10 minutes 35.122 seconds


    TimeoutError(None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 79, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 879, in test_many_partitions_compacted
    self._test_many_partitions(compacted=True)
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 1076, in _test_many_partitions
    self._restart_stress(scale, topic_names, n_partitions,
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 570, in _restart_stress
    inter_restart_check()
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 1053, in progress_check
    repeater.await_group_ready()
  File "/home/ubuntu/redpanda/tests/rptest/services/kgo_repeater_service.py", line 219, in await_group_ready
    self.redpanda.wait_until(group_ready,
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1990, in wait_until
    wait_until(wrapped,
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: None

JIRA Link: CORE-1341

[VladLazar]

https://buildkite.com/redpanda/vtools/builds/8763

[VladLazar]

https://buildkite.com/redpanda/vtools/builds/8799

[mmaslankaprv]

https://buildkite.com/redpanda/vtools/builds/9009
https://buildkite.com/redpanda/vtools/builds/9016

[piyushredpanda]

@StephanDollberg : this is hopefully gone now with your fix? If so, please close.

[michael-redpanda]

Returned: https://buildkite.com/redpanda/vtools/builds/10287

[StephanDollberg]

-------------------------------------------------------------------------------
--
  | test_id:    rptest.scale_tests.many_partitions_test.ManyPartitionsTest.test_many_partitions_compacted
  | status:     FAIL
  | run time:   8 minutes 27.662 seconds
  |  
  |  
  | TimeoutError(None)
  | Traceback (most recent call last):
  | File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
  | data = self.run_test()
  | File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
  | return self.test_context.function(self.test)
  | File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 82, in wrapped
  | r = f(self, *args, **kwargs)
  | File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 883, in test_many_partitions_compacted
  | self._test_many_partitions(compacted=True)
  | File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 1080, in _test_many_partitions
  | progress_check()
  | File "/home/ubuntu/redpanda/tests/rptest/scale_tests/many_partitions_test.py", line 1060, in progress_check
  | repeater.await_group_ready()
  | File "/home/ubuntu/redpanda/tests/rptest/services/kgo_repeater_service.py", line 272, in await_group_ready
  | self.redpanda.wait_until(group_ready,
  | File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1167, in wait_until
  | wait_until(wrapped,
  | File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
  | raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
  | ducktape.errors.TimeoutError: None

Hmm that one looks like slightly different in that isn't happening during the restart tests but in the in-between "progress checks" which is a bit unusual.

[vbotbuildovich]

*https://buildkite.com/redpanda/vtools/builds/10344

[vbotbuildovich]

*https://buildkite.com/redpanda/vtools/builds/10465
*https://buildkite.com/redpanda/vtools/builds/10487
*https://buildkite.com/redpanda/vtools/builds/10520
*https://buildkite.com/redpanda/vtools/builds/10658
*https://buildkite.com/redpanda/vtools/builds/10812
*https://buildkite.com/redpanda/vtools/builds/10888
*https://buildkite.com/redpanda/vtools/builds/11064
*https://buildkite.com/redpanda/vtools/builds/11077
*https://buildkite.com/redpanda/vtools/builds/11095
*https://buildkite.com/redpanda/vtools/builds/11101
*https://buildkite.com/redpanda/vtools/builds/11116

[github-actions]

This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.

[piyushredpanda]

Not seen in at least two months, closing