TimeoutError waiting for topic_storage_purged in TopicDeleteCloudStorageTest.topic_delete_unavailable_test

[dlex]

Module: rptest.tests.topic_delete_test
Class: TopicDeleteCloudStorageTest
Method: topic_delete_unavailable_test

on (amd64, container) https://buildkite.com/redpanda/redpanda/builds/20621#01858070-ed5d-4031-a40a-b86891ceab01
on (arm64, VM) https://buildkite.com/redpanda/vtools/builds/5007#01857e64-9b47-44f1-ade7-92fcfff06d73

    TimeoutError('')
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 35, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/topic_delete_test.py", line 238, in topic_delete_unavailable_test
    wait_until(lambda: topic_storage_purged(self.redpanda, self.topic),
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError

Related to #7460

[jcsp]

A leadership transfer is happening very shortly before the topic deletion. This could be a real bug where our deletion is racing somehow.

[dlex]

May not be the same failure, but also a timeout in the same test:

    TimeoutError('Segments were not removed')
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 35, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/topic_delete_test.py", line 260, in topic_delete_unavailable_test
    self._populate_topic(next_topic)
  File "/root/tests/rptest/tests/topic_delete_test.py", line 207, in _populate_topic
    wait_for_segments_removal(self.redpanda, topic_name, i, 5)
  File "/root/tests/rptest/util.py", line 256, in wait_for_segments_removal
    wait_until(done,
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: Segments were not removed

on (amd64, container) https://buildkite.com/redpanda/redpanda/builds/20705#01858463-ffa4-495f-925f-9a6fdf1723f2