Nagios: mitigate large workspaces on dockerhost-equinix-ubuntu2204-x64-1

[sxa]

This machine appears to have some large workspaces in some of the containers - we should look at these and see if there was an obvious reason why they are so big and haven't been deleted:

⚠️ HOST: dockerhost-equinix-ubuntu2204-x64-1 SERVICE: Check Docker Container Health STATE: WARNING MESSAGE: WARNING - These Docker Containers Have Large Workspaces: ,ubi8.2226,0e592afe0a76 See Nagios

[sxa]

Each of these jobs have worksapces around the 4Gb mark:

drwxrwxr-x 7 jenkins jenkins 4096 Feb 20 12:24 Test_openjdk11_hs_sanity.system_x86-64_linux
drwxrwxr-x 7 jenkins jenkins 4096 Jan 30 03:39 Test_openjdk17_hs_extended.openjdk_x86-64_linux_rerun
drwxrwxr-x 6 jenkins jenkins 4096 Feb 13 00:56 Test_openjdk21_hs_extended.openjdk_x86-64_linux_rerun

[sxa]

Analysis:

• The first of those three is still running so I'll leave it alone
• The second is from https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_x86-64_linux_rerun/4/ which hit a ten hour timeout (So probably needs to be evaluated in terms of whether it's an issue that should be covered in Problem machines for release #2662 if it is particularly problematic on this machine)
• The third is from https://ci.adoptium.net/job/Test_openjdk21_hs_extended.openjdk_x86-64_linux_rerun/4/console which suffered the same fate - this may be less prevelant now that the number of rerun iterations has been dropped from 3 to 1 (Both of those timeouts occurred with ITERATIONS=3)
  The two rerun jobs have been removed from the file system and the alerts have now stopped

[sxa]

@steelhead31 @smlambert FYI I've removed the rerun directories based on the above so the alerts should stop but we need to be mindful that we may have an issue with space leakage in the situation where we hit a timeout.