Unexpected EOF - Humble binary builds

[ijnek]

unexpected EOF has happened across a few of my Humble Ubuntu Jammy binary builds in the last few days.

• https://build.ros2.org/job/Hbin_uJ64__nao_lola__ubuntu_jammy_amd64__binary/32/console
• https://build.ros2.org/job/Hbin_ujv8_uJv8__cv_bridge__ubuntu_jammy_arm64__binary/18/console
• https://build.ros2.org/job/Hbin_ujv8_uJv8__ros_image_to_qimage__ubuntu_jammy_arm64__binary/20/console

They seem to pass the subsequent build that usually happens within 24 hours of the failed one.

[Blast545]

Maybe related? ros2/ci#702 cc: @claraberendsen

[claraberendsen]

@ijnek From the three builds listed here only one had a remaining online agent I could go through.
I have not found evidence of the error related with unattended upgrade or of a OOM killed process during that time frame.
My best guess on the cause of this issue is this line in the log

Jun 24 23:00:01 ip-10-0-1-202 CRON[3101021]: (root) CMD (/root/docker-disk-cleanup.sh)

that executes this script that does system prune and that for some reason the docker container got selected there.
Let me know if you see it again I can dig a bit more if there are more available agents.

[wep21]

I have encountered the similar issue that says error waiting for container: unexpected EOF.
https://build.ros2.org/job/Hbin_uJ64__aws_sdk_cpp_vendor__ubuntu_jammy_amd64__binary/16/display/redirect
https://build.ros2.org/job/Rbin_ujv8_uJv8__aws_sdk_cpp_vendor__ubuntu_jammy_arm64__binary/11/display/redirect