[Bug] KubeRay Worker group pod keeps restarting on EKS - Fails to CrashLoopBackOff

[teopopescu]

Search before asking

• I searched the issues and found no similar issues.

KubeRay Component

Others

What happened + What you expected to happen

I am following steps 2-5 here on an Amazon EKS cluster. I am able to run a job and access the dashboard, however, the workers keep restarting (K9s screenshot attached)

Logs of the ray-worker can be found below:

Running the same steps on kind works as expected, with the worker pod being in ready state and not failing

Reproduction script

kubectl create ns ray-system
helm repo add kuberay https://ray-project.github.io/kuberay-helm/ -n ray-system
helm repo update
helm install kuberay-operator kuberay/kuberay-operator --version 1.2.2 -n ray-system
helm install raycluster kuberay/ray-cluster --version 1.2.2 -n ray-system

Anything else

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[kevin85421]

Do you have a reproduction script especially the setup of your EKS cluster so that I can reproduce on an EKS cluster?