Accessing the Ray Dashboard

If you want to gain more insight into the computation process, you can access the Ray Dashboard of the QC service, which allows you to monitor the current occupation of the service, as well as look for stuck requests.

📡 Forwarding the necessary ports

To access the dashboard, you first need to forward the number \(8265\) from the service head pod. You can do so using the following command from your local machine:

kubectl port-forward services/rayservice-qc-head-svc 8265:8265 -n rationai-jobs-ns

While the command above is running, you can access the dashboard at the following address:

127.0.0.1:8265/

🖥️ Using the Dashboard

In the dashboard, the most useful tabs are the Cluster tab and the Serve tab. In the first one, you can see the if there are any worker pods active and what is their utilization. The second tab provides you with more fine-grained information about the computation progress.

👀 Viewing Computation Progress

Each request is processed in a single replica inside the QC/Ingress deployment. To view the replicas, you first need to navigate to the Ingress dashboard:

If there are any active replicas, you can select one in the Logs section and watch the progress in the STDOUT tab (or look for any immediate errors in the STDERR tab):

Warning

Please note that each replica is destroyed after a minute of inactivity. Once destroyed, you won't be able to access the logs anymore.