Learn how to set up monitoring for the Gateway server.
Behind the scenes, the Gateway server is a Ray Serve + FastAPI application. This means that you can monitor it using the built-in Ray dashboard on port 8265 and access Prometheus metrics exposed on port 8080, i.e. http://your-gateway-ip:8080.If all is well, the logs in the “Serve” panel of the Ray dashboard will all be INFO level, possibly with a few warnings about non-optimal settings.Note that there is no dedicated /health endpoint right now - if you need it, let us know, and as a stop-gap solution, you can use the ray_health_check_rpc_latency_ms metric.
