Docker Model Runner Adds vLLM Support on macOS | Docker - at first just noticed, that could be interesting later because I can run models via Docker with vllm, while using Apple Silicon at the same time. Interesting here is that it comes as a Docker image ready to use, and I don't have to fiddle with setup. I'm currently working more with my own rfc1437/MLXServer: a simple MLX based server for small models to run locally simply because I only need it for offline operation, but vllm-metal could be very exciting later.