vLLM docker image For MAC CPU Silicon

General
1

hello everyone,

I want to run vLLM on my MACBookPro M2Pro.

By reading the Offical Document, It said I have to build vLLM from source codes to run it on Apple CPU M2Pro

While My MAC Operating System version is too low, can not build it from source codes. then I want to download a vLLM docker image for MAC CPU M2Pro, and run vLLM in docker container

But I did not found that image on DOCKER HUB

So, I seek some help here : where can i download vllm docker image for MAC M2pro

1 Like
2

There is currently no official vLLM Docker image for Mac (Apple Silicon) CPU on Docker Hub. The official vLLM images on Docker Hub (vllm/vllm-openai) are built for Linux/amd64 and require NVIDIA GPUs; they do not support Apple Silicon CPUs out of the box. For Apple Silicon (M1/M2/M3), the official documentation and maintainers state you must build vLLM from source on your Mac, as there are no pre-built wheels or images for this device (docs, github_file).

There are some unofficial, community-built images (e.g., on Docker Hub by individual users), but there is no formal, supported vLLM CPU image for Mac M2Pro. The only official CPU image is published to AWS ECR (public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.7.2), but this is for Linux/amd64, not Mac ARM (github_issue). If you want to run vLLM on your Mac M2Pro, you must upgrade your OS to meet the build requirements and build from source, or attempt to build a Docker image yourself using the provided Dockerfiles and cross-compilation instructions (docs, github_file).

Would you like more detail on how to build vLLM from source or create a custom Docker image for Apple Silicon?

Sources:

3

I’m also facing the similar issue.
Today I’m planning to build a docker image and publish it on docker hub. Will share it here once I’m done. Hope that helps.

4

There is currently no official vLLM Docker image for Mac (Apple Silicon) CPUs on Docker Hub, and the maintainers recommend building from source for Apple Silicon (docs). If you successfully build and publish a working Docker image for Mac M2/M3 CPUs, it would be helpful to share the Dockerfile and image link with the community, as others have requested this but no official or widely shared solution exists (github_issue).

Would you like step-by-step guidance on building such a Docker image for Apple Silicon?

Sources: