royalcat

Repositories

11

Projects Packages

23

Public activity Starred repositories

rocket-inference (sha256:b71ea588e0b45660ec67b475f1183423ad7c15de08b974c9fb65cab8e34e97a0)

Published 2026-10-09 14:44:00 +00:00 by royalcat

Installation

Pull the image from the command line:

docker pull git.kmsign.org/royalcat/rocket-inference@sha256:b71ea588e0b45660ec67b475f1183423ad7c15de08b974c9fb65cab8e34e97a0

Digest

sha256:b71ea588e0b45660ec67b475f1183423ad7c15de08b974c9fb65cab8e34e97a0

For more information on the Container registry, see the documentation.

Image layers

# debian.sh --arch 'arm64' out/ 'trixie' '@1791158400'

RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends curl ca-certificates && rm -rf /var/lib/apt/lists/* # buildkit

COPY /src/target/aarch64-unknown-linux-gnu/release/rocket-inference /usr/local/bin/rocket-inference # buildkit

EXPOSE [8383/tcp]

ENTRYPOINT ["rocket-inference"]

CMD ["serve" "--backend" "flex" "--dtype" "f32" "--npu" "--npu-attn" "cpu" "--port" "8383" "--max-tokens" "8192" "--model-dir" "/models/qwen3-embedding-0.6b" "--model-name" "qwen3-embedding"]

Details

Container

2026-10-09 14:44:00 +00:00

0

OCI / Docker

linux/arm64

41 MiB

Versions (9) View all

e3701a5 2026-10-09

b4634c9 2026-10-09

4a8657b 2026-10-09

b09c082 2026-10-08

64d2fa9 2026-10-08