royalcat

Repositories

11

Projects Packages

23

Public activity Starred repositories

rocket-inference (sha256:1b770e86320a5fa5e78644aaf741a0f0f354b89eacf1a9d72cfb098af4db7000)

Published 2026-10-06 19:34:10 +00:00 by royalcat

Installation

Pull the image from the command line:

docker pull git.kmsign.org/royalcat/rocket-inference@sha256:1b770e86320a5fa5e78644aaf741a0f0f354b89eacf1a9d72cfb098af4db7000

Digest

sha256:1b770e86320a5fa5e78644aaf741a0f0f354b89eacf1a9d72cfb098af4db7000

For more information on the Container registry, see the documentation.

Image layers

# debian.sh --arch 'arm64' out/ 'trixie' '@1791158400'

RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends curl ca-certificates && rm -rf /var/lib/apt/lists/* # buildkit

COPY /src/target/aarch64-unknown-linux-gnu/release/rocket-inference /usr/local/bin/rocket-inference # buildkit

EXPOSE [8383/tcp]

ENTRYPOINT ["rocket-inference"]

CMD ["serve" "--backend" "flex" "--dtype" "f32" "--npu" "--npu-attn" "cpu" "--port" "8383" "--max-tokens" "8192" "--model-dir" "/models/qwen3-embedding-0.6b" "--model-name" "qwen3-embedding"]

Details

Container

2026-10-06 19:34:10 +00:00

3

2026-10-20 22:33:08 +00:00

OCI / Docker

linux/arm64

39 MiB

Versions (9) View all

e3701a5 2026-10-09

b4634c9 2026-10-09

4a8657b 2026-10-09

b09c082 2026-10-08

64d2fa9 2026-10-08