royalcat

Repositories

11

Projects Packages

23

Public activity Starred repositories

embeddings-fast (sha256:4ab50989a476f852ce753b780bad405f221536be6b3e5d62926cd56822eae8af)

Published 2026-10-05 18:17:57 +00:00 by royalcat

Installation

Pull the image from the command line:

docker pull git.kmsign.org/royalcat/embeddings-fast@sha256:4ab50989a476f852ce753b780bad405f221536be6b3e5d62926cd56822eae8af

Digest

sha256:4ab50989a476f852ce753b780bad405f221536be6b3e5d62926cd56822eae8af

For more information on the Container registry, see the documentation.

Image layers

# debian.sh --arch 'arm64' out/ 'trixie' '@1789689600'

RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends curl ca-certificates && rm -rf /var/lib/apt/lists/* # buildkit

COPY /src/target/aarch64-unknown-linux-gnu/release/embeddings-fast /usr/local/bin/embeddings-fast # buildkit

EXPOSE [8383/tcp]

ENTRYPOINT ["embeddings-fast"]

CMD ["serve" "--backend" "flex" "--dtype" "f32" "--npu" "--npu-attn" "cpu" "--port" "8383" "--max-tokens" "8192" "--model-dir" "/models/qwen3-embedding-0.6b" "--model-name" "qwen3-embedding"]

Details

Container

2026-10-05 18:17:57 +00:00

0

OCI / Docker

linux/arm64

42 MiB

Versions (3) View all

0c99eed 2026-10-05

48eb71b 2026-10-05

3c347b1 2026-10-05