Files
ModelForge/docs/architecture/VISION_EMBEDDINGS.md
T

10 lines
950 B
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# vision.embedding@1
`vision.embedding@1` accepts a bounded batch of image or text items. Each item has exactly one modality. Images are PNG/JPEG, base64 encoded at the gateway boundary and constrained to 4096×4096 pixels in the runtime.
The response exposes normalized vectors, their dimension, and an immutable `EmbeddingSpace` identifier. Equal dimensions never imply compatible spaces. Identity binds the exact artifact revision and digest, RuntimeProfile fingerprint, processor, input image size, normalization and pooling/projection semantics.
The preferred SigLIP2 SO400M candidate is retained as discovery evidence but is not forced into a shared 16 GiB GPU envelope. The M9 safe baseline is SigLIP2 Base patch16/224, loaded offline by `transformers_siglip2`.
Evaluation uses a deterministic, locally generated image/text retrieval set and typed Recall@K, MRR, latency and peak-VRAM evidence. Fixtures never leave the local environment.