面壁 MiniCPM-OCR 1.0 的 DSpark 草稿头 GGUF 版本发布

GGUF build of the DSpark draft head for MiniCPM-OCR 1.0. A draft model, not a standalone OCR model — pair it with the matching main checkpoint.

Files

File	Size
`dspark-MiniCPM-OCR-1_0-F16.gguf`	0.606 GB
`dspark-MiniCPM-OCR-1_0-Q8_0.gguf`	0.327 GB
`dspark-MiniCPM-OCR-1_0-Q6_K.gguf`	0.255 GB
`dspark-MiniCPM-OCR-1_0-Q5_K_M.gguf`	0.233 GB
`dspark-MiniCPM-OCR-1_0-Q5_K_S.gguf`	0.232 GB
`dspark-MiniCPM-OCR-1_0-Q5_1.gguf`	0.243 GB
`dspark-MiniCPM-OCR-1_0-Q5_0.gguf`	0.232 GB
`dspark-MiniCPM-OCR-1_0-Q4_K_M.gguf`	0.211 GB
`dspark-MiniCPM-OCR-1_0-Q4_K_S.gguf`	0.209 GB
`dspark-MiniCPM-OCR-1_0-Q4_1.gguf`	0.220 GB
`dspark-MiniCPM-OCR-1_0-Q4_0.gguf`	0.209 GB

Use the main model's projector (mmproj-model-f16-4x.gguf from MiniCPM-OCR-1.0-gguf); this repository contains only the draft.

Usage

llama-cli \
  -m MiniCPM-OCR-1_0-Q8_0.gguf \
  --mmproj mmproj-model-f16-4x.gguf \
  -md dspark-MiniCPM-OCR-1_0-Q8_0.gguf \
  --spec-type draft-dspark \
  --image page.png -p "Text Recognition:" \
  --jinja -ngl 99 -ngld 99 -fa on

-md is the draft model and --spec-type draft-dspark enables the draft; -ngld offloads draft layers to GPU.

llama-mtmd-cli does not accept a draft model. Use llama-cli or llama-server when enabling DSpark with multimodal input.

Each tier carries the absolute target token IDs in its d2t tensor (the safetensors export stores them delta-encoded).

Related checkpoints

Format	HF Mirror	ModelScope
BF16 (original)	🤗	ModelScope
GGUF (llama.cpp)	🤗	ModelScope
AWQ W4A16	🤗	ModelScope
GPTQ W4A16	🤗	ModelScope
DSpark draft (BF16)	🤗	ModelScope
DSpark draft (GGUF) (this repo)	🤗	ModelScope

FAQ

Installation, model downloads, GPU memory, input formats, and unexpected outputs: FAQ.

License

Model weights, code, and documentation are released under the Apache License 2.0.