Skip to content

winnow:e4b

3 TagsUpdated 7.5B params8192 context100+ languagesApache-2.0by EldanRing

Winnow-E4B, Q8_0 GGUF, with the author's fitted temperature: 0.722 on typed decisions, smaller and faster than 12b.

multilingual7.5b
ollaya run winnow:e4b --preset triage "I was charged twice for my subscription this month and want a refund."

Details

  • weights840e3f50e5a9 · 8.0 GBgguf · Q8_0 · huggingface.co/EldanRing/Winnow-E4B/resolve/734302f…/gguf/Winnow-E4B-Q8_0.gguf
  • decision3b76b10f430a · 2 KB{"engine": "llama", "family": "winnow", "layout": "winnow-v1", "gguf": {…}, …}
  • calibration82007815eb87 · 258 B{"temperature": [1.257, 1.257, 1.257]}
  • licenseb8186b826818 · 11 KBWinnow-E4B

Every layer is checked against its sha256 when it is pulled. Weights and tokenizers download from the model author's Hugging Face repository at a pinned commit; Ollaya never re-hosts them.

Winnow readme and all models