snap
2 TagsUpdated Apache-2.0by logitlab
logitlab's snap1-2b: MiniCPM5-2B fine-tuned to read one option letter after the prompt of emnlmn's snap engine. Ollaya runs the author's Q8_0 GGUF on llama.cpp with snap's own prompt, on NVIDIA GPUs, Apple silicon or the CPU.
decisionfine-tunedgguf2b
Tags
| Name |
|---|
| snaplatestSame as snap:2b.2.7 GB · 8192 ctx · English, it |
| snap:2bsnap1-2b (MiniCPM5-2B), Q8_0 GGUF, raw probabilities: 0.648 on typed decisions; up to 26 options per question.2.7 GB · 8192 ctx · English, it |
Tags without a suffix load fp16 on a CUDA GPU and fp32 on CPU; add -fp16 or -fp32 to pin one precision.