clef:flash-fp16
3 TagsUpdated 9B params4096 contextEnglishApache-2.0by Cloudflare
Cloudflare's Clef-Flash: Qwen3.5-9B post-trained with a joint schema head that scores every option of every question together, in one forward pass per request. Needs about 19 GB of memory. This tag computes in fp16 on NVIDIA GPUs: faster than clef:flash, with at least 99.5 % of its decisions the same. On a CPU it runs, slowly; use clef:flash there.
9b
ollaya run clef:flash-fp16 --preset triage "I was charged twice for my subscription this month and want a refund."curl http://localhost:11435/api/decide \
-H "Content-Type: application/json" \
-d '{
"model": "clef:flash-fp16",
"state": "I was charged twice for my subscription this month and want a refund.",
"questions": {
"department": {
"type": "choice",
"instructions": "Which team should handle this?",
"criteria": {
"billing": "Payments, invoices and refunds",
"technical": "Bugs, errors and outages",
"account": "Login, profile and settings"
}
},
"refund": {
"type": "noul",
"instructions": "Is the customer asking for a refund?"
}
}
}'# Already using a TypeSafe SDK? Set TYPESAFE_BASE_URL=http://localhost:11435 instead.
import requests
response = requests.post(
"http://localhost:11435/api/decide",
json={
"model": "clef:flash-fp16",
"state": "I was charged twice for my subscription this month and want a refund.",
"questions": {
"department": {
"type": "choice",
"instructions": "Which team should handle this?",
"criteria": {
"billing": "Payments, invoices and refunds",
"technical": "Bugs, errors and outages",
"account": "Login, profile and settings"
}
},
"refund": {
"type": "noul",
"instructions": "Is the customer asking for a refund?"
}
}
},
)
answers = response.json()["answers"]
print(answers["department"]["choice"], answers["refund"]["noul"])const response = await fetch("http://localhost:11435/api/decide", {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify({
model: "clef:flash-fp16",
state: "I was charged twice for my subscription this month and want a refund.",
questions: {
department: {
type: "choice",
instructions: "Which team should handle this?",
criteria: {
billing: "Payments, invoices and refunds",
technical: "Bugs, errors and outages",
account: "Login, profile and settings"
}
},
refund: {
type: "noul",
instructions: "Is the customer asking for a refund?"
}
}
}),
});
const { answers } = await response.json();
console.log(answers.department.choice, answers.refund.noul);Details
- graph27f9da9d85c7 · 13 MB
onnx · clef · 9B · fp16 - weights8b45a8e96814 · 4.9 GB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/model-00001-of-00004.safetensors - weights7590856c713e · 5.0 GB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/model-00002-of-00004.safetensors - weightse6eac2467952 · 5.0 GB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/model-00003-of-00004.safetensors - weights9fcecc6556b3 · 3.9 GB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/model-00004-of-00004.safetensors - weights19cdcec8c81d · 244 MB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/joint_head.safetensors - tokenizer06b9509352d2 · 20 MB
huggingface.co/Cloudflare/clef-flash/resolve/17f0b0a…/tokenizer.json - decision35a9f4935cff · 3 KB
{"engine": "onnx", "family": "clef", "encoder": "", "layout": "clef-joint-v1", …} - calibration16180173d812 · 165 B
{"temperature": [1.0, 1.0, 1.0]} - license0e73553d4bd8 · 10 KB
Clef-Flash by Cloudflare (https://huggingface.co/Cloudflare/clef-flash): Qwen3.5-9B, fully post-trained, with a joint schema head, Apache-2.0.
Every layer is checked against its sha256 when it is pulled. Weights and tokenizers download from the model author's Hugging Face repository at a pinned commit; Ollaya never re-hosts them.