pplx-decider
3 TagsUpdated Apache-2.0by Perplexity AI
Perplexity's decision model: Qwen3.5-4B distilled from its 27B decision models, with a readout over 255 answer codes. Every question of a request shares one sequence and reads the whole request, and the probabilities are calibrated with Perplexity's temperature. Up to 255 options.
decisionmultilingualfine-tuned4b
Tags
| Name |
|---|
| pplx-deciderlatestSame as pplx-decider:flash.9.1 GB · 8192 ctx · 100+ languages |
| pplx-decider:flashpplx-decider-flash-v1.2 (Qwen3.5-4B), about 9 GB in memory.9.1 GB · 8192 ctx · 100+ languages |
| pplx-decider:flash-fp16pplx-decider-flash v1.2: Qwen3.5-4B post-trained by Perplexity (distilled from its 27B decision models), with a 255-code readout. Every question of a request shares one sequence, read at a marker after each question; the full-attention layers see the whole request. Up to 255 options and levels, 8,192 tokens per sequence. Needs about 9 GB of memory. This tag computes in fp16 on NVIDIA GPUs: faster than pplx-decider:flash, with at least 99.5 % of its decisions the same. On a CPU it runs, slowly; use pplx-decider:flash there.9.1 GB · 8192 ctx · 100+ languages |
Tags without a suffix load fp16 on a CUDA GPU and fp32 on CPU; add -fp16 or -fp32 to pin one precision.