Text Classification
cortiq
Laya
English
cmf
jev
decision-making
structured-output
tool-selection
semantic-routing
on-device
metal
vulkan
intent-classification
resonance-routing
Instructions to use infosave/cmf-decision with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- cortiq
How to use infosave/cmf-decision with cortiq:
# one Rust binary, no additional dependencies cargo install cortiq-cli # or a prebuilt binary from github.com/infosave2007/cmf/releases hf download infosave/cmf-decision --include "*.cmf" --local-dir . ls *.cmf # some repos ship more than one quantization
cortiq run FILE.cmf --prompt "What is the capital of France?"
cortiq serve FILE.cmf --port 8080 # OpenAI-compatible server
- Laya
How to use infosave/cmf-decision with Laya:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
|
Download figures/latency.svg from infosave/cmf-decision: direct link, hf CLI and curl.
- Browser
- Download file 9.97 kB
-
https://huggingface.co/infosave/cmf-decision/resolve/main/figures/latency.svg
- Command line
-
hf download hf://infosave/cmf-decision/figures/latency.svg
-
curl -L -o latency.svg https://huggingface.co/infosave/cmf-decision/resolve/main/figures/latency.svg
9.97 kB
| <svg xmlns:xlink="http://www.w3.org/1999/xlink" width="864pt" height="378pt" viewBox="0 0 864 378" xmlns="http://www.w3.org/2000/svg" version="1.1"> | |
| <metadata> | |
| <rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> | |
| <cc:Work> | |
| <dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/> | |
| <dc:date>2026-09-27T21:33:33.002967</dc:date> | |
| <dc:format>image/svg+xml</dc:format> | |
| <dc:creator> | |
| <cc:Agent> | |
| <dc:title>Matplotlib v3.9.4, https://matplotlib.org/</dc:title> | |
| </cc:Agent> | |
| </dc:creator> | |
| </cc:Work> | |
| </rdf:RDF> | |
| </metadata> | |
| <defs> | |
| <style type="text/css">*{stroke-linejoin: round; stroke-linecap: butt}</style> | |
| </defs> | |
| <g id="figure_1"> | |
| <g id="patch_1"> | |
| <path d="M 0 378 | |
| L 864 378 | |
| L 864 0 | |
| L 0 0 | |
| z | |
| " style="fill: #fafbfd"/> | |
| </g> | |
| <g id="axes_1"> | |
| <g id="patch_2"> | |
| <path d="M 177.12 306.18 | |
| L 803.52 306.18 | |
| L 803.52 113.4 | |
| L 177.12 113.4 | |
| z | |
| " style="fill: #fafbfd"/> | |
| </g> | |
| <g id="matplotlib.axis_1"> | |
| <g id="xtick_1"> | |
| <g id="line2d_1"> | |
| <path d="M 177.12 306.18 | |
| L 177.12 113.4 | |
| " clip-path="url(#p3e660b5b59)" style="fill: none; stroke: #dde5eb; stroke-width: 0.8; stroke-linecap: square"/> | |
| </g> | |
| <g id="line2d_2"/> | |
| <g id="text_1"> | |
| <text style="fill: #586977; font: 12px 'DejaVu Sans'; text-anchor: middle" x="177.12" y="325.298125" transform="rotate(-0 177.12 325.298125)">0</text> | |
| </g> | |
| </g> | |
| <g id="xtick_2"> | |
| <g id="line2d_3"> | |
| <path d="M 311.829677 306.18 | |
| L 311.829677 113.4 | |
| " clip-path="url(#p3e660b5b59)" style="fill: none; stroke: #dde5eb; stroke-width: 0.8; stroke-linecap: square"/> | |
| </g> | |
| <g id="line2d_4"/> | |
| <g id="text_2"> | |
| <text style="fill: #586977; font: 12px 'DejaVu Sans'; text-anchor: middle" x="311.829677" y="325.298125" transform="rotate(-0 311.829677 325.298125)">100</text> | |
| </g> | |
| </g> | |
| <g id="xtick_3"> | |
| <g id="line2d_5"> | |
| <path d="M 446.539355 306.18 | |
| L 446.539355 113.4 | |
| " clip-path="url(#p3e660b5b59)" style="fill: none; stroke: #dde5eb; stroke-width: 0.8; stroke-linecap: square"/> | |
| </g> | |
| <g id="line2d_6"/> | |
| <g id="text_3"> | |
| <text style="fill: #586977; font: 12px 'DejaVu Sans'; text-anchor: middle" x="446.539355" y="325.298125" transform="rotate(-0 446.539355 325.298125)">200</text> | |
| </g> | |
| </g> | |
| <g id="xtick_4"> | |
| <g id="line2d_7"> | |
| <path d="M 581.249032 306.18 | |
| L 581.249032 113.4 | |
| " clip-path="url(#p3e660b5b59)" style="fill: none; stroke: #dde5eb; stroke-width: 0.8; stroke-linecap: square"/> | |
| </g> | |
| <g id="line2d_8"/> | |
| <g id="text_4"> | |
| <text style="fill: #586977; font: 12px 'DejaVu Sans'; text-anchor: middle" x="581.249032" y="325.298125" transform="rotate(-0 581.249032 325.298125)">300</text> | |
| </g> | |
| </g> | |
| <g id="xtick_5"> | |
| <g id="line2d_9"> | |
| <path d="M 715.95871 306.18 | |
| L 715.95871 113.4 | |
| " clip-path="url(#p3e660b5b59)" style="fill: none; stroke: #dde5eb; stroke-width: 0.8; stroke-linecap: square"/> | |
| </g> | |
| <g id="line2d_10"/> | |
| <g id="text_5"> | |
| <text style="fill: #586977; font: 12px 'DejaVu Sans'; text-anchor: middle" x="715.95871" y="325.298125" transform="rotate(-0 715.95871 325.298125)">400</text> | |
| </g> | |
| </g> | |
| </g> | |
| <g id="matplotlib.axis_2"> | |
| <g id="ytick_1"> | |
| <g id="line2d_11"/> | |
| <g id="text_6"> | |
| <text style="fill: #586977; font: 700 12px 'DejaVu Sans'; text-anchor: end" x="167.12" y="145.345636" transform="rotate(-0 167.12 145.345636)">BANKING77</text> | |
| </g> | |
| </g> | |
| <g id="ytick_2"> | |
| <g id="line2d_12"/> | |
| <g id="text_7"> | |
| <text style="fill: #586977; font: 700 12px 'DejaVu Sans'; text-anchor: end" x="167.12" y="215.15455" transform="rotate(-0 167.12 215.15455)">CLINC150</text> | |
| </g> | |
| </g> | |
| <g id="ytick_3"> | |
| <g id="line2d_13"/> | |
| <g id="text_8"> | |
| <text style="fill: #586977; font: 700 12px 'DejaVu Sans'; text-anchor: end" x="167.12" y="284.963464" transform="rotate(-0 167.12 284.963464)">MASSIVE</text> | |
| </g> | |
| </g> | |
| </g> | |
| <g id="patch_3"> | |
| <path d="M 177.12 119.17266 | |
| L 182.400619 119.17266 | |
| L 182.400619 131.254972 | |
| L 177.12 131.254972 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #087f6e"/> | |
| </g> | |
| <g id="text_9"> | |
| <text style="fill: #087f6e; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="189.917419" y="128.525066" transform="rotate(-0 189.917419 128.525066)">3.92</text> | |
| </g> | |
| <g id="patch_4"> | |
| <path d="M 177.12 134.745418 | |
| L 282.732387 134.745418 | |
| L 282.732387 146.82773 | |
| L 177.12 146.82773 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #66a9d2"/> | |
| </g> | |
| <g id="text_10"> | |
| <text style="fill: #28688f; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="290.249187" y="144.097824" transform="rotate(-0 290.249187 144.097824)">78.40</text> | |
| </g> | |
| <g id="patch_5"> | |
| <path d="M 177.12 150.318175 | |
| L 646.354219 150.318175 | |
| L 646.354219 162.400487 | |
| L 177.12 162.400487 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #64748b"/> | |
| </g> | |
| <g id="text_11"> | |
| <text style="fill: #64748b; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="653.871019" y="159.670581" transform="rotate(-0 653.871019 159.670581)">348.33</text> | |
| </g> | |
| <g id="patch_6"> | |
| <path d="M 177.12 188.981574 | |
| L 182.225497 188.981574 | |
| L 182.225497 201.063886 | |
| L 177.12 201.063886 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #087f6e"/> | |
| </g> | |
| <g id="text_12"> | |
| <text style="fill: #087f6e; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="189.742297" y="198.33398" transform="rotate(-0 189.742297 198.33398)">3.79</text> | |
| </g> | |
| <g id="patch_7"> | |
| <path d="M 177.12 204.554331 | |
| L 282.867097 204.554331 | |
| L 282.867097 216.636643 | |
| L 177.12 216.636643 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #66a9d2"/> | |
| </g> | |
| <g id="text_13"> | |
| <text style="fill: #28688f; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="290.383897" y="213.906737" transform="rotate(-0 290.383897 213.906737)">78.50</text> | |
| </g> | |
| <g id="patch_8"> | |
| <path d="M 177.12 220.127089 | |
| L 704.521858 220.127089 | |
| L 704.521858 232.209401 | |
| L 177.12 232.209401 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #64748b"/> | |
| </g> | |
| <g id="text_14"> | |
| <text style="fill: #64748b; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="712.038658" y="229.479495" transform="rotate(-0 712.038658 229.479495)">391.51</text> | |
| </g> | |
| <g id="patch_9"> | |
| <path d="M 177.12 258.790487 | |
| L 181.16129 258.790487 | |
| L 181.16129 270.872799 | |
| L 177.12 270.872799 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #087f6e"/> | |
| </g> | |
| <g id="text_15"> | |
| <text style="fill: #087f6e; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="188.67809" y="268.142893" transform="rotate(-0 188.67809 268.142893)">3.00</text> | |
| </g> | |
| <g id="patch_10"> | |
| <path d="M 177.12 274.363245 | |
| L 271.955613 274.363245 | |
| L 271.955613 286.445557 | |
| L 177.12 286.445557 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #66a9d2"/> | |
| </g> | |
| <g id="text_16"> | |
| <text style="fill: #28688f; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="279.472413" y="283.715651" transform="rotate(-0 279.472413 283.715651)">70.40</text> | |
| </g> | |
| <g id="patch_11"> | |
| <path d="M 177.12 289.936003 | |
| L 643.71391 289.936003 | |
| L 643.71391 302.018315 | |
| L 177.12 302.018315 | |
| z | |
| " clip-path="url(#p3e660b5b59)" style="fill: #64748b"/> | |
| </g> | |
| <g id="text_17"> | |
| <text style="fill: #64748b; font: 700 12px 'DejaVu Sans'; text-anchor: start" x="651.23071" y="299.288409" transform="rotate(-0 651.23071 299.288409)">346.37</text> | |
| </g> | |
| </g> | |
| <g id="text_18"> | |
| <text style="fill: #142b36; font: 700 24px 'DejaVu Sans'; text-anchor: start" x="47.52" y="31.752" transform="rotate(-0 47.52 31.752)">Milliseconds locally. Less waiting over HTTPS.</text> | |
| </g> | |
| <g id="text_19"> | |
| <text style="fill: #586977; font: 12.5px 'DejaVu Sans'; text-anchor: start" x="47.52" y="55.944" transform="rotate(-0 47.52 55.944)">Median response time (ms) · Lower is better</text> | |
| </g> | |
| <g id="text_20"> | |
| <text style="fill: #586977; font: 10.5px 'DejaVu Sans'" transform="translate(47.52 346.983738)">Local: Apple M4, one thread, full text → decision. HTTPS/API: network included, different hardware.</text> | |
| <text style="fill: #586977; font: 10.5px 'DejaVu Sans'" transform="translate(47.52 361.134949)">Jev BANKING77: four workers; other API runs: serial. No hardware-normalized speedup claim.</text> | |
| </g> | |
| <g id="text_21"> | |
| <text style="fill: #087f6e; font: 700 11px 'DejaVu Sans'; text-anchor: end" x="812.16" y="30.24" transform="rotate(-0 812.16 30.24)">CORTIQ</text> | |
| </g> | |
| <g id="legend_1"> | |
| <g id="patch_12"> | |
| <path d="M 54 90.226125 | |
| L 67.2 90.226125 | |
| L 67.2 81.826125 | |
| L 54 81.826125 | |
| z | |
| " style="fill: #087f6e"/> | |
| </g> | |
| <g id="text_22"> | |
| <text style="font: 12px 'DejaVu Sans'; text-anchor: start" x="76.8" y="90.226125" transform="rotate(-0 76.8 90.226125)">Cortiq · local CPU</text> | |
| </g> | |
| <g id="patch_13"> | |
| <path d="M 204.725625 90.226125 | |
| L 217.925625 90.226125 | |
| L 217.925625 81.826125 | |
| L 204.725625 81.826125 | |
| z | |
| " style="fill: #66a9d2"/> | |
| </g> | |
| <g id="text_23"> | |
| <text style="font: 12px 'DejaVu Sans'; text-anchor: start" x="227.525625" y="90.226125" transform="rotate(-0 227.525625 90.226125)">Cortiq · HTTPS</text> | |
| </g> | |
| <g id="patch_14"> | |
| <path d="M 337.605 90.226125 | |
| L 350.805 90.226125 | |
| L 350.805 81.826125 | |
| L 337.605 81.826125 | |
| z | |
| " style="fill: #64748b"/> | |
| </g> | |
| <g id="text_24"> | |
| <text style="font: 12px 'DejaVu Sans'; text-anchor: start" x="360.405" y="90.226125" transform="rotate(-0 360.405 90.226125)">Jev 1.13 · API</text> | |
| </g> | |
| </g> | |
| </g> | |
| <defs> | |
| <clipPath id="p3e660b5b59"> | |
| <rect x="177.12" y="113.4" width="626.4" height="192.78"/> | |
| </clipPath> | |
| </defs> | |
| </svg> | |