Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Intel® Neural Compressor

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: Intel® Neural Compressor

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 190 • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 23 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 22

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 21

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 18

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 18 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 188 • 5

INC4AI/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 17 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 175 • 1

Intel/bart-large-cnn-int8-dynamic-inc

Updated Mar 22, 2024 • 26 • 1

Intel/distilbart-cnn-12-6-int8-dynamic-inc

Updated Mar 22, 2024 • 22 • 2

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 10

Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 9

Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 18

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 10

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 21 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 33 • 9

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18, 2024 • 17

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 13

Intel/bert-large-uncased-rte-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 16

Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 12 • 1

Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 12

Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22, 2024 • 16

Intel/bert-base-uncased-CoLA-int8-inc

Text Classification • Updated Mar 22, 2024 • 19

Intel/bert-large-uncased-cola-int8-inc

Text Classification • Updated Mar 22, 2024 • 12

Intel/bert-base-uncased-STS-B-int8-inc

Text Classification • Updated Mar 22, 2024 • 15

Intel/bert-base-cased-finetuned-sst2-int8-inc

Text Classification • Updated Mar 21, 2024 • 18

Intel/bert-base-uncased-QNLI-int8-inc

Text Classification • Updated Mar 22, 2024 • 23