Feature Extraction
sentence-transformers
Safetensors
Transformers
qwen3
text-generation
sentence-similarity
text-embeddings-inference
Instructions to use Qwen/Qwen3-Embedding-0.6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Qwen/Qwen3-Embedding-0.6B with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Qwen/Qwen3-Embedding-0.6B") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use Qwen/Qwen3-Embedding-0.6B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Qwen/Qwen3-Embedding-0.6B")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-Embedding-0.6B") model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-Embedding-0.6B", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
ONNX conversion
#18
by shuttie - opened
- .gitattributes +1 -0
- onnx/model.onnx +3 -0
- onnx/model.onnx_data +3 -0
- onnx/model_qint8_arm64.onnx +3 -0
- onnx/model_qint8_avx512.onnx +3 -0
- onnx/model_qint8_avx512_vnni.onnx +3 -0
- onnx/model_quint8_avx2.onnx +3 -0
.gitattributes
CHANGED
|
@@ -14,6 +14,7 @@
|
|
| 14 |
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
*.onnx filter=lfs diff=lfs merge=lfs -text
|
|
|
|
| 17 |
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
*.pb filter=lfs diff=lfs merge=lfs -text
|
|
|
|
| 14 |
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.onnx_data filter=lfs diff=lfs merge=lfs -text
|
| 18 |
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 19 |
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 20 |
*.pb filter=lfs diff=lfs merge=lfs -text
|
onnx/model.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:55a191d290e740e4bd2f37915aff5107503b60d318b636b95da8aa88ef026a7f
|
| 3 |
+
size 1577664
|
onnx/model.onnx_data
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c7569e58783ee0ad8c5fb797d7944aa4f5928af53fb4c1f626f71885af22969
|
| 3 |
+
size 2383077376
|
onnx/model_qint8_arm64.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:85689f02c507b4f72eb473f33ceed491f0172d09463e83d5f9ed1a551e68c5ec
|
| 3 |
+
size 600127789
|
onnx/model_qint8_avx512.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:85689f02c507b4f72eb473f33ceed491f0172d09463e83d5f9ed1a551e68c5ec
|
| 3 |
+
size 600127789
|
onnx/model_qint8_avx512_vnni.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:85689f02c507b4f72eb473f33ceed491f0172d09463e83d5f9ed1a551e68c5ec
|
| 3 |
+
size 600127789
|
onnx/model_quint8_avx2.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a7eda29cc374b01ae75eb1af1ab65c3c61a64c43f39f16e08c6e37c075dcbf4d
|
| 3 |
+
size 600127788
|