MetaCLIP
Collection
MetaCLIP & MetaCLIP2 OpenCLIP and timm models. All models are dual timm + OpenCLIP (or just timm for specific vit encoders). โข 24 items โข Updated โข 3
How to use timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b with timm:
import timm
model = timm.create_model("hf-hub:timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b", pretrained=True)How to use timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-classification", model="timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b")
pipe("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoImageProcessor, AutoModelForImageClassification
processor = AutoImageProcessor.from_pretrained("timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b")
model = AutoModelForImageClassification.from_pretrained("timm/vit_huge_patch14_clip_quickgelu_224.metaclip_2pt5b", device_map="auto")