Instructions to use pthinc/pofuduk_cicikus_v4_5B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use pthinc/pofuduk_cicikus_v4_5B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="pthinc/pofuduk_cicikus_v4_5B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("pthinc/pofuduk_cicikus_v4_5B")
model = AutoModelForMultimodalLM.from_pretrained("pthinc/pofuduk_cicikus_v4_5B", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use pthinc/pofuduk_cicikus_v4_5B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "pthinc/pofuduk_cicikus_v4_5B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/pofuduk_cicikus_v4_5B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/pthinc/pofuduk_cicikus_v4_5B

SGLang

How to use pthinc/pofuduk_cicikus_v4_5B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "pthinc/pofuduk_cicikus_v4_5B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/pofuduk_cicikus_v4_5B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "pthinc/pofuduk_cicikus_v4_5B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pthinc/pofuduk_cicikus_v4_5B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Unsloth Desktop
Docker Model Runner
How to use pthinc/pofuduk_cicikus_v4_5B with Docker Model Runner:
```
docker model run hf.co/pthinc/pofuduk_cicikus_v4_5B
```

pofuduk_cicikus_v4_5B

Commit History

May 18

20:04
Update LICENSE.md

prometechinc

Verified signature
626b241

Apr 25

19:34
Update README.md

prometechinc

Verified signature
adbb4d9

Mar 27

11:38
Update README.md

prometechinc

Verified signature
a7ec45f
11:21
Update README.md

prometechinc

Verified signature
1cb3c17
11:15
(Trained with Unsloth)

prometechinc

Verified signature
b1ea3ff
11:06
(Trained with Unsloth)

prometechinc

Verified signature
bd1c5b1
11:06
Unsloth Model Card

prometechinc

Verified signature
52077c2

Mar 26

11:39
Update README.md

prometechinc

Verified signature
2cef850
11:35
Update README.md

prometechinc

Verified signature
4f98d2c

Mar 25

20:13
Update README.md

prometechinc

Verified signature
e722a79
20:12
Update README.md

prometechinc

Verified signature
ac9e22b
14:29
Update README.md

prometechinc

Verified signature
72a2fa0
14:28
Update README.md

prometechinc

Verified signature
3417715
14:27
Update README.md

prometechinc

Verified signature
cf0597a
14:24
Update README.md

prometechinc

Verified signature
4be8810
14:11
Update README.md

prometechinc

Verified signature
446a949
14:08
Update README.md

prometechinc

Verified signature
2cca56e
14:06
Update README.md

prometechinc

Verified signature
257e50f
14:05
Update README.md

prometechinc

Verified signature
ebed028
14:04
Update README.md

prometechinc

Verified signature
673351f
14:00
Update README.md

prometechinc

Verified signature
d8b221e
13:57
Update README.md

prometechinc

Verified signature
e9df8b3
13:50
Update README.md

prometechinc

Verified signature
520ca54
13:48
Update README.md

prometechinc

Verified signature
8a42221
13:47
Update README.md

prometechinc

Verified signature
b1af70f
13:43
Update README.md

prometechinc

Verified signature
f94ab2f
13:39
Update README.md

prometechinc

Verified signature
aa956d9
13:37
Update README.md

prometechinc

Verified signature
ab66710
13:36
Update README.md

prometechinc

Verified signature
d18fb5b
13:36
Update README.md

prometechinc

Verified signature
35c9e87
13:33
Update README.md

prometechinc

Verified signature
f0558f4
13:32
Update README.md

prometechinc

Verified signature
8e3d393
13:24
Update README.md

prometechinc

Verified signature
8bc43c4
13:23
Rename LICENSE to LICENSE.md

prometechinc

Verified signature
3ef8d68
13:20
Update README.md

prometechinc

Verified signature
b65260b
13:19
Update README.md

prometechinc

Verified signature
056a4b6
13:10
Update README.md

prometechinc

Verified signature
1c6f35c
13:07
Update README.md

prometechinc

Verified signature
f90c73e
12:58
Update README.md

prometechinc

Verified signature
031a27c
12:18
initial commit

prometechinc

Verified signature
529d918

Commit History

May 18

Update LICENSE.md

Apr 25

Update README.md

Mar 27

Update README.md

Update README.md

(Trained with Unsloth)

(Trained with Unsloth)

Unsloth Model Card

Mar 26

Update README.md

Update README.md

Mar 25

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Rename LICENSE to LICENSE.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

initial commit