Instructions to use alst10/Qwen3.5-Creative-19B-A3B-REAP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use alst10/Qwen3.5-Creative-19B-A3B-REAP with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP # Run inference directly in the terminal: llama cli -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP # Run inference directly in the terminal: llama cli -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP # Run inference directly in the terminal: ./llama-cli -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP # Run inference directly in the terminal: ./build/bin/llama-cli -hf alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
Use Docker
docker model run hf.co/alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
- LM Studio
- Jan
- Ollama
How to use alst10/Qwen3.5-Creative-19B-A3B-REAP with Ollama:
ollama run hf.co/alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
- Unsloth Desktop
- Docker Model Runner
How to use alst10/Qwen3.5-Creative-19B-A3B-REAP with Docker Model Runner:
docker model run hf.co/alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
- Lemonade
How to use alst10/Qwen3.5-Creative-19B-A3B-REAP with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull alst10/Qwen3.5-Creative-19B-A3B-REAP:Q4_0_ROCMFP
Run and chat with the model
lemonade run user.Qwen3.5-Creative-19B-A3B-REAP-Q4_0_ROCMFP
List all available models
lemonade list
- Atomic Chat
Qwen3.5-Creative-19B-A3B-REAP - ROCmFPX Quantized
This model was dynamically quantized and generated using the ROCmFPX My Repo Space
- Original Base Model: Timersofc/Qwen3.5-Creative-19B-A3B-REAP
Usage Instructions with ROCmFPX llama.cpp
To run this model, you must use the specialized ROCmFPX fork of llama.cpp by charlie12345. Standard llama.cpp releases do not currently support ROCmFPX quantization formats.
# 1. Clone the ROCmFPX repository
git clone --depth 1 [https://github.com/charlie12345/ROCmFPX.git](https://github.com/charlie12345/ROCmFPX.git)
cd ROCmFPX
# 2. Build the project
cmake -B build -G Ninja -DGGML_CUDA=OFF -DGGML_NATIVE=OFF
cmake --build build --target llama-cli -j
# 3. Run the model
./build/bin/llama-cli -m Qwen3.5-Creative-19B-A3B-REAP-Q4_0_ROCMFP4_FAST.gguf -p "You are a helpful assistant. Hello!" -n 128
License
This model is distributed under the Creative Commons Attribution 4.0 International (CC BY 4.0) license. Please adhere to the original license constraints of the base model and provide appropriate attribution when sharing.
- Downloads last month
- 87
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for alst10/Qwen3.5-Creative-19B-A3B-REAP
Base model
Qwen/Qwen3.5-35B-A3B-Base Finetuned
Qwen/Qwen3.5-35B-A3B Finetuned
Timersofc/Qwen3.5-Creative-19B-A3B-REAP