Instructions to use MigoXV/AgenticASR-Refiner-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use MigoXV/AgenticASR-Refiner-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Use Docker
docker model run hf.co/MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use MigoXV/AgenticASR-Refiner-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "MigoXV/AgenticASR-Refiner-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "MigoXV/AgenticASR-Refiner-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
- Ollama
How to use MigoXV/AgenticASR-Refiner-GGUF with Ollama:
ollama run hf.co/MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use MigoXV/AgenticASR-Refiner-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use MigoXV/AgenticASR-Refiner-GGUF with Docker Model Runner:
docker model run hf.co/MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
- Lemonade
How to use MigoXV/AgenticASR-Refiner-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.AgenticASR-Refiner-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use MigoXV/AgenticASR-Refiner-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use MigoXV/AgenticASR-Refiner-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "MigoXV/AgenticASR-Refiner-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
AgenticASR-Refiner-GGUF
ๆฌไปๅบ็ฑ MigoXV ๅๅธ๏ผๆไพ Andrew0425/AgenticASR-Refiner ็ Q4_K_M GGUF ้ๅ็ๆฌ๏ผ็จไบๅจๆฏๆ GGUF ็ๆฌๅฐๆจ็็ฏๅขไธญ็บ ๆญฃไธญๆ ASR ่ฝฌๅๆๆฌใ
ๆจกๅๆฅๆถๅทฒ็ป่ฏๅซๅบ็ๆๅญ๏ผ่พๅบไฟฎๆญฃๅ็ๆๅญ๏ผๅฏ็จไบๅค็ๅฃ็ใ้ๅคใ้ๅญใๆ ็นไปฅๅๆฐๅญๅๆฏ่ฏญ่กจ่พพใ่พๅ ฅๆฏๆๆฌ๏ผไธ็ดๆฅๆฅๆถ้ณ้ข๏ผๅฎๆด่ฏญ้ณ่ฏๅซๆต็จ้่ฆๅฆ่ก้ ็ฝฎ ASR ๆจกๅใ
ๆจกๅไธๆไปถ
| ้กน็ฎ | ๅ ๅฎน |
|---|---|
| ๅๅงๆจกๅ | Andrew0425/AgenticASR-Refiner |
| ๆถๆ | Llama๏ผ24 ๅฑ๏ผ้่็ปดๅบฆ 1536 |
| ๅๆฐ่งๆจก | ็บฆ 1.1B๏ผGGUF ๅ ๆฐๆฎๆ ่ฎฐ๏ผ |
| ๆ ผๅผ | GGUF v3 |
| ้ๅ | Q4_K_M |
| ๆไปถ | AgenticASR-Refiner-Q4_K_M.gguf |
| ๆไปถๅคงๅฐ | 688,065,792 ๅญ่๏ผ็บฆ 656.19 MiB |
| ่ฎธๅฏ่ฏ | Apache-2.0๏ผๆฒฟ็จไธๆธธๆจกๅๅฃฐๆ |
ไธ่ฟฐ็ปๆๅๆ ผๅผไฟกๆฏๆฅ่ชๆฌไปๅบ GGUF ๆไปถใๆไปถๅ ๅซ tokenizer ๅ่ๅคฉๆจกๆฟใๅ ๆฐๆฎไธญ็ไธไธๆ้ฟๅบฆไธบ 131,072 token๏ผ่ฟไธๆฏๆฌ้ๅ็ๆฌ็้ฟๆๆฌ่ดจ้้ช่ฏ็ปๆใไธ้ข็็คบไพไฝฟ็จ 4,096 token ไธไธๆ๏ผ่พๅ ฅไธ็ๆๅ ๅฎนๅ ฑไบซๆญค้ข็ฎใ
ๆฌๆฌกๅๅธๆไพๅทฒๆ GGUF ๆไปถ๏ผๆฒกๆ่ฟฝๅ ่ฎญ็ปใๆชๆไพๅฏๅค็ฐ็่ฝฌๆขๅทฅๅ ท็ๆฌใๅฎๆด่ฝฌๆขๅฝไปคๆ้ๅๆ กๅ่ฎฐๅฝใ
ไธ่ฝฝ
ๅฎ่ฃ Hugging Face CLI ๅๆง่ก๏ผ
hf download MigoXV/AgenticASR-Refiner-GGUF \
AgenticASR-Refiner-Q4_K_M.gguf \
--local-dir ./AgenticASR-Refiner-GGUF
ๆไปถ SHA-256๏ผ
1dcbbbfde39742b213101c0d5fe645bfda18e5c9b693409205c481efbb487758
ไฝฟ็จ llama.cpp
ๅๅคๆฏๆ่ฏฅๆจกๅๆถๆๅๅ ๅต Jinja ่ๅคฉๆจกๆฟ็ llama.cppใไปฅไธไธบ่ฟ่ก็คบไพ๏ผๆฌๆฌกๅๅธๆชๅฏน่ฏฅๅฝไปคๆง่ก็ซฏๅฐ็ซฏๆจ็ๆต่ฏใ
ๅฏๅจๆฌๅฐ HTTP ๆๅก๏ผ
llama-server \
--model ./AgenticASR-Refiner-GGUF/AgenticASR-Refiner-Q4_K_M.gguf \
--alias AgenticASR-Refiner \
--ctx-size 4096 \
--jinja \
--host 127.0.0.1 \
--port 8080
ๅจๅฆไธไธช็ป็ซฏๅ้็บ ้่ฏทๆฑ๏ผ
curl http://127.0.0.1:8080/v1/chat/completions \
-H 'Content-Type: application/json' \
-d '{
"model": "AgenticASR-Refiner",
"messages": [
{
"role": "system",
"content": "ไฝ ๆฏ ASR ๆๆฌ็บ ้ๅฉๆใไฟ็ๅๆ๏ผๆๅฐไฟฎๆน๏ผๅปๅฃ็/้ๅค๏ผไฟฎ้ๅญ๏ผ่กฅๅฟ
่ฆๆ ็น๏ผ่ง่ๆฐๅญใๆฅๆใๆฏ่ฏญๅไปฃ็ ็ฌฆๅท๏ผๅค็่ชๆไฟฎๆญฃใไธ่ฆๆป็ปใๆฉๅๆ่งฃ้ใ้่ฆๆ้ๅฎไฝๅจๆซๅฐพ่ฟฝๅ <KEY>[่ฏ1ใ่ฏ2]๏ผๆฒกๆๅไธๅ ใ"
},
{
"role": "user",
"content": "ๅฏ้ฃไธชๆๅคฉๆไปฌๆไปฌๅผไผ่ฎจ่ฎบๆฅๅฃใ"
}
],
"temperature": 0,
"max_tokens": 512,
"stop": ["<|im_end|>"]
}'
ไป choices[0].message.content ่ฏปๅ็ปๆใ็คบไพๆพๅผ่ฎพ็ฝฎ temperature: 0๏ผ้ฟๅ
ไฝฟ็จ GGUF ๅ
่ฎฐๅฝ็้ป่ฎค้ๆ ทๆธฉๅบฆใๅ
ทไฝๆๅกๅๆฐ่ง llama-server ๆๆกฃใ
่พๅบไธไฝฟ็จๅปบ่ฎฎ
่พๅบๆญฃๆไธบ็บ ๆญฃๅ็่ฝฌๅ๏ผ่ฅๆจกๅๆ ่ฎฐไบ้่ฆๆ้ๅฎไฝ๏ผๆซๅฐพๅฏ่ฝๅธฆๆ <KEY>[่ฏ1ใ่ฏ2]ใ้่ฆ็บฏๆญฃๆๆถ๏ผๅฏๅจๅบ็จๅฑๆๅ่ฏฅๆซๅฐพๅญๆฎตๅนถไธๆญฃๆๅๅผไฟๅญใ่ฏฅๅญๆฎต็ฑๆจกๅ็ๆ๏ผไธไฟ่ฏๆฏๆฌกๅญๅจๆๆ ผๅผๅฎๅ
จๆญฃ็กฎใ
่พ้ฟ่ฝฌๅๅฏๆๅฅๅๆฎตๅค็๏ผๅนถไธบๆฏๆฎต้ข็่พๅบ็ฉบ้ดใๅฆๆๆฅๅฃ่ฟๅ finish_reason: "length"๏ผๅบๆฃๆฅๆฏๅฆๆชๆญ๏ผ็ผฉ็ญ่พๅ
ฅๆๅขๅ ็ๆ้ข็ฎใ่ฟ่กๅ
ๅญ่ฟๅ
ๅซ KV cache ๅๆจ็็ผๅฒๅบ๏ผไธ่ฝไป
ๆ GGUF ๆไปถๅคงๅฐไผฐ็ฎใ
่ฏไผฐไธ้ๅถ
ๆฌไปๅบๅฐๆชๆไพ Q4_K_M ็ๆฌ็ CER/WERใ็ธๅฏนๅๅงๆ้็็ฒพๅบฆๅๅใๅๅ้ๆๅปถ่ฟ่ฏๆตใ้ๅๅฏ่ฝๅฝฑๅ็บ ้่ดจ้๏ผๆจกๅไนๅฏ่ฝ่ฏฏๆนไบบๅใไธๆๅ่ฏใๆฐๅญๆๅๆฌๆญฃ็กฎ็่ฝฌๅใ้จ็ฝฒๅๅบไฝฟ็จ่ชๅทฑ็่ฝฌๅๆ ทๆฌๅฏนๆฏ็บ ้ๅๅ็ปๆใ
ๆจกๅๅชๆ นๆฎ่พๅ ฅๆๅญๆจๆญ๏ผๆ ๆณๅฉ็จๅๅง้ณ้ขๆถ้คๆญงไนใๆฌไปๅบไธๅฏนๆช่ฏไผฐ่ฏญ่จใ้ขๅๆ้ฟไธไธๆๆๆไฝไฟ่ฏใ
ๆฅๆบไธ่ฎธๅฏ
- ๅๅงๆ้ไธ่ฎธๅฏๅฃฐๆ๏ผAndrew0425/AgenticASR-Refinerใ
- ไธๆธธ้กน็ฎ๏ผAnXMuy/AgenticASRใ
- ไธๆธธ่ฎบๆ๏ผAgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approachใ
- ๆฌไปๅบๆไพ GGUF ้ๅๅๅ๏ผๆจกๅ็ ็ฉถไธ่ฎญ็ปๅฝๅไบๅไฝ่ ใ่ฎธๅฏ่ฏๅ จๆ่ง LICENSEใ
- Downloads last month
- 146
4-bit
Model tree for MigoXV/AgenticASR-Refiner-GGUF
Base model
Andrew0425/AgenticASR-Refiner