AgenticASR-Refiner-GGUF

ๆœฌไป“ๅบ“็”ฑ MigoXV ๅ‘ๅธƒ๏ผŒๆไพ› Andrew0425/AgenticASR-Refiner ็š„ Q4_K_M GGUF ้‡ๅŒ–็‰ˆๆœฌ๏ผŒ็”จไบŽๅœจๆ”ฏๆŒ GGUF ็š„ๆœฌๅœฐๆŽจ็†็Žฏๅขƒไธญ็บ ๆญฃไธญๆ–‡ ASR ่ฝฌๅ†™ๆ–‡ๆœฌใ€‚

ๆจกๅž‹ๆŽฅๆ”ถๅทฒ็ป่ฏ†ๅˆซๅ‡บ็š„ๆ–‡ๅญ—๏ผŒ่พ“ๅ‡บไฟฎๆญฃๅŽ็š„ๆ–‡ๅญ—๏ผŒๅฏ็”จไบŽๅค„็†ๅฃ็™–ใ€้‡ๅคใ€้”™ๅญ—ใ€ๆ ‡็‚นไปฅๅŠๆ•ฐๅญ—ๅ’Œๆœฏ่ฏญ่กจ่พพใ€‚่พ“ๅ…ฅๆ˜ฏๆ–‡ๆœฌ๏ผŒไธ็›ดๆŽฅๆŽฅๆ”ถ้Ÿณ้ข‘๏ผ›ๅฎŒๆ•ด่ฏญ้Ÿณ่ฏ†ๅˆซๆต็จ‹้œ€่ฆๅฆ่กŒ้…็ฝฎ ASR ๆจกๅž‹ใ€‚

ๆจกๅž‹ไธŽๆ–‡ไปถ

้กน็›ฎ ๅ†…ๅฎน
ๅŽŸๅง‹ๆจกๅž‹ Andrew0425/AgenticASR-Refiner
ๆžถๆž„ Llama๏ผŒ24 ๅฑ‚๏ผŒ้š่—็ปดๅบฆ 1536
ๅ‚ๆ•ฐ่ง„ๆจก ็บฆ 1.1B๏ผˆGGUF ๅ…ƒๆ•ฐๆฎๆ ‡่ฎฐ๏ผ‰
ๆ ผๅผ GGUF v3
้‡ๅŒ– Q4_K_M
ๆ–‡ไปถ AgenticASR-Refiner-Q4_K_M.gguf
ๆ–‡ไปถๅคงๅฐ 688,065,792 ๅญ—่Š‚๏ผŒ็บฆ 656.19 MiB
่ฎธๅฏ่ฏ Apache-2.0๏ผŒๆฒฟ็”จไธŠๆธธๆจกๅž‹ๅฃฐๆ˜Ž

ไธŠ่ฟฐ็ป“ๆž„ๅ’Œๆ ผๅผไฟกๆฏๆฅ่‡ชๆœฌไป“ๅบ“ GGUF ๆ–‡ไปถใ€‚ๆ–‡ไปถๅŒ…ๅซ tokenizer ๅ’Œ่Šๅคฉๆจกๆฟใ€‚ๅ…ƒๆ•ฐๆฎไธญ็š„ไธŠไธ‹ๆ–‡้•ฟๅบฆไธบ 131,072 token๏ผ›่ฟ™ไธๆ˜ฏๆœฌ้‡ๅŒ–็‰ˆๆœฌ็š„้•ฟๆ–‡ๆœฌ่ดจ้‡้ชŒ่ฏ็ป“ๆžœใ€‚ไธ‹้ข็š„็คบไพ‹ไฝฟ็”จ 4,096 token ไธŠไธ‹ๆ–‡๏ผŒ่พ“ๅ…ฅไธŽ็”Ÿๆˆๅ†…ๅฎนๅ…ฑไบซๆญค้ข„็ฎ—ใ€‚

ๆœฌๆฌกๅ‘ๅธƒๆไพ›ๅทฒๆœ‰ GGUF ๆ–‡ไปถ๏ผŒๆฒกๆœ‰่ฟฝๅŠ ่ฎญ็ปƒใ€‚ๆœชๆไพ›ๅฏๅค็Žฐ็š„่ฝฌๆขๅทฅๅ…ท็‰ˆๆœฌใ€ๅฎŒๆ•ด่ฝฌๆขๅ‘ฝไปคๆˆ–้‡ๅŒ–ๆ กๅ‡†่ฎฐๅฝ•ใ€‚

ไธ‹่ฝฝ

ๅฎ‰่ฃ… Hugging Face CLI ๅŽๆ‰ง่กŒ๏ผš

hf download MigoXV/AgenticASR-Refiner-GGUF \
  AgenticASR-Refiner-Q4_K_M.gguf \
  --local-dir ./AgenticASR-Refiner-GGUF

ๆ–‡ไปถ SHA-256๏ผš

1dcbbbfde39742b213101c0d5fe645bfda18e5c9b693409205c481efbb487758

ไฝฟ็”จ llama.cpp

ๅ‡†ๅค‡ๆ”ฏๆŒ่ฏฅๆจกๅž‹ๆžถๆž„ๅŠๅ†…ๅตŒ Jinja ่Šๅคฉๆจกๆฟ็š„ llama.cppใ€‚ไปฅไธ‹ไธบ่ฟ่กŒ็คบไพ‹๏ผŒๆœฌๆฌกๅ‘ๅธƒๆœชๅฏน่ฏฅๅ‘ฝไปคๆ‰ง่กŒ็ซฏๅˆฐ็ซฏๆŽจ็†ๆต‹่ฏ•ใ€‚

ๅฏๅŠจๆœฌๅœฐ HTTP ๆœๅŠก๏ผš

llama-server \
  --model ./AgenticASR-Refiner-GGUF/AgenticASR-Refiner-Q4_K_M.gguf \
  --alias AgenticASR-Refiner \
  --ctx-size 4096 \
  --jinja \
  --host 127.0.0.1 \
  --port 8080

ๅœจๅฆไธ€ไธช็ปˆ็ซฏๅ‘้€็บ ้”™่ฏทๆฑ‚๏ผš

curl http://127.0.0.1:8080/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "AgenticASR-Refiner",
    "messages": [
      {
        "role": "system",
        "content": "ไฝ ๆ˜ฏ ASR ๆ–‡ๆœฌ็บ ้”™ๅŠฉๆ‰‹ใ€‚ไฟ็•™ๅŽŸๆ„๏ผŒๆœ€ๅฐไฟฎๆ”น๏ผšๅŽปๅฃ็™–/้‡ๅค๏ผŒไฟฎ้”™ๅญ—๏ผŒ่กฅๅฟ…่ฆๆ ‡็‚น๏ผŒ่ง„่Œƒๆ•ฐๅญ—ใ€ๆ—ฅๆœŸใ€ๆœฏ่ฏญๅ’Œไปฃ็ ็ฌฆๅท๏ผŒๅค„็†่‡ชๆˆ‘ไฟฎๆญฃใ€‚ไธ่ฆๆ€ป็ป“ใ€ๆ‰ฉๅ†™ๆˆ–่งฃ้‡Šใ€‚้‡่ฆๆ˜“้”™ๅฎžไฝ“ๅœจๆœซๅฐพ่ฟฝๅŠ  <KEY>[่ฏ1ใ€่ฏ2]๏ผ›ๆฒกๆœ‰ๅˆ™ไธๅŠ ใ€‚"
      },
      {
        "role": "user",
        "content": "ๅ—ฏ้‚ฃไธชๆ˜Žๅคฉๆˆ‘ไปฌๆˆ‘ไปฌๅผ€ไผš่ฎจ่ฎบๆŽฅๅฃใ€‚"
      }
    ],
    "temperature": 0,
    "max_tokens": 512,
    "stop": ["<|im_end|>"]
  }'

ไปŽ choices[0].message.content ่ฏปๅ–็ป“ๆžœใ€‚็คบไพ‹ๆ˜พๅผ่ฎพ็ฝฎ temperature: 0๏ผŒ้ฟๅ…ไฝฟ็”จ GGUF ๅ†…่ฎฐๅฝ•็š„้ป˜่ฎค้‡‡ๆ ทๆธฉๅบฆใ€‚ๅ…ทไฝ“ๆœๅŠกๅ‚ๆ•ฐ่ง llama-server ๆ–‡ๆกฃใ€‚

่พ“ๅ‡บไธŽไฝฟ็”จๅปบ่ฎฎ

่พ“ๅ‡บๆญฃๆ–‡ไธบ็บ ๆญฃๅŽ็š„่ฝฌๅ†™๏ผ›่‹ฅๆจกๅž‹ๆ ‡่ฎฐไบ†้‡่ฆๆ˜“้”™ๅฎžไฝ“๏ผŒๆœซๅฐพๅฏ่ƒฝๅธฆๆœ‰ <KEY>[่ฏ1ใ€่ฏ2]ใ€‚้œ€่ฆ็บฏๆญฃๆ–‡ๆ—ถ๏ผŒๅฏๅœจๅบ”็”จๅฑ‚ๆๅ–่ฏฅๆœซๅฐพๅญ—ๆฎตๅนถไธŽๆญฃๆ–‡ๅˆ†ๅผ€ไฟๅญ˜ใ€‚่ฏฅๅญ—ๆฎต็”ฑๆจกๅž‹็”Ÿๆˆ๏ผŒไธไฟ่ฏๆฏๆฌกๅญ˜ๅœจๆˆ–ๆ ผๅผๅฎŒๅ…จๆญฃ็กฎใ€‚

่พƒ้•ฟ่ฝฌๅ†™ๅฏๆŒ‰ๅฅๅˆ†ๆฎตๅค„็†๏ผŒๅนถไธบๆฏๆฎต้ข„็•™่พ“ๅ‡บ็ฉบ้—ดใ€‚ๅฆ‚ๆžœๆŽฅๅฃ่ฟ”ๅ›ž finish_reason: "length"๏ผŒๅบ”ๆฃ€ๆŸฅๆ˜ฏๅฆๆˆชๆ–ญ๏ผŒ็ผฉ็Ÿญ่พ“ๅ…ฅๆˆ–ๅขžๅŠ ็”Ÿๆˆ้ข„็ฎ—ใ€‚่ฟ่กŒๅ†…ๅญ˜่ฟ˜ๅŒ…ๅซ KV cache ๅ’ŒๆŽจ็†็ผ“ๅ†ฒๅŒบ๏ผŒไธ่ƒฝไป…ๆŒ‰ GGUF ๆ–‡ไปถๅคงๅฐไผฐ็ฎ—ใ€‚

่ฏ„ไผฐไธŽ้™ๅˆถ

ๆœฌไป“ๅบ“ๅฐšๆœชๆไพ› Q4_K_M ็‰ˆๆœฌ็š„ CER/WERใ€็›ธๅฏนๅŽŸๅง‹ๆƒ้‡็š„็ฒพๅบฆๅ˜ๅŒ–ใ€ๅžๅ้‡ๆˆ–ๅปถ่ฟŸ่ฏ„ๆต‹ใ€‚้‡ๅŒ–ๅฏ่ƒฝๅฝฑๅ“็บ ้”™่ดจ้‡๏ผ›ๆจกๅž‹ไนŸๅฏ่ƒฝ่ฏฏๆ”นไบบๅใ€ไธ“ๆœ‰ๅ่ฏใ€ๆ•ฐๅญ—ๆˆ–ๅŽŸๆœฌๆญฃ็กฎ็š„่ฝฌๅ†™ใ€‚้ƒจ็ฝฒๅ‰ๅบ”ไฝฟ็”จ่‡ชๅทฑ็š„่ฝฌๅ†™ๆ ทๆœฌๅฏนๆฏ”็บ ้”™ๅ‰ๅŽ็ป“ๆžœใ€‚

ๆจกๅž‹ๅชๆ นๆฎ่พ“ๅ…ฅๆ–‡ๅญ—ๆŽจๆ–ญ๏ผŒๆ— ๆณ•ๅˆฉ็”จๅŽŸๅง‹้Ÿณ้ข‘ๆถˆ้™คๆญงไน‰ใ€‚ๆœฌไป“ๅบ“ไธๅฏนๆœช่ฏ„ไผฐ่ฏญ่จ€ใ€้ข†ๅŸŸๆˆ–้•ฟไธŠไธ‹ๆ–‡ๆ•ˆๆžœไฝœไฟ่ฏใ€‚

ๆฅๆบไธŽ่ฎธๅฏ

Downloads last month
146
GGUF
Model size
1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MigoXV/AgenticASR-Refiner-GGUF

Quantized
(1)
this model

Paper for MigoXV/AgenticASR-Refiner-GGUF