Llama-3-Chinese-8B-Instruct-v3-GGUF

这个仓库包含了Llama-3-Chinese-8B-Instruct-v3-GGUF（兼容llama.cpp/ollama等），是Llama-3-Chinese-8B-Instruct-v3模型的量化版本。

注意：这是一个指令模型，可以直接适用于对话、问答等任务。

更多细节（性能、使用方法等）请参考GitHub项目页面：https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

量化性能

评测指标：PPL，越低越好

其他

• 完整模型：https://modelscope.cn/models/ChineseAlpacaGroup/llama-3-chinese-8b-instruct-v3

• 关于本模型的提问，请通过 https://github.com/ymcui/Chinese-LLaMA-Alpaca-3 提交issue

This repository contains Llama-3-Chinese-8B-Instruct-v3-GGUF (llama.cpp/ollama/tgw, etc. compatible), which is the quantized version of Llama-3-Chinese-8B-Instruct-v3.

Note: this is an instruction (chat) model, which can be used for conversation, QA, etc.

Further details (performance, usage, etc.) should refer to GitHub project page: https://github.com/ymcui/Chinese-LLaMA-Alpaca-3

Performance

Metric: PPL, lower is better

Others

• For full model, please see: https://huggingface.co/hfl/llama-3-chinese-8b-instruct-v3

• If you have questions/issues regarding this model, please submit an issue through https://github.com/ymcui/Chinese-LLaMA-Alpaca-3