qwen-14b-chat-int4-qlora

模型文件和权重，请浏览“模型文件”页面获取。

当前模型的贡献者未提供更加详细的模型介绍，但是您可以通过如下git clone命令，或者ModelScope SDK来下载模型。

Clone with HTTP

git clone https://www.modelscope.cn/greatheart/qwen-14b-chat-int4-qlora.git

如果您是本模型的贡献者，我们邀请您根据模型贡献文档说明，及时完善模型卡片内容。## Training procedure

The following bitsandbytes quantization config was used during training:

• quant_method: QuantizationMethod.GPTQ
• bits: 4
• tokenizer: None
• dataset: None
• group_size: 128
• damp_percent: 0.01
• desc_act: False
• sym: True
• true_sequential: True
• usecudafp16: False
• model_seqlen: None
• blocknameto_quantize: None
• modulenameprecedingfirstblock: None
• batch_size: 1
• padtokenid: None
• use_exllama: False
• maxinputlength: None
• exllama_config: {'version': }
• cacheblockoutputs: True
• modulesinblocktoquantize: None

Framework versions

• SWIFT 1.8.0.dev0

Base model information

• BaseModel Class QWenLMHeadModel