首页程序员
产品
招聘用人
云端工作
自由工作、远程工作
项目研发
需求梳理
规划落地您的想法
整包开发
一站式软件开发
云服务
UniSMS
合一短信 聚合API短信平台
技术
发布需求
开发者入驻
APP

baichuan2_multirounds

我要开发同款
匿名用户2024年07月31日
11阅读
所属分类ai、baichuan
开源地址https://modelscope.cn/models/asatala/baichuan2_multirounds

作品详情

Training procedure

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

The following bitsandbytes quantization config was used during training:

  • loadin8bit: False
  • loadin4bit: True
  • llmint8threshold: 6.0
  • llmint8skip_modules: None
  • llmint8enablefp32cpu_offload: False
  • llmint8hasfp16weight: False
  • bnb4bitquant_type: nf4
  • bnb4bitusedoublequant: True
  • bnb4bitcompute_dtype: float16

Framework versions

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

  • PEFT 0.5.0

声明：本文仅代表作者观点，不代表本站立场。如果侵犯到您的合法权益，请联系我们删除侵权资源！如果遇到资源链接失效，请您通过评论或工单的方式通知管理员。未经允许，不得转载，本站所有资源文章禁止商业使用运营!
下载安装【程序员客栈】APP
实时对接需求、及时收发消息、丰富的开放项目需求、随时随地查看项目状态
前往安装

评论

重点城市程序员兼职推荐
北京程序员兼职上海程序员兼职深圳程序员兼职杭州程序员兼职广州程序员兼职成都程序员兼职南京程序员兼职武汉程序员兼职西安程序员兼职重庆程序员兼职郑州程序员兼职长沙程序员兼职苏州程序员兼职合肥程序员兼职厦门程序员兼职济南 程序员兼职青岛程序员兼职天津程序员兼职大连程序员兼职福州程序员兼职石家庄程序员兼职沈阳程序员兼职太原程序员兼职无锡程序员兼职南昌程序员兼职哈尔滨程序员兼职南宁程序员兼职珠海程序员兼职宁波程序员兼职昆明程序员兼职东莞程序员兼职贵阳程序员兼职美国程序员兼职长春程序员兼职温州程序员兼职佛山程序员兼职常州程序员兼职呼和浩特程序员兼职兰州程序员兼职乌鲁木齐程序员兼职中山程序员兼职海口程序员兼职洛阳程序员兼职
更多
重点岗位程序员兼职推荐
C++兼职Rust兼职小程序兼职cocos2d-x兼职Unity3D兼职DBA兼职运维兼职测试兼职移动其他兼职Go兼职UE设计师兼职全栈兼职技术创始人兼职CTO兼职项目经理兼职产品经理兼职原画师兼职UI设计师兼职前端兼职iOS兼职Android兼职Node.js兼职Ruby兼职架构师兼职Python兼职C#兼职C兼职PHP兼职Java兼职鸿蒙兼职区块链兼职人工智能兼职硬件开发兼职
更多

您好 👋

我们能提供什么帮助？

向我们发送消息

常见问题、使用帮助、人工咨询等

智能搜索手机访问

使用微信扫一扫