1.简介 (Introduction)
本模型是Meta-Llama-3-8B-Instruct模型的前两层,由于Llama3-8B共有32层,使用CPU加载模型时,16G的内存无法加载模型,故从32层中摘取前两层保存为一个新的模型。
主要用于 llama3-from-scratch-zh 和 llama3-from-scratch 的学习,方便笔记本用户快速加载模型,运行学习。
This model is the first two layers of the Meta-Llama 3-8B-Instruct model. As Llama3-8B has 32 layers, the model cannot be loaded with 16G of memory when CPU is used to load the model, so remove the first two layers from the 32 layers and store them as a new model.
It is mainly used for llama3-from-scratch-zh and llama3-from-scratch learning, convenient laptop users fast load model, operation study.
2.模型下载 (Model Download)
SDK doenload
# install ModelScope
pip install modelscope
#SDK download model
from modelscope import snapshot_download
model_dir = snapshot_download('wdndev/Meta-Llama-3-8B-Instruct-2layers')
Git download model
#Git模型下载
git clone https://www.modelscope.cn/wdndev/Meta-Llama-3-8B-Instruct-2layers.git
如果您是本模型的贡献者,我们邀请您根据模型贡献文档,及时完善模型卡片内容。
评论