ChatTruth-7B
ChatTruth-7B 在Qwen-VL的基础上，使用精心设计的数据进行了优化训练。与Qwen-VL相比，模型在大分辨率上得到了大幅提升。创新性提出Restore Module使大分辨率计算量大幅减少。
安装要求 (Requirements)
transformers 4.32.0
python 3.8 and above
pytorch 1.13 and above
CUDA 11.4 and above
快速开始 (Quickstart)
from transformers import AutoModelForCausalLM, AutoTokenizer
from transformers.generation import GenerationConfig
import torch
torch.manual_seed(1234)
model_path = 'ChatTruth-7B' # your downloaded model path.
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
# use cuda device
model = AutoModelForCausalLM.from_pretrained(model_path, device_map="cuda", trust_remote_code=True).eval()
model.generation_config = GenerationConfig.from_pretrained(model_path, trust_remote_code=True)
model.generation_config.top_p = 0.01
query = tokenizer.from_list_format([
{'image': 'demo.jpeg'},
{'text': '图片中的文字是什么'},
])
response, history = model.chat(tokenizer, query=query, history=None)
print(response)
# 昆明太厉害了
评论