Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MiniCPM-V-2.6 promp template的明文格式? #661

Open
apepkuss opened this issue Nov 9, 2024 · 3 comments
Open

MiniCPM-V-2.6 promp template的明文格式? #661

apepkuss opened this issue Nov 9, 2024 · 3 comments

Comments

@apepkuss
Copy link

apepkuss commented Nov 9, 2024

请教一下,MiniCPM-V-2.6 promp template 具体的明文格式是什么样的?是否可以提供一个具体的例子?下面是猜测的多轮对话的chat template,不知道是否正确?谢谢!

<|im_start|>system

{system_message}<|im_end|>

<|im_start|>user

{user_message_1}<|im_end|>

<|im_start|>assistant<|im_end|>

{assistant_message_1}<|im_end|>

<|im_start|>user

{user_message_2}<|im_end|>

<|im_start|>assistant<|im_end|>
@LDLINGLINGLING
Copy link
Collaborator

看起来基本是这样的

@apepkuss
Copy link
Author

不要需要用到 <|endoftext|> 吧?谢谢

@apepkuss
Copy link
Author

apepkuss commented Nov 19, 2024

@LDLINGLINGLING 还有几个问题想确认一下:

  1. 用户的问题和图片是以什么样式存放到 user_message
  2. 图片是需要转换为base64或者其他编码?

llama.cpp的llava文档提供了相关章节,对templating做了描述:https://github.com/ggerganov/llama.cpp/tree/master/examples/llava#llava-cli-templating-and-llava-16-prompting。

MiniCPM-V-2.6 并没有提供相关信息。

谢谢!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants