Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

常见问题的Q11,[a53lite runtimellerror] get function send api error, ret2,有没有其他的排错思路? #41

Open
loredunk opened this issue Aug 27, 2024 · 1 comment

Comments

@loredunk
Copy link
Contributor

loredunk commented Aug 27, 2024

image

我的bm-smi版本 sophon-driver sophon-libsophon sophon-libsophon-dev 这些都是0.5.1版本的。

另外我打印了我的Bmodel,应该是没什么问题的。常见问题中的Q11所有方法差不多都试了。其中聊天的上下文挺短的,就是让他生成一个冒泡排序,请问还有什么其他排错思路嘛?

linaro@bm1684:/data$ model_tool --info rwkv6-1b6_bf16_1dev.bmodel
bmodel version: B.2.2+v1.8.beta.0-331-g9ce86277c-20240822
chip: BM1684X
create time: Thu Aug 22 17:17:44 2024

kernel_module name: libbm1684x_kernel_module.so
kernel_module size: 2704256
kernel_module md5: b1a3be79d383ae55916e67b482035021
cpuop_module name: libbm1684x_kernel_module.so
cpuop_module size: 0
cpuop_module md5: d41d8cd98f00b204e9800998ecf8427e
==========================================
net 0: [embedding]  static
------------
stage 0, core num: 1
input: input_ids, [1, 1], int32, scale: 1, zero point: 0
output: hidden_dim_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 1: [lm_head]  static
------------
stage 0, core num: 1
input: hidden_dim, [1, 2048], bfloat16, scale: 1, zero point: 0
output: m_logits_MatMul_f32, [1, 65536], float32, scale: 1, zero point: 0
==========================================
net 2: [greedy_head]  dynamic
------------
stage 0, core num: 1
input: m_logits, [max:1, max:65536], float32, scale: 1, zero point: 0
output: token_TopK, [1, 1], int32, scale: 1, zero point: 0
==========================================
net 3: [penalty_sample_head]  static
------------
stage 0, core num: 1
subnet number: 3
input: m_logits, [1, 65536], float32, scale: 1, zero point: 0
input: input_ids, [1, 4096], int32, scale: 1, zero point: 0
input: top_p, [1], float32, scale: 1, zero point: 0
input: temperature, [1], float32, scale: 1, zero point: 0
input: penalty, [1], float32, scale: 1, zero point: 0
output: probs_Softmax, [1, 50], float32, scale: 1, zero point: 0
output: token_TopK, [1, 50], int32, scale: 1, zero point: 0
==========================================
net 4: [block_0]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 5: [block_1]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 6: [block_2]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 7: [block_3]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 8: [block_4]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 9: [block_5]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 10: [block_6]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 11: [block_7]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 12: [block_8]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 13: [block_9]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 14: [block_10]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 15: [block_11]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 16: [block_12]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 17: [block_13]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 18: [block_14]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 19: [block_15]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 20: [block_16]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 21: [block_17]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 22: [block_18]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 23: [block_19]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 24: [block_20]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 25: [block_21]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 26: [block_22]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
==========================================
net 27: [block_23]  static
------------
stage 0, core num: 1
input: b_in, [1, 2048], bfloat16, scale: 1, zero point: 0
input: state.1, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0
output: b_out_Add, [1, 2048], bfloat16, scale: 1, zero point: 0
output: state_ScatterND, [1, 1584, 2048], bfloat16, scale: 1, zero point: 0


device mem size: 3287437096 (weight: 3237699584, instruct: 4046632, runtime: 45690880)
host mem size: 0 (weight: 0, runtime: 0)

请问还有什么其他排错思路嘛?

@github-staff github-staff deleted a comment from loredunk Aug 27, 2024
@loredunk
Copy link
Contributor Author

loredunk commented Aug 28, 2024

上面被delete的comment包好了一个压缩包链接,说能Fix我的问题,被github风控检测了 ,还好发的是exe,我是linux没法装,估计是木马程序!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants
@loredunk and others