Skip to content
This repository has been archived by the owner on Mar 1, 2024. It is now read-only.

Add truncation for data_process.get_context_representation #125

Open
pingzhili opened this issue Apr 12, 2023 · 0 comments
Open

Add truncation for data_process.get_context_representation #125

pingzhili opened this issue Apr 12, 2023 · 0 comments

Comments

@pingzhili
Copy link

When the mention of context is greater than max_seq_len (default to 32), it will raise AssertionError due to the assertion here
I propose that add a truncation for input_ids (at least add a truncation argument of config)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant