Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Which part is knowledge distillation #16

Open
skill-diver opened this issue Jan 15, 2024 · 3 comments
Open

Which part is knowledge distillation #16

skill-diver opened this issue Jan 15, 2024 · 3 comments

Comments

@skill-diver
Copy link

skill-diver commented Jan 15, 2024

Hello, Author,

Your paper is very nice, thanks for sharing. I have a confusion is that I can't find which part of the codes shows the knowledge distillation.

@shuh15
Copy link
Collaborator

shuh15 commented Feb 4, 2024

Hi, the released code is for inference and the knowledge distillation is during training process.

@code-inflation
Copy link

Are there any plans to release the code used for training?

@chankeh
Copy link

chankeh commented Apr 17, 2024

for

hi bro, have you found the distillation part ? i also have the same confusion ....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants