Skip to content

Issues: FranxYao/Long-Context-Data-Engineering

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

12 Open 5 Closed
12 Open 5 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Error in Llama-3.2-3B needle evaluation
#18 opened Nov 9, 2024 by prakamya-mishra
ValueError: TensorParallelPreTrainedModel does not support Flash Attention 2.0 yet.
#17 opened May 3, 2024 by ZetangForward
Upsampling: Statistical biasas of distribution of dataset
#15 opened Apr 11, 2024 by michaelfeil
In the process of tokenization of data, there is no attack defense injected into the special tokens (such as <s>, etc</s>.) existing in the data
#14 opened Apr 3, 2024 by Kwen-Chen
2
【有个奇怪的问题】如果pred = expect_answer, 按照作者给的metric计算出来的分数不等于1
#12 opened Mar 22, 2024 by randomtutu
1
Collapsed performance in short length (related to a bug in HF's LlamaDynamicNTKScalingRotaryEmbedding)
#11 opened Mar 21, 2024 by gaotianyu1350
When did you perform dynamic-NTK?
#10 opened Mar 20, 2024 by Liu-yuliang
1
论文复现相关
#8 opened Mar 18, 2024 by chenglu66
3
Was the base frequency increased, or do you rely on position interpolation via scaling?
#6 opened Mar 4, 2024 by tgunter
3
【评估求问】关于pretrain阶段的model，follow instruction能力应该比较差，文中的测试的方法可以分享一下吗？
#5 opened Mar 4, 2024 by randomtutu
5
It seems the result we get is not the same as the repo shows
#3 opened Feb 20, 2024 by linbeyoung
12
Small correction for YaRN-Mistral model
#2 opened Feb 19, 2024 by bloc97
2
ProTip! Follow long discussions with comments:>50.