Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Datasets from SILOLM #20

Closed
3 of 15 tasks
blester125 opened this issue Nov 7, 2023 · 1 comment
Closed
3 of 15 tasks

Datasets from SILOLM #20

blester125 opened this issue Nov 7, 2023 · 1 comment
Assignees
@wildphoton

Comments

@blester125
Copy link
Collaborator

blester125 commented Nov 7, 2023 •
edited by nkandpa2
Loading

Domain: Various

We may need to double check their pre-processing and decide if we want to update them.

  • Pile of Law
  • Case Law Access Project
  • Github from RedPajama
  • HackerNews
  • Ubuntu IRC
  • Stackexchange from RedPajama
  • Stackoverflow corpus from Kaggle
  • Deepmind Mathematics
  • AMPS dataset
  • ArXiv abstracts
  • S2ORC (scientific papers)
  • Gutenberg Corpus (PG19)
  • MOT corpus (News)
  • Wikinews
  • Wikipedia from RedPajama
@StellaAthena
Copy link
Collaborator

Closing as merged into #46

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wildphoton wildphoton

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@blester125 @wildphoton @StellaAthena