This is the Repository for CUAI 6th NLP Papers Implementation Study.
🖤Gyeongbin Bak (박경빈) - Majoring Computer science and engineering
🖤Yumin Kim (김유민) - Majoring Global Finance and Applied Statistics
| DATE | SUBJECT | CONTENT | REFERENCE |
|---|---|---|---|
| 03.10.23 | Decide Papers and codes to Implement | ||
| 03.17.23 | Read Paper | Attention is all you need | https://arxiv.org/pdf/1706.03762.pdf |
| 03.24.23 | Code Analysis 1 | havardnlp:The Annotated Transformer | http://nlp.seas.harvard.edu/2018/04/03/attention.html |
| 03.31.23 | Code Analysis 2 | Session by @Yu-billie | |
| 04.07.23 | Code Analysis 3 | Session by @Gyeongbin | |
| 04.28.23 | Documentation | ||
| 05.12.23 | Read Paper | Language Models are Unsupervised Multitask Learners | https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf (참고: https://arxiv.org/pdf/2005.14165.pdf) |
| 05.18.23 | Code Analysis | GPT2 implementation | https://github.com/openai/gpt-2/ |
| 05.25.23 | Documentation | Attention, GPT on README |