Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Wave] Fun projects for beginnners #278

Open
1 of 10 tasks
raikonenfnu opened this issue Nov 19, 2024 · 1 comment
Open
1 of 10 tasks

[Wave] Fun projects for beginnners #278

raikonenfnu opened this issue Nov 19, 2024 · 1 comment

Comments

@raikonenfnu
Copy link
Contributor

raikonenfnu commented Nov 19, 2024

Are you interested in learning more about GPU programming and developing cool optimizations? Do you want to help build next generation and state-of-the-art machine learning models and layers? Do you want to define the future programming paradigm of machine learning and GPU layers? Look no further, come join us in building "Wave"!

Here are some fun starter tasks to look at:

  • Implement backwards attention kernel on TKW
  • Cache kernels
  • Scalar support #285 - @nithinsubbiah
  • Auto detection of hardware architecture in runtime - [TKW] Add CDNA2 + CDNA3 Int8 intrinsics and refactor intrinsic enums #279
  • Support more architecture in codegen aside from CDNA.
  • Refactor Wave ops definition and make it autogen documentations
  • Implement Pytorch Linear Layer (forward, backward) that uses custom TKW kernel
  • Implement Pytorch Conv2d Layer (forward, backward) that uses custom TKW kernel
  • Implement Pytorch Attention Layer (forward, backward) that uses custom TKW kernel
  • Integrate Wave kernel into sharktank for e2e S.T we can inject IR from TKW into model IR.
@NoumanAmir657
Copy link

Would this be open for someone who has almost no knowledge of GPU programming except for some basic understanding.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants