Skip to content

A simple tested pytorch implementation of llama3 without fairscale.

License

Notifications You must be signed in to change notification settings

mr-raccoon-97/simple-llama3

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

simple-llama3

A simple tested pytorch implementation of llama3 without fairscale.

If you want to understand the transformer model I recommend you to read my implementation of a vanilla transformer, since I rehuse some code here.

About

A simple tested pytorch implementation of llama3 without fairscale.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages