Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce GitHub Actions Workflow for Llama Stack Tests #523

Open
wants to merge 43 commits into
base: main
Choose a base branch
from
Open

Introduce GitHub Actions Workflow for Llama Stack Tests #523

wants to merge 43 commits into from

Conversation

ConnorHack
Copy link

What does this PR do?

Initial implementation of GitHub Actions workflow for automated testing of Llama Stack.

Key Features

  • Automatically runs tests on pull requests and manual dispatch
  • Provides support for GPU required model tests
  • Reports test results and uploads summaries

ConnorHack and others added 30 commits November 6, 2024 09:17
@ConnorHack
Add workflow for GitHub Actions
e972a04
@ConnorHack
Update torchrun to pytest and checkpoint directory env var
9d56361
@ConnorHack
Remove Workplace Message notification Action
02663d8
@ConnorHack
Add aiosqlite as library dependency
e200a42
@ConnorHack
Add RANK environment variable for torch.distributed
307b2ca
@ConnorHack
Add WORLD_SIZE env var for torch.distributed
274b5a0
@ConnorHack
Add torchrun specially for meta_reference
f6b658e
@ConnorHack
Rename checkpoint directory env var
00829b8
@ConnorHack
Remove old environment variables
91b37c8
@ConnorHack
Merge branch 'meta-llama:main' into main
b7f18eb
@ConnorHack
Update checkpoint directory to include model
69215b6
@ConnorHack
Merge branch 'meta-llama:main' into main
edfd92d
@ConnorHack
Update model name for mete-reference template
2795731
@ConnorHack
Merge branch 'meta-llama:main' into main
a5acb59
@ConnorHack
Merge branch 'meta-llama:main' into main
0ec4ddd
@ConnorHack
Merge branch 'meta-llama:main' into main
05f1041
@ConnorHack
Account for if a permitted model is None
16ffe19
@ConnorHack
Undo None check and temporarily move if model check before builder
490c5fb
@ConnorHack
Merge branch 'meta-llama:main' into main
0930234
@ConnorHack
Merge branch 'meta-llama:main' into main
19bc7e8
@ConnorHack
Merge branch 'meta-llama:main' into main
94bfd9a
@ConnorHack
Pre-emptively test llama stack RC
318c988
@ConnorHack
Remove testing llama-stack RC
046eec9
@ConnorHack
Merge branch 'meta-llama:main' into main
4136acc
@ConnorHack
Dynamically change provider in tests
4968797
@ConnorHack
Add debug statement for PROVIDER_ID
25e23a1
@ConnorHack
Add manual provider back for testing
143e91f
@ConnorHack
Remove testing llama-stack RC
377896a
@ConnorHack
Test new provider name
1481a67
@ConnorHack
Remove unnecessary env vars
0e9ed36
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ashwinb ashwinb Awaiting requested review from ashwinb ashwinb is a code owner

@yanxi0830 yanxi0830 Awaiting requested review from yanxi0830 yanxi0830 is a code owner

@hardikjshah hardikjshah Awaiting requested review from hardikjshah hardikjshah is a code owner

@dltn dltn Awaiting requested review from dltn dltn is a code owner

@raghotham raghotham Awaiting requested review from raghotham raghotham is a code owner

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ConnorHack @facebook-github-bot