Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add new component for serving python applications #35

Merged
merged 24 commits into from
Oct 31, 2024
Merged

feat: add new component for serving python applications #35

merged 24 commits into from
Oct 31, 2024

Conversation

kkiani
Copy link
Contributor

@kkiani kkiani commented Oct 8, 2024

No description provided.

@kkiani kkiani linked an issue Oct 8, 2024 that may be closed by this pull request
Add Resources for Hosting Application Layer of LLM App #34
Closed
3 tasks
@kkiani kkiani force-pushed the feature/prompt-engineering-resource branch from 813f5f8 to fd00c64 Compare October 10, 2024 09:20
@kkiani kkiani force-pushed the feature/prompt-engineering-resource branch 2 times, most recently from 72ac6b0 to 60c6677 Compare October 31, 2024 14:36
kkiani added 23 commits October 31, 2024 15:48
@kkiani
feat(resources): add new component for serving python applications
74c23a6
@kkiani
docs(resources): reformat the docstrings
0732c38
@kkiani
refactor: change lambda_component name to serverless_python_component
784b0f4
@kkiani
fix(py-serverless): unable to deploy with dependency bigger than 250mb
c6d30fc
@kkiani
chore(example): add example for python serverless component
a806acd
@kkiani
feat(llm): make the llm controller support hosting the scripts as well
8d9368e
@kkiani
test: disabling the api key
f988bd9
@kkiani
fix(llm): force set the region for the boto3 client
d8885cf
@kkiani
refactor: seprating build time and runtime dependencies
6bbbb92
@kkiani
fix(core): seprating run/build time dependencies
7d7b274
@kkiani
refactor(llm): revert back python serverless to lambda layer
d667a7d
@kkiani
feat(llm): remove openai chat method for a native method
ae33f82
@kkiani
fix(llm): endpoint parameter store not being created
8726352
@kkiani
refactor(llm): using code mode instead of docker mode with lambda
24bf005
@kkiani
feat(core, llm): add supporting tags
13825c2 
Controllers now can pass two set of tags to the downstream Pulumi
resources. First is the user defined tags which is a list of tags set at
initialization of the controller. Second is a set of default tags which
is enforced by the controller. By default damavand's base controller is
setting two default tags including `application` and `tool`.
@kkiani
feat(core, llm): cost managements supports within controllers
bb0620c
@kkiani
fix(llm): cannot access the api key
aeffe26
@kkiani
fix(llm): lambda function does not have access to ssm or secrets
c091235
@kkiani
refactor(serverless): uploading dependencies directly to lambda
f1bcf80 
Previously, we used s3 to upload the dependencies there and then provide
s3 object for the lambda layer. Now, lambda layer directly pick up the
dependencies without needing s3 to host the dependencies files.
@kkiani
fix(serverless): pushing empty dependency packages to lambda layer
8325e4a
@kkiani
fix(llm): cannon recreate secrets after destroying
058c83c
@kkiani
fix(llm): secret key connot be found
7642e2f
@kkiani
chore: update the packages lock file
b9c3fc9
@kkiani kkiani force-pushed the feature/prompt-engineering-resource branch from 60c6677 to b9c3fc9 Compare October 31, 2024 15:08
@kkiani kkiani merged commit d51c628 into main Oct 31, 2024
0 of 2 checks passed
@kkiani kkiani deleted the feature/prompt-engineering-resource branch October 31, 2024 15:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add Resources for Hosting Application Layer of LLM App
1 participant
@kkiani