-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Created a new page in Integrations section for Pydantic plugin in Flyte documentation #1757
base: master
Are you sure you want to change the base?
Conversation
Signed-off-by: sumana sree <[email protected]>
Signed-off-by: sumana sree <[email protected]>
Signed-off-by: sumana sree <[email protected]>
Signed-off-by: sumana sree <[email protected]>
Signed-off-by: sumana sree <[email protected]>
can you please explain me what should be done to avoid errors? |
# Pydantic is a data validation and settings management library for Python, enabling the creation of data models with type annotations. | ||
# | ||
# Flyte leverages Pydantic for robust input validation and serialization, ensuring that task inputs are correctly structured. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this seems repetitive. also, can you come up with a better example? something that solves a use case. needn't be complex, but must solve a problem. does that make sense?
|
||
from flytekit import task, workflow | ||
from flytekit.types.file import FlyteFile | ||
from pydantic.v1 import BaseModel |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
pydantic v2 should work: flyteorg/flytekit#2217
could you run this workflow on Union serverless/flyte sandbox and share with us the result of the execution?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@samhita-alla I am currently experiencing difficulties while executing my code on the Union serverless/Flyte sandbox. Specifically, I have encountered errors related to importing the BaseModel
from the Pydantic library.
- When attempting to execute the following code:
from pydantic.v1 import BaseModel
- When I tried this:
from pydantic import BaseModel
I am not able to understand how to avoid these errors. How to resolve these errors?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
you need to define an imagespec and add the plugin to packages: https://docs.flyte.org/en/latest/user_guide/customizing_dependencies/imagespec.html#image-spec-example
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Co-authored-by: Samhita Alla <[email protected]> Signed-off-by: Sumana Sree Angajala <[email protected]>
@ppiegaze do you have an idea of why the test failure here? It's like it's checking for the existence of a page that's just being created? |
Description:
This pull request adds a new example demonstrating the integration of Pydantic with Flytekit. This PR closes issue
Changes:
pydantic_plugin
underexamples
to host the Pydantic integration example.Dockerfile
for the example to facilitate containerized execution.requirements.in
file specifying the necessary dependencies.pydantic_integration_example.py
demonstrating how to define and use Pydantic models in Flyte tasks and workflows.README.md
file with a detailed introduction to Pydantic, installation instructions, and example usage.