Skip to content

Commit

Permalink
Merge branch 'master' into feature/ODS-2600_Validate_DSC_creates_all_…
Browse files Browse the repository at this point in the history
…Serverless_CRs
  • Loading branch information
asanzgom authored Mar 7, 2024
2 parents 8b1f734 + 58c64a2 commit e0fc0be
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 3 deletions.
7 changes: 5 additions & 2 deletions ods_ci/tests/Resources/CLI/ModelServing/llm.resource
Original file line number Diff line number Diff line change
Expand Up @@ -606,6 +606,7 @@ Clean Up Test Project
[Documentation] Deletes the given InferenceServices, check the NS gets removed from ServiceMeshMemberRoll
... and deletes the DS Project
[Arguments] ${test_ns} ${isvc_names} ${isvc_delete}=${TRUE} ${wait_prj_deletion}=${TRUE}
... ${kserve_mode}=Serverless
IF ${isvc_delete} == ${TRUE}
FOR ${index} ${isvc_name} IN ENUMERATE @{isvc_names}
Log Deleting ${isvc_name}
Expand All @@ -614,8 +615,10 @@ Clean Up Test Project
ELSE
Log To Console InferenceService Delete option not provided by user
END
Wait Until Keyword Succeeds 10 1s Namespace Should Be Removed From ServiceMeshMemberRoll
... namespace=${test_ns}
IF "${kserve_mode}"=="Serverless"
Wait Until Keyword Succeeds 10 1s Namespace Should Be Removed From ServiceMeshMemberRoll
... namespace=${test_ns}
END
${rc} ${out}= Run And Return Rc And Output oc delete project ${test_ns}
Should Be Equal As Integers ${rc} ${0}
IF ${wait_prj_deletion}
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,7 @@ Verify User Can Serve And Query A bigscience/mt0-xxl Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Expand Down Expand Up @@ -85,6 +86,7 @@ Verify User Can Serve And Query A google/flan-t5-xl Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Expand Down Expand Up @@ -120,6 +122,7 @@ Verify User Can Serve And Query A google/flan-t5-xxl Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Expand Down Expand Up @@ -154,6 +157,7 @@ Verify User Can Serve And Query A elyza/elyza-japanese-llama-2-7b-instruct Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Expand Down Expand Up @@ -189,9 +193,10 @@ Verify User Can Serve And Query A ibm/mpt-7b-instruct2 Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Verify User Can Serve And Query A google/flan-ul-2 Model
[Documentation] Basic tests for preparing, deploying and querying a LLM model
... using Kserve and TGIS runtime
Expand Down Expand Up @@ -224,6 +229,7 @@ Verify User Can Serve And Query A google/flan-ul-2 Model
[Teardown] Run Keywords
... Clean Up Test Project test_ns=${test_namespace}
... isvc_names=${models_names} wait_prj_deletion=${FALSE}
... kserve_mode=${KSERVE_MODE}
... AND
... Run Keyword If "${KSERVE_MODE}"=="RawDeployment" Terminate Process llm-query-process kill=true

Expand Down

0 comments on commit e0fc0be

Please sign in to comment.