Skip to content

Commit

Permalink
Merge pull request #5 from RedHatQuickCourses/Technical-Edits
Browse files Browse the repository at this point in the history
Adding Images, Grammar Edits, Intro Video
  • Loading branch information
kknoxrht authored Jun 12, 2024
2 parents 373f645 + f900be9 commit 06edc31
Show file tree
Hide file tree
Showing 13 changed files with 30 additions and 12 deletions.
Binary file modified .DS_Store
Binary file not shown.
Binary file modified modules/.DS_Store
Binary file not shown.
Binary file added modules/ROOT/.DS_Store
Binary file not shown.
Binary file added modules/ROOT/images/intro_v4.mp4
Binary file not shown.
25 changes: 16 additions & 9 deletions modules/ROOT/pages/index.adoc
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
= Serving LLM Models on OpenShift AI
:navtitle: Home

Welcome to this Quick course on _Deploying an LLM using OpenShift AI_.

video::intro_v4.mp4[width=800,start=60,opts=autoplay]

Welcome to this quick course on _Serving an LLM using OpenShift AI_.

This program was designed to guide you through the process of installing an OpenShift AI Platform using an OpenShift Container Platform Web Console UI. We get hands-on experience in each component needed to enable a RHOAI Platform using an Openshift Container Platform Cluster.

Expand All @@ -19,11 +22,15 @@ IMPORTANT: The hands-on labs in this course were created and tested with RHOAI v

The PTL team acknowledges the valuable contributions of the following Red Hat associates:

*Christopher Nuland
* Christopher Nuland

* Vijay Chebolu

* Noel O'Conner

*Vijay Chebolu & Team
* Hunter Gerlach

*Karlos Knox
* Karlos Knox

== Classroom Environment

Expand Down Expand Up @@ -56,16 +63,16 @@ For Red Hat partners who do not have access to RHDP, provision an environment us

The overall objectives of this course include:

* Familiarize utilizing Red Hat OpenShift AI to Serve & Interact with an LLM.
* Utilize Red Hat OpenShift AI to serve & interact with an LLM

* Install Red Hat OpenShift AI Operators & Dependencies
* Install Red Hat OpenShift AI operators & dependencies

* Add a custom Model Serving Runtime
* Add a custom model serving runtime

* Create a data science project, workbench & data connections

* Load an LLM model into the Ollama Runtime Framework
* Load an LLM model into the Ollama runtime framework

* Import (from Git repositories), interact with LLM model via a Jupyter Notebook
* Import (from git repositories), interact with LLM model via a Jupyter Notebooks

* Experiment with the Mistral LLM
Binary file added modules/chapter2/images/createDSC.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added modules/chapter2/images/createsecret.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added modules/chapter2/images/dcsyamlfile.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added modules/chapter2/images/openshiftai_operator.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added modules/chapter2/images/serverless_operator.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 3 additions & 1 deletion modules/chapter2/pages/section1.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,9 @@ This exercise uses the Red Hat Demo Platform; specifically the OpenShift Contain

Installing these Operators prior to the installation of the OpenShift AI Operator in my experience has made a difference in OpenShift AI acknowledging the availability of these components and adjusting the initial configuration to shift management of these components to OpenShift AI.

. Navigate to **Operators** -> **OperatorHub** and search for *OpenShift AI*.
* Navigate to **Operators** -> **OperatorHub** and search for *OpenShift AI*.

image::openshiftai_operator.png[]

. Click on the `Red{nbsp}Hat OpenShift AI` operator. In the pop up window that opens, ensure you select the latest version in the *stable* channel and click on **Install** to open the operator's installation view.
+
Expand Down
13 changes: 11 additions & 2 deletions modules/chapter2/pages/section2.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,9 @@ The content of the Secret (data) should contain two items, *tls.cert* and *tls.k
. In the Navigation pane on the left, click on the *Workloads* section, then *Secrets* under Workloads.
. From the Project dropdown, toggle the *show default projects* radial button to on.
. Select the *openshift-ingress* project from the list.

image::openshiftingress_project.png[]

. Locate the file named *ingress-certs-(XX-XX-2024)*, type should be *Opaque*
. Click on the filename to open the secret, Select the *YAML Tab*
. Copy all the text from the window, and ensure that you scroll down. (CTL-A should work).
Expand All @@ -48,8 +51,10 @@ tls.key: >-
LS0tLS1CRUd...
type: kubernetes.io/tls
```
image::createsecret.png[]


* Copy the Name in red portion of the text (optional, but helpful)
* Copy the name of the secret from line 4, just the name (optional, but helpful)
* Click *create* to apply this YAML into the istio-system proejct (namespace).

*We have copied the Secret used by OCP & made it available be used by OAI.*
Expand Down Expand Up @@ -81,12 +86,16 @@ serving:
managementState: Managed
name: knative-serving
```
image::dcsyamlfile.png[]

Once you have made those changes to the YAML file, *Click Create* to Deploy the Data Science Cluster.


image::createDSC.png[]

Single Model Serve Platform will now be deployed to expose ingress connections with the same certificate as OpenShift Routes. Endpoints will be accessible using TLS without having to ignore error messages or create special configurations.

== Epilogue
== OpenShift AI install summary

Congratulations, you have successfully completed the installation of OpenShift AI on an OpenShift Container Cluster. OpenShift AI is now running on a new Dashboard!

Expand Down

0 comments on commit 06edc31

Please sign in to comment.