Skip to content

Commit

Permalink
updates
Browse files Browse the repository at this point in the history
Signed-off-by: (Bit-Mage) <[email protected]>
  • Loading branch information
(Bit-Mage) committed Nov 21, 2024
1 parent 7a205fe commit fddc446
Show file tree
Hide file tree
Showing 10 changed files with 67 additions and 0 deletions.
3 changes: 3 additions & 0 deletions Content/20231012140139-large_language_models.org
Original file line number Diff line number Diff line change
Expand Up @@ -161,5 +161,8 @@ The scaling laws for Large Language Models (LLMs) describe how changes in differ
- *Temperature, Top-k, and Top-p Sampling*:
- These hyperparameters work together to modulate the randomness and quality of the generated text during inference.

** [[id:4f197b8c-7f2c-442f-9350-ef1f83cd8701][Low Rank Adaptation]]
** [[id:02b7c7eb-2ba2-43b8-8cdb-c5e7d201596a][RLHF]]
* Resources
** Book: Building LLMs for production
- https://towardsai.net/book
3 changes: 3 additions & 0 deletions Content/20240818170034-llammaindex.org
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,10 @@
#+title: Llammaindex
#+filetags: :ai:tool:

*
* Relevant Nodes
** [[id:d9d30a75-f1aa-4ca0-8480-cb617afe29ab][Deep Lake Vector Stores]]
** [[id:29c7a4c9-2699-4c8c-b2f2-a8e9bd5731ce][Ragas]]
** [[id:a8c2f397-3380-4aae-a771-63a4b688d4fe][DeepEval]]
* Resources
- https://www.llamaindex.ai/
5 changes: 5 additions & 0 deletions Content/20241120170558-golden_datasets.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
:PROPERTIES:
:ID: a8bec6b4-f0ca-4c93-bbf0-a187935dd57b
:END:
#+title: Golden Datasets
#+filetags: :ai:data:
9 changes: 9 additions & 0 deletions Content/20241120170737-ragas.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
:PROPERTIES:
:ID: 29c7a4c9-2699-4c8c-b2f2-a8e9bd5731ce
:END:
#+title: Ragas
#+filetags: :tool:ai:

* Resources
- https://github.com/explodinggradients/ragas/tree/main
- https://docs.ragas.io/en/stable/
8 changes: 8 additions & 0 deletions Content/20241120171009-deep_eval.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
:PROPERTIES:
:ID: a8c2f397-3380-4aae-a771-63a4b688d4fe
:END:
#+title: DeepEval
#+filetags: :tool:ai:

* Resources
- https://github.com/confident-ai/deepeval
9 changes: 9 additions & 0 deletions Content/20241121103238-autogpt.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
:PROPERTIES:
:ID: 663bd13a-1f02-4e96-a56f-1257ff5a162b
:END:
#+title: AutoGPT
#+filetags: :tool:ai:


* Resources
- https://agpt.co/blog/introducing-the-autogpt-platform
13 changes: 13 additions & 0 deletions Content/20241121112417-rlhf.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
:PROPERTIES:
:ID: 02b7c7eb-2ba2-43b8-8cdb-c5e7d201596a
:ROAM_ALIASES: "Reinforcement Learning from Human Feedback"
:END:
#+title: RLHF
#+filetags: :rl:ai:


* Relevant Nodes
** [[id:64e7e0eb-ab1f-42db-b027-fc8069a65f3d][Direct Preference Optimization]]
** [[id:54f1b3b2-28ba-485b-947a-98c48ae41caa][RLAIF]]
* Resources
- https://openai.com/index/instruction-following/
6 changes: 6 additions & 0 deletions Content/20241121112433-low_rank_adaptation.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
:PROPERTIES:
:ID: 4f197b8c-7f2c-442f-9350-ef1f83cd8701
:ROAM_ALIASES: "Quantized Low-Rank Adaptation" QLoRa LoRA
:END:
#+title: Low Rank Adaptation
#+filetags: :ai:
6 changes: 6 additions & 0 deletions Content/20241121113422-direct_preference_optimization.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
:PROPERTIES:
:ID: 64e7e0eb-ab1f-42db-b027-fc8069a65f3d
:ROAM_ALIASES: DPO
:END:
#+title: Direct Preference Optimization
#+filetags: :ai:
5 changes: 5 additions & 0 deletions Content/20241121113552-rlaif.org
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
:PROPERTIES:
:ID: 54f1b3b2-28ba-485b-947a-98c48ae41caa
:ROAM_ALIASES: "Reinforcement Learning from AI Feedback"
:END:
#+title: RLAIF

0 comments on commit fddc446

Please sign in to comment.