Integrate LLM3 Claude

[tubamos]

Item type: data pipeline

Description: As part of our multiple LLM strategy, this task involves implementing the fourth LLM which will be Anthropic's Claude 3.5 Sonnet which was released in June 20, 2024.

User Story

• As a developer,
• I want to select and implement a new LLM into the Langchain framework to support our multiple LLM strategy,
• so that the capacity of our application is improved by leveraging the strengths of multiple LLMs.

Acceptance Criteria

• Claude 3.5 Sonnet (release date: June 20, 2024) has been integrated in the app.
• Claude can be easily switched with other LLMs in the as part of the multiple LLM strategy.
• Perform thorough testing to ensure the new LLM interacts correctly with existing components.

Definition of Done

• The feature has been fully implemented.
• The feature has been manually tested and works as expected without critical bugs.
• The feature code is documented with clear explanations of its functionality and usage.
• The feature code has been reviewed and approved by at least one team member.
• The feature branches have been merged into the main branch and closed.
• The feature utility, function and usage have been documented in the respective project wiki on github.