Skip to content

Commit

Permalink
Autogenstudio Update - Support for Anthropic/Mistral, Other Updates (m…
Browse files Browse the repository at this point in the history
…icrosoft#3439)

* [.Net] feature: Ollama integration (#2693)

* [.Net] feature: Ollama integration with

* [.Net] ollama agent improvements and reorganization

* added ollama fact logic

* [.Net] added ollama embeddings service

* [.Net] Ollama embeddings integration

* cleaned the agent and connector code

* [.Net] cleaned ollama agent tests

* [.Net] standardize api key fact ollama host variable

* [.Net] fixed solution issue

---------

Co-authored-by: Xiaoyun Zhang <[email protected]>

* [.Net] Fix #2687 by adding global:: keyword in generated code (#2689)

* add tests

* remove approved file

* update

* update approve file

* update news (#2694)

* update news

* cleanup

* [.Net] Set up Name field in OpenAIMessageConnector (#2662)

* create OpenAI tests project

* update

* update

* add tests

* add mroe tests:

* update comment

* Update dotnet/src/AutoGen.OpenAI/Middleware/OpenAIChatRequestMessageConnector.cs

Co-authored-by: David Luong <[email protected]>

* Update AutoGen.OpenAI.Tests.csproj

* fix build

---------

Co-authored-by: David Luong <[email protected]>

* Custom Runtime Logger <> FileLogger (#2596)

* added logger param for custom logger support

* added FileLogger

* bump: spell check

* bump: import error

* added more log functionalites

* bump: builtin logger for FileLogger

* type check and instance level logger

* tests added for the fileLogger

* formatting bump

* updated tests and removed time formatting

* separate module for the filelogger

* update file logger test

* added the FileLogger into the notebook

* bump json decode error

* updated requested changes

* Updated tests with AutoGen agents

* bump file

* bump: logger accessed before intializedsolved

* Updated notebook to guide with a filename

* added thread_id to the FileLogger

* bump type check in tests

* Updated thread_id for each log event

* Updated thread_id for each log event

* Updated with tempfile

* bump: str cleanup

* skipping-windows tests

---------

Co-authored-by: Chi Wang <[email protected]>

* Update groupchat.py to remove Optional type hint when they are not checked for None (#2703)

* gpt40 tokens update (#2717)

* [CAP] Improved AutoGen Agents support & Pip Install (#2711)

* 1) Removed most framework sleeps 2) refactored connection code

* pre-commit fixes

* pre-commit

* ignore protobuf files in pre-commit checks

* Fix duplicate actor registration

* refactor change

* Nicer printing of Actors

* 1) Report recv_multipart errors 4) Always send 4 parts

* AutoGen generate_reply expects to wait indefinitely for an answer.  CAP can wait a certain amount and give up.   In order to reconcile the two, AutoGenConnector is set to wait indefinitely.

* pre-commit formatting fixes

* pre-commit format changes

* don't check autogenerated proto py files

* Iterating on CAP interface for AutoGen

* User proxy must initiate chat

* autogencap pypi package

* added dependencies

* serialize/deserialize dictionary elements to json when dealing with ReceiveReq

* 1) Removed most framework sleeps 2) refactored connection code

* Nicer printing of Actors

* AutoGen generate_reply expects to wait indefinitely for an answer.  CAP can wait a certain amount and give up.   In order to reconcile the two, AutoGenConnector is set to wait indefinitely.

* pre-commit formatting fixes

* pre-commit format changes

* Iterating on CAP interface for AutoGen

* User proxy must initiate chat

* autogencap pypi package

* added dependencies

* serialize/deserialize dictionary elements to json when dealing with ReceiveReq

* pre-commit check fixes

* fix pre-commit issues

* Better encapsulation of logging

* pre-commit fix

* pip package update

* [.Net] fix #2722 (#2723)

* fix bug and add tests

* update

* [.Net] Mark Message as obsolete and add ToolCallAggregateMessage type (#2716)

* make Message obsolete

* add ToolCallAggregateMessage

* update message.md

* address comment

* fix tests

* set round to 1 temporarily

* revert change

* fix test

* fix test

* Update README.md (#2736)

* Update human-in-the-loop.ipynb (#2724)

* [CAP] Refactor:  Better Names for classes and methods (#2734)

* Bug fix

* Refactor: Better class names, method names

* pypi version

* pre-commit fixes

* Avoid requests 2.32.0 to fix build (#2761)

* Avoid requests 2.32.0 to fix build

* comment

* quote

* Debug: Gemini client was not logged and causing runtime error (#2749)

* Debug: gemini client was not logged

* Resolve docker issue in LMM test

* Resolve comments

---------

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* [Add] Fix invoking Assistant API (#2751)

Co-authored-by: Eric Zhu <[email protected]>

* Add silent option in nested chats and group chat (#2712)

* feat: respect silent request in nested chats and group chat

* fix: address plugin test

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>

* fix openai compatible changes (#2718)

Co-authored-by: Eric Zhu <[email protected]>

* add warning if duplicate function is registered (#2159)

* add warning if duplicate function is registereed

* check _function_map and llm_config

* check function_map and llm_config

* use register_function and  llm_config

* cleanups

* cleanups

* warning test

* warning test

* more test coverage

* use a fake config

* formatting

* formatting

---------

Co-authored-by: Jason <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>

* Added ability to ignore the addition of the select speaker prompt for a group chat (#2726)

Co-authored-by: Eric Zhu <[email protected]>

* Update Deprecation Warning for `CompressibleAgent` and `TransformChatHistory` (#2685)

* improved deprecation warnings

* compressible_agent test fix

* fix retrieve chat history test

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>

* added Gemini safety setting and Gemini generation config (#2429)

* added Gemini safety setting and Gemini generation config

* define params_mapping as a constant as a class variable

* fixed formatting issues

---------

Co-authored-by: nikolay tolstov <[email protected]>
Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>

* logger fix (#2659)

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>

* Ignore Some Messages When Transforming (#2661)

* works

* spelling

* returned old docstring

* add cache fix

* spelling?

---------

Co-authored-by: Eric Zhu <[email protected]>

* [.Net] rename Autogen.Ollama to AutoGen.Ollama and add more test cases to AutoGen.Ollama (#2772)

* update test

* add llava test

* add more tests

* rm Autogen.Ollama

* add AutoGen.ollama

* update

* rename to temp

* remove ollama

* rename

* update

* rename

* rename

* update

* [.Net] add AutoGen.SemanticKernel.Sample project (#2774)

* add AutoGen.SemanticKernel.Sample

* revert change

* [.Net] add ollama-sample and adds more tests (#2776)

* add ollama-sample and adds more tests

* Update AutoGen.Ollama.Sample.csproj

* Create JSON_mode_example.ipynb (#2554)

* Create JSON_mode_example.ipynb

* updated json example

* added metadata to JSON notebook

* fixed details in wrong metadata

* Update JSON_mode_example.ipynb

removed colab cell

* fixed error

* removed cell output

* whitespace fixed

I think its fixed?

* finally fixed whitespace

* Add packaging explicitly (#2780)

* Introduce AnthropicClient and AnthropicClientAgent (#2769)

* Reference project

Revert "Set up the Agent. Basic Example set up, boilerplate for connector, ran into signing issue."

This reverts commit 0afe04f2

End to end working anthropic agent + unit tests

Set up the Agent. Basic Example set up, boilerplate for connector, ran into signing issue.

* Add pragma warning

* - Remove Message type
- tabbing fix white space in csproj
- Remove redundant inheritance
- Edit Anthropic.Tests' rootnamespace
- Create AutoGen.Anthropic.Samples

* short-cut agent extension method

* Pass system message in the constructor and throw if there's system message in Imessages

---------

Co-authored-by: luongdavid <[email protected]>

* actions version update for the TransformMessages workflow (#2759)

Co-authored-by: Chi Wang <[email protected]>

* allow serialize_to_str to work with non ascii when dumping via json.dumps (#2714)

Co-authored-by: Jason <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* PGVector Support for Custom Connection Object (#2566)

* Added fixes and tests for basic auth format

* User can provide their own connection object. Added test for it.

* Updated instructions on how to use. Fully tested all 3 authentication methods successfully.

* Get password from gitlab secrets.

* Hide passwords.

* Update notebook/agentchat_pgvector_RetrieveChat.ipynb

Co-authored-by: Li Jiang <[email protected]>

* Hide passwords.

* Added connection_string test. 3 tests total for auth.

* Fixed quotes on db config params. No other changes found.

* Ran notebook

* Ran pre-commits and updated setup to include psycopg[binary] for windows and mac.

* Corrected list extension.

* Separate connection establishment function. Testing pending.

* Fixed pgvectordb auth

* Update agentchat_pgvector_RetrieveChat.ipynb

Added autocommit=True in example

* Rerun notebook

---------

Co-authored-by: Li Jiang <[email protected]>
Co-authored-by: Li Jiang <[email protected]>

* Remove duplicate project declared in AutoGen.sln (#2789)

* remove duplicate project in AutoGen.sln

* Add EndProject

* [fix] file logger import (#2773)

Co-authored-by: Chi Wang <[email protected]>

* DBRX (Databricks LLM) example notebook (#2434)

* Resolving test failures locally

* Resolving test failures locally

* Updates to website resources and docs, author

* Adding image

* Fixes to precommit and doc files for lfd

* Fixing ruff exclusion of new notebook

* Updates to support notebook rendering

* Updates to support notebook rendering

* Removing some results to try to fix docs render issue

* pre-commit to standardize formatting

---------

Co-authored-by: Eric Zhu <[email protected]>

* Blogpost and news (#2790)

* blog and news

* update

* economist

* news update

* bump version to 0.2.28

* link update

* address comments

* address comments

* add quote

* address comment

* address comment

* fix link

* guidance

* Update Getting-Started.mdx (#2781)

Add missing os import

Co-authored-by: Chi Wang <[email protected]>

* Improve the error messge (#2785)

* fix links and tags from databricks notebook (#2795)

* fix type object 'ConversableAgent' has no attribute 'DEFAULT_summary_prompt' (#2788)

Co-authored-by: Chi Wang <[email protected]>

* print next speaker (#2800)

* print next speaker

* fix test error

* [.Net] Release note for 0.0.14 (#2815)

* update release note

* update trigger

* [.Net] Update website for AutoGen.SemanticKernel and AutoGen.Ollama (#2814)

* update sk documents

* add ollama doc

* [CAP] User supplied threads for agents (#2812)

* First pass:  message loop in main thread

* pypi version bump

* Fix readme

* Better example

* Fixed docs

* pre-commit fixes

* Fix initialization of client in retrieve_docs() function (#2830)

* fix typo and update news (#2825)

* fix typo and update news

* add link

* update link

* fix metadata

* tag

* Add llamaindex agent integration (#2831)

* white spaces

* add llamaindex agent wrapper for autogen

* formatting

* formatting fixes

* add support for llamaindex agents

* fix style

* fix style

* delete file

* re-add file

* fixes pre-commit errors

* feat: Add agentchat_group_chat_with_llamaindex_agents notebook

This commit adds the notebook "agentchat_group_chat_with_llamaindex_agents.ipynb" which demonstrates how to integrate Llamaindex agents into Autogen. The notebook includes code for setting up the API endpoint, creating Llamaindex agents, and setting up a group chat.

* Refactor code

* feat: Add test for LLamaIndexConversableAgent

This commit adds a new test file `test_llamaindex_conversable_agent.py` that contains a test case for the `LLamaIndexConversableAgent` class. The test verifies the functionality of group chat with two MultimodalConversable Agents, limiting the chat by the `max_round` parameter. It also checks if the number of rounds does not exceed the maximum specified rounds.

The purpose of this change is to ensure that the `LLamaIndexConversableAgent` behaves as expected and correctly handles group chats with limited rounds.

Note: This commit includes import statements and setup code necessary for running the test case.

* fix formatting

* feat: Add LlamaIndexAgent job to GitHub Actions workflow

This commit adds a new job called "LlamaIndexAgent" to the GitHub Actions workflow. The job runs on multiple operating systems (ubuntu-latest, macos-latest, windows-2019) and uses Python version 3.11. It sets up the Python environment, installs necessary packages and dependencies for LMM, performs coverage testing using pytest, and uploads the coverage report to Codecov.

The commit also includes changes to the test_llamaindex_conversable_agent.py file. It imports os and sys modules, appends a path to sys.path, and adds skip conditions for tests based on certain conditions.

These changes improve the CI/CD pipeline by adding a new job for LlamaIndexAgent and enhancing test conditions in test_llamaindex_conversable_agent.py.

* fix test yaml

* cleanup tests

* fix test run

* formatting

* add test

* fix yaml

* pr feedback

* add documentation to website

* fixed style

* edit to document page

* newline

* make skip reason easier to see

* compose skip reasons

* fix env variable name

* refactor: Update package installation in contrib workflows

- Replaced specific package installations with more general ones
- Updated the installation of llama-index packages and dependencies
- Added new packages for llama-index and Wikipedia tools

* Update dependencies and add new agents for group chat

- Update dependencies to specific versions
- Add new agent `entertainent_specialist` for discovering entertainment opportunities in a location
- Modify the `test_group_chat_with_llama_index_conversable_agent` function to include the new agent in the group chat

* Update pydantic version requirement in setup.py

- Update pydantic version requirement from "pydantic>=1.10,<3,!=2.6.0" to "pydantic>=1.10,<3"
- Remove comment about issue with pydantic 2.6.0

* Refactor ChatMessage instantiation in _extract_message_and_history()

- Refactored the instantiation of ChatMessage in the _extract_message_and_history() function.
- Added an empty dictionary as additional_kwargs to the ChatMessage constructor.

* Refactor test_llamaindex_conversable_agent.py

- Removed unused import and variable
- Updated OpenAI model to gpt-4
- Reduced max_iterations for location_specialist and entertainment_specialist from 30 to 5
- Changed human_input_mode for user_proxy to "NEVER"
- Added assertion for max_rounds in entertainent_assistant

These changes improve code efficiency and ensure proper functionality.

* Remove entertainment_specialist agent and update user_proxy settings in test_llamaindex_conversable_agent.py

- Remove the creation of entertainent_specialist agent
- Update the max_consecutive_auto_reply setting for user_proxy to 10
- Update the default_auto_reply setting for user_proxy to "Thank you. TERMINATE"

* Refactor installation of LlamaIndex packages and dependencies

- Simplify installation commands for LlamaIndex packages
- Remove specific version numbers from pip install commands

* Update test_llamaindex_conversable_agent.py to include verbose output during pytest.

- Add the -v flag to the pytest command in contrib-openai.yml.
- Print a message when skipping the test due to missing dependencies or key.

* Refactor OpenAI workflow, remove LlamaIndexAgent

This commit removes the LlamaIndexAgent from the OpenAI workflow in order to streamline and simplify the code. The LlamaIndexAgent was no longer necessary and its removal improves overall code organization and maintainability.

* feat: Add test for group chat functionality with LLamaIndexConversableAgent

use mock reactagent in test

* Update Dockerfile for devcontainer

- Updated the Dockerfile for the devcontainer environment.
- Added installation of build-essential, npm, git-lfs, and other packages.
- Upgraded pip and installed pydoc-markdown, pyyaml, and colored libraries.

* Update devcontainer.json with new VS Code extensions and terminal settings

- Updated the list of VS Code extensions in devcontainer.json to include "GitHub.copilot"
- Added a new terminal profile for Linux with the path set to "/bin/bash"
- Set the default Linux terminal profile to "bash"

* removeall

* feat: Add Dockerfiles and devcontainer configurations

This commit adds Dockerfiles and devcontainer configurations for different use cases in the `.devcontainer` directory. The following changes were made:

- Added `Dockerfile` for basic setups (`base`)
- Added `Dockerfile` for advanced features (`full`)
- Added `Dockerfile` for AutoGen project developers (`dev`)
- Added `Dockerfile` for AutoGen project developers using Studio (`studio`)
- Updated existing files with necessary dependencies and configurations
- Modified README.md to provide instructions on customizing Dockerfiles and managing the Docker environment

These changes allow users to easily set up their AutoGen development environment using Docker containers.

* delete

* Add authors.yml file with author information

This commit adds the authors.yml file, which contains information about various authors contributing to the project. Each author entry includes their name, title, URL, and image URL. This file will be used to display author information on the website.

* delete

* Add test cases for agent chat functionality

This commit adds new test cases for the agent chat functionality. The test cases include scenarios such as auto feedback from code execution, function calls, currency calculator, async function calls, group chat finite state machine, cost token tracking, and group chat state flow. These test cases cover different versions of Python (3.10, 3.11, and 3.12) and are skipped if OpenAI is not installed or the Python version does not match.

* delete

* feat: Add LLM configuration documentation

This commit adds documentation for configuring an agent's access to LLMs. It includes information on the `llm_config` argument, `config_list`, and other configuration parameters. The commit also provides examples of filtering the `config_list` based on model names and tags. Additionally, it demonstrates how to add an HTTP client in `llm_config` for proxy usage. Finally, it mentions helper functions for loading a config list from API keys, environment variables, files, or `.env` files.

Closes #1234

* delete

* feat: Add LLM configuration documentation

This commit adds documentation for configuring an agent's access to LLMs. It includes information on the `llm_config` argument, `config_list`, and other configuration parameters. The commit also provides examples of filtering the `config_list` based on model names and tags. Additionally, it demonstrates how to add an HTTP client in `llm_config` for proxy usage. Finally, it mentions helper functions for loading a config list from various sources.

Closes #1234

* delete

* adding back notebooks

* reset

* feat: Add setup.py for package installation

This commit adds a new file, `setup.py`, which is used for installing the package. The `setup.py` file includes information such as the author, description, and dependencies of the package. This allows users to easily install and use the package in their projects.

The `setup.py` file also includes different extra requirements for specific functionalities, such as retrieving chat data or running Jupyter notebooks. These extra requirements are installed when specified during installation.

Overall, this addition improves the usability and installation process of the package.

* Broken links fix (#2843)

* Update Examples.md

* Update agent_chat.md

* Update agent_chat.md

* Update Optional-Dependencies.md

* Update JSON_mode_example.ipynb

* Update JSON_mode_example.ipynb

* Update JSON_mode_example.ipynb

* Update JSON_mode_example.ipynb

* Update agentchat_agentoptimizer.ipynb

* Update agentchat_nested_chats_chess.ipynb

* update guide about roadmap issues (#2846)

* update guide about roadmap issues

* update link

* Fix chromadb get_collection ignores custom embedding_function (#2854)

* Use Gemini without API key (#2805)

* google default auth and svc keyfile for Gemini

* [.Net] Release note for 0.0.14 (#2815)

* update release note

* update trigger

* [.Net] Update website for AutoGen.SemanticKernel and AutoGen.Ollama (#2814)
support vertex ai compute region

* [CAP] User supplied threads for agents (#2812)

* First pass:  message loop in main thread

* pypi version bump

* Fix readme

* Better example

* Fixed docs

* pre-commit fixes

* refactoring, minor fixes, update gemini demo ipynb

* add new deps again and reset line endings

* Docstring for the init function. Use private methods

* improve docstring

---------

Co-authored-by: Xiaoyun Zhang <[email protected]>
Co-authored-by: Rajan <[email protected]>
Co-authored-by: Zoltan Lux <[email protected]>

* Refactor hook registration and processing methods (#2853)

* Refactor hook registration and processing methods

- Refactored the `hook_lists` dictionary to use type hints for better readability.
- Updated the `register_hook` method signature to include type hints for the `hook` parameter.
- Added type hints to the `process_last_received_message` method parameters and return value.

This commit refactors the code related to hook registration and processing in the `conversable_agent.py` file. The changes improve code readability and maintainability by using type hints and updating method signatures.

* Refactor hook_lists initialization and add type hints

- Refactored the initialization of `hook_lists` to use a colon instead of an equal sign.
- Added type hints for the parameters and return types of `process_last_received_message` method.

* Refactor hook registration and processing in conversable_agent.py

- Refactored the `hook_lists` dictionary to use a more generic type for the list of hooks.
- Updated the signature check for `process_message_before_send`, `process_all_messages_before_reply`, and `process_last_received_message` hooks to ensure they are callable with the correct signatures.
- Added error handling to raise a ValueError or TypeError if any hook does not have the expected signature.

* Refactor hook processing in conversable_agent.py

- Simplify the code by removing unnecessary type checks and error handling.
- Consolidate the logic for processing hooks in `_process_message_before_send`, `process_all_messages_before_reply`, and `process_last_received_message` methods.

* Refactor register_hook method signature for flexibility

The commit changes the signature of the `register_hook` method in `conversable_agent.py`. The second argument, `hook`, is now of type `Callable` instead of `Callable[[List[Dict]], List[Dict]]`. This change allows for more flexibility when registering hooks.

* [.Net] Add AOT compatible check for AutoGen.Core (#2858)

* add AutoGen.AotCompatibility test

* add aot test

* fix build error

* update ps1 path

* Updated the azure client to support AAD auth. (#2879)

* add github icon (#2878)

* [Refactor] Transforms Utils (#2863)

* wip

* tests + docstrings

* improves tests

* fix import

* allow function to remove termination string in groupchat (#2804)

* allow function to remove termination string in groupchat

* improve docstring

Co-authored-by: Joshua Kim <[email protected]>

* improve docstring

Co-authored-by: Joshua Kim <[email protected]>

* improve test case description

Co-authored-by: Joshua Kim <[email protected]>

---------

Co-authored-by: Joshua Kim <[email protected]>

* AgentOps Runtime Logging Implementation (#2682)

* add agentops req

* track conversable agents with agentops

* track tool usage

* track message sending

* remove record from parent

* remove record

* simple example

* notebook example

* remove spacing change

* optional dependency

* documentation

* remove extra import

* optional import

* record if agentops

* if agentops

* wrap function auto name

* install agentops before notebook test

* documentation fixes

* notebook metadata

* notebook metadata

* pre-commit hook changes

* doc link fixes

* git lfs

* autogen tag

* bump agentops version

* log tool events

* notebook fixes

* docs

* formatting

* Updated ecosystem manual

* Update notebook for clarity

* cleaned up notebook

* updated precommit recommendations

* Fixed links to screenshots and examples

* removed unused files

* changed notebook hyperlink

* update docusaurus link path

* reverted setup.py

* change setup again

* undo changes

* revert conversable agent

* removed file not in branch

* Updated notebook to look nicer

* change letter

* revert setup

* revert setup again

* change ref link

* change reflink

* remove optional dependency

* removed duplicated section

* Addressed clarity commetns from howard

* minor updates to wording

* formatting and pr fixes

* added info markdown cell

* better docs

* notebook

* observability docs

* pre-commit fixes

* example images in notebook

* example images in docs

* example images in docs

* delete agentops ong

* doc updates

* docs updates

* docs updates

* use agent as extra_kwarg

* add logging tests

* pass function properly

* create table

* dummy function name

* log chat completion source name

* safe serialize

* test fixes

* formatting

* type checks

---------

Co-authored-by: reibs <[email protected]>
Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Eric Zhu <[email protected]>
Co-authored-by: Howard Gil <[email protected]>
Co-authored-by: Alex Reibman <[email protected]>

* Autogenstudio docs (#2890)

* add autogenstudio docs

* update ags readme to point to docs page

* update docs

* update docs

* update faqs

* update, fix typos

* [.Net] Add Goolge gemini (#2868)

* update

* add vertex gemini test

* remove DTO

* add test for vertexGeminiAgent

* update test name

* update IGeminiClient interface

* add test for streaming

* add message connector

* add gemini message extension

* add tests

* update

* add gemnini sample

* update examples

* add test for iamge

* fix test

* add more tests

* add streaming message test

* add comment

* remove unused json

* implement google gemini client

* update

* fix comment

* Squash changes (#2849)

* version update (#2908)

* version update

* version update

* Bugfix: PGVector/RAG - Calculate the Vector Size based on Model Dimensions (#2865)

* Calculate the dimension size based off model chosen.

* Added example docstring.

* Validated working notebook with sentence models of different dimensions.

* Validated removal of model_name working.

* Second example uses conn object.

* embedding_function no longer directly references .encode

* Fixed pre-commit issue.

* Use try/except to raise error when shape is not found in embedding function.

* Re-ran notebook.

* Update autogen/agentchat/contrib/vectordb/pgvectordb.py

Co-authored-by: Li Jiang <[email protected]>

* Update autogen/agentchat/contrib/vectordb/pgvectordb.py

Co-authored-by: Li Jiang <[email protected]>

* Added .encode

* Removed example comment.

* Fix overwrite doesn't work with existing collection when custom embedding function has different dimension from default one

---------

Co-authored-by: Li Jiang <[email protected]>

* Update notebook (#2886)

* Change chunk size of vectordb from max_tokens to chunk_token_size (#2896)

* Update retrieve_user_proxy_agent.py

* Update retrieve_user_proxy_agent.py

---------

Co-authored-by: Li Jiang <[email protected]>

* CRLF changed to LF (#2915)

* pre-commit version update and a few spelling fixes (#2913)

* Improve update context condition checking rule (#2883)

Co-authored-by: Chi Wang <[email protected]>

* Docs typo cli-code-executor.ipynb (#2909)

Co-authored-by: Chi Wang <[email protected]>

* human input mode annotations fixed (#2864)

Co-authored-by: Chi Wang <[email protected]>

* [.Net] Add Gemini samples to AutoGen.Net website + configure Gemini package to be ready for release (#2917)

* update website

* fix buid error

* update

* changed CRLF to LF (#2935)

* Bump braces from 3.0.2 to 3.0.3 in /website (#2934)

Bumps [braces](https://github.com/micromatch/braces) from 3.0.2 to 3.0.3.
- [Changelog](https://github.com/micromatch/braces/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/braces/compare/3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: braces
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* update update.md (#2937)

* Allow passing in custom pricing in config_list (#2902)

* update

* update

* TODO comment removed

* update

---------

Co-authored-by: Yiran Wu <[email protected]>
Co-authored-by: Davor Runje <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* Update OAI_CONFIG_LIST_sample (#2867)

Co-authored-by: Chi Wang <[email protected]>

* Fix repeated comma typo (#2940)

* [.Net] update oai tests by using new OpenAI resources (#2939)

* update oai tests

* Update MetaInfo.props

* [Autobuild] improve robustness and reduce cost (#2907)

* Update Autobuild.

* merge main into autobuild

* update test for new autobuild

* update author info

* fix pre-commit

* Update autobuild notebook

* Update autobuild_agent_library.ipynb

* Update autobuild_agent_library.ipynb

* Fix pre-commit failures.

---------

Co-authored-by: Linxin Song <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* Filter models with tags instead of model name (#2912)

* identify model with tags instead of model name

* models

* model to tag

* add more model name

* format

* Update test/agentchat/test_function_call.py

Co-authored-by: Chi Wang <[email protected]>

* Update test/agentchat/test_function_call.py

Co-authored-by: Chi Wang <[email protected]>

* Update test/agentchat/test_tool_calls.py

Co-authored-by: Chi Wang <[email protected]>

* Update test/agentchat/test_tool_calls.py

Co-authored-by: Chi Wang <[email protected]>

* remove uncessary tags

* use gpt-4 as tag

* model to tag

* add tag for teachable agent test

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: AutoGen-Hub <[email protected]>

* Fix missing messages in Gemini history (#2906)

* fix missing message in history

* fix message handling

* add list of Parts to Content object

* add test for gemini message conversion function

* add test for gemini message conversion

* add message to asserts

* add safety setting support for vertexai

* remove vertexai safety settings

* Client class utilities (#2949)

* Addition of client utilities, initially for parameter validation

* Corrected test

* update: type checks and few tests

* fix: docs, tests

---------

Co-authored-by: Hk669 <[email protected]>

* change specified api-version (#2955)

* Update agentchat_function_call_currency_calculator.ipynb (#2952)

minor fix

* Bump ws from 7.5.9 to 7.5.10 in /website (#2964)

Bumps [ws](https://github.com/websockets/ws) from 7.5.9 to 7.5.10.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/7.5.9...7.5.10)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* should_hide_tools function added to client_utils (#2966)

* Anthropic Client (#2931)

* intial setup for the anthropic client with cost config

* update: other methods added

* fix: formatting

* fix: config unused

* update: changes made in the client

* update: test added to the workflow

* update: added tests to the anthropic client

* fix: errors in workflows and client

* fix

* fix: anthropic tools type

* update: notebook anthropic

* Nonetype fixed

* fix-tests config

* update: tests and client issues

* logger support

* remove sys path

* updated the functioning of the client

* update: type hints and stream

* skip tests- importerror

* fix: anthropic client and tests

* none fix

* Alternating roles, parameter keywords, cost on response,

* update: anthropic notebook

* update: notebook with more details

* devcontainer

* update: added validate_params from the client_utils

* fix: formatting

* fix: minor comment

---------

Co-authored-by: Mark Sze <[email protected]>

* a_initaite_chats update (#2958)

* Fix #2845 - LocalCommandLineCodeExecutor is not working with virtual environments (#2926)

* Used absolute path of virtual environment bin path in local command executors

* Checked if the expected venv is used or not

* Added code comments for documentation

* fix: format issue - shutil lib

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Li Jiang <[email protected]>

* type fix for ChatResult (#2973)

* Fix #2960 by checking if the values are a list of lists. (#2971)

* Fix #2960 by checking values are list of list

* Reduce dictionary look up overhead

* [.Net] fix #2859 (#2974)

* add getting start sample project

* update

* update

* revert change

* [.Net] add ReAct sample (#2977)

* add ReAct sample

* fix source geenrator test

* Mistral Client (#2892)

* Initial commit of Mistral client class

* Updated to manage final system message for reflection_with_llm

* Add Mistral support to client class

* Add Mistral support across the board (based on Gemini changes)

* Test file for Mistral client

* Updated handling of config, added notebook for documentation

* Added support for additional API parameters

* Remove unneeded code, updated exception raising

* Updated handling of keywords, including type checks, defaults, warnings. Updated notebook example to remove logging warnings.

* Added class description.

* Updated tests to support new config handling.

* Moved parameter parsing to create function, minimised init, added parameter tests

* Refined parameter validation

* Correct spacing

* Fixed string concat in parameter validation

* Corrected upper/lower bound warning

* Use client_tools, tidy up Mistral create, better handle tool call response, tidy tests

* Update of documentation notebook, replacement of old version

* Update to handle multiple tool_call recommendations in a message

* Updated tests to accommodate multiple tool_calls as well as content in message

* Update autogen/oai/mistral.py comment

Co-authored-by: Qingyun Wu <[email protected]>

* cleanup, rewrite mock

* update

---------

Co-authored-by: Qingyun Wu <[email protected]>
Co-authored-by: kevin666aa <[email protected]>

* Fix qdrant version (#2984)

* Anthropic client fixes (#2981)

* add claude 3.5 sonnet to pricing

* Fix import error for client_utils

* fix import order for ruff formatter

* name key is not supported in anthropic message so let's remove it

* Improved tool use message conversion, changed create to return standard response

* Converted tools to messages for speaker selection, moved message conversion to function, corrected bugs

* Minor bracket typo.

* Renaming function

* add groupchat and run notebook

---------

Co-authored-by: Mark Sze <[email protected]>
Co-authored-by: Qingyun Wu <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Together AI Client (#2919)

* First pass together.ai client class

* Config handling, models and cost

* Added tests, moved param management to create function

* Tests, parameter, validation, logging updates

* Added use of client_utils PR 2949

* Updated to return OAI response

* Notebook example

* Improved function calling, updated tests, updated notebook with Chess example

* Tidied up together client class, better parameter handling, simpler exception capture, warning for no cost, reuse in tests, cleaner tests

* Update of documentation notebook, replacement of old version

* Fix of messages parameter for hide_tools function call

* Update autogen/oai/together.py

Co-authored-by: Qingyun Wu <[email protected]>

* Update together.py to fix text

---------

Co-authored-by: Qingyun Wu <[email protected]>
Co-authored-by: Yiran Wu <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* Uniform Interface for calling different LLMs (#2916)

* update

* update

* Minor tweaks on text

---------

Co-authored-by: Mark Sze <[email protected]>

* fix: created in ChatCompletion for clients (#2988)

* Bump version to 0.2.30 (#2990)

* update notebook wording and format (#2991)

* Fixed alternating message role bug in Anthropic client (#2992)

* Fixed alternating message role bug

* Fix bug

* Message handling to support multiple function calls (#2997)

* LLM Observability documentation fixes: Broken links, grammar, and spelling (#2995)

* update markdown hyperlinks to stable urls

* update notebook images and text

* re-write observability section

* Updated section

* update wording

* added newline

* update styling in image tags to be jsx compatible

* added text

* update link

* simplified text

---------

Co-authored-by: Braelyn Boynton <[email protected]>

* bump version (#2999)

Co-authored-by: Li Jiang <[email protected]>

* Improve doc in tutorial/conversation-patterns and customized_speaker_selection (#3006)

* update

* update

---------

Co-authored-by: Yiran Wu <[email protected]>

* [.Net] Update website with Tutorial section (#2982)

* update

* Update -> Releaes Notes

* add ImageChat

* update

* update

* fix #2975 (#3012)

* AgentEval Blogpost (#2954)

* first draft of agent eval blog post

* adding NextSteps section

* Update website/blog/2024-06-21-AgentEval/index.mdx

Co-authored-by: Chi Wang <[email protected]>

* Update website/blog/2024-06-21-AgentEval/index.mdx

Co-authored-by: Chi Wang <[email protected]>

* addressing some pr comments

* fixing whitespace

* fixing typo

* adding bit about sequential chats

* fixing whitespace

* adding more about verifier

---------

Co-authored-by: Beibin Li <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* improve `Create agent with tools` and add tuturial reference in index.md (#3024)

* #2708 add Add a judgment to the graph constructor (#2709)

* #2708 add Add a judgment to the graph constructor

* #2708 add Add a judgment to the graph constructor & added unit test

* #2708 #2079 move GraphTests to AutoGen.Tests; delete AutoGen.Core.Tests project

* [.Net] add sample on how to make function call using lite llm and ollama Plus move ollama openai sample to AutoGen.OpenAI.Sample project (#3015)

* add sample

* Update Connect_To_Ollama.cs

* Update Connect_To_Ollama.cs

* Create azure_cosmos_db in ecosystems.md (#2371)

* Create azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* Update azure_cosmos_db.md

* fix log_function_use warning (#3018)

* Groq Client (#3003)

* Groq Client Class - main class and setup, except tests

* Change pricing per K, added tests

* Streaming support, including with tool calling

* Used Groq retries instead of loop, thanks Gal-Gilor!

* Fixed bug when using logging.

---------

Co-authored-by: Qingyun Wu <[email protected]>

* [.Net] fix #3014 by adding local model function call in dotnet website (#3044)

* add instruction in ollama-litellm function call example

* add tutorial

* fix tests

* Update README.md (#3025)

adding links to blogposts to increase the clarity

* [.Net] Support tools for AnthropicClient and AnthropicAgent   (#2944)

* Squash commits : support anthropic tools

* Support tool_choice

* Remove reference from TypeSafeFunctionCallCodeSnippet.cs and add own function in test proj

* [.Net] Fix #3045 (#3047)

* make IStreamingMessage obsolete

* update final reply message

* Fix llama_index tests (#3063)

* Update qdrant dependency (#3064)

* Update qdrant dependency

* Update qdrant dependency

* Fix simple typos in human-in-the-loop.ipynb (#3051)

* update readme (#3057)

* update readme

* Update README.md

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* add notion link

---------

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Blog post for enhanced non-OpenAI model support (#2965)

* Blogpost for enhanced non-OpenAI model support

* update: quickstart with simple conversation

* update: authors details

* Added upfront text

* Added function calling, refined text. Added chess for alt-models notebook, updated examples listing.

* Added Groq to blog

* Removed acknowledgements

---------

Co-authored-by: Hk669 <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Fix simple typo in chat-termination.ipynb (#3050)

* Cohere Client (#3004)

* initial setup for cohere client

* client update

* changes: ClintType added to the utils

* Revert "changes: ClintType added to the utils"

This reverts commit 80d61552287f2d2eff50b4c0f1a4adfd97233aa3.

* Message conversion to Cohere, Parameter handling, cost calculation, streaming, tool calling

* Changed Groq references.

* minor fix

* tests added

* ref fix

* added in the workflows

* Fixed bug on non-streaming text generation

* fix: formatting

* Support Cohere rule for last message not USER when tool_results exist

* Added Cohere to documentation

* fixed client.py merge, removed unnecessary comments in groq.py, updated Cohere documentation, added Groq documentation

* log: ignored params

* update: custom exception added

---------

Co-authored-by: Mark Sze <[email protected]>
Co-authored-by: Mark Sze <[email protected]>

* bump version (#3073)

* Update azure_cosmos_db.md (#3043)

* Update AutoTX Link on Gallery.json (#3082)

* fix: support openai service account apikey format (#3078)

* [.Net] Update FunctionCallTemplate.tt to encode `"` (#3068)

* Update FunctionCallTemplate.tt

changed the desscription assigning to handle double quotes in comments and prevent the generated code from breaking.

* Added the necessary changes

Fixed handling of double quotes in descriptions within FunctionCallTemplate.tt.
Standardized newline characters to ensure consistency.
Updated test cases in FunctionCallTemplateEncodingTests to verify correct encoding of double quotes in descriptions.
Cleaned up unnecessary using directives in FunctionCallTemplateEncodingTests.
Aligned the template with the approved test output.

* test cases passing

Test cases passing like `Starting test execution, please wait...
A total of 1 test files matched the specified pattern.

Passed!  - Failed:     0, Passed:     9, Skipped:     0, Total:     9, Duration: 66 ms - AutoGen.SourceGenerator.Tests.dll (net8.0)`

* Delete FunctionCallTemplateTests.TestFunctionCallTemplate.approved.txt

Deleted the ApprovalTests/FunctionCallTemplateTests.TestFunctionCallTemplate.approved.txt successfully!

* Revert "Delete FunctionCallTemplateTests.TestFunctionCallTemplate.approved.txt"

This reverts commit 7a6ea9cf0d5831ba7a5c445a7f9b64da713c600d.

---------

Co-authored-by: Xiaoyun Zhang <[email protected]>

* Demo Notebook for Using Gemini with VertexAI (#3032)

* add notebook for using Gemini with VertexAI

* add missing image

* remove part with workload identity federation

* Spelling

* Capitalisation and tweak on config note.

* autogen gemini gcp image

* fix formatting

* move gemini vertexai notebook to website/docs/topics/non-openai-models

* Adjust license

Co-authored-by: Chi Wang <[email protected]>

* remove auto-generated cell

---------

Co-authored-by: Mark Sze <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* [.Net] fix #2695 and #2884 (#3069)

* add round robin orchestrator

* add constructor for orchestrators

* add tests

* revert change

* return single orchestrator

* address comment

* [.Net] Agent as service: Run an `IAgent` as openai chat completion endpoint (#2633)

* update

* add test

* clean up

* update

* Delete dotnet/src/AutoGen.Server/AutoGen.Service.csproj.user

* implement streaming

* add sample project

* rename AutoGen.Service to AutoGen.WebAPI

* rename AutoGen.Service to AutoGen.WebAPI

* add stateflow to related papers (#3108)

* [.Net] Prepare release note for AutoGen.Net 0.0.16 (#3117)

* add release note

* update repo info

* fix notebook (#3093)

* middleware examples updated to return modified message passing assertion.  modified the default agent reply so that it is different from the user's prompt (#3128)

* feat: Qdrant support for the VectorDB interface (#3035)

* feat: Qdrant support

* chore: pre-defined vector db

* Fix issues

---------

Co-authored-by: Li Jiang <[email protected]>

* Fix websurfer test error (#3138)

* Fix assertion error

* Update triggers

* [.Net] update sk version from 1.10.0 to 1.15.1 (#3131)

* update sk version

* fix sk test error

* add cancellation token to transition check lambda (#3132)

* fix build and tests (#3134)

* [.Net] update dotnet-ci and dotnet-release to use 8.0.x version when setting up .NET. And enable format check (#3136)

* use 8.0.x versin

* enable format check

* change file header

* apply code format

* add instructions in ci to fix format error

* add comment back

* update (#3144) (#3145)

* Update qdrant notebook for new qdrant vectordb (#3140)

* Add qdrant notebook, rename notebooks

* Revert changes of pgvector notebook

* Fix assertion error

* Fixed a typo in tool-use.ipynb (#3151)

Fixed a typo in tool-use.ipynb: comaptible -> compatible

* Add Agentok into gallery (#3148)

* docs: Added Agentok into gallery.

* Fixed the format issue

* Track agentok.png with Git LFS

---------

Co-authored-by: Qingyun Wu <[email protected]>

* Fix typo in agentchat_nestedchat.ipynb (#3139)

* Update JSON_mode_example.ipynb (#3130)

Improve minor mistakes in documentation

* Fix docstring (#3172)

* add streaming tool call example (#3167)

* Added anthropic bedrock (#3103)

* Added anthropic bedrock

* Code format and fixed import

* Added tests for anthropic bedrock

* tests update

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Update token_count_utils.py - Replace `print` with `logger.warning` for consistency (#3168)

The code was using both `logger.warning` and `print` for showing warning. This commit fixes this inconsistency which can be an issue on production environments / logging systems

* fix: update method name in GeminiClient (#3007)

- change from `_initialize_vartexai` to `_initialize_vertexai`

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* add Use AutoGen.Net agent as model in AG Studio (#3182)

* add Use AutoGen.Net agent as model in AG Studio

* add git lfs

* test

* dotnet/nuget/icon.png,dotnet/resource/images/background.png,dotnet/resource/images/square.png,dotnet/test/AutoGen.Anthropic.Tests/images/square.png,dotnet/test/AutoGen.Ollama.Tests/images/image.png,dotnet/test/AutoGen.Ollama.Tests/images/square.png,dotnet/test/AutoGen.Tests/ApprovalTests/square.png,dotnet/website/images/articles/CreateAgentWithTools/single-turn-tool-call-with-auto-invoke.png,dotnet/website/images/articles/CreateAgentWithTools/single-turn-tool-call-without-auto-invoke.png,dotnet/website/images/articles/CreateUserProxyAgent/image-1.png,dotnet/website/images/articles/PrintMessageMiddleware/printMessage.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/FinalStepsA.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/FinalStepsB.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/FinalStepsC.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/Step5.2OpenAIModel.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/Step5.3ModelNameAndURL.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/Step6.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/Step6b.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/Terminal.png,dotnet/website/images/articles/UseAutoGenAsModelinAGStudio/TheModelTab.png,notebook/friendly_and_suspicous.jpg,notebook/nested-chats-chess.png,notebook/nested_chat_1.png,notebook/nested_chat_2.png,notebook/optiGuide_new_design.png,notebook/viz_gc.png,samples/apps/auto-anny/images/icon.png,samples/apps/autogen-studio/docs/ara_stockprices.png,samples/apps/autogen-studio/frontend/src/images/icon.png,test/test_files/test_image.png,website/blog/2023-04-21-LLM-tuning-math/img/level2algebra.png,website/blog/2023-04-21-LLM-tuning-math/img/level3algebra.png,website/blog/2023-04-21-LLM-tuning-math/img/level4algebra.png,website/blog/2023-04-21-LLM-tuning-math/img/level5algebra.png,website/blog/2023-05-18-GPT-adaptive-humaneval/img/design.png,website/blog/2023-05-18-GPT-adaptive-humaneval/img/humaneval.png,website/blog/2023-06-28-MathChat/img/mathchatflow.png,website/blog/2023-06-28-MathChat/img/result.png,website/blog/2023-10-18-RetrieveChat/img/retrievechat-arch.png,website/blog/2023-10-26-TeachableAgent/img/teachable-arch.png,website/blog/2023-11-06-LMM-Agent/img/teaser.png,website/blog/2023-11-09-EcoAssistant/img/chat.png,website/blog/2023-11-09-EcoAssistant/img/results.png,website/blog/2023-11-09-EcoAssistant/img/system.png,website/blog/2023-11-09-EcoAssistant/img/template-demo.png,website/blog/2023-11-09-EcoAssistant/img/template.png,website/blog/2023-11-13-OAI-assistants/img/teaser.jpg,website/blog/2023-11-20-AgentEval/img/agenteval-CQ.png,website/blog/2023-11-20-AgentEval/img/math-problems-plot.png,website/blog/2023-11-20-AgentEval/img/tasks-taxonomy.png,website/blog/2023-11-26-Agent-AutoBuild/img/agent_autobuild.png,website/blog/2023-12-01-AutoGenStudio/img/autogenstudio_config.png,website/blog/2023-12-01-AutoGenStudio/img/autogenstudio_home.png,website/blog/2023-12-01-AutoGenStudio/img/autogenstudio_skills.png,website/blog/2023-12-23-AgentOptimizer/img/agentoptimizer.png,website/blog/2024-01-25-AutoGenBench/img/teaser.jpg,website/blog/2024-02-02-AutoAnny/img/AutoAnnyLogo.jpg,website/blog/2024-02-11-FSM-GroupChat/img/FSM_logic.png,website/blog/2024-02-11-FSM-GroupChat/img/FSM_of_multi-agents.png,website/blog/2024-02-11-FSM-GroupChat/img/teaser.jpg,website/blog/2024-02-29-StateFlow/img/alfworld.png,website/blog/2024-02-29-StateFlow/img/bash_result.png,website/blog/2024-02-29-StateFlow/img/intercode.png,website/blog/2024-02-29-StateFlow/img/sf_example_1.png,website/blog/2024-03-03-AutoGen-Update/img/contributors.png,website/blog/2024-03-03-AutoGen-Update/img/dalle_gpt4v.png,website/blog/2024-03-03-AutoGen-Update/img/gaia.png,website/blog/2024-03-03-AutoGen-Update/img/love.png,website/blog/2024-03-03-AutoGen-Update/img/teach.png,website/blog/2024-03-11-AutoDefense/imgs/architecture.png,website/blog/2024-03-11-AutoDefense/imgs/defense-agency-design.png,website/blog/2024-03-11-AutoDefense/imgs/table-4agents.png,website/blog/2024-03-11-AutoDefense/imgs/table-agents.png,website/blog/2024-03-11-AutoDefense/imgs/table-compared-methods.png,website/blog/2024-05-24-Agent/img/agents.png,website/blog/2024-05-24-Agent/img/leadership.png,website/blog/2024-06-21-AgentEval/img/agenteval_ov_v3.png,website/blog/2024-06-24-AltModels-Classes/img/agentstogether.jpeg,website/docs/Use-Cases/images/agent_example.png,website/docs/Use-Cases/images/app.png,website/docs/Use-Cases/images/autogen_agents.png,website/docs/autogen-studio/img/agent_assistant.png,website/docs/autogen-studio/img/agent_groupchat.png,website/docs/autogen-studio/img/agent_new.png,website/docs/autogen-studio/img/agent_skillsmodel.png,website/docs/autogen-studio/img/ara_stockprices.png,website/docs/autogen-studio/img/model_new.png,website/docs/autogen-studio/img/model_openai.png,website/docs/autogen-studio/img/skill.png,website/docs/autogen-studio/img/workflow_chat.png,website/docs/autogen-studio/img/workflow_export.png,website/docs/autogen-studio/img/workflow_new.png,website/docs/autogen-studio/img/workflow_profile.png,website/docs/autogen-studio/img/workflow_sequential.png,website/docs/autogen-studio/img/workflow_test.png,website/docs/ecosystem/img/ecosystem-composio.png,website/docs/ecosystem/img/ecosystem-databricks.png,website/docs/ecosystem/img/ecosystem-fabric.png,website/docs/ecosystem/img/ecosystem-llamaindex.png,website/docs/ecosystem/img/ecosystem-memgpt.png,website/docs/ecosystem/img/ecosystem-ollama.png,website/docs/ecosystem/img/ecosystem-promptflow.png,website/docs/topics/non-openai-models/images/cloudlocalproxy.png,website/docs/tutorial/assets/code-execution-in-conversation.png,website/docs/tutorial/assets/code-executor-docker.png,website/docs/tutorial/assets/code-executor-no-docker.png,website/docs/tutorial/assets/conversable-agent.jpg,website/docs/tutorial/assets/group-chat.png,website/docs/tutorial/assets/human-in-the-loop.png,website/docs/tutorial/assets/nested-chats.png,website/docs/tutorial/assets/sequential-two-agent-chat.png,website/docs/tutorial/assets/two-agent-chat.png,website/static/img/autogen_agentchat.png,website/static/img/autogen_app.png,website/static/img/chat_example.png,website/static/img/create_gcp_svc.png,website/static/img/gallery/TensionCode.png,website/static/img/gallery/autotx.png,website/static/img/gallery/composio-autogen.png,website/static/img/gallery/default.png,website/static/img/gallery/robot.jpg,website/static/img/gallery/webagent.jpg,website/static/img/gallery/x-force-ide-ui.png: convert to Git LFS

* update (#3175)

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* [.Net] Allow passing a kernel to Interactive Service. (#3183)

* accept a running kernel for Interactive Service

* add kernel running check

* rename Service -> WebAPI (#3177)

* Enhance vertexai integration (#3086)

* switch to officially supported Vertex AI message sending + safety setting converion for vertexai

* add system instructions

* switch to officially supported Vertex AI message sending + safety setting converion for vertexai

* fix bug in safety settings conversion

* add missing system instructions

* add safety settings to send message

* add support for credentials objects

* add type checkingchange project_id to project arg

* add more tests

* fix mock creation in test

* extend docstring

* fix errors with gemini message format in chats

* add option for vertexai response validation setting & improve docstring

* readding empty message handling

* add more tests

* extend and improve gemini vertexai jupyter notebook

* rename project arg to project_id and GOOGLE_API_KEY env var to GOOGLE_GEMINI_API_KEY

* adjust docstring formatting

* [.Net] Add a constructor which takes ChatCompletionOptions for OpenAIChatAgent (#3170)

* accept ChatCompletionOptions in constrcutor

* fix comment

* [CAP] Convenience methods for protobuf and some minor refactoring (#3022)

* First pass:  message loop in main thread

* pypi version bump

* Fix readme

* Better example

* Fixed docs

* pre-commit fixes

* Convenience methods for protobufs

* support non-color consoles

* Non-color console and allow user input

* Minor update to single_threaded_demo

* new pypi version

* pre-commit fixes

* change pypi name

---------

Co-authored-by: Qingyun Wu <[email protected]>

* [CAP]  Address missed PR comment changes (Minor) (#3201)

* Address PR comments

* Address PR comments

* [.Net] fix #3203 (#3204)

* add net6 & net8

* update

* add tools and stop sequence

* Fix typo in agentchat_society_of_mind.ipynb (#3180)

Co-authored-by: Mark Sze <[email protected]>

* Fix Anthropic Bedrock support (#3210)

* Added _configure_openai_config_for_bedrock to include aws variables in openai_config, necessary for setting AnthropicBedrock as client.

* Removed aws_session_token from required_keys

* Removed check for aws_session_token

* Removed all checks for aws_session_token

* Ran pre-commit

---------

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Resolve arguments formatting (#3194)

Fixed formatting for "clear_history"

Co-authored-by: Chi Wang <[email protected]>

* +mdb atlas vectordb [clean_final] (#3000)

* +mdb atlas

* Update test/agentchat/contrib/vectordb/test_mongodb.py

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* update test_mongodb.py; we dont need to do the assert .collection_name vs .name

* Try fix mongodb service

* Try fix mongodb service

* Update username and password

* Update autogen/agentchat/contrib/vectordb/mongodb.py

* closer --- but im not super thrilled about the solution...

* PYTHON-4506 Expanded tests and simplified vector search pipelines

* Update mongodb.py

* Update mongodb.py - Casey

* search_index_magic

index_name change; keeping track of lucene indexes is tricky

* Fix format

* Fix tests

* hacking trying to figure this out

* Streamline checks for indexes in construction and restructure tests

* Add tests for score_threshold, embedding inclusion, and multiple query tests

* refactored create_collection to meet base object requirements

* lint

* change the localhost port to 27017

* add test to check that no embedding is there unless explicitly provided

* Update logger

* Add test get docs with ids=None

* Rename and update notebook

* have index management include waiting behaviors

* Adds further optional waits or users and tests. Cleans up upsert.

* ensure the embedding size for multiple embedding inputs is equal to dimensions

* fix up tests and add configuration to ensure documents and indexes are READY for querying

* fix import failure

* adjust typing for 3.9

* fix up the notebook output

* changed language to communicate time taken on first init_chat call

* replace environment variable usage

---------

Co-authored-by: Fabian Valle <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
Co-authored-by: Li Jiang <[email protected]>
Co-authored-by: Casey Clements <[email protected]>
Co-authored-by: Jib <[email protected]>
Co-authored-by: Jib <[email protected]>
Co-authored-by: Cozypet <[email protected]>

* avoid scan tool false alarm (#3218)

Co-authored-by: gongwn1 <[email protected]>

* Fix failing GitGuardian check (#3228)

* Agent Observability Blog Post (#3209)

* update markdown hyperlinks to stable urls

* update notebook images and text

* re-write observability section

* Updated section

* update wording

* added newline

* update styling in image tags to be jsx compatible

* added text

* update link

* simplified text

* created blog

* replace flow images with fewer shadows

* reformat line

* add authors

* updated discord link and direct paths to image URLS

* removed images since they are not stored in the AgentOps github

* remove trailing whitespaces

* removed newline

* removed whitespace

* Update website/blog/2024-07-25-AgentOps/index.mdx

Co-authored-by: Mark Sze <[email protected]>

* single quotes with double quotes

---------

Co-authored-by: Braelyn Boynton <[email protected]>
Co-authored-by: Mark Sze <[email protected]>

* Fix ConversableAgent break link in agent_chat.md file to  include the .md extension in the link for ConversableAgent (#3221)

ConversableAgent has a break link in website/docs/Use-Cases/agent_chat.md file

* update input prompt message (#3149)

Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: Qingyun Wu <[email protected]>

* Add gpt-4o-mini to model list (#3169)

* Add gpt-4o-mini to model list

* Fix formatting issue and verify with pre-commit

* Remove extra space

* Minor change to make pre-commit (formatting checks) pass

---------

Co-authored-by: Qingyun Wu <[email protected]>
Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
Co-authored-by: Ian <[email protected]>

* Observability blog post styling hot fix (#3234)

* update markdown hyperlinks to stable urls

* update notebook images and text

* re-write observability section

* Updated section

* update wording

* added newline

* update styling in image tags to be jsx compatible

* added text

* update link

* simplified text

* created blog

* replace flow images with fewer shadows

* reformat line

* add authors

* updated discord link and direct paths to image URLS

* removed images since they are not stored in the AgentOps github

* remove trailing whitespaces

* removed newline

* removed whitespace

* Update website/blog/2024-07-25-AgentOps/index.mdx

Co-authored-by: Mark Sze <[email protected]>

* single quotes with double quotes

* fix widths

---------

Co-authored-by: Braelyn Boynton <[email protected]>
Co-authored-by: Mark Sze <[email protected]>

* bump version (#3231)

* bump version

* update

* format

---------

Co-authored-by: kevin666aa <[email protected]>
Co-authored-by: Yiran Wu <[email protected]>
Co-authored-by: Chi Wang <[email protected]>

* [Typo] Update MongoDB Notebook to acknlowedge >=M10 support (#3220)

* [Typo] Update MongoDB Notebook to acknlowedge >=M10 support

The notebook instructions state we support only >=M30 clusters for AutoGen. This is slightly misleading. We support >=M10 clusters or any cluster that allows for index creation from client code. This support is continually updating so this PR updates the language to reflect that.

* Add link!

---------

Co-authored-by: Li Jiang <[email protected]>

* Update Microsoft Fabric notebook (#3243)

Co-authored-by: HRUSHIKESH DOKALA <[email protected]>

* Fix reference links (#3239)

* fix broken reference links that's pointing to a page that doesn't exists

* Fix 2 broken links and use the correct format

---------

Co-authored-by: Chi Wang <[email protected]>

* Improve error messaging (#3236)

* Update error language and corresponding tests

* Updated another test to use the new error message

* Recreated doc for Local LLMs - LiteLLM and Ollama - native function calling in Ollama (#3197)

* Recreated documentation for Local LLMs - LiteLLM and Ollama

* Added Docker = False for code execution example

---------

Co-authored-by: Chi Wang <[email protected]>

* [.Net] add SendAsync api to iterate group chat step by step (#3214)

* add SendAsync api and tests

* update example to use new sendAsync API

* bump version and add release note (#3246)

* update version

* early support for anthropic, mistral api

* Add additional tests to capture edge cases and more error conditions (#3237)

* Add additional unit tests to capture additional edge cases

* fix formatting issue (pre-commit)

* [CAP] Added a factory for runtime (#3216)

* Added Runtime Factory to support multiple implementations

* Rename to ComponentEnsemble to ZMQRuntime

* rename zmq_runtime

* rename zmq_runtime

* pre-commit fixes

* pre-commit fix

* pre-commit fixes and default runtime

* pre-commit fixes

* Rename constants

* Rename Constants

---------

Co-authored-by: Li Jiang <[email protected]>

* [Feature]: Add global silent param for ConversableAgent (#3244)

* feat: add is_silent param

* modify param name

* param doc

* fix: silent only overwrite agent own

* fix: change _is_silent to static method and receive verbose print

* fix test failure

* add kwargs for ConversableAgent subclass

---------

Co-authored-by: gongwn1 <[email protected]>
Co-authored-by: Li Jiang <[email protected]>
Co-authored-by: Umer Mansoor <[email protected]>

* Fix Issue #2880: Document the usage of the AAD auth (#2941)

* Document the usage of the AAD auth. #2880

Added the document for the usage of AAD !

* Update website/docs/topics/llm_configuration.ipynb

Co-authored-by: Qingyun Wu <[email protected]>

* Updated Location and Link to Azure OpenAI documentation

* Update AutoTX Link on Gallery.json (#3082)

Co-Authored-By: Qingyun Wu <[email protected]>
Co-Authored-By: Yiran Wu <…
  • Loading branch information
Show file tree
Hide file tree
Showing 39 changed files with 2,485 additions and 1,027 deletions.
3 changes: 3 additions & 0 deletions samples/apps/autogen-studio/.gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@ autogenstudio/web/workdir/*
autogenstudio/web/ui/*
autogenstudio/web/skills/user/*
.release.sh
.nightly.sh

notebooks/work_dir/*

# Byte-compiled / optimized / DLL files
__pycache__/
Expand Down
81 changes: 5 additions & 76 deletions samples/apps/autogen-studio/autogenstudio/chatmanager.py
Original file line number Diff line number Diff line change
@@ -1,20 +1,13 @@
import asyncio
import json
import os
import time
from datetime import datetime
from queue import Queue
from typing import Any, Dict, List, Optional, Tuple, Union

import websockets
from fastapi import WebSocket, WebSocketDisconnect

from .datamodel import Message, SocketMessage, Workflow
from .utils import (
extract_successful_code_blocks,
get_modified_files,
summarize_chat_history,
)
from .datamodel import Message
from .workflowmanager import WorkflowManager


Expand Down Expand Up @@ -82,76 +75,12 @@ def chat(
connection_id=connection_id,
)

workflow = Workflow.model_validate(workflow)

message_text = message.content.strip()
result_message: Message = workflow_manager.run(message=f"{message_text}", clear_history=False, history=history)

start_time = time.time()
workflow_manager.run(message=f"{message_text}", clear_history=False)
end_time = time.time()

metadata = {
"messages": workflow_manager.agent_history,
"summary_method": workflow.summary_method,
"time": end_time - start_time,
"files": get_modified_files(start_time, end_time, source_dir=work_dir),
}

output = self._generate_output(message_text, workflow_manager, workflow)

output_message = Message(
user_id=message.user_id,
role="assistant",
content=output,
meta=json.dumps(metadata),
session_id=message.session_id,
)

return output_message

def _generate_output(
self,
message_text: str,
workflow_manager: WorkflowManager,
workflow: Workflow,
) -> str:
"""
Generates the output response based on the workflow configuration and agent history.
:param message_text: The text of the incoming message.
:param flow: An instance of `WorkflowManager`.
:param flow_config: An instance of `AgentWorkFlowConfig`.
:return: The output response as a string.
"""

output = ""
if workflow.summary_method == "last":
successful_code_blocks = extract_successful_code_blocks(workflow_manager.agent_history)
last_message = (
workflow_manager.agent_history[-1]["message"]["content"] if workflow_manager.agent_history else ""
)
successful_code_blocks = "\n\n".join(successful_code_blocks)
output = (last_message + "\n" + successful_code_blocks) if successful_code_blocks else last_message
elif workflow.summary_method == "llm":
client = workflow_manager.receiver.client
status_message = SocketMessage(
type="agent_status",
data={
"status": "summarizing",
"message": "Summarizing agent dialogue",
},
connection_id=workflow_manager.connection_id,
)
self.send(status_message.dict())
output = summarize_chat_history(
task=message_text,
messages=workflow_manager.agent_history,
client=client,
)

elif workflow.summary_method == "none":
output = ""
return output
result_message.user_id = message.user_id
result_message.session_id = message.session_id
return result_message


class WebSocketConnectionManager:
Expand Down
35 changes: 34 additions & 1 deletion samples/apps/autogen-studio/autogenstudio/cli.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ def ui(
port: int = 8081,
workers: int = 1,
reload: Annotated[bool, typer.Option("--reload")] = False,
docs: bool = False,
docs: bool = True,
appdir: str = None,
database_uri: Optional[str] = None,
):
Expand Down Expand Up @@ -48,6 +48,39 @@ def ui(
)


@app.command()
def serve(
workflow: str = "",
host: str = "127.0.0.1",
port: int = 8084,
workers: int = 1,
docs: bool = False,
):
"""
Serve an API Endpoint based on an AutoGen Studio workflow json file.
Args:
workflow (str): Path to the workflow json file.
host (str, optional): Host to run the UI on. Defaults to 127.0.0.1 (localhost).
port (int, optional): Port to run the UI on. Defaults to 8081.
workers (int, optional): Number of workers to run the UI with. Defaults to 1.
reload (bool, optional): Whether to reload the UI on code changes. Defaults to False.
docs (bool, optional): Whether to generate API docs. Defaults to False.
"""

os.environ["AUTOGENSTUDIO_API_DOCS"] = str(docs)
os.environ["AUTOGENSTUDIO_WORKFLOW_FILE"] = workflow

uvicorn.run(
"autogenstudio.web.serve:app",
host=host,
port=port,
workers=workers,
reload=False,
)


@app.command()
def version():
"""
Expand Down
55 changes: 37 additions & 18 deletions samples/apps/autogen-studio/autogenstudio/database/dbmanager.py
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
import threading
from datetime import datetime
from typing import Optional

Expand All @@ -15,30 +16,39 @@
Skill,
Workflow,
WorkflowAgentLink,
WorkflowAgentType,
)
from .utils import init_db_samples

valid_link_types = ["agent_model", "agent_skill", "agent_agent", "workflow_agent"]


class WorkflowAgentMap(SQLModel):
agent: Agent
link: WorkflowAgentLink


class DBManager:
"""A class to manage database operations"""

_init_lock = threading.Lock() # Class-level lock

def __init__(self, engine_uri: str):
connection_args = {"check_same_thread": True} if "sqlite" in engine_uri else {}
self.engine = create_engine(engine_uri, connect_args=connection_args)
# run_migration(engine_uri=engine_uri)

def create_db_and_tables(self):
"""Create a new database and tables"""
try:
SQLModel.metadata.create_all(self.engine)
with self._init_lock: # Use the lock
try:
init_db_samples(self)
SQLModel.metadata.create_all(self.engine)
try:
init_db_samples(self)
except Exception as e:
logger.info("Error while initializing database samples: " + str(e))
except Exception as e:
logger.info("Error while initializing database samples: " + str(e))
except Exception as e:
logger.info("Error while creating database tables:" + str(e))
logger.info("Error while creating database tables:" + str(e))

def upsert(self, model: SQLModel):
"""Create a new entity"""
Expand All @@ -62,7 +72,7 @@ def upsert(self, model: SQLModel):
session.refresh(model)
except Exception as e:
session.rollback()
logger.error("Error while upserting %s", e)
logger.error("Error while updating " + str(model_class.__name__) + ": " + str(e))
status = False

response = Response(
Expand Down Expand Up @@ -115,7 +125,7 @@ def get_items(
session.rollback()
status = False
status_message = f"Error while fetching {model_class.__name__}"
logger.error("Error while getting %s: %s", model_class.__name__, e)
logger.error("Error while getting items: " + str(model_class.__name__) + " " + str(e))

response: Response = Response(
message=status_message,
Expand Down Expand Up @@ -157,16 +167,16 @@ def delete(self, model_class: SQLModel, filters: dict = None):
status_message = f"{model_class.__name__} Deleted Successfully"
else:
print(f"Row with filters {filters} not found")
logger.info("Row with filters %s not found", filters)
logger.info("Row with filters + filters + not found")
status_message = "Row not found"
except exc.IntegrityError as e:
session.rollback()
logger.error("Integrity ... Error while deleting: %s", e)
logger.error("Integrity ... Error while deleting: " + str(e))
status_message = f"The {model_class.__name__} is linked to another entity and cannot be deleted."
status = False
except Exception as e:
session.rollback()
logger.error("Error while deleting: %s", e)
logger.error("Error while deleting: " + str(e))
status_message = f"Error while deleting: {e}"
status = False
response = Response(
Expand All @@ -182,6 +192,7 @@ def get_linked_entities(
primary_id: int,
return_json: bool = False,
agent_type: Optional[str] = None,
sequence_id: Optional[int] = None,
):
"""
Get all entities linked to the primary entity.
Expand Down Expand Up @@ -217,19 +228,21 @@ def get_linked_entities(
linked_entities = agent.agents
elif link_type == "workflow_agent":
linked_entities = session.exec(
select(Agent)
.join(WorkflowAgentLink)
select(WorkflowAgentLink, Agent)
.join(Agent, WorkflowAgentLink.agent_id == Agent.id)
.where(
WorkflowAgentLink.workflow_id == primary_id,
WorkflowAgentLink.agent_type == agent_type,
)
).all()

linked_entities = [WorkflowAgentMap(agent=agent, link=link) for link, agent in linked_entities]
linked_entities = sorted(linked_entities, key=lambda x: x.link.sequence_id) # type: ignore
except Exception as e:
logger.error("Error while getting linked entities: %s", e)
logger.error("Error while getting linked entities: " + str(e))
status_message = f"Error while getting linked entities: {e}"
status = False
if return_json:
linked_entities = [self._model_to_dict(row) for row in linked_entities]
linked_entities = [row.model_dump() for row in linked_entities]

response = Response(
message=status_message,
Expand All @@ -245,6 +258,7 @@ def link(
primary_id: int,
secondary_id: int,
agent_type: Optional[str] = None,
sequence_id: Optional[int] = None,
) -> Response:
"""
Link two entities together.
Expand Down Expand Up @@ -357,6 +371,7 @@ def link(
WorkflowAgentLink.workflow_id == primary_id,
WorkflowAgentLink.agent_id == secondary_id,
WorkflowAgentLink.agent_type == agent_type,
WorkflowAgentLink.sequence_id == sequence_id,
)
).first()
if existing_link:
Expand All @@ -373,6 +388,7 @@ def link(
workflow_id=primary_id,
agent_id=secondary_id,
agent_type=agent_type,
sequence_id=sequence_id,
)
session.add(workflow_agent_link)
# add and commit the link
Expand All @@ -385,7 +401,7 @@ def link(

except Exception as e:
session.rollback()
logger.error("Error while linking: %s", e)
logger.error("Error while linking: " + str(e))
status = False
status_message = f"Error while linking due to an exception: {e}"

Expand All @@ -402,6 +418,7 @@ def unlink(
primary_id: int,
secondary_id: int,
agent_type: Optional[str] = None,
sequence_id: Optional[int] = 0,
) -> Response:
"""
Unlink two entities.
Expand All @@ -417,6 +434,7 @@ def unlink(
"""
status = True
status_message = ""
print("primary", primary_id, "secondary", secondary_id, "sequence", sequence_id, "agent_type", agent_type)

if link_type not in valid_link_types:
status = False
Expand Down Expand Up @@ -452,6 +470,7 @@ def unlink(
WorkflowAgentLink.workflow_id == primary_id,
WorkflowAgentLink.agent_id == secondary_id,
WorkflowAgentLink.agent_type == agent_type,
WorkflowAgentLink.sequence_id == sequence_id,
)
).first()

Expand All @@ -465,7 +484,7 @@ def unlink(

except Exception as e:
session.rollback()
logger.error("Error while unlinking: %s", e)
logger.error("Error while unlinking: " + str(e))
status = False
status_message = f"Error while unlinking due to an exception: {e}"

Expand Down
Loading

0 comments on commit 4f9383a

Please sign in to comment.