Group Chat works but the chat_history don't

[rlucasfm]

I have this simple script that is supposed to work as a autonomous "PR Reviewer", working through a group chat. I can see on the terminal the outputs working well, but when I try to get the response in a variable, and look at the chat history, it only shows the first message sent to the chat.
The full working code below:

import os
from dotenv import load_dotenv
import autogen
from autogen import ConversableAgent, register_function, GroupChat, GroupChatManager
from typing_extensions import Annotated
import requests
import pickle
load_dotenv()

logging_session_id = autogen.runtime_logging.start(logger_type="file", config={"filename": "runtime.log"})

diff_url = "https://github.com/ComposioHQ/composio/pull/285.diff"

llm_config = {
    "model": "gpt-3.5-turbo",
    # "cache_seed": None,
}

def pull_diffs(
        diff_url: Annotated[str, "A pull-request diff url"]
) -> Annotated[str, "The pull-request diff content"]:
    print("DIFF URL", diff_url)
    contents = requests.get(diff_url).text
    return contents

assistant_agent = ConversableAgent(
    name="assistant_agent",
    llm_config=False,
    human_input_mode="NEVER",
    is_termination_msg=lambda msg: "terminate" in msg.get("content").lower()
)

diff_puller_agent = ConversableAgent(
    name="Github_Diff_Puller_Agent",
    description='''A helpful agent capable of pulling diffs from github.
    It's main goal is to receive a github link that contains the diffs of a PR,
    and to return the raw content of the diffs.
    ''',
    system_message='''
    Your main goal is to receive a github link that contains the diffs of a PR,
    and to return the raw content of the diffs.
    You can get the pr diff by calling pull_diffs(diff_url).
    You should return the entire diff content as the original.
    When you finished your work, reply with TERMINATE. 
    ''',
    llm_config=llm_config,
    human_input_mode="NEVER",
    is_termination_msg=lambda msg: "terminate" in msg.get("content").lower()
)

register_function(
    pull_diffs,
    caller=diff_puller_agent,
    executor=assistant_agent,
    name="pull_diffs",
    description="Get the pr diff from a link"
)

code_analyzer_agent = ConversableAgent(
    name="Code_Analyzer_Agent",
    description='''A helpful agent capable of analyzing code and PR diffs.
    It's main goal is to receive a diff file from github and check for errors and
    big logical differences, and describe it in the most informative way.
    ''',
    system_message='''
    Your main goal is to receive a diff file from github and check for errors and
    big logical differences, and describe it in the most informative way.
    You first check for errors, check for logical differences, and then summarize the changes.
    Your output must be detailed and very thorough and should follow the format:
    Errors: ...
    Logical Differences: ...
    Summary: ...
    When you finished your work, reply with TERMINATE.
    ''',
    llm_config=llm_config,
    human_input_mode="NEVER",
    is_termination_msg=lambda msg: "terminate" in msg.get("content").lower()
)

review_writer_agent = ConversableAgent(
    name="PR_Review_Writer_Agent",
    description='''A helpful agent capable of writing pull-request reviews.
    It's main goal is to receive information about a pull-request and write a 
    descriptive review for the collaborators.
    ''',
    system_message='''
    Your main goal is to receive a information about a pull-request 
    with errors, logical differences and summary of the changes and write in the most
    informative and readable way a review for the collaborators.
    You should output your review in a markdown format, being the most detailed possible.
    When you finished your work, reply with TERMINATE.
    ''',
    llm_config=llm_config,
    human_input_mode="NEVER",
    is_termination_msg=lambda msg: "terminate" in msg.get("content").lower()
)

group_chat = GroupChat(
    agents=[assistant_agent, diff_puller_agent, code_analyzer_agent, review_writer_agent],
    messages=[],
    max_round=6,
    allowed_or_disallowed_speaker_transitions={
        assistant_agent: [diff_puller_agent, code_analyzer_agent, review_writer_agent],
        diff_puller_agent: [assistant_agent],
        code_analyzer_agent: [assistant_agent],
        review_writer_agent: [assistant_agent]
    },
    speaker_transitions_type="allowed"
)

group_chat_manager = GroupChatManager(
    groupchat=group_chat,
    llm_config=llm_config
)

chat = group_chat_manager.initiate_chat(
    group_chat_manager,
    message=f"I want to review a PR. Here's the diff link: {diff_url}",
    summary_method="last_msg"
)

with open("chat.pickle", "wb") as f:
    pickle.dump({
        "initiated_chat": chat,
        # "group_chat_manager": group_chat_manager.chat_messages,
        "group_chat": group_chat.messages
    }, f, protocol=pickle.HIGHEST_PROTOCOL)

print(chat.chat_history)

autogen.runtime_logging.stop()

[gendestus]

For our project, we ran into this and assume it's a bug. We're looking into registering reply functions to get around this for now. Sorry it's not much but we're hitting it for the first time today. If this isn't answered by the time we figure out the pattern I'll post it here.

[rlucasfm]

Thank you for the consideration.
I stopped the project for the a while, because of other priorities, but I will probably get back at it and maybe take a look in how I can contribute.
I was just afraid it was supposed to work that way or that I was trying to access something that wasnt supposed to be there.