Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ketan simplified co act workflow #3793

Closed
wants to merge 69 commits into from

Conversation

ketan1741
Copy link
Contributor

Short description of the problem this fixes or functionality that this introduces. This may be used for the CHANGELOG

  • This PR implements a simplified multi-agent workflow inspired by the CoAct paper.
  • Currently, in swe-bench eval, there are complex instances that OpenHands fails, especially ones that single CodeActAgent overlooks the buggy location. If we have a grounding test case for the issue, this workflow seems to help.
  • An overkill-ish successful trajectory with replanning can be found here.
  • A task which CoActPlannerAgent finished but CodeActAgent failed (I expected both to be able to complete it):
    CoAct traj
    CodeAct traj

Give a summary of what the PR does, explaining any non-trivial design decisions

  • Modify CodeAct to make it accept delegated task.
  • Implement 2 new agents, planner and executor with the same abilities as CodeAct, different system prompts, additional action parsers.

Link of any specific issues this addresses

@neubig
Copy link
Contributor

neubig commented Sep 10, 2024

Hey @ketan1741 , I'm confused. How does this relate to #3770 ?

@ketan1741
Copy link
Contributor Author

ketan1741 commented Sep 10, 2024

Hey @ketan1741 , I'm confused. How does this relate to #3770 ?

Hey, Prof. @neubig! Hoang wanted me to have a different branch if I were to make updates to our workflow implementation to make it more reliable/improve it.

@neubig
Copy link
Contributor

neubig commented Sep 10, 2024

Ah, I see. We can figure this out.

Copy link
Contributor

This PR is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale Inactive for 30 days label Oct 27, 2024
@mamoodi
Copy link
Collaborator

mamoodi commented Nov 1, 2024

Hi @ketan1741 this PR was marked as stale because it hasn't had any activity in 30 days. Did you want to close it and reopen if it became ready again? Or is it being actively worked on?

@ketan1741
Copy link
Contributor Author

Hi @ketan1741 this PR was marked as stale because it hasn't had any activity in 30 days. Did you want to close it and reopen if it became ready again? Or is it being actively worked on?

Hey! Thanks for checking in. Yes, sorry I forgot to close this PR. I am working on it on a different branch after the latest refactoring.
I will open a new one once I feel it is ready.

cc: @Srishti-Chouhan @bhaavanaa

@ketan1741 ketan1741 closed this Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Stale Inactive for 30 days
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants