coder's People
Forkers
linshaoxin-maker evdcush nashid jjhw krish240574 cdj0311 sxthunder eltociear happyman76589 dreamplayer-zhang ayeshgk liuyanmei22 fredvinegar aredhelnft evelynmitchell evafighter tecworks-devcoder's Issues
Set of instances for ablation study
Congratulations on the great results on swebench! We would like to reproduce this work. Do you have any plans to release the code and data (instance id of the small set for the ablation study)?
Code to reproduce experiments?
Wow, congratulations on the great results on SWE-Bench Lite! We would love to reproduce the results, are there plans to release the code?
Source code
Please share your source code
Plan to open-source
Hi, thanks for the nice work! Do you have a plan to release the source code of CodeR, so that people can learn more about it?
Question about manager plans and related-issue-retrieval action
Congratulations on the release and thank you for citing the AutoCodeRover paper!
The paper was a great read. After going through it, I have a couple of clarification questions:
-
The Plan D part above Figure 3 mentions that "Plan D takes a test-driven approach with a ground truth test for issues (such as 'fail-to-pass' and 'pass-to-pass' tests in SWE-bench)."
Does this mean the developer-written tests for the issue (i.e. thetest_patch
field in SWE-bench instances) were provided to CodeR? -
Section 2 mentions that "Action 18 retrieves the top-1 similar issue and its corresponding patch by description." (action 18 is
related issue retrieval
from Table 1).
This is an interesting approach! I'm curious how you defined "similarity" between issues - was this using a RAG-based approach on the issue descriptions? Besides, how did you construct the corpus of issues to retrieve from?
Thank you very much in advance for your time and assistance!
Which multi-agent framework and LLM did you use exactly?
Is this not clear from paper
Are you going to publish it?
Does PlanD use ground truth tests?
Hi, does the plan D mentioned in your paper use "fail-to-pass" tests that are actually used to evaluate the patches?
If so, this would be kind of unfair because most of the other methods do not use those.
Could you maybe specify how many instances in the paper are solved by Plan D?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.