DEV Community

Cover image for I Tried Pair Programming With Three Different AI Tools For a Month
Elsie Rainee
Elsie Rainee

Posted on

I Tried Pair Programming With Three Different AI Tools For a Month

Context matters more than raw speed

AI coding tools can write a function in seconds. The harder question is whether that function actually belongs in your codebase. Does it follow the existing architecture? Does it handle edge cases? Will the tests still pass? And when something breaks three files later, can the AI help find the real cause instead of generating another patch?

To answer those questions, I spent a month using Cursor, GitHub Copilot, and Claude Code as pair-programming tools while working through practical development tasks: writing code, debugging errors, refactoring functions, creating tests, and making changes across multiple files.

I wasn't testing which tool could produce the most code. I was testing which one could make real programming work faster without creating more work afterward.

The Short Answer

After using all three tools on real development tasks, I wouldn't call one tool the absolute winner.

Each was better at a different part of programming:

  • Cursor was strongest for interactive coding and multi-file changes inside an AI-focused editor.
  • GitHub Copilot was the most convenient for everyday coding, autocomplete, boilerplate, and smaller functions.
  • Claude Code was strongest when a task required understanding a larger codebase, debugging across files, or completing several steps from the terminal.

The biggest difference wasn't how quickly they generated code. It was how much useful context they could use before generating it.

That became the most important lesson of the entire test.

What I Actually Tested

I wanted to avoid the usual AI coding comparison where every tool gets the same simple prompt:

"Build a todo app."

That doesn't tell you much about real development.

Instead, I used tasks that resemble normal work inside an existing project.

Task 1: Add a New Function

I started with existing code and asked each tool to implement a missing function.

For example:

async function getUserById(id) {
  // implementation needed
}
Enter fullscreen mode Exit fullscreen mode

The requirement was straightforward: fetch the user, handle an unsuccessful response, validate the returned data, and return a predictable result.

This tested something basic but important:

Could the AI follow the existing project's coding style instead of inventing its own?

All three could generate a working starting point.

The difference came during cleanup.

Copilot was very good at quickly producing the first implementation. Cursor made it easier to reference related files and adapt the function to the surrounding project. Claude Code was particularly useful when I wanted it to inspect how similar functions were already implemented elsewhere before making any changes.

That distinction matters in an existing application.

Writing code from scratch is easy.

Writing code that belongs in an existing codebase is harder.

Debugging Was a Better Test

Code generation wasn't where I saw the biggest differences.

Debugging was.

I gave the tools actual errors rather than asking them to invent a solution.

A typical task looked something like this:

TypeError: Cannot read properties of undefined
at UserList.jsx:42

Instead of asking:

"Fix this error."

I provided the relevant component, API function, and data structure and asked the tool to identify the root cause.

This produced much more useful results.

GitHub Copilot

Copilot was good when the problem was close to the code I was currently editing.

If the error was caused by a missing null check or an obvious incorrect variable, it could quickly suggest the fix.

The limitation arose when the cause was elsewhere.

I sometimes had to manually provide additional files and context.

Cursor

Cursor handled these situations better when the related code was already inside the project.

I could ask it to inspect the component, API call, and related types and explain where the data shape stopped matching expectations.

That made debugging feel less like autocomplete and more like having a second pair of eyes.

Claude Code

Claude Code was particularly useful when the debugging task crossed several files.

Instead of focusing only on the line that threw the error, I could ask it to trace the data flow.

That was valuable because many real bugs aren't located where the application crashes.

The crash is often just the final symptom.

Refactoring: Where AI Can Save Time and Create It

Refactoring was another useful test.

I took working code that had become difficult to maintain and asked each tool to improve it without changing its behavior.

For example:

function calculateTotal(items) {
  let total = 0;

  for (let i = 0; i < items.length; i++) {
    if (items[i].active) {
      total += items[i].price * items[i].quantity;
    }
  }

  return total;
}
Enter fullscreen mode Exit fullscreen mode

A simple refactor is easy.

But real refactoring usually comes with constraints:

  • Don't change the API.
  • Preserve existing behavior.
  • Keep the current data structure.
  • Don't introduce another dependency.
  • Maintain test coverage.
  • Follow the project's existing conventions.

That's where the tools started behaving differently.

Copilot was excellent for smaller refactoring suggestions.

Cursor was better when I wanted to make a broader change while reviewing the affected files.

Claude Code was useful when the refactoring involved understanding how the function was used throughout the repository.

The important part: review the diff

This became a rule for me.

Never accept a large AI-generated refactor without reading the diff.

A cleaner-looking implementation isn't automatically a safer implementation.

AI can remove duplication while accidentally changing behavior.

It can also "improve" something that was intentionally written that way because of another part of the application.

Writing Tests With AI

Testing was one area where all three tools saved me time.

I could provide an existing function and ask for unit tests covering:

  • Normal input
  • Empty input
  • Invalid input
  • Missing values
  • API failures
  • Boundary conditions

The first set of generated tests was usually reasonable.

But there was an obvious problem.

AI tends to write tests based on the implementation it sees.

That can result in tests that confirm what the code currently does rather than tests that prove what the application should do.

For example, if the implementation has an incorrect default value, an AI-generated test may encode that behavior.

So I stopped asking:

"Write tests for this function."

I got better results with:

"Write tests based on the expected behavior described below. Include edge cases and failure scenarios. Do not assume the current implementation is correct."

That small change produced much more useful tests.

Multi-File Changes Changed My Opinion

The biggest difference between these tools became obvious when I stopped asking them to write individual functions.

I gave them a feature.

For example:

Add pagination to the existing user list. Keep the current API response format, add loading and error states, update the API request, preserve the existing filters, and add tests for the new behavior.

Now the AI needs to understand:

  1. Where the API request happens.
  2. Where the user list is rendered.
  3. How state is currently managed.
  4. How filters work.
  5. Where tests live.
  6. Which files need modification.
  7. Whether the existing API supports the requested behavior.

That's much closer to real software development.

Cursor

Cursor performed well when I wanted to stay inside the editor and interactively guide the changes.

I could inspect the proposed modifications and adjust the implementation as I went.

GitHub Copilot

Copilot remained useful, but I found myself having to provide more direction for larger changes.

It was excellent when I already knew what needed to happen and wanted assistance implementing it.

Claude Code

Claude Code was particularly useful when the task required repository-level investigation before implementation.

That made it valuable for larger changes where the first step wasn't writing code; it was figuring out where to change the code.

Which Tool Required the Least Correction?

This was harder to measure than lines of generated code.

I started paying attention to a more practical metric:

How much work did I have to do after the AI finished?

That included:

  • Fixing incorrect assumptions
  • Removing unnecessary code
  • Correcting APIs
  • Changing variable names
  • Adding missing error handling
  • Rewriting tests
  • Fixing regressions
  • Reverting unnecessary changes

This changed my view of productivity.

A tool that generates 200 lines in a minute isn't necessarily faster than one that generates 80 useful lines if I have to spend another 30 minutes fixing the first result.

For me, useful code was more important than generated code.

My Practical Comparison

Programming Task Best Fit Why
Inline autocomplete GitHub Copilot Fast suggestions while typing
Small functions GitHub Copilot Low friction and quick generation
Interactive refactoring Cursor Strong editor-based workflow
Multi-file editing Cursor Easier to guide and review changes
Debugging a simple error GitHub Copilot Quick contextual suggestions
Debugging across files Claude Code Better suited to repository-level investigation
Understanding an unfamiliar repository Claude Code Useful for tracing project structure
Writing unit tests All three Good starting point with human review
Large implementation tasks Cursor / Claude Code Better suited to multi-step work
Final code review Human developer AI shouldn't be the final authority

What AI Pair Programming Actually Changed

The biggest productivity improvement wasn't that I stopped programming.

I programmed differently.

Before using AI heavily, a lot of time went into:

  • Searching documentation
  • Looking up syntax
  • Writing repetitive code
  • Creating test boilerplate
  • Tracing unfamiliar functions
  • Building the first version of a solution

AI reduced much of that friction.

But another category of work became more important:

  • Reviewing generated code
  • Checking assumptions
  • Testing edge cases
  • Reading diffs
  • Writing better prompts
  • Breaking large tasks into smaller requirements

So AI didn't remove engineering work.

It shifted where I spent my time.

The Mistakes I Had to Watch For

After a month, I became much more careful about a few recurring problems.

1. AI assumes things

If the requirement isn't clear, the tool fills in the gaps.

That can mean choosing an API pattern, library, naming convention, or architecture that isn't appropriate for the project.

2. Working code can still be bad code

Something can compile, pass basic tests, and still be unnecessarily complicated.

3. Tests can give false confidence

A generated test suite isn't automatically good coverage.

4. Large changes need smaller checkpoints

I got better results when I broke large tasks into stages rather than asking for an entire feature in a single prompt.

5. Git became even more important

With AI making more changes, reviewing commits and diffs became essential.

I wanted to know exactly what changed and why.

The Pair-Programming Workflow That Worked Best for Me

The most reliable workflow was surprisingly simple.

Step 1: Explain the existing code

Give the AI the relevant files and ask it to explain the current behavior before making any changes.

Step 2: Define the requirement

State exactly what should change and what must remain unchanged.

Step 3: Ask for a plan

For larger tasks, have the AI identify which files need to be modified before writing code.

Step 4: Implement in smaller pieces

Don't unquestioningly accept a giant change.

Step 5: Review the diff

Check every meaningful modification.

Step 6: Run tests

Never treat generated code as finished simply because it looks correct.

Step 7: Ask the AI to challenge its own solution

One useful prompt was:

"Review this implementation for edge cases, regressions, unnecessary complexity, and assumptions that may be incorrect."

That often uncovered issues I hadn't noticed.

So, Which AI Pair Programmer Would I Choose?

If I were starting a project today, I wouldn't choose based only on benchmark scores or feature lists.

I'd choose based on my workflow.

  • For everyday coding and autocomplete: GitHub Copilot.
  • For an editor-centered workflow with interactive AI assistance: Cursor.
  • For repository-level debugging, investigation, and larger terminal-based tasks: Claude Code.

But there's an important qualification.

I wouldn't let any of them become the final decision-maker.

The AI can suggest the implementation.

I still decide whether the implementation is correct.

That's the difference between using AI as a pair programmer and using AI as a code generator.

Conclusion

After a month of using three different AI tools for pair programming, I came away with a much less exciting but more useful answer: AI doesn't make programming disappear; it makes certain parts of programming dramatically faster.

GitHub Copilot was excellent when I needed fast assistance while writing code. Cursor became more useful when the work involved interactive editing and multiple files. Claude Code stood out when I needed to investigate a repository, trace a problem, or work through a larger task from the terminal.

The real productivity gain came from combining AI generation with normal engineering discipline.

I still read the code.

I still review diffs.

I still run tests.

I still debug failures.

And I still make the architectural decisions.

That's the most realistic way to think about AI pair programming today. The goal isn't to have an AI write your entire application while you sit back. The goal is to remove repetitive work, shorten the distance between an idea and a working implementation, and give you another tool for thinking through difficult programming problems.

The best AI pair programmer isn't the one that writes the most code. It's the one that helps you spend more time solving engineering problems and less time fighting repetitive implementation work.

Top comments (27)

Collapse
 
andersonkevin profile image
Kevin Anderson

Really enjoyed this comparison. The point that stood out to me most was that context matters more than raw code generation speed. Your debugging and multi-file testing examples make the differences between Cursor, Copilot, and Claude Code much clearer. I also agree that reviewing diffs and testing AI-generated code are still essential. Great practical breakdown!

Collapse
 
elsie-rainee profile image
Elsie Rainee

Thank you so much! 😊 I completely agree, context ended up being one of the biggest differences between the tools. Raw code generation is impressive, but understanding the project, relationships between files, and the broader intent makes a much bigger difference in real-world development. And yes, reviewing diffs and testing are still non-negotiable!

Collapse
 
unitbuilds profile image
UnitBuilds • Edited

Just a note, that's with different AI harnesses, not different AI tools per say.

Claude is known for their efficient indexing system for large codebases, but that's a harness thing, not a model thing, if you put Claude models via an API key in a different harness, it wont act the same. That's why with CoPilot, almost all the models 'feel' identical, despite being different vendors, perfect place to see the proof, try Haiku there, vs in Claude Code.

If you're going down that line, lemme widen the horizon a bit for you, download Qoder, from Alibaba (Qwen), give it a go, I've tried Copilot, Claude, Antigravity, Cursor, Codex and I found that Qoder is simply smarter, with smarter tools. It's also the only one that offers an actually free model. The Lite model, on a $20 paid plan, is actually uncapped and it's REALLY good... I pushed around 2m+ LOC output through it and it never hit a 'fair usage' cap, it never slowed down, it never got a 'servers too busy', not a single glitch at all.

Collapse
 
elsie-rainee profile image
Elsie Rainee

That's a really important distinction, thanks for spelling it out. The "harness vs. model" point gets lost a lot, people benchmark a vendor's brand when they're actually benchmarking the scaffolding (context management, tool-calling, retrieval) built around it. The Copilot example is a great illustration since it flattens everything into feeling similar.

Appreciate the Qoder callout too. It's built on Alibaba's Qwen3-Coder model with a free plan that currently includes unlimited completions/edits plus limited chat and agent credits during its public preview, so worth noting some of that generosity may be preview-era pricing that shifts later, but definitely enough to justify trying it myself. Will give it a spin on a real repo and see how the indexing actually holds up.

Collapse
 
suraj09 profile image
Suraj Suradkar

The shift from “generated code” to “work after the AI finishes” is the metric I relate to most. A 200-line solution that creates 30 minutes of cleanup isn't productivity. Correction cost is probably a much better measure of AI-assisted development than output volume.

Collapse
 
elsie-rainee profile image
Elsie Rainee

Exactly! 🙌 I think “correction cost” is such an important way to measure AI-assisted development. Generating hundreds of lines of code means very little if you spend the next 30 minutes fixing, cleaning up, and understanding it. The best tools are the ones that reduce the total work, not just the time spent writing code. Thanks for sharing this perspective!

Collapse
 
mayur-upadhyay profile image
Mayur Upadhyay

Really liked the focus on useful code over generated code. The point about context being more important than raw generation speed really stood out. I also agree that reviewing diffs and testing AI-generated changes is essential, especially for multi-file refactors. Great practical comparison of Cursor, Copilot, and Claude Code.

Collapse
 
elsie-rainee profile image
Elsie Rainee

Thank you! 🙌 “Useful code over generated code” really sums up the biggest takeaway for me. Fast generation is great, but the real value comes from how well the tool understands the context and how much follow-up work the code creates. Especially with multi-file changes, reviewing and testing everything is still essential. Glad you enjoyed the comparison!

Collapse
 
officialmailkr profile image
오피셜메일

도구가 만든 코드 줄 수보다 “AI가 끝낸 뒤 내가 얼마나 고쳐야 했는가”를 생산성 지표로 본 점이 설득력 있습니다. 특히 구현을 보기 전에 기존 코드를 설명하게 하고, 변경 금지 조건을 적은 뒤 작은 단위로 diff와 테스트를 확인하는 7단계는 어떤 도구를 쓰더라도 재현 가능한 기준이 되겠네요.

Collapse
 
elsie-rainee profile image
Elsie Rainee

정확히 그게 핵심입니다. 생성된 코드 줄 수는 허상 지표입니다. AI가 200줄을 작성했는데 그 중 180줄을 다시 고쳐야 한다면 그건 생산성이 아니라 뒷수습입니다. "수정 전 먼저 설명하게 하기" 단계는 아마 대부분의 사람들이 가장 많이 건너뛰는 부분이고 동시에 가장 많은 문제를 일으키는 부분입니다. 이 단계는 도구가 무언가를 변경하기 전에 컨텍스트를 제대로 이해하고 있다는 것을 증명하게 만듭니다. 작은 단위로 diff를 확인하는 방식은 뼈아픈 경험에서 나온 것입니다. AI가 한 번에 대규모로 생성한 변경 사항은 제대로 검토하기가 거의 불가능합니다. 작은 단위로 나누면 실제로 코드베이스에 반영되는 내용을 직접 통제할 수 있습니다.

Collapse
 
devmonowar profile image
Monowar Hossain

I really like the focus on context rather than raw code generation speed. In real projects, generating a function is usually the easy part—the difficult part is making sure it fits the existing architecture, handles edge cases, and doesn’t create problems elsewhere.

I’ve found the same thing when working on WordPress projects and plugins: an AI can produce a working solution quickly, but understanding the existing codebase and making the right change without breaking something else is where the real value is.

The comparison between Cursor, Copilot, and Claude Code is interesting, especially the point that each tool performs better depending on the type of task. Great experiment!

Collapse
 
elsie-rainee profile image
Elsie Rainee

Appreciate that, and the WordPress parallel tracks closely with what I saw. Plugin ecosystems are a good stress test for exactly this because so much of the "correct" answer depends on conventions and hooks that aren't visible in the function you're asking for. The model can write valid PHP that ignores how the rest of the site expects to be extended. Which task types did you find each tool handled that context better or worse on?

Collapse
 
eduzsh profile image
Edu Peralta

Your debugging section is the part that matched my week. Generation quality across Cursor, Copilot, and Claude Code is closer than people admit. The gap shows up when the crash line is only a symptom three files upstream, and only the tool that will chase the data flow finds the real cause. The test prompt change is the other keeper: once I stopped asking for tests of the current implementation, the agent stopped encoding my bugs as expected behavior.

Collapse
 
elsie-rainee profile image
Elsie Rainee

Glad that part landed. It was the one section I almost cut because it felt less quantifiable than the rest, but it's the real finding. Generation is commodity at this point. Tracing is where the tools separate, because it requires the model to distrust the stack trace instead of patching the line it points to. And yeah, the test-prompt change surprised me too. "Write tests for what this should do" versus "write tests for what this does" sounds like a small wording difference and produces completely different test suites, one of which quietly certifies your bugs as spec.

Collapse
 
byteox2 profile image
Niuniu Ox

The one-month, three-tool rotation is exactly the right way to test these — most comparisons are written after a weekend. What I'd love to know: did you notice the tools' strengths changing with task type? I run a local model (Ollama) alongside a hosted assistant, and the split I landed on is local for boilerplate/test scaffolding, hosted for gnarly cross-file refactors — the local one wins on latency and not leaking code, the hosted one wins when context spans 10+ files. Also curious how you measured "better" — acceptance rate of suggestions, or time-to-working-code? Those two diverge a lot in my logs.

Collapse
 
elsie-rainee profile image
Elsie Rainee

It did, and probably more than the headline comparison suggested. Boilerplate and scaffolding were close to a wash across all three. The separation showed up on cross-file work and on anything where the "bug" was a symptom of a decision made upstream. Your local/hosted split makes sense for the same reason: latency and privacy don't care about task type, but context span does, so routing on that axis is smart. On measurement, I leaned closer to time-to-working-code than acceptance rate, mainly because acceptance rate rewards suggestions that look right in isolation, and the failures I cared about were the ones that looked right and weren't. They diverge exactly where you'd expect, anywhere the model is confidently wrong rather than visibly unsure.

Collapse
 
zira125 profile image
Zira

Useful distinction between generated code and useful code. One measurement I’d add is a small task matrix with pinned tool versions and the same repository snapshot: time to first workable patch, review/correction time, test pass rate, and reverted changes. That makes “least correction” less subjective without pretending a month-long self-test is a controlled benchmark.

For debugging across files, I’d also record how much context was supplied versus discovered by the tool. Otherwise a tool that looks better may simply have received a more complete slice of the codebase. The practical gate for me is still the diff plus behavior tests, especially for refactors where a passing test suite may encode the old bug.

Collapse
 
elsie-rainee profile image
Elsie Rainee

Fair, and I'll say it plainly: this was a self-test, not a benchmark, and I don't want to oversell "least correction" as more rigorous than it was. Your matrix is the right shape for anyone who wants to make this replicable: pinned versions, same snapshot, time-to-first-workable-patch, correction time, pass rate, reverted changes. The context-supplied-vs-discovered point is the one I'd flag as most important and least reported anywhere. A tool that autonomously greps the right three files before answering is doing something categorically different from one that only reasons over what's in the prompt, and comparisons that don't separate those two are comparing apples to a tool with a rake. Agreed on the gate too. For refactors specifically, a green test suite is only as good as whether the tests encode intended behavior or just current behavior, which is its own trap.

Collapse
 
routinekit profile image
RoutineKit

What stuck from your month is that the tool barely mattered once the handoff was wrong. On client work I started forcing a four-line sticky at the top of the file before any pair session: goal in one sentence, constraints the model must not invent, the one acceptance check, and what is explicitly out of scope.

If I skip that, every tool happily builds a different wrong thing at high confidence. If I keep it, even a weaker model stays useful because the conversation has a fence. Curious whether your worst sessions were “bad model” or “no shared brief,” and whether you ever pasted that brief back mid-session when the pair drifted.

Collapse
 
elsie-rainee profile image
Elsie Rainee

Both, honestly, but more often no shared brief than bad model. The tool would take an underspecified prompt and commit to an interpretation early, then defend it for the rest of the session. That's not a model failing, that's a model doing exactly what an unconstrained prompt asked for. Your four-line sticky is basically the fix I converged on too, just less formalized. I'd usually restate constraints and acceptance criteria in the message itself. And yes, mid-session I'd paste it back verbatim when things drifted, especially in longer agent sessions where the model had clearly stopped weighting the original goal against however many tool calls of exploration it had done since. Worth turning that sticky into an actual file you attach or pin rather than retyping it. Cheaper than re-litigating scope three turns in.

Some comments may only be visible to logged-in visitors. Sign in to view all comments.