QA Is Your Most Overlooked Competitive Advantage

By Craig Wells, Vice President of Operations, Super Evil Megacorp

Early in my career I inherited a QA process that was, to put it charitably, chaos. Builds were pushed to the testing team on an ad hoc basis. There was no stabilization cycle, no comprehensive build verification suite, just a loose collection of tickets vaguely describing what had changed and an external testing team trying to make sense of it all. Full regression runs would start, get interrupted by a new build, and have to restart from scratch. Nobody had a clear picture of what had been tested, what hadn’t, or whether the build QA was working on today was the same one they’d started yesterday.

Shipping in that environment meant declaring the build was ready before you actually knew if it was. When it wasn’t, the instability that followed consumed weeks of engineering time, required multiple emergency patches across iOS, Android, and our servers, and delayed the next release entirely. The CTO sent a studio-wide message describing player frustration as “loud.” That landed.

But what had gone wrong? The easy conclusion was that QA had missed too much. More testers. Better coverage. Faster turnaround. But that diagnosis misses the point entirely. The QA team wasn’t failing, they were absorbing the cost of a development process that had no structure. Bugs don’t appear at the end of a release cycle. They accumulate throughout one. And when there’s no structure governing how features are built, reviewed, and stabilized before they reach QA, testers inherit every problem the development process failed to catch upstream.

That experience changed how I think about QA permanently. A team that’s treated as a downstream quality gate will perform like one, absorbing problems it had no hand in creating and getting blamed for the results. The studios that get the most out of QA treat it as a strategic partner embedded in development from the start.

Principle 1: QA Is an Equal Partner in Game Development

The fix to that early situation didn’t come from adding more testers or tightening the testing process in isolation. It came from bringing QA to the table as an equal partner in solving the problem. Working together with the QA lead and the CTO, we diagnosed the root cause and addressed it structurally: four weeks of active development followed by a two week stabilization period where builds moved to staging and stayed there. The QA lead helped build a real build verification suite, established regular standups for status and triage, and drove post-mortems when bugs made it to live. The external testing spend dropped by 7x.

None of that happens if QA is treated as a downstream recipient of whatever the development team produces. The improvements came because QA had a seat at the table and a voice in how the process was structured. That’s the point. QA dysfunction is almost never a QA problem, it’s a process problem that QA is paying the price for. And the people best positioned to help fix it are the ones living inside it every day.

This is why QA should be a co-equal partner in development rather than sitting as an isolated function downstream of everyone else. Treating QA as an equal partner isn’t a philosophical nicety, it’s what makes the whole system work.

Principle 2: QA Is Your Closest Proxy to Players

Equal partnership opens doors beyond process improvements. When QA has genuine standing in the development process, they can offer something no other function in the studio can: an unbiased read on whether your game is actually working for players.

Your QA team is often the closest voice of the player you have inside the studio, playing your game every day without the baggage of having built it, and many QA professionals bring deep familiarity with the games space your product operates in. They’re not invested in the design decisions that went into a feature. They’re not attached to the art that shipped with it. They just know whether it feels good or not. That’s a valuable signal that some studios systematically ignore.

The reason is bias. QA is trained to report functional issues. Something is broken or it isn’t. That’s a clear, actionable, binary framework. Qualitative feedback, this mechanic feels clunky, this progression curve loses me around hour three, doesn’t fit that framework. So it doesn’t get reported, and if it does, it doesn’t land well.

When you try to expand QA’s role beyond functional testing, friction surfaces on both sides. QA testers often don’t feel it’s their place to weigh in on design decisions, they’ve been conditioned to stay in their lane. And when they do offer qualitative feedback, they can become frustrated when the design team doesn’t immediately act on it. On the dev side, the instinct is often to treat qualitative observations the same way they treat bug reports, something to be triaged, prioritized, and closed. That’s the wrong framework. A bug report demands a fix. A qualitative observation informs a conversation. Both sides need to understand that distinction before the dynamic can function.

QA needs explicit permission and coaching to give qualitative feedback. The wider team needs to learn how to receive it, taking it seriously without treating every observation as an action item. When it works, you have a group of people inside your walls who can tell you whether your game is landing with real players before those players ever touch it.

Principle 3: QA Needs to Be Involved in Game Development From the Very Beginning

The player proxy value that QA offers only matters if their feedback arrives early enough to act on. Many teams bring QA in once a feature is built, which is also the point at which changing anything is most expensive. By the time QA is playing a nearly finished feature, the cost of meaningful change is high and the appetite for it is low.

QA involved at the paper design or prototype stage can catch structural problems before a line of code is written. They can identify what tooling will be needed to properly test a feature, saving significant time once it reaches them. They can also flag combinatorial complexity early, features that interact with many other systems require careful testing planning, and the earlier that planning begins the better. Every hour of QA time invested upstream returns more than the same hour spent downstream.

But early involvement isn’t purely defensive. QA brings a player perspective that the rest of the development team often loses over time. They know what has resonated with players in the past, what mechanics landed and which ones confused. That accumulated knowledge is a design resource. Brought in early, QA can surface ideas and directions that the wider team wouldn’t have considered, not just catching what’s wrong, but helping shape what’s right.

AI Won't Replace QA. It Will Amplify What QA Can Do.

Everything described above is a philosophy that studios can implement today with the teams and tools they already have. AI has the potential to change how much of it they can sustain at scale.

The part of QA work that consumes the most time and offers the least strategic value is also the part most amenable to automation: functional coverage. Smoke checks. Regression testing. Build verification. Combinatorial testing across platforms. These tasks require consistency and thoroughness, not judgment.

AI agents are beginning to show the ability to handle parts of this work, running test coverage overnight, across platforms, and filing structured bug reports before the team arrives in the morning. The confidence that kind of coverage could provide in a nightly build is something a human QA team simply can’t match on its own without an enormous investment in person hours that are better spent on the work that actually requires human judgment.

At my current studio we’re in the early stages of exactly this kind of integration, starting, deliberately, with what our existing tools already give us before reaching for new ones. Automated functional tests built into our commit pipeline. AI agents running coverage on nightly builds. The goal isn’t to reduce the QA team. It’s to free them from the work that doesn’t require a human so they can focus entirely on the work that does, the partnership with the dev team, the player feedback, the early design involvement that no automated system can replicate.

QA Has Always Been a Competitive Advantage

The three principles above aren’t complicated: Treat QA as an equal partner; Listen to what they tell you about your players; Bring them in early enough that their input can actually change something. Studios that do this consistently ship better games, not because they have more testers, but because they’ve built a function that tells them the truth about their product while there’s still time to act on it.

AI won’t change that calculus. It will sharpen it. When the grunt work of functional coverage is handled by automated systems, the value of a QA team that is genuinely embedded in development, one that has the trust, the access, and the organizational standing to shape how a game gets made, only grows. The philosophy has to come first. The technology makes it more powerful.

Craig Wells, Vice President of Operations, Super Evil Megacorp

Scroll to Top