The analogy Wall uses is telling: “If you think about hiring a new employee at your average tech company, your first day on the job, they’re like, ‘Okay, here’s your laptop, here’s your email address, here are your credentials. Here’s how you sign into GitHub.’ You probably spend your first day setting that environment up.”

That same principle applies to AI agents, Wall argues. “If you expect these AI agents to be able to do the kinds of things people are doing, they’re going to need all the same tools. They’re going to need their own work environment.”

Runloop focused initially on the coding vertical based on a strategic insight about the nature of programming languages versus natural language. “Coding languages are far narrower and stricter than something like English,” Wall explained. “They have very strict syntax. They’re very pattern driven. These are things large language models (LLMs) are really good at.”

More importantly, coding offers what Wall calls “built-in verification functions.” An AI agent writing code can continuously validate its progress by running tests, compiling code or using linting tools. “Those kind of tools aren’t really available in other environments. If you’re writing an essay, I guess you could do spell check, but evaluating the relative quality of an essay while you’re partway through it — there’s not a compiler.”

This technical advantage has proven prescient. The AI code tools market has indeed emerged as one of the fastest-growing segments in enterprise AI, driven by tools like GitHub Copilot, which Microsoft reports is used by millions of developers, and OpenAI’s recently announced Codex improvements.

Inside Runloop’s cloud-based devboxes: Enterprise AI agent infrastructure

Runloop’s core product, called “devboxes,” provides isolated, cloud-based development environments where AI agents can safely execute code with full filesystem and build tool access. These environments are ephemeral — they can be spun up and torn down dynamically based on demand.

“You can spin up 1,000, use 1,000 for an hour, then maybe you’re done with some particular task,” said Wall. Then, “you don’t need 1,000, so you can tear them down.”

One example illustrates the platform’s utility. When a customer that builds AI agents to automatically write unit tests for improving code coverage detects production issues in their customers’ systems, they deploy thousands of devboxes simultaneously to analyze code repositories and generate comprehensive test suites.

“They’ll onboard a new company and say, ‘Hey, the first thing we should do is look at your code coverage everywhere, notice where it’s lacking, go write a whole ton of tests then cherry pick the most valuable ones to send to your engineers for code review,’” Wall explained.

Runloop customer success: Six-month time savings and 200% customer growth

Despite only launching billing in March and self-service signup in May, Runloop has achieved significant momentum. The company reports “a few dozen customers,” including Series A companies and major model laboratories, with customer growth exceeding 200% and revenue growth exceeding 100% since March.

“Our customers tend to be of the size and shape of people who are very early on the AI curve, and are pretty sophisticated about using AI,” Wall noted. “That right now, at least, tends to be Series A companies trying to build AI as their core competency, or some of the model labs who obviously are the most sophisticated about it.”

The impact appears substantial. Dan Robinson, CEO of Detail.dev, a Runloop customer, called the platform “killer for our business. We couldn’t have gotten to market so quickly without it. Instead of burning months building infrastructure, we’ve been able to focus on what we’re passionate about: Creating agents that crush tech debt… Runloop basically compressed our go-to-market timeline by six months.”

AI code testing and evaluation: Moving beyond simple chatbot interactions

Runloop’s second major product, Public Benchmarks, addresses another critical need: Standardized testing for AI coding agents. Traditional AI evaluation focuses on single interactions between users and language models. Runloop’s approach is fundamentally different.

“What we’re doing is judging potentially hundreds of tool uses, hundreds of LLM calls, and judging a composite or longitudinal outcome of an agent run,” Wall explained. “It’s far more longitudinal, and very importantly, it’s context rich.”

For example, when evaluating an AI agent’s ability to patch code, “you can’t evaluate the diff or the response from the LLM. You have to put it into the context of the full code base and use something like a compiler and the tests.”

This capability has attracted model laboratories as customers, who use Runloop’s evaluation infrastructure to verify model behavior and support training processes.

The AI coding tools market has attracted massive investment and attention from technology giants. Microsoft’s GitHub Copilot leads in market share, while Google recently announced new AI developer tools, and OpenAI continues advancing its Codex platform.

However, Wall sees this competition as validation rather than a threat. “I hope lots of people build AI coding bots,” he said, drawing an analogy to Databricks in the machine learning (ML) space. “Spark is open source, it’s something anyone can use… Why do people use Databricks? Well, because actually deploying and running that is pretty difficult.”

Wall anticipates the market will evolve toward domain-specific AI coding agents rather than general-purpose tools. These agents will outperform on a specific task, such as security testing, database performance optimization or specific programming frameworks.

Runloop’s revenue model and growth strategy for enterprise AI infrastructure

Runloop operates on a usage-based pricing model with a modest monthly fee plus charges based on actual compute consumption. For larger enterprise customers, the company is developing annual contracts with guaranteed minimum usage commitments.

The $7 million in funding will primarily support engineering and product development. “The incubation of an infrastructure platform is a little bit longer,” Wall noted. “We’re just now starting to really broadly go to market.”

The company’s team of 12 includes veterans from Vercel, Scale AI, Google and Stripe — experience that Wall believes is crucial for building enterprise-grade infrastructure. “These are pretty seasoned and pretty senior infrastructure people. It would be pretty difficult for every single company to go assemble a team like this to solve this problem.”

What’s next for AI coding agents and enterprise deployment platforms

As enterprises increasingly adopt AI coding tools, the infrastructure to support them becomes critical. Industry analysts project continued rapid growth, with the global AI code tools market expanding from $4.86 billion in 2023 to over $25 billion by 2030.

Wall’s vision extends beyond coding to other domains where AI agents will need sophisticated work environments. “Over time, we think we’ll probably take on other verticals,” he said, although coding remains the immediate focus due to its technical advantages for AI deployment.

The fundamental question, as Wall frames it, is practical: “If you’re a CSO or a CIO at one of these companies, and your team wants to use five agents each, how are you possibly going to onboard that and bring into your environment 25 agents?”

For Runloop, the answer lies in providing the infrastructure layer that makes AI agents as easy to deploy and manage as traditional software applications — turning the vision of digital employees from prototype to production reality.

“Everyone believes you’re going to have this digital employee base: How do you onboard them?” Wall said. “If you have a platform that these things are capable of running on, and you vetted that platform, that becomes the scalable means for people to start broadly using agents.”