---
title: Why not build an AI CEO using LLMs?
slug: just-pdf-testing/why-not-build-an-ai-ceo-using-llms
createdAt: 2026-10-20T09:31:32.605Z
---

### Why not build an AI CEO using LLMs?

Can LLMs be used to create an AI CEO? There are significant practical challenges that make the task effectively impossible, as they would amplify many of LLMs’ worst properties.

- **Enterprise Data -&#x20;**&#x41;t its simplest, the key challenge is the structure and properties of enterprise data. Enterprises guard their data both due to legal obligations around sensitive information, and to maintain a competitive advantage. Consequently, the internet does not contain vast amounts of SAP ERP or Salesforce CRM instances with detailed operating procedures or the schemas linking the tables of various structured databases. Modern LLMs which are mainly trained on Reddit and the internet are truly operating out of domain and in uncharted waters when it comes to enterprise. Furthermore, the business environment changes rapidly and without warning and a CEO must be able to adapt and weather the storm – this fast and continual learning from limited data is something that today’s LLMs are incapable of.
- **Causal knowledge -&#x20;**&#x49;n fact, this difficulty isn’t a mere engineering challenge. Once we start getting further from the training data, we start running into serious problems at the theory level. Robustly performing in a shifting domain (such as business) requires causal knowledge. Learning causal knowledge from a blank slate requires intervention: the ability to take actions and observe the results. In practice, LLMs only train from intervention in the final stage of their training pipeline: Reinforcement Learning from Human Feedback (RLHF) and from Verifiable Rewards (RLVR).

  RLHF was designed for both correctness and alignment, rewarding the model for outputs that satisfy humans and training the model to seek these rewards. To ensure that models learn the correct things, these annotations require expert knowledge – and while there will always be fresh University graduates looking to make some extra cash, competent CEOs value their time immensely and are compensated accordingly. Producing datasets of CEO preference data is not economically feasible – and no one else is qualified for the job.

  In contrast, RLVR empowers the training process to directly allow models to learn from large amounts of experience. To train effective reasoning, models need this experience to connect how their reasoning leads to correct or incorrect results. RLVR enables this by giving the model a task that can be easily checked as correct or incorrect (e.g., solving a math problem), and then rewarding the model only when its thinking leads to the correct answer. This works very well for mathematics and coding tasks where executing the solution in the environment is cheap and easy. This is not however feasible for business: we can’t execute our AI CEO’s decisions and reward it based on how results unfold – this would be impractically slow, confounded by external factors such as market conditions, and ruinously expensive.
- **Inapplicable Scaling laws -&#x20;**&#x41;t very significant expense, small datasets for a specific enterprise could be created – but scaling laws would hamper its performance. Less training data means training a smaller model, and as models get smaller the performance decreases. These issues cannot be practically overcome at the scale required to train modern LLMs.
  To give an example, significant recent work has shown that model size significantly impacts ability to reason about uncertainty – a major issue for the AI CEO. Researchers at Meta and the University of Maryland found that smaller models such as gpt-4.1-mini, Llama-3.3-70B, and DeepSeek-R1-Distill-Qwen-7B all struggled with sampling from conditional probabilities, and that performance declined both as the models size decreased, and as the complexity of the task (and correspondingly the length of the context) increased. Relatedly, researchers at Apple found that similar LLMs struggled to estimate their own uncertainty when executing instruction following tasks – a problem as competent AI CEO must be able to gauge their confidence in the correctness of their plan of action. This is exacerbated by LLMs limited ability to plan; even on relatively simple tasks such as travel planning, reasoning models such as O1 can score as low as 58% – small models such as Llama 8B barely reach 12% accuracy, and can’t pass 15% even with chain of thought, self-consistency, or tree of thought methods for test-time scaling.
- **Hallucinations -&#x20;**&#x46;ailing to get the right answer is not the worst case scenario – worse than a wrong answer is a misleading one. Hallucination, the generation of answers that contain factual errors or logical leaps while being superficially plausible, is one of the significant barriers to LLM adoption in high-risk enterprise domains such as finance, healthcare and robotics. An LLM powered AI CEO, responsible for the livelihoods of thousands of employees, is a non-starter for these enterprises. Research on information answering tasks has found increased hallucination rates with smaller models, the hallucination rate sometimes doubling with smaller model variants; other work has found similar findings on hallucination rates in long-form question answering.

### How hard is it for AI to run a business?

![](https://dkr5ukfddrfw9.cloudfront.net/web/blog-media/building-the-foundations-of-an-ai-ceo/games-resized.jpg)

Let’s consider a simple business that’s easy to quantify. In *Roller Coaster Tycoon&#x20;*(RCT) the player takes the role of a CEO and manages an amusement park business where they construct rides, hire staff, market their offering, and generally oversee their park operations. Now let’s compare this to some landmark challenges in the history of AI research: Chess, Go, Pacman\*, Montezuma’s Revenge, Dota2, and the International Math Olympiad.

Historic AI breakthroughs share one critical trait: they were solved with oceans of precise, domain-specific data.

- Chess & Go: Millions of exact game states and moves.
- Dota 2: Over 180 years of simulated gameplay.
- Math Olympiad: Trained on the sum of human mathematical knowledge via the internet, plus curated proofs.

However, RCT presents itself as a much more challenging environment compared to every other benchmark listed above due to the following factors

- **Test time Generalization -** Every AI success story above depended on exhaustive examples of how to act step by step. Business cannot afford this luxury: it is impossible to collect centuries of granular decisions. The internet can provide high-level advice, but not centuries of second-by-second playthroughs of RCT – and forget about sensitive, real-world enterprise data. This creates a profound need for generalization: going from broad common-sense knowledge to low-level actions without relying on massive historical datasets.
- **The Nature of the Goal -** Another difference between RCT and the rest of the games: business objectives are completely open-ended. Maximizing profit is not a finish line, it’s a moving horizon. There’s no provably correct strategy, no “checkmate” moment. Contrast this with a chess win, a solved proof, or a perfect Pac-Man run. Those tasks end. Businesses do not.
- **The Imperative of Continuous Learning -** Because data is scarce and the optimality is unknowable, businesses must learn continuously via focus groups, pilot projects, A/B tests, and applied research. But even the thousands of samples needed for fine-tuning a LLM are impractical. Only a few companies can sustain thousands of pilot projects. We need systems that learn from tens of samples, leveraging prior knowledge to choose what to test. In RCT terms: what happens when we unlock a new ride? There’s no vast dataset on how to price, place, and staff it. At best, there’s general advice—often wrong, incomplete, or blind to better ideas. Businesses experiment because improvement is survival.
- **The Long Horizon -** Unlike games or proofs, businesses are built to keep going. The Hudson’s Bay Company operated for 355 years, pivoting from the fur trade to consumer retail. The Hotel Krone in Switzerland predates the industrial revolution, housing guests since 1418. And Japan’s Kongō Gumi has thrived for over 1,400 years. A business must outlive its founders, adapting across centuries. There is no “game over.”
- **The Uncertainty Factor -** Business environments are unpredictable. Rides break down, guests fluctuate, weather shifts. Risk estimation becomes essential, a task that humbled Nobel laureates at Long-Term Capital Management. Compare this to deterministic domains: bishops never start moving horizontally, each proof step is right or wrong, and Pac-Man never changes its scoring system.

Compared to other gaming environments introduced before, running a business demands has a unique set of demands that AI must deliver :

- Generalization from sparse, heterogeneous data
- Open-ended optimization without clear verification
- Intelligent, low-cost experimentation
- Adaptation across decades in uncertain environments

The table below summarizes how RCT business is a much more complex gaming environment compared to every other previous landmark where AI achieved comparable performance compared to humans or beat them.

![](https://dkr5ukfddrfw9.cloudfront.net/web/blog-media/building-the-foundations-of-an-ai-ceo/rct-comparision-table-1.jpg)

\*Note: The previous startup of the Skyfall founding team invented a reinforcement learning based Divide and conquer algorithm to master the Ms-Pacman game score of 999,990.

### Introducing MAPS - towards running a real world enterprise

Can current SOTA AI systems meet the hurdles mentioned in the previous section? Can AI systems help build enterprises that can last centuries?

To answer this question, we built Mini Amusement Parks (MAPs): a benchmark inspired by *Roller Coaster Tycoon* and playable now here.&#x20;

MAPs isn’t just a game. It’s a stress test for the future of AI:

- Can AI pursue an open-ended goal, like profit?
- Can AI make long-term plans under uncertainty?
- Can AI learn fast in an interactive world?

In MAPs, you start with nothing but an entrance, an exit, and a blank canvas. With over 100 turns, you can design, build, and manage your park - buy rides, hire staff, and invest in research to unlock new tiers of attractions. Every decision matters.

But why does MAPs matter? Because MAPs is operating a business in miniature. If AI can handle the complexity of real-world enterprises, then AI can master MAPs.

![](https://dkr5ukfddrfw9.cloudfront.net/web/blog-media/building-the-foundations-of-an-ai-ceo/game-image-2.png)

Human MAPs gameplay involves a number of staff (including janitors, mechanics, clowns, stockers, vendors and more), as well as a large variety of researched rides and stores
