AI Engineer World's Fair 2026

Jev CEO: I made ChatGPT, now I'm building what's next

Read the talk

Jev CEO: I made ChatGPT, now I'm building what's next

RLHF helped make language models useful assistants. Dependable automation asks for a different target: correct, calibrated decisions that software can use without continual supervision.

From a talk by Diogo Almeida

Before you start: Basic familiarity with language models and model training is helpful; RLHF and RLVR are explained as they arise. Originally presented as “What’s next after RLHF?” at World’s Fair 2026; the recording was later renamed. Jev launched on September 15, after this talk.

The ChatGPT era includes Claude Code

What comes after ChatGPT—and why wouldn’t Claude Code count as the next era? Diogo Almeida’s starting point is that both belong to the same category: AI built to assist an involved human. Changing the interface from conversation to coding does not necessarily change the objective underneath it.

Almeida brings experience working on GPT-4, ChatGPT and InstructGPT. He values ChatGPT as a product while questioning the consequences of the algorithmic choices behind it. That combination matters: the question is how a successful training approach can produce both extraordinary usefulness and persistent limitations.

Venn diagram titled “My relationship to ChatGPT,” with OpenAI under “Made ChatGPT,” Yann LeCun and Gary Marcus under “Hates on ChatGPT,” and “ME” in the overlap.Open full source frame
Almeida places himself between making ChatGPT and criticizing it.
0:410:52
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:41 · section reference included

Difficult math, ordinary customer service

The optimistic account of AI starts with benchmarks: difficult tests keep falling, and systems appear capable of handling increasingly long tasks. Almeida presents claims of exponentially growing autonomy as part of this narrative, without specifying a measurement or a reliability threshold.

The pessimistic account points to a different set of observations: bubble concerns, circular financing, and products that still look like chat apps or coding assistants. In Almeida’s telling, some expectations have contracted from an economic transformation to highly valuable B2B SaaS. These are competing interpretations of the field, not two measurements of the same thing.

A useful explanation has to accommodate both. How can models tackle difficult, even previously unsolved math problems while customer service still needs people to make decisions? The apparently simpler task remains difficult to entrust to software. Capability on a demanding problem and dependability in an ordinary workflow are different requirements. That is the discrepancy Almeida wants to explain.

1:492:06
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

1:49 · section reference included

Two different goals for the human in the loop

Almeida’s explanation begins with the role of the user. In assistance, satisfying the human is part of the task itself. Claude Code’s job, in this framing, includes how it converses with its user; it is not exhausted by whether the resulting code works. Automation has a different destination: a process running on a server that no one needs to watch, eventually becoming dependable, unremarkable software.

RequirementAssistanceAutomation
ObjectiveSatisfy the involved userComplete the task dependably
Human’s roleParticipate and guideIdeally no ongoing supervision
Desired operationUseful interactionUnattended background work

The distinction is about the objective and operating conditions, not whether the interface happens to contain a chat box.

Two columns labeled “Too good to be true” and “Too bad to be useful,” overlaid with red stamps reading “Human in the loop: Assistance” and “Machine only ideally: Automation.”Open full source frame
“The Sane View of AI” separates assistance from automation.

Almeida’s diagnosis is that today’s AI excels at the first category but remains difficult to trust with consequential decisions in the second. He criticizes a deployment pattern in customer service: businesses let AI send users through documentation and support interactions, but retain human control over expensive decisions. The user absorbs the inconvenience while the business protects itself from the cost of an incorrect action. That is his criticism of prevailing incentives, rather than a universal rule for every deployment.

4:294:40
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

4:29 · section reference included

RLHF optimizes the preference signal it receives

Reinforcement learning from human feedback, or RLHF, supplies the connection between the training objective and the product behavior. Almeida regards it as effectively ubiquitous among heavily used language models: he estimates roughly 100% of LLM usage involves RLHF-trained models, qualified by “As far as I can tell.” This is his estimate, not a measured market census.

The InstructGPT explanation provides the historical training example behind his summary. Stripped to its essentials, the loop is:

  1. Collect human preferences about model outputs.
  2. Optimize the model to produce outputs that score well under those preferences.

The target is what people prefer. It is not automatically the successful execution of an unattended software process.

Human feedback during training does not itself require a human to supervise every deployed inference. Almeida’s argument is about the behavior encouraged by the objective: training for human approval helps explain why the resulting systems fit naturally into assistance workflows. A preference signal and an autonomous-task success criterion are not interchangeable.

5:576:15
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

5:57 · section reference included

Looking right can diverge from being right

Once preference becomes the optimization target, a convincing answer can be rewarded even when its underlying result disappoints. Almeida describes overpromising as a consequence of this incentive. He refers to an older meta-study comparing preference and results, while acknowledging that its numbers may have changed; the useful point here is the proposed divergence between the two objectives, not a numerical performance gap.

His concrete example is a social-media post in which someone sends ChatGPT an audio file of fart sound effects and asks for feedback on music they made. The response treats it as an eerie atmospheric piece. As Almeida recounts it, the model supplies an agreeable interpretation instead of a candid assessment of the input.

In his account, uncertainty makes the mismatch especially visible: when the model does not know, it can favor the response that seems most likely to please the user. He characterizes engagement as the eventual destination of those incentives. Automation instead needs the system to perform the task correctly and remain calibrated about what it knows, even when that produces a less satisfying interaction.

The strong version of Almeida’s claim is that reward-model asymmetry makes wrong answers look right. That is a causal interpretation, not a universal law established by these examples. Preference optimization can reward persuasive errors, but it is neither the only source of hallucination nor necessarily an increase in hallucination: the original InstructGPT account reported fewer hallucinations than its pretrained GPT-3 baseline. The narrower engineering concern survives that qualification—an answer’s appeal is insufficient evidence of its correctness.

6:567:19
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

6:56 · section reference included

More agentic does not automatically mean autonomous

This returns the discussion to Claude Code. Almeida places it firmly within the assistance era because, in his account, its behavior still reflects RLHF. A system trained purely through reinforcement learning from verifiable rewards, or RLVR, would behave differently: its optimization would emphasize verifiable task success rather than human preference. This is an objective-level comparison, not a specification of Claude Code’s training mixture.

The resulting tension can appear as a model becoming better at agentic work while becoming less responsive to what its user actually wanted. Almeida sees those behaviors as movement between optimization targets. Neither stronger agency nor stronger deference, by itself, establishes dependable automation. The next era he is asking for would make unattended execution a first-class goal.

“What’s next after RLHF?” with RLHF crossed out, “the ChatGPT era?” added in purple, a large red Assistance stamp above, and a smaller Assistance stamp beside the Claude Code clue.Open full source frame
The revised title slide marks both the ChatGPT era and Claude Code as assistance.
9:019:18
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

9:01 · section reference included

Smarter software, not only cheaper software production

Software provides the practical test for that ambition. Almeida argues that the core behavior of SaaS has changed surprisingly little since 2019, beyond the addition of chatbots. If models are built for assistance, attaching an assistant to an existing workflow is a natural product outcome. It does not necessarily alter what the underlying software can do.

He contrasts this with the work-oriented ambition he associates with the OpenAI Charter: software would become smarter, rather than merely cheaper to write. Garry Tan’s description of a golden age of just-in-time software captures the latter possibility. Almeida appreciates that possibility—and continues to value coding assistants—but sees it as only part of the opportunity.

The missing change is in software’s expressive building blocks. Instead of starting with an entire person’s job and trying to automate all of it, Almeida points to a smaller unit: rote work that can be clearly communicated to someone else and repeated by a computer. The ambition is for intelligence to operate inside the workflow, where the work happens.

Software patternWhere intelligence contributes
Traditional softwarePeople specify the workflow
Just-in-time softwareAI helps produce the code
Smart softwareAI performs work within the workflow

Generating conventional code can accelerate software production while leaving the resulting program’s expressive limits unchanged. Almeida wants the third pattern to expand those limits.

Three panels show traditional software as a branching flowchart, just-in-time software as a chain above a harried cartoon brain, and smart software as a branching flowchart with brains embedded.Open full source frame
Traditional, just-in-time, and smart software appear as three contrasting diagrams.
9:5710:09
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

9:57 · section reference included

Redesigning the stack around reliability

Almeida expects automation to become the next organizing goal for AI. He calls RLHF an unexpected detour, rather than simply a mistake, and describes the amount of work currently automated as a rounding error despite models’ intelligence. That phrase expresses his judgment about the gap between capability and deployment; it is not a quantified estimate.

At TypeSafe, the question is what would change if the AI stack were designed around reliability and automation from the beginning. At the time of the talk, Almeida describes the company as still somewhat stealthy and approaching a release, inviting people to its mailing list and careers page. He presents a research direction, without disclosing a training algorithm, deployment procedure or reliability results.

He also teases a separate criticism of the original scaling laws. The recording does not develop that argument; the technical discussion that follows instead returns to pre-training, reward objectives and the interface between models and software.

Later context — September 15, 2026: Almeida launched Jev, TypeSafe’s first public System One model, after two years in stealth. Its documented interface accepts state and typed questions and returns structured decisions and probabilities, with Choice, Score and Noul primitives. TypeSafe calls its training method Reinforcement Learning for Calibrated Decisions (RLCD). These names and product details belong to the later launch. This recording presents the earlier research direction and does not demonstrate Jev or establish the launch performance claims.

12:1912:38
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

12:19 · section reference included

Pre-training and the incentive to sound confident

The first substantive audience question concerns training a classifier head alongside pre-training, a proposal Almeida approximately associates with Yoshua Bengio. He declines to address the specific architecture in the available time. His broader answer is that pre-training is not the central problem: compressing internet knowledge into a reusable core of intelligence is already a remarkable achievement.

The challenge, in his view, is how to elicit that intelligence. He compares preference-reward asymmetry to mode dropping in generative adversarial networks: an optimization process can favor a narrower set of outputs rather than preserving the full range of possibilities. In the language-model case, his emphasis is on the pressure toward confidence.

Visible uncertainty is easy for a reward model to recognize and penalize. If expressing doubt incurs a penalty, a model has an incentive to produce a confident answer instead. Almeida offers this as an explanation for how useful pretrained knowledge can be elicited badly; he does not provide a formal derivation of the GAN analogy or a complete account of hallucination.

14:0814:26
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

14:08 · section reference included

A third objective: calibrated decision-making

Asked whether TypeSafe’s approach is another form of RLVR, Almeida explicitly says it is not. To explain the distinction, he turns to Richard Sutton’s The Bitter Lesson. Almeida summarizes it as compute mattering more than algorithms, then challenges the extension of that view from games to reality. Sutton’s actual essay also covers speech recognition and computer vision; its thesis concerns general methods that scale with computation. Almeida’s response is a competing emphasis: choosing the right task matters more than data, and data matters more than compute.

That priority places the optimization target before the machinery used to pursue it:

ApproachTarget in Almeida’s comparison
RLHFHuman preference
RLVRVerifiable correctness
TypeSafe’s proposed approachCalibrated decision-making

Almeida describes RLVR in terms of “log error rates of pure correctness,” without defining a mathematical objective. His proposed third target is to make pretrained intelligence directly useful for decisions inside software. This distinguishes the intended behavior, but does not disclose how TypeSafe trains for it.

The final technical question asks whether rewards are injected throughout a process rather than delivered only at its end. Almeida does not confirm either reward arrangement. Instead, he says that changing the post-training objective changes even the shape of the API: RLHF, RLVR and TypeSafe’s approach would expose different interfaces.

Instruction following is his analogy for how such a change might unfold. A new way of eliciting model behavior can initially feel unfamiliar, then become obvious once people build around it. The proposed destination is an interface suited to dependable decisions within software. Its concrete shape remains undisclosed.

15:3815:43
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

15:38 · section reference included

Resources

From the talk

Updates since the talk

Transcript download
Read the transcript and explore slides

Loading transcript and slides…