AI Engineer World's Fair 2025
The New Lean Startup
About this talk
Oleve co-founder Sid Bendre explains how a four-person team built a profitable consumer-software portfolio, describing Quizard AI and Unstuck AI, early product distribution, generalist hiring, KPI ownership, and product-engineer accountability. He details using LaunchDarkly to route LLM traffic around provider rate limits, recover from third-party failures, and run interface or paywall experiments without deployments, then outlines AI-augmented operations and briefly previews a separate TRELLIS presentation.
Chapters
- 0:00Oleve and the tiny-team startup model
- 1:17Quizard AI, Codex, and Unstuck AI growth
- 3:20Lean operating principles, hiring, and KPI ownership
- 5:48LaunchDarkly for LLM routing, resilience, and experiments
- 7:46Product ownership and AI-augmented operating models
- 12:44One-person companies and the TRELLIS presentation preview
Talk transcript
- 0:00
[upbeat music] I'm Sid. I'm one of the co-founders of Oleve, and this is the new lean startup.
- 0:21
We've been seeing a fundamental shift in how successful companies are being built. More and more companies are getting smaller, rounds are getting delayed, and profitability is being attained earlier than ever in their lifetime.
- 0:32
A lot of this is being driven mainly by the advent of AI tooling. These companies are generating millions of ARR with teams smaller than most startups' engineering departments. The age of bloated teams and endless hiring rounds is over.
- 0:46
Welcome to the era of tiny teams. First, a bit of background on Oleve. We're building a family of iconic consumer software products that we hope will enable people to live better, more fulfilling and productive lives.
- 1:00
We are a tiny team that scaled to-- scaled a portfolio of virally successful products to six million dollars in ARR profitably and have generated over half a billion views across social media, achieving this with a tiny team of just four.
- 1:12
We're based out of New York City, and here's a brief history on us.
- 1:17
On the 26th of January in twenty twenty-three, we launched a Quizard AI mobile app. We launched it with a TikTok video that went viral overnight and generated a million views that turned into ten thousand users in less than thirty hours.
- 1:29
We actually started scaling with no LLM costs. This is because back then we had the initial Codex model launch, which was in beta preview. Funny enough, we were cycling, uh, between ten different accounts from our friends, um, just so that we could, uh, prompt engineer, uh, or generate these AI outputs.
- 1:45
Interestingly enough, Codex, even though it was meant for-- as a coding model, could be prompt engineered for any open domain conversation. As you all may know, it ended up being sunset for abuse.
- 1:56
We ended up getting a lot of-- We ended up getting reached out directly by OpenAI on a few of our different accounts that we were cycling through as being one of the top model users, um, for the Codex model at the time.
- 2:07
My co-founders and I then graduated, and then we moved to New York City, um, the fall of twenty twenty-three, where we started our back-to-school campaign. Which was a series of, um, man-on-the-street videos across different, uh, prestigious colleges in the US.
- 2:21
This is when we hit our first million dollars in ARR and also achieved profitability within the first nine months of operating.
- 2:28
We then even had another successful campaign in the spring of twenty twenty-four that got us all the way to number six in the charts of education alongside giants like Duolingo, Photomath, and, uh, Golf.
- 2:41
We then took all our learnings in the spring of twenty-four and doubled down on a new product, Unstuck AI, a study companion tool for students. We were able to get to a million users in under nine weeks and generated over a quarter billion views across socials in a month.
- 2:56
A, a few weeks ago, we were able to get both products in the top ten in the education charts. Unstuck went all the way up to number three in the education charts, right under Golf and Duolingo.
- 3:06
We've now also launched in stealth our third product, which is our first product outside the education domain. It took three weeks to build thanks to all the blueprints that we've built in advance, we'll speak more on this later, and have already reached a thousand plus users.
- 3:20
By the way, it's already profitable. Our lean playbook boils down to three key pillars: operating principles that lay the foundation of leanness, org-organizational structure that set up the systems for this leanness, and AI tooling augmentation, which optimizes scaling.
- 3:38
Let me start with operating principles, which I believe is the main bedrock for why we're so lean.
- 3:44
It starts with hiring. We either hire right or not at all. We only hire 10Xer generals that have multiple complementary spikes in, uh, similar fields. So for example, our product engineers are full stack developers, great product thinkers, and really good at fundamentals of computer network, for example.
- 4:01
We also have marketers who can code, we have designers who can build, and, uh, the likes. We try to aim for people whose complementary spikes can shape and drive 10X outputs within the team.
- 4:12
The second key principle is profit first mentality. We are relentless about prioritizing profits because profit is power and profit is focus. Profit gives us a clear mechanism to make all our decisions and guide a North Star for the company.
- 4:26
This leads to our third principle. Does this move your KPI? Everyone in the company owns a KPI. KPI alignment removes micromanagement bullshit because everyone is focused on moving their metric week over week.
- 4:40
This also means decisions must be validated against this KPI.
- 4:45
Our fourth principle is continuous process refinement. For any repeating process, we always ask, "How would we do this better? Is there any way we can improve? What was wrong about this run that we-- th-this previous run?"
- 4:57
We view failures in the company and issues in the company as systems failures, which lets us set up a feedback loop for improving ourselves and improving the processes that we use, both on an operational standpoint, but also a technical standpoint.
- 5:10
The fifth pillar is super tools. We're pretty lazy, so we like to consolidate a lot of our workflows onto one platform if we can, and that ends up being-- meaning that we have to reinvent the ways we use old tools.
- 5:22
More on this in a bit. And the last principle I'd emphasize is don't learn it twice. We believe in building compounding benefits by investing in technical playbooks and operational blueprints.
- 5:34
This allows us to compound our benefits or compound our learning so that the benefits can be used across new products. This is exactly how we were able to hit a million users on Unstuck within nine weeks, taking everything we learned over a year and a half on Quizard.
- 5:48
More on the super tools concept. For example, one of our super tools is LaunchDarkly. The intended use case of LaunchDarkly is a feature management platform that helps software teams control and release features safely and quickly.
- 6:00
Here are some of our extended use cases.
- 6:03
We use LaunchDarkly as a manual traffic load balancer. Specifically, we, we put LaunchDarkly in between all our LLM calls so that we can reroute traffic to different LLM providers based on, uh, hitting rate limits, different strategic, uh, initiatives or whatever.
- 6:16
It just gives us an on-the-fly mechanism for choosing where our traffic goes and allows us to split things within rate limits. This was especially important in the early days when rate limits were really tight and also, um, it was hard to...
- 6:28
Yeah, rate limits were really tight and it was hard to get, um, quotas increased on individual endpoints. Specifically, I'm talking about Azure OpenAI.
- 6:36
The second extended use case is on-the-fly infrastructure changes. For us, this looks like how on Unstuck, which takes in a lot of files to ingest. For specific file formats, we have a lot of waterfall ingestion processes.
- 6:49
What I mean by that is we depend on a lot of third-party services that can be reliable. By using LaunchDarkly, we're able to change the prioritization of these processes on-the-fly, so that if one of these third-party re- third-party services goes down, we're able to reor- organize the service on-the-fly to make sure it's up and running and available
- 7:05
to our users worldwide. The third extended use case is UI modifications and paywall, paywall experiments without having code pushes. We have built an experimentation layer around LaunchDarkly, which allows us to run and spin up experiments without needing to make a code push.
- 7:25
The third-- Uh, sorry. The second pillar that guides our leanness is our organizational structure, especially in our organ... Uh, especially in our engineering org, in the way we hire and that we organize our engineers.
- 7:35
For this, we look to Palantir, who successfully scaled across multiple market segments. We believe that we're building the consumer version of Palantir with our harvester and cultivator model. Let me explain this.
- 7:46
For harvesters, these are product engineers similar to the Palantir Deltas or the forward deploy software engineers that own and live and die by their products. They're living in the metrics, working on AB experiments, building features end-to-end, and working with the marketing team and effectively owning the entire product's existence.
- 8:03
Harvesters are people who build products that people actually want and pay for.
- 8:08
Then we have the cultivators. Cultivators are AI software engineers whose main goal is building the company's agentic operating system. They're pioneering automation across different business units, including marketing, design, product, with the idea of expanding infrastructure that affects all the users everywhere and helps us win in every market.
- 8:26
Cultivators are creating the foundation that let us ship and scale faster in any market.
- 8:32
And finally, the last pillar is AI-driven and AI and tool augmentation. One important note in thinking about this is when we think about hiring, we like to think of tool use as being something that will allow a ten Xer to become a hundred Xer, as opposed to the contrast, which is using tools to fill gaps and augment
- 8:52
the shortcomings of someone who's not at the standard that we like to hire for.
- 8:58
With that being said, we use a slew of products for our day-to-day task automation, for things like scriptwriting, campaign analysis, operations, code generation, and communications. Effectively, by paying for a bunch of services, we have augmented and enabled everyone to have their own chief of staff within the company.
- 9:16
Now back to the blueprints. One more thing is we believe heavily in compounding benefits and reinvesting in blueprints. This includes things like code-complete templates, which build in all the learnings that we've learned over two and a half years of scaling products with virality in mind, reusable internal libraries and modules that govern our core, um, services that we
- 9:35
use, like our LLM providers, and shared infrastructure that we use across applications, such as our notification system or the experimentation layer that I talked about earlier. Being in consumer, con- experimentation is kind of the backbone of everything we do, and that's why it is always built out as a first layer to every new product that we launch.
- 9:52
But while blueprints give us a deterministic leverage and compounding effects, what happens when these blueprints can be executed on demand by systems that can learn and adapt and coordinate faster than real teams?
- 10:04
At Oleve, we're thinking about taking this further and how AI can augment the future of our work, and this is devised into mul- three specific stages. The first stage is human-led tooling.
- 10:16
We build specialized tooling that sits and is embedded into the workflows of our different teams across marketing, product, and design. This includes things like internal dashboards, scraping tools, and prompt chained agents.
- 10:25
The whole idea is we are trying to augment the day-to-day task of anyone on our team.
- 10:31
Stage two of this automation includes workflow automation, where we actually take off entire processes from people on the team, i.e., we have now consolidated on the individual tools that we built them to augment their workflows to now take over the entire workflows.
- 10:44
This frees up bandwidth on their end to take on more interesting tasks or, or take, take on more high-leverage opportunities within the company. The third stage of all this is consolidating all the workflows that we've built under one autonomous decision-making system, i.e., an orchestration of multiple agents working together to serve the role of an ent- of one
- 11:05
new employee. Part of the goal with Oleve is to build a company where we hire people for their strategic insight, their talent, and their taste, but run the entire company on a bunch of agents.
- 11:17
We've already started this. To-- For example, we've started building platforms that drive our market research, so that we can find out lucrative markets to launch our new product into, as well as our acquisition process as we start to acquire new apps and scale the company.
- 11:30
This includes things like agents that are scanning the markets consistently and daily for lucrative opportunities, um, categories that are doing super well, and trends in the market, as well as scoring acquisition targets for strategic fit.
- 11:43
We've also started scaling our and augmenting our growth systems. The same imp- principles apply in terms of leveraging tools and AI. We are trying to automate our virality engine.
- 11:51
This includes mon-monitoring content, having on-the-fly feedback loops be kicked off when we have certain events being triggered, and also dealing with relationships as we work with creators and influencers and such.
- 12:04
But we think we can take this further. We imagine a world where we can have one strategic person sit on top of an army of specialized agents. Instead of managing people, it becomes a, it becomes a game of commanding capability.
- 12:17
They set the objective, the agents execute, and the system improves over time. But what we really want to build is a larger future, where we can have not just one person running a team, but one person running an entire product org, commanding a clu-- commanding multiple clusters of agents that serve different business units.
- 12:35
We see a world where we can have people run entire portfolios of apps themselves just by leveraging the systems that we build and automate over time. This is effectively our vision.
- 12:44
We're building a portfolio of one person billion-dollar companies. As a quick aside, before I wrap up here, I will be talking tomorrow about TRELLIS, which i-- which stands for Targeted Refinement of Emergent LLM Intelligence Through Structured Segmentation.
- 12:58
It is a framework that I came up with for scaling reliable A-AI user experiences to five million users, designed specifically around our virality engine, i.e., it is built for systems where you intend to go viral as your main go-to-market.
- 13:11
This will be part of the Testing the Untestable talk tomorrow at two twenty p.m. in the Soma room.
- 13:17
Thank you for listening. [audience clapping] [upbeat music]