AI Engineer World's Fair 2024
Hypermode Launch
About this talk
Kevin Van Gundy introduces Hypermode, drawing on his experience at Vercel to argue that rapid iteration and incremental adoption matter more than committing early to rigid architectures. He presents Hypermode as an AI runtime and surrounding developer tools that integrate models and data, support interchangeable models and inference observability, provide editor typeahead, and streamline retrieval-augmented generation through integrated embedding and search. He closes by inviting attendees to a practical workshop covering natural-language search, intelligent sorting, and outlier detection.
Chapters
- 0:00Lessons from Vercel: rapid iteration and incremental adoption
- 1:26Reducing AI friction with an observable, model-flexible runtime
- 2:56Developer experience and integrated RAG embedding and search
- 4:06Workshop invitation, practical AI applications, and credits
Talk transcript
- 0:00
[on hold music] Before Hypermode, I worked at Vercel.
- 0:16
We had an office down the street above a pizzeria, and we had three big problems. One, we were losing to other JavaScript frameworks. Two, we were losing badly to other hosting providers.
- 0:29
And three, I was losing to my diet of exclusively pepperoni pizza. [laughing]
- 0:35
Eventually, we started to win, not because we were smart or we knew all the right answers, but because we built this core competency of iterating really, really, really quickly.
- 0:46
We didn't know the optimum strategy, but we figured if we just tried more things faster than everyone else, we'd eventually be able to adapt and figure out the right products and strategies to figure out what the market wanted.
- 0:58
Iteration is the compound interest of software. Keep doing it long enough and eventually really good stuff starts to happen.
- 1:05
Because we tried a lot of things really quickly, we eventually figured out two things. One, developers wanna incrementally adopt new technologies. And two, they don't wanna commit to architectural patterns before they know how their application's actually gonna work.
- 1:22
But iteration can't happen if you're afraid of getting it wrong.
- 1:26
The same thing that has held back web is also holding back AI. And if I'm honest, there are even more things for us to get wrong about GenAI. When I think about it, I'm grossly overwhelmed.
- 1:37
What's the right hardware? What's the right w- model? What's the right prompt? How do I integrate? How do I monitor? How do I improve? Everyone here knows a horror story of someone with a runaway bill, a hallucinating chatbot, a project that took months and months and never delivered any value.
- 1:54
And in the end, we need to build systems that de-risk getting it wrong
- 1:59
because we are going to get it wrong a lot.
- 2:03
Picking the wrong model doesn't matter if there's no friction to switching it out. Integration is simple when your classical systems and your AI systems use the same APIs. You can fearlessly make changes to prompts, strategies, data mixes if you can trace that inference step by step by step.
- 2:19
At Hypermode, we care deeply about making AI approachable. Everyone here should be able to put AI in their apps without specialized skills.
- 2:29
At its core, Hypermode is a runtime. It allows you to easily integrate models and data into AI functions.
- 2:36
We then surround that runtime with a bunch of tools that make it easy for you to e- to rapidly iterate and observe those AI functions in prod. We make it easy to get started, incrementally adopt AI as appropriate, and then as your team develops those skills, reimagine those applications as AI-native.
- 2:56
First and foremost, we wanted to make the developer experience of developing with AI a lot less terrible.
- 3:02
When it comes to adding a new model to your service, you probably don't wanna read a bunch of pages of docs to figure out the temperature's on a zero to two rather than a zero to one or a one to ten.
- 3:12
With Hypermode, we provide you typeahead in your favorite code editor right out of the box. No SDKs, nothing to download.
- 3:19
Then when you do ship to prod, we give you strong defaults just to get started. Or if you have your own stack, bring it along. In either case, we'll remove a lot of that complexity for you.
- 3:29
For example, traditional RAG requires N+1 requests. You need to make an additional call to embed the inputs, go talk to your Vector store. With Hypermode, we c- you can do that all in one request.
- 3:41
We build in memory embedding and search service that allow you to do that and save a couple hundred milliseconds per request.
- 3:49
Finally, building intuition around nondeterminix sys- nondeterministic systems is hard. Each model has its own personality, and we make it really easy for you to quickly compare different inferences, different tunes, different models, and you can then export this data set to fine-tune.
- 4:06
On Monday, your boss is going to ask you, "What did you learn at AI World Fair?" If you come by our workshop after lunch, I'll prove to you that you can make AI...
- 4:15
Uh, sorry. I'll prove to you that you can make iteration velocity a core competency. The team that built all this amazing stuff will be there. We'll show you how to build natural language search, intelligently sort every data list in your product, detect outliers, catch bad guys.
- 4:29
You'll walk over the demo that you're proud of and a plan to put something like it in prod by the end of next month. And if seeing my happy face again and building something really cool is not enough, we'll give you $1,000 in Hypermode credits to get started.
- 4:42
Thank you all so much. [outro music]