AI Engineer World's Fair 2026
Agentic Sites: Building Hyper Personalized Websites — Carlos Sanchez, Adobe
Read the talk
Agentic Sites: Building Hyper-Personalized Websites
Carlos Sanchez shows how Adobe’s prototype turns visitor intent into a purpose-built page by changing selected content blocks, grounding them in the existing site, and treating latency as part of model quality.
From a talk by Carlos Sanchez
At a glance
Ideas worth remembering
Personalize selected blocks rather than freely generating the whole website; use the existing site as the retrieval corpus so adaptations remain connected to approved content.
Treat latency as part of model quality. In the reported 15-prompt example, the chosen configuration averaged 1.1 seconds versus 4.6 seconds for the next option, but that comparison does not establish universal provider performance.
Pre-generating a “For You” page moves inference ahead of navigation, reducing visible waiting at the cost of repeated calls and potentially wasted generation.
Marketers define the intent groups and strategy; the model chooses and orders suitable blocks for the selected group.
The camping-coffee and conference-comparison demos show the central capability: reorganize several grounded blocks around a visitor’s task, rather than returning a conventional list of search results.
Behavioral personalization requires more than model engineering. Because the prototype records visited pages and time spent, a production design also needs explicit privacy and data-governance decisions.
Start with what the visitor is trying to accomplish
Carlos Sanchez begins with a different organizing question for a website: what is this visitor trying to do right now? Instead of serving one fixed page to everyone, the proposed system interprets browsing behavior and explicit requests, then adapts the experience in real time. Engagement and conversion are the intended marketing outcomes, although the talk does not present measurements showing that this implementation improves either one.
The important constraint is that the system does not freely generate an entire website. It changes selected content blocks according to a persona or inferred intent while preserving the surrounding site. That smaller action space fits the practical requirements of brands with strict visual and editorial guidelines: the model can choose, arrange, and rewrite approved material without inventing every component from scratch.
To constrain the content itself, the team turns the existing site into a retrieval corpus. Retrieval-augmented generation supplies relevant products, guides, stories, and other site material as context for each response. This connects generated copy to available content, but grounding alone cannot guarantee that every recommendation or claim will be correct; it narrows the source material rather than eliminating model error.
Sanchez describes three forms of adaptation:
- Persona adaptation: change selected blocks as the system classifies the visitor.
- Query-driven assembly: build a results page around an explicit search or request.
- Behavior-based recommendation: prepare a page from what the visitor has browsed and what the system infers they may want.
The third mode is the least direct because it relies on inferred intent rather than a stated request.
Marketers define the strategy in natural language and use analytics to revise it. The intended loop runs from a business goal to a personalized experience, then from observed behavior back into the next strategy change. Sanchez describes the loop at a conceptual level; he does not specify an optimization algorithm, attribution method, or success threshold.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
A page generator has an interaction budget
The frontend composes adaptable blocks and updates them through the AI service. Behind it, the team continuously evaluates prompts across multiple models and providers. Model selection is deliberately site-specific: corpus size, subject matter, commerce type, and the required outputs can all change which configuration is accurate enough and fast enough.
The team uses Promptfoo for comparisons across local and hosted providers, evaluating accuracy alongside speed. Latency is not an infrastructure footnote here. If generation happens after a visitor asks for a page, inference time becomes page-load time, so Sanchez sets a target of roughly one or two seconds.
For one example site and a set of 15 prompts, the selected Cerebras configuration averaged 1.1 seconds to generate a page; the next configuration averaged 4.6 seconds. That large gap drove the provider choice for the demonstration. These results describe one prompt set and site, not a universal ranking of providers or models.
This produces a practical selection rule: choose enough capability to satisfy the task within the interaction budget. The model is mostly generating bounded copy, selecting blocks, and arranging them, so Sanchez argues that the workload does not require the largest available LLM. A configuration can be imperfect yet useful if its quality is acceptable for the site and its response arrives before the experience feels broken. The talk leaves “good enough” to application-specific evaluation rather than defining a universal threshold.
Prompts reflect the site’s size, domain, commerce type, and desired adaptations.
The chosen configuration must meet both the site’s quality requirements and the page’s interaction budget.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Move some generation ahead of the click
The runtime inputs combine browsing activity with explicit queries. In the example, those signals can change the hero card, product selection, blog feed, navigation, and calls to action. Personalization therefore affects emphasis, ordering, recommendations, and the next action—not just a line of greeting text.
A “For You” page creates a useful timing option. As the visitor browses, the backend can repeatedly generate or refresh recommendations and prefetch the resulting page. When the visitor opens it, the expensive work may already be complete. This relaxes the immediate latency requirement, but it spends additional inference before the system knows whether the visitor will use the result.
Freshness creates the corresponding cost. Every new signal can make the prepared recommendation stale, so keeping it aligned with current behavior may require more generations and more LLM calls. The design trades waiting at navigation time for background inference cost.
Queries can also place visitors into marketer-defined personas or intent groups, such as buying a product versus gathering information. Marketers decide which groups exist and how they should be treated; AI selects the blocks, suggestions, sequence, and potentially media for the selected group. This keeps the segmentation strategy under business control while delegating page assembly to the model.
Sanchez treats generated images as a possible extension, with a sharper brand risk than text. Image generation is slower, and marketing acceptance depends on quality and brand fit. The demonstrated architecture does not require it: product pages and comparisons can be assembled from existing products, guides, experiences, and site media.
The stack separates observation, generation, retrieval, and delivery. The browser collects signals. A backend calls the LLM and reasons over retrieval results from the site’s vector database. Adobe Experience Manager serves pages and static content at the edge. This lets the static site remain fast and controlled while selected blocks take a dynamic path through retrieval and inference.
That signal path also creates an important production concern that the presentation does not explore: the demo records visited pages and time spent, then makes those observations available to the LLM. A deployed system would need explicit decisions about consent, retention, access, and what behavioral data may be sent to an inference service.
Browsing and queries provide intent signals.
Static site content remains at the edge while selected blocks travel through a retrieval-and-generation path.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
A camping request changes the whole product story
Sanchez calls the ambition “Audience of One”: a marketing experience assembled for an individual rather than a broad segment. His demonstration uses a fully generated example site for coffee equipment. He browses stories and products, spending time on individual pages before opening a debugging panel.
The panel shows the mechanism behind the apparent personalization. The visitor is bucketed as “exploring,” while the system records visited pages and time spent on each. Those signals are available to the LLM, and a “For You” page has already been generated from the browsing history.
The explicit-query demo makes the transformation easier to inspect. Sanchez asks for a coffee machine suitable for preparing coffee while camping. The resulting page changes its introductory copy, adds camping-specific tips, and recommends two machines described as appropriate for that use. The page is more than a ranked search result: several blocks tell one coherent product story around the same intent.
A similar run in debug mode takes 1.64 seconds in total, including the round trip to the LLM. Sanchez reports approximately 2,300 tokens per second for that run; another run shows about one second of LLM time and roughly 2,200 tokens per second. These numbers describe different layers of performance: total generation time includes more than model decoding, while token throughput measures only generation rate.
The demo interface also lets the team switch models and adjust temperature and token settings. Automated Promptfoo tests provide repeatable comparisons, while manual interaction reveals whether a configuration behaves well inside the actual page experience. The two methods answer different questions: batch evaluation measures defined cases; interactive inspection exposes coherence, responsiveness, and presentation problems that a score may miss.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Carry the pattern to another site in under an hour
Sanchez then introduces Of One Labs, a tool that accepts a URL and generates an agentic demonstration site in less than an hour. The claim concerns creating a demo, not automatically converting any production site with its full brand, security, analytics, accessibility, and editorial requirements intact.
He applied the tool to the AI Engineer site. The generated experience centers on a search box with AI-generated suggestions; a query for European AI conferences is intended to assemble a page focused on relevant events. As in the coffee example, the query supplies the job the page should perform rather than merely a keyword to match.
The strongest result is a side-by-side conference comparison. Once the system infers that a visitor is choosing between two events, it changes the information structure to support that decision. This is the more consequential form of personalization in the talk: the system does not simply rank one item above another; it selects a comparison layout suited to the visitor’s task.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Intent-driven assembly can outlive the conventional webpage
The closing example asks what this pattern might become if a personal assistant mediates the interaction. Sanchez imagines a spoken shopping request producing a personalized visual response on a television. The user supplies intent by voice, and the system chooses a screen-sized presentation without requiring a phone or computer.
He is careful not to claim certainty about whether the web itself is dying or what will replace it. The supported result is narrower: the demonstration shows that a system can already assemble selected, site-grounded blocks around a visitor’s inferred or explicit intent. Extending that result into a general assistant-driven interface remains a proposed direction.
Sanchez expects generation to become faster, cheaper, and more widely applicable, but those are forecasts. The engineering lesson available today is concrete: constrain what may change, retrieve from the site’s approved content, evaluate models against each site’s quality and latency needs, and assemble the page around the job the visitor is trying to complete.
Suggest correction
This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.
Resources
From the talk
The official AI Engineer page includes the recording, timestamped transcript, chapters, and a concise talk summary.
Further reading
- Carlos Sanchez’s WeblogReference
Sanchez’s technical weblog covers his broader work in AI, infrastructure, Kubernetes, and automation.
- Carlos Sanchez on XReference
The speaker’s public profile for updates on his technical projects and presentations.
Related talks
- Personalization in the Era of LLMs
A complementary look at LLM-based personalization in recommendation systems, including user representations, catalog embeddings, and steerable music and podcast recommendations.
- Agent Output Is Not UX: Rendering Layer Your LLM Pipeline Is Missing - Bala Ramdoss, Amazon Lens
Extends the interface question by explaining why model output needs a controlled rendering layer, version-aware contracts, and safe fallbacks before it becomes production UX.
- How to evaluate a model for your use case
Develops the talk’s model-selection principle: generic benchmarks cannot replace application-specific evaluations tied to the actual deployment task.
Read the complete timestamped transcript
- 0:01
[music]
- 0:13
>> Hello.
- 0:14
Thank you for coming. Um I'm going to
- 0:17
talk to you about Agility Sites, how we
- 0:20
call it as building hyper-personalized
- 0:23
websites. I'm not going to just talk
- 0:25
about it. I'm going to show you what
- 0:27
we're building.
- 0:28
Um I've been working on on this project
- 0:31
for for a bit now, and
- 0:34
we'll try to show you what is possible
- 0:36
today with with AI.
- 0:39
Uh I work at Adobe at a
- 0:42
I'm a principal scientist at a product
- 0:44
that not many people know, Adobe
- 0:45
Experience Manager, content management.
- 0:47
We run a lot of
- 0:49
uh
- 0:50
website properties for big brands, and
- 0:53
my background is in in open source, uh
- 0:56
contributing to to a lot of foundations
- 0:58
and projects.
- 1:01
What are Agility Sites, and how are we
- 1:04
building this thing?
- 1:06
So, we're looking for sites
- 1:08
that are
- 1:10
uh
- 1:11
looking at the what intent the user
- 1:14
browsing
- 1:15
uh has. What is the user doing? What is
- 1:19
the user trying to achieve? And the end
- 1:22
goal is to personalize these pages for
- 1:25
the for the current user browsing, so
- 1:28
that eventually this
- 1:31
uh drives uh higher engagement or uh
- 1:34
conversions, whatever the marketing
- 1:36
teams want to want to achieve.
- 1:39
And these pages are personalized in real
- 1:41
time based on the on the user that is
- 1:45
uh accessing the site, and what is the
- 1:48
what is the user doing.
- 1:50
The stack we're using is AMH delivery.
- 1:53
So, this is the part of the product we
- 1:55
we have,
- 1:56
uh where all the content is on the edge
- 1:59
and then we have back end service that
- 2:02
powers this experience with
- 2:05
different LLM providers LLM services
- 2:09
we use Cerebras for fast inference or we
- 2:13
can use also we tried bedrock and and a
- 2:15
bunch of others. I'll be showing
- 2:17
Cerebras today
- 2:19
and you will see the reason why.
- 2:22
The
- 2:23
the engine that is personalizing this
- 2:27
this bits is
- 2:30
using the rich content and blocks.
- 2:33
So different blocks on the site are
- 2:36
customized depending on on what the user
- 2:38
persona is.
- 2:40
We don't want the the whole site to be
- 2:42
generated. I mean if you talk to
- 2:44
marketing people they they have a very
- 2:46
strict brand guidelines. You don't want
- 2:48
to just
- 2:49
come up with our have some
- 2:51
hallucinations there. So the what is
- 2:54
personalized is different sections of
- 2:56
the site and we use the whole site as
- 3:00
a corpus. We built a rack from the whole
- 3:03
site. So what is generated is grounded
- 3:06
on on the existing site.
- 3:09
We tried to solve the problem where one
- 3:12
size fits all. We want
- 3:14
hyper-personalized experiences. Also we
- 3:16
want to help
- 3:18
our customers to do more automatic
- 3:21
authoring. So not having to create
- 3:24
thousands of different variations of the
- 3:26
site but use AI for this
- 3:29
and then do these multiple layers of of
- 3:32
personalization.
- 3:35
Some examples of what we're doing or
- 3:37
I'll show in the demo. It's
- 3:40
instant persona adaptation, query
- 3:43
generation when the user search for
- 3:44
something on the site, the page with the
- 3:47
results is customized for them and also
- 3:50
uh, something like recommendations where
- 3:52
after you browse the site for a period
- 3:54
of time, we
- 3:55
we can create a page that recommends
- 3:58
something based on on on what you are
- 4:00
what we think you are looking for.
- 4:02
For marketers, uh, they can define this
- 4:05
strategy on natural language, and they
- 4:07
can use analytics to
- 4:10
to drive the loop of personalization,
- 4:13
and what is the end goal, and how this
- 4:17
goes back again to change to adapt the
- 4:19
personalization to improve that uh,
- 4:22
whole cycle. Everybody's talking about
- 4:24
loops in this conference, so that's
- 4:26
that's one of the loops there.
- 4:30
How the architecture look like? So, it's
- 4:32
a dynamic front end with some blocks,
- 4:34
what I mentioned before, and with uh,
- 4:37
edge delivery services is basically you
- 4:39
compose these blocks, and uh, they are
- 4:42
updated on on real time through with the
- 4:46
AI.
- 4:47
The back end,
- 4:49
uh, we
- 4:51
we do the um,
- 4:53
evaluation of the models and the
- 4:55
providers,
- 4:56
and one thing we realized is is that
- 4:58
this is very dependent on the site. So,
- 5:01
we have a bunch of prompts, and we look
- 5:04
uh, we run it across a huge variety of
- 5:06
uh, models and providers, and then we
- 5:08
look at the accuracy, we look at the
- 5:10
speed, but this is going to depend
- 5:12
highly on what type of site, like how
- 5:14
big is the site, how I don't know, what
- 5:16
different
- 5:19
what different um,
- 5:21
area is the site targeting, what what
- 5:24
type of commerce it is, and so on. So,
- 5:26
we we run this this
- 5:29
um, evaluation continuously. We use uh,
- 5:32
Promptfoo. Uh, anybody heard about
- 5:34
Promptfoo?
- 5:35
Okay, some people.
- 5:37
So, Promptfoo allows you to evaluate
- 5:39
models um, prompts against my multiple
- 5:43
models, providers, and you can do local
- 5:46
models and any of the
- 5:49
a bunch of open AI compatible
- 5:52
uh providers and and uh
- 5:55
a lot of them, basically.
- 5:57
We look for two things. Why? Accuracy.
- 6:01
That's that's typically what people look
- 6:03
for, but also we want the speed because
- 6:05
we don't want the site generation to
- 6:08
take
- 6:09
more than 1 or 2 seconds,
- 6:12
right? Because people uh
- 6:14
this is already
- 6:17
uh proven that people want the the
- 6:19
faster the site, the more conversions it
- 6:22
it generates or the the better the
- 6:23
experience it is for the user.
- 6:26
Um yeah, what I mentioned is different
- 6:27
sites may have different requirements.
- 6:29
Uh so, you may have to run this uh
- 6:32
evaluation of models depending on the
- 6:35
site.
- 6:37
This is a an ex
- 6:39
uh we we secured this
- 6:41
some of these queries, so we have a 15
- 6:44
prompts for this example site.
- 6:46
Um we have uh
- 6:49
at the top you can see with Cerebras on
- 6:51
the Gemma 4 model that was announced
- 6:53
last last week,
- 6:55
we can get an average latency of 1.1
- 6:58
seconds generating a page.
- 7:00
You you can compare that to the second
- 7:02
one, which is 4.6 seconds, right? So,
- 7:06
the difference is huge.
- 7:09
And that's why uh we use Cerebras for
- 7:11
for this use case.
- 7:13
And uh
- 7:16
you can see that different providers,
- 7:18
different models have different
- 7:21
um
- 7:22
different speeds. And here is uh let me
- 7:25
I can show you the whole
- 7:28
thing here. Not this one, this one,
- 7:30
right? So, at the at the bottom we have
- 7:33
other other tasks.
- 7:35
Sometimes uh maybe some of them may be
- 7:38
good.
- 7:39
They don't need to be perfect, but
- 7:41
they're good enough if they're fast
- 7:42
enough. So, that's going to be the the
- 7:44
kind of
- 7:45
decisions that you need to make on
- 7:47
whether the model is good enough for
- 7:50
your use case or not.
- 7:53
Yeah, we're looking Yeah, average 1.1
- 7:55
seconds. And then the the next ones are
- 7:58
going from 4 seconds higher.
- 8:01
And you don't need a huge LLM to do this
- 8:03
sort of work because you are generating
- 8:06
text, you are deciding where to put
- 8:09
blocks and how to organize the website,
- 8:12
you don't need a lots of information for
- 8:14
that.
- 8:16
So, this browsing and the queries
- 8:20
uh is are being recorded. So, these are
- 8:23
the metrics or the
- 8:27
the the data we gather from the user,
- 8:30
and this is fed into the LLM to
- 8:33
personalize the site. And then in this
- 8:36
example, we personalize the hero card,
- 8:38
the products, the blog feeds, and and
- 8:41
the navigation based based on the
- 8:42
persona.
- 8:44
Also, what are some of the buttons like
- 8:46
our call to action navigation, you can
- 8:48
also we can also personalize those.
- 8:52
We
- 8:53
we create and I'll show you the a for
- 8:55
you page, which is a recommendation.
- 8:57
And this is a interesting one because
- 9:00
this you could
- 9:02
pre-generate, right? As the user browses
- 9:05
your site, you gather these signals, and
- 9:08
you could keep generating in this. So,
- 9:10
in this case, you wouldn't need so such
- 9:12
a big speed.
- 9:14
But
- 9:16
but that's interesting because it it
- 9:17
would be if a user wanted to
- 9:20
buy something, you could just say,
- 9:22
"Okay, for you, I will recommend these
- 9:24
three products or or something like
- 9:26
that."
- 9:27
Um
- 9:29
Yeah, and then they can see this
- 9:31
recommendation, and if they go there,
- 9:33
that that could be pre-fetched for them.
- 9:35
And obviously, you have to keep updating
- 9:37
it as the user navigates around the site
- 9:39
and and so on. So that that's also
- 9:42
something to consider on the cost cost
- 9:46
implications of doing multiple
- 9:48
generations, multiple LLM calls.
- 9:54
When
- 9:55
when the user runs a query, dynamic
- 9:58
personalized page is shown to them.
- 10:00
When the
- 10:02
these queries are also grouped into
- 10:05
personas or intent types. So what is
- 10:08
this guy what is this guy trying to do
- 10:11
in the site? Is trying to buy something?
- 10:13
Is trying to just get information? So
- 10:16
you can get marketers to decide what
- 10:20
type of groups, how many groups you want
- 10:22
to have, how you want to deal with with
- 10:23
customers. And the AI will choose the
- 10:26
the blocks and the suggestions for for
- 10:28
those groups of people.
- 10:31
Um
- 10:33
And we can adopt yes, the the different
- 10:36
blocks, the the the sequence of the
- 10:39
blocks and
- 10:41
media. You could also do media. One of
- 10:44
the things we consider is
- 10:46
there was some a model announced
- 10:48
today or yesterday the
- 10:50
the nano banana light. So you could even
- 10:53
generate images
- 10:55
very fast on the fly.
- 10:58
Obviously not as fast as text, but
- 11:00
that's also something that would be
- 11:03
I don't I don't know if it's that
- 11:04
something like marketing people would
- 11:06
want to have generated images. That
- 11:09
depends on on the quality a lot if it's
- 11:11
on brand.
- 11:13
And
- 11:15
the site in this example we have a a
- 11:18
product site
- 11:20
and then we have guides, experiences,
- 11:21
blocks and the whole response of the LLM
- 11:24
is grounded there. And
- 11:27
there's comparisons. We can do
- 11:28
comparisons between products that are
- 11:30
tailor and the product pages can be
- 11:32
tailored for the for the user.
- 11:36
Okay, this is this is a bit of the
- 11:38
stack.
- 11:39
Um not going to spend too much time
- 11:42
here, but the browser you have some
- 11:45
layers. You have the browser where the
- 11:47
signals get
- 11:50
get
- 11:51
uh
- 11:52
from I got I got I got so
- 11:55
I got from the from the user and then we
- 11:58
have the back end. Uh
- 12:00
we can have the back end. We run this
- 12:01
some of these in in Google. Some of
- 12:03
these are in our Cloudflare. So, the
- 12:06
back end is basically just calling the
- 12:07
LLM and doing some reasoning using the
- 12:11
rack that is built on on the site to do
- 12:13
the generation.
- 12:16
And you have obviously you have to have
- 12:18
the vector database, the inference uh
- 12:21
machinery and uh
- 12:24
that obvious business manager is doing
- 12:25
the serving the
- 12:28
the
- 12:29
at the edge is serving the the pages and
- 12:31
the static content.
- 12:33
So, let me show you because I think this
- 12:35
is uh so, we call this uh audience of
- 12:38
one
- 12:39
because the idea of in marketing
- 12:43
they they always dream on being able to
- 12:45
personalize things for each individual.
- 12:49
So, we call it yeah audience of one. So,
- 12:51
I have this this site. Uh this is a site
- 12:54
that is absolutely generated
- 12:56
uh example site. It's a coffee
- 12:59
uh machinery. So, I can go and and read
- 13:02
some stories
- 13:04
and I can go and look at some products.
- 13:08
Let's go and look at this product.
- 13:11
I can spend some time here.
- 13:16
Uh
- 13:17
let's go and click
- 13:19
here.
- 13:20
Okay, so I'm I'm browsing around the
- 13:22
site and I have this debugging tool
- 13:25
thing uh which
- 13:28
Uh
- 13:29
let me go here, I think.
- 13:37
Let's see.
- 13:40
So, down there is the signals that the
- 13:44
that the browsing
- 13:46
is giving us. So, I don't know if you
- 13:48
can see it much because I cannot see it
- 13:50
much. The So,
- 13:52
the user is bucketed into the exploring
- 13:55
category. We have the pages that have
- 14:00
have visited, and then we have how much
- 14:02
time is spending on each page. All of
- 14:04
this data is now available for the LLM.
- 14:09
So,
- 14:11
if I go here, I already have a for you
- 14:14
page that was generated for me
- 14:16
and
- 14:18
based on my browser.
- 14:21
And you will not notice that it's
- 14:24
slightly different than everything else,
- 14:26
but if I go here and I run a query
- 14:29
like I want I'm looking for a coffee
- 14:33
machine to
- 14:36
uh prepare
- 14:38
coffee
- 14:40
while camping.
- 14:44
The site is this was just generated for
- 14:47
me.
- 14:48
And then you're going to see some things
- 14:50
like the text is customized. Camping
- 14:52
shouldn't mean compromising on your
- 14:55
uh whatever routine.
- 14:57
Uh the coffee tips for camping um
- 15:00
machinery that are being recommended are
- 15:02
coffee agile and um or the nano, which
- 15:05
are
- 15:07
good for
- 15:09
for the
- 15:11
for a camping trip, right?
- 15:14
So, you saw how fast this was.
- 15:17
I'm going to run it here something
- 15:19
similar that I had here and I can run it
- 15:22
on the debug mode here.
- 15:25
And you will see, let's make this
- 15:27
bigger.
- 15:30
Total time 164 seconds to generate the
- 15:33
page. So, this includes a round trip to
- 15:35
the LLM. This is using Cerebras Gemma 4.
- 15:38
So, the the Gemma model from Google
- 15:40
running on Cerebras on their
- 15:43
very fast chips.
- 15:45
Uh we get
- 15:47
2,300
- 15:48
tokens per second.
- 15:50
Which is not bad.
- 15:52
I would say.
- 15:53
>> [snorts]
- 15:54
>> And if I run it again, uh probably
- 15:56
something like that.
- 15:58
Uh the LLM time is 1 second. And again,
- 16:01
2,200 tokens per second.
- 16:04
This is something that we only dreamed
- 16:06
about before.
- 16:10
On the on this site example site, we
- 16:13
have some other options.
- 16:16
Uh
- 16:16
so, because we we've been showing this
- 16:18
to customers, so we have the
- 16:20
the ability to change the different
- 16:22
models, temper temperature, tokens, and
- 16:24
so on. And we can uh
- 16:28
we can
- 16:29
show uh and try the different models and
- 16:31
see how they behave. Besides the
- 16:33
automatic test with Prompt Full, then we
- 16:36
can uh manually come and and click
- 16:38
things and see and see how that how that
- 16:40
works.
- 16:42
And uh
- 16:44
we also have
- 16:46
uh OfOneLabs.
- 16:48
So, we have we build this tool that
- 16:50
generates an agentic site for any site
- 16:53
we want. So, if somebody wants to have a
- 16:57
demo for a customer, come here
- 17:00
and enter the URL. In less than an hour,
- 17:02
you have an agentic site. I did this
- 17:03
last week with the AI engineering site.
- 17:07
And
- 17:08
I got this site that is just a search
- 17:11
box and a few things.
- 17:13
And
- 17:15
let me open it here, the full page. Not
- 17:18
this one. Yeah, okay.
- 17:20
So, I could say
- 17:23
Europe AI conferences.
- 17:25
So, these suggestions are also AI
- 17:27
generated. And I get a page that is
- 17:32
more focused on
- 17:34
It should be more focused on on the on
- 17:37
this European conferences.
- 17:40
If I go back, did I go
- 17:44
I can search for anything the same way I
- 17:47
did with with the Arco. So, I as a
- 17:49
specific There was someone that was
- 17:52
generating a good comparison side to
- 17:54
side.
- 17:55
Let me see if this one. Okay, here. This
- 17:57
one.
- 17:58
I went and this generated a page with
- 18:02
a pretty good comparison. If I'm looking
- 18:04
at two conferences and I need to decide,
- 18:06
if I figure out that the user wants to
- 18:08
do that, this is great because that
- 18:10
gives them a side-by-side comparison on
- 18:12
the fly.
- 18:14
Now,
- 18:17
this this is I think this is cool
- 18:19
already, but then we have I have this
- 18:22
idea that
- 18:24
probably the I'm
- 18:27
a bunch of people are we are talking
- 18:28
about is the web that is is the web the
- 18:31
future still and so on. Nobody knows.
- 18:34
But we can also do something with this
- 18:38
with this audience of one, this
- 18:40
generative sites. So, imagine you have
- 18:43
you have your personal assistant and you
- 18:46
ask a query through in this case through
- 18:49
Google and you say I want to buy I don't
- 18:52
remember what the query said. It was
- 18:53
something like I want to buy a machine
- 18:57
and I get this on my Google TV.
- 18:59
Right? So, this is absolutely
- 19:01
personalized to my query.
- 19:04
Okay? No, go back.
- 19:08
This is absolutely personalized to my
- 19:09
query. So, I'm there in my living room.
- 19:11
I don't need a phone, I don't need a
- 19:13
computer, I don't need anything, just my
- 19:16
voice and something that will
- 19:19
kind of show me
- 19:21
something that is absolutely
- 19:22
personalized to to me.
- 19:29
Okay, so that one.
- 19:31
So,
- 19:33
what I was trying to show and hopefully
- 19:35
you remember from this session is that
- 19:38
this is now possible.
- 19:40
It's only going to get better from here
- 19:42
on. It's only going to get cheaper, it's
- 19:44
only going to get faster.
- 19:45
And you will uh be able to have uh
- 19:48
huge personalization options for sites
- 19:52
and for other things.
- 19:54
And you can do this with intent driven.
- 19:57
So, what is the what is my user trying
- 19:59
to do? What does my user want to buy?
- 20:02
These sort of questions. And you can uh
- 20:06
assemble a page just for them.
- 20:08
And you can also do this with uh
- 20:11
multiple models and and eventually
- 20:14
it's just going to be
- 20:16
faster and faster, right?
- 20:18
So,
- 20:19
that's it. Um
- 20:21
thank you for coming and I hope you you
- 20:22
got the idea. Thanks.
- 20:24
>> [applause]