← All AI Engineer talks

AI Engineer World's Fair 2024

Hyperspace: More Nodes Is All You Need

Nicolas Schlaepfer· VP, AI R&D, Hyperspace5:48

Read the talk

Hyperspace: From Shared Inference to Editable Agent Plans

Hyperspace connects community-provided inference to an editable task graph, combining model-based planning, web extraction, contextual execution, and a Python terminal.

From a talk by Nicolas Schlaepfer

Inference from someone else’s computer

What would a chat experience look like if the inference came from another person’s computer? Nicolas Schlaepfer introduces Hyperspace as a decentralized AI network built from resources contributed by a community of personal-computer owners. He describes the organization as having no GPUs of its own. Its existing AI OS application, available for Windows and Mac, uses llama.cpp for inference: in his example, a user could download the application and chat using inference supplied by someone in Belgium.

The next step is to make that network useful across different kinds of work. Schlaepfer’s premise is that a mixture of expert models can provide a better AI experience than relying on one large closed-source model. That preference for diversity becomes a concrete design choice in the workflow demonstrated later: different models receive different jobs.

0:280:44
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:28 · section reference included

Turn a query into an editable plan

The new product, also called Hyperspace, is intended to run on that network. It combines prompt engineering, a visual interface built with React Flow, Python execution, and RAG-like web browsing. The interface puts a graph of tasks beside generated explanations and code, making the intermediate work visible rather than presenting only a final chat response.

Slide titled Hyperspace showing connected task cards on the left and a snake-game explanation with Python code on the right.
Hyperspace pairs a node graph with generated output and Python code.

Planning starts with a fine-tuned model. A user submits a query, and the model produces a directed acyclic graph, or DAG, represented as JSON. The graph expresses a methodical plan: distinct tasks connected into a workflow, with no dependency cycle that leads back to an earlier task. This structured output gives the interface something it can display and let the user edit.

Web extraction supplies another primitive. Hyperspace uses Puppeteer and Beautiful Soup in its in-house scraping pipeline, converting website HTML into Markdown that is easier for an LLM to consume. The node editor and terminal then give power users direct access to the workflow. Individual React Flow nodes generated by the orchestration model can be changed to fit the task.

1:241:46
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

1:24 · section reference included

Review the graph before execution

The early demo begins with a sample query. After submission, the application opens the node editor, where HyperEngine V3, the DAG orchestration model, streams in the plan node by node. Generation produces an editable working surface; the user does not have to accept the plan unchanged.

Before execution, the user can revise three parts of each node:

  • Title: the name of the task.
  • Task description: what the node should do.
  • Expected output: what the node should produce.

The user can also add as many nodes as needed. These controls expose both the work requested and the intended result, so a generated plan can be adjusted before it is run.

Browser showing a branching graph of task cards with editing icons and an Execute button.
A generated plan in Hyperspace’s node editor.
3:083:20
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:08 · section reference included

Give each node the context it needs

Selecting Execute produces an output for each node. Each node creates a query based on its task, combining three sources of context: the overall goal, the local goal, and what happened in the previous node. The overall goal keeps the task connected to the user’s request; the local goal specifies the current work; the previous result carries information forward.

For example, a Python-learning workflow could carry an earlier explanation of functions into a task about reduce. The query-building pattern can be expressed directly in Python:

python

def build_node_query(overall_goal: str, local_goal: str,
                     previous_output: str) -> str:
    return "\n\n".join([
        f"Overall goal:\n{overall_goal}",
        f"Current task:\n{local_goal}",
        f"Previous node output:\n{previous_output}",
    ])

query = build_node_query(
    overall_goal="Teach Python functions through worked examples.",
    local_goal="Explain reduce with an example that sums integers.",
    previous_output="A function takes inputs and returns a result.",
)
print(query)

This constructs the next query; it does not execute the task. The mechanism is the explicit combination of shared purpose, current instructions, and prior output.

The demo assigns reasoning and summarization to separate models:

RoleModel
ReasoningQwen2 Instruct
SummarizationLlama 3 70B

Schlaepfer credits this combination with providing diverse synthesized answers. He does not specify the Qwen2 size or the exact Llama variant; the linked Llama card documents the instruction-tuned variant. In the displayed result, the graph remains visible beside generated Python explanations and code, including a reduce example and an explanation of object-oriented programming.

Hyperspace node graph on the left, with a reduce-function code example and an object-oriented programming explanation in the output pane on the right.
The task graph alongside generated Python explanations and code.
3:464:06
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:46 · section reference included

From generated code to an execution environment

When a node’s output contains Python, the user can run it and inspect the result in the terminal. The terminal opens automatically with the output, extending the workflow from generating code to executing it inside the product.

Schlaepfer presents these capabilities as groundwork for future agentic behavior. The runtime also exposes a virtual file system on the right, where the user can change directories. The intended set of agent primitives comprises memory, Python execution, planning, and code generation. The demonstrated editor, outputs, terminal, and file tree make those foundations tangible, while broader agentic behavior remains the direction of development.

Browser interface with task nodes and Python output above an open dark terminal and a file-system tree.
Hyperspace’s terminal and file system beneath the task graph and output.

The recorded demo closes with a release forecast of the coming weeks. Back onstage, Schlaepfer narrows that forecast to later that week through a waitlist and directs the audience to the Hyperspace AI Twitter account for updates. This is the historical announcement at the June 2024 AI Engineer World’s Fair, rather than a statement of present availability.

4:304:39
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

4:30 · section reference included

Resources

From the talk

  • C/C++ inference engine with local model execution, quantization and CPU/GPU support.

  • React library for editable node-based interfaces and interactive diagrams, with guides and examples.

  • JavaScript browser automation library with installation instructions and browser-control examples.

  • Python documentation for parsing, navigating and extracting content from HTML and XML.

  • Hello Qwen2Article4:13

    Original Qwen2 announcement introducing the model sizes, instruction-tuned variants and evaluation results.

Updates since the talk

Read the complete timestamped transcript
  1. 0:00

    [upbeat music] Hello, everybody. Uh, my name is Nicolas Schlaepfer.

  2. 0:16

    I'm an AI engineer. I think I'm at the right place. Um, today I'm gonna be pronouncing, uh, a new product we've been working on at Hyperspace. Um, a little bit about us.

  3. 0:28

    Uh, we are a decentralized AI network. Uh, we have no GPUs. Um, we're building a community who takes, uh, the resources from their personal computer and contributes, uh, to our decentralized network.

  4. 0:44

    Um, we have a product currently out called AI OS. Um, you can download it for Windows and Mac. It uses llama.cpp and does inference. So technically you can download it, get inference from somebody in Belgium, and you can have a chat experience like that.

  5. 1:00

    So we're hoping to... Oh, actually, sorry. Um, we really believe in, uh, diverse models. Uh, we think, uh, not having, um, just one big closed source model is the answer for the best AI experience.

  6. 1:17

    Um, having a mixture of a bunch of great experts will provide the best AI experience.

  7. 1:24

    Um, so that gets us to our self-titled product, Hyperspace, which will be built on our network. Um, this is a really interesting product. It's a mix of prompt engineering, um, visual, uh, React Flow, uh, Python execution, and, uh, RAG-like, uh, web browsing.

  8. 1:46

    So for the first thing with this product, we wanted to build a, uh, fine-tuned model that outputted agentic planning experiences. So you'd put in a query, you get in a DAG, or you get out a DAG in a JSON format, and this is a, uh, a methodical plan from that query.

  9. 2:06

    Um, we also wanted to have a primitive of having a in-house web scraping experience for LLMs. So we're using Puppeteer and Beautiful Soup to scrape websites, convert that, uh, HTML into, uh, a Markdown, something easier to read for LLMs to digest.

  10. 2:28

    Um, kind of the product we're gonna talk about is, uh, we have a node editor and a terminal, and this is gonna be a power tool for the power users.

  11. 2:37

    Um, this node editor will allow you to change each node in the React Flow to, uh, fit your needs, and this is coming from the DAG org- or DAG orchestration model we have.

  12. 2:49

    Um, here's a little video demo of, uh, our product. I recorded it yesterday in the hotel, so I'm sorry for the audio, and here we go. [gentle music]

  13. 3:08

    Welcome to a very early look at Hyperspace. Let's begin with a sample query.

  14. 3:20

    Once you submit your query, you're brought into our node editor view, where each node is streamed in from our DAG orchestration model, HyperEngine V3.

  15. 3:31

    We want to emphasize that the user's still in full control. They can edit the title, task description, and expected output.

  16. 3:39

    They also have the freedom to add as many nodes as they like.

  17. 3:46

    Let's execute. Now that our outputs are done, we can talk a little bit about the outputs. Each output is coming from each node, and each node is creating a query based on that task.

  18. 4:06

    It's combining the overall goal, the local goal, and whatever's happened in the previous node.

  19. 4:13

    We're using a reasoning model and a summarization model. For reasoning, we're using Qwen2 Instruct, and then for summarization, we're using Llama 370B. This helps provide a diverse set of synthesized answers.

  20. 4:30

    For the outputs that do have Python, we can go ahead and run them and see them in our terminal.

  21. 4:39

    Terminal will automatically open it up with the output.

  22. 4:43

    We want to provide the groundwork for agentic behavior in the future by providing these core primitives.

  23. 4:52

    Over here on our right, we have our virtual file system that changes our directory.

  24. 4:58

    We're trying to build out all the primitives to what an agent would need: memory, Python execution, planning, and code generation.

  25. 5:08

    Thank you so much for watching. We're very excited to get this out in the coming weeks. [upbeat music] [audience applauding]

  26. 5:18

    Um, happy to announce that'll be available later this week via waitlist, so go ahead and pay attention to our Twitter, Hyperspace AI. All right. Thank you. That's my time. [upbeat music]