Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara

Talk transcript

1. 0:00

   [instrumental music] Hi, I'm Ofer from Vectara. At Vectara, we developed a trustworthy agent operating system, and there's a lot of really cool use cases with this, like document generation, conversational AI or chatbots, either internal or external, and Enterprise Deep Research, which I'm gonna talk about today.

2. 0:23

   But before I jump into Enterprise Deep Research, let me tell you a little bit more about our operating system for agents. First of all, it's a SaaS platform, but also runs on your own VPC or on-premise in your own data center.

3. 0:38

   And here are some of the main features that we really are proud of. We have very advanced multimodal ingest to support images, tables, in a way that makes them, you know, findable and retrieved to be able to make sense of them in a, in a RAG or agentic RAG workflow.

4. 0:56

   Very strong focus on, again, retrieval accuracy with hybrid retrieval, lots of features around metadata, re-ranking, et cetera. And then we're, we're kinda known for a lot of work around hallucination mitigation, both hallucination detection and correction.

5. 1:12

   In fact, our hallucination detection model, also called HHEM, has just passed five mil downloads about couple months ago. I think it's at 5.5 right now or something like that.

6. 1:25

   And generally, our, our operating system platform is what you would need for enterprise-grade deployment, so security, role-based access controls, bring your own model, custom prompts, observability, monitoring, everything you would need.

7. 1:41

   So why does this matter? Well, in any generative AI application, and Enterprise Deep Research is no different, hallucinations are still a problem, and you wanna base your applications on really robust information.

8. 1:57

   In fact, this is, uh, statistics that shows that about 73% of LLM customers implementing use cases say that factual accuracy is their top challenge right now. So that's why we spend so much time in hallucination mitigation, which enables Enterprise Deep Research at really high quality.

9. 2:17

   Okay. So with that in mind, let me jump into what is deep research. Deep research itself is something many of you probably know already. It's when an AI agent conducts in-depth multi-step investigation, usually by autonomously browsing or searching the web in some way, getting results, synthesizing all these results together to generate a comprehensive report for you with

10. 2:41

    citations and all the information you need to answer a particular question. Many have implemented this sort of web-based deep research. Gemini or Google has that, ChatGPT, Anthropic, Perplexity, et cetera.

11. 2:54

    Here's an example of what it looks like. If you haven't used it, I highly encourage you to use it. It's a very powerful tool, and I use this all the time.

12. 3:00

    This is the screenshot of how you choose it in Gemini, for example, and here's how you choose it in ChatGPT. And this is usually something that takes about, you know, twenty, thirty minutes to complete because it does a lot of work underneath the covers.

13. 3:14

    Now, Enterprise Deep Research, think about it as exactly the same idea, only now it goes to your private data. So again, the same process, multi-agent with reflection, with synthesis of the final results, parallel execution of, of agents underneath, and it queries your enterprise data, of course, using, in this case, Vectara agentic RAG capabilities with all the bells

14. 3:38

    and whistles of high accuracy and hallucination mitigation. And then we have corpus understanding, which allows you to plan properly based on your data.

15. 3:49

    There are many really amazing use cases for this, and I'm gonna just mention a few here that I like. One is responding to an RFP. I've had this in my career multiple times when you have to respond to an RFP, and getting the answers to 150 questions is really difficult.

16. 4:06

    So having-- being able to use Enterprise Deep Research to go through all of your enterprise datasets, picking up the right documents and answering those questions is a really cool use case.

17. 4:17

    Employee onboarding is this idea of if you come to a new team or you join a new company and a company wants to onboard you quickly, it's usually very difficult.

18. 4:26

    Nobody knows what's going on. There's no, like, onboarding guide. The last one was generated three years ago, and it's not up to date, et cetera. So again, being able to generate a on-demand onboarding guide using all the documentation we have on Jira or on Notion or Google Drive or SharePoint, very, very powerful.

19. 4:48

    And then in different industries, there's also different use cases. For example, in financial services, you might have the generation of an investment memo as a really cool use case, and you can imagine the same thing in healthcare and insurance and other industries as well.

20. 5:02

    So those are some of the use cases. There's a lot more. I'm Ofer. You can connect with me here in the links I'm showing below. And if you are interested to learn more about Vectara and Enterprise Deep Research, please contact us and we'll happy to, to do a demo for you.

21. 5:17

    Thanks very much.