How Web Data Infrastructure Powers the Next Generation of AI
AI Engineer World's Fair 2026 · 19:03
Web data infrastructure and scraping APIs
Oxylabs provides infrastructure for collecting public web data at scale, serving AI developers and businesses working in e-commerce, marketing intelligence and cybersecurity. Its products span proxy networks, Web Scraper API, Fast Search API, browser automation and custom datasets. Users can retrieve parsed website data, supply search results to AI workflows, and gather data for model training and retrieval-augmented generation. AI Studio adds a no-code interface for collecting web data through natural-language prompts.
Founded in 2015 by Julius Černiauskas, Oxylabs is now led by CEO Vytautas Savickas, with Černiauskas serving as chairman. Its engineering work includes machine-learning models that adapt data extraction to website layout changes. Its Oxy Parser tool automates HTML parsing by using language models to generate XPath selectors and Pydantic models to validate data; reusable selector caches support repeated extraction tasks.
Oxylabs expanded its portfolio by acquiring Webshare in 2022 and ScrapingBee in 2025, the latter for a reported eight-figure sum. In July 2026, the company reported $350 million in annual recurring revenue and more than 350,000 tech teams worldwide. It also announced its first outside investment: $130 million from Warburg Pincus at a $3.6 billion group valuation.
AI Engineer World's Fair 2026 · 19:03
Affiliations reflect their AIE appearances, not necessarily current employment.
The talk examines load testing and the gap between a system working in development and delivering reliable service in the real world.
Affiliations reflect each recorded session, not necessarily current employment.