Latest news with #SnorkelAI
Forbes
7 days ago
- Business
- Forbes
Snorkel AI Raises $100 Million To Build Better Evaluators For AI Models
Snorkel AI CEO Alex Ratner said his company is placing more emphasis on helping subject matter experts build datasets and models for evaluating AI systems. Alex Ratner, CEO of Snorkel AI remembers a time when data labeling —the grueling task of adding context to swathes of raw data and grading an AI model's response— was considered 'janitorial' work among AI researchers. But that quickly changed when ChatGPT stunned the world in 2022 and breathed new life (and billions of dollars) into a string of startups rushing to supply human-labeled data to the likes of OpenAI and Anthropic to train capable models. Now, the crowded field of data labelling appears to be undergoing another shift. Fewer companies are training large language models from scratch, leaving that task instead to the tech giants. Instead, they are fine-tuning models and building applications in areas like software development, healthcare and finance, creating demand for specialized data. AI chatbots no longer just write essays and haikus; they're being tasked with high stakes jobs like helping physicians make diagnoses or screening loan applications, and they're making more mistakes. Assessing a model's performance has become crucial for businesses to trust and ultimately adopt AI, Ratner said. 'Evaluation has become the new entry point,' he told Forbes. That urgency for measuring AI's abilities across very specific use cases has sparked a new direction for Snorkel AI, which is shifting gears to help enterprises create evaluation systems and datasets to test their AI models and adjust them accordingly. Data scientists and subject matter experts within an enterprise use Snorkel's software to curate and generate thousands of prompt and response pairs as examples of what a correct answer looks like to a query. The AI model is then evaluated according to that dataset, and trained on it to improve overall quality. The company has now raised $100 million in a Series D funding round led by New York-based VC firm Addition at a $1.3 billion valuation— a 30% increase from its $1 billion valuation in 2021. The relatively small change in valuation could be a sign that the company hasn't grown as investors expected, but Ratner said it's a result of a 'healthy correction in the broader market.' Snorkel AI declined to disclose revenue. Customer support experts at a large telecommunication company have used Snorkel AI to evaluate and fine tune its chatbot to answer billing related questions and schedule appointments, Ratner told Forbes. Loan officers at one of the top three U.S. banks have used Snorkel to train an AI system that mined databases to answer questions about large institutional customers, improving its accuracy from 25% to 93%, Ratner said. For nascent AI startup Rox that didn't have the manpower or time to evaluate its AI system for salespeople, Snorkel helped improve the accuracy by between 10% to 12%, Rox cofounder Sriram Sridharan told Forbes. It's a new focus for the once-buzzy company, which spun out of the Stanford Artificial Intelligence Lab in 2019 with a product that helped experts classify thousands of images and text. But since the launch of ChatGPT in 2022, the startup has been largely overshadowed by bigger rivals as more companies flooded the data labelling space. Scale AI, which also offers data labeling and evaluation services, is reportedly in talks to finalize a share sale at a $25 billion valuation, up from its $13.8 billion valuation a year ago. Other competitors include Turing, which doubled its valuation to $2.2 billion from 2021, and Invisible Technologies, which booked $134 million in 2024 revenue without raising much from VCs at all. Snorkel has faced macro challenges too: As AI models like those powering ChatGPT got better, they could label data on a massive scale for free, shrinking the size of the market further. Ratner acknowledged that Snorkel saw a brief period of slow growth right after OpenAI launched ChatGPT and said enterprises had paused pilots with some vendors to consider using AI models for labelling directly. But he said Snorkel's business bounced back in 2023 and has grown since. Ratner said Snorkel's differentiator is its emphasis on bringing in subject matter experts — either its own or those within a company– and using a proprietary method called 'programmatic labelling,' to automatically assign labels to massive troves of data through simple keywords or bits of code as opposed to doing it manually. The aim is to help time-crunched experts like doctors and lawyers label data faster and more economically. As it leans into evaluation, which also requires data generation, Snorkel has started hiring tens of thousands of skilled contractors like STEM professors, lawyers, accountants and fiction writers to create specialized datasets for multiple AI developers, who then use the datasets to evaluate their models (he declined to say which frontier AI labs Snorkel works with). They can also use this data to add new functionality to their chatbots, like the ability to break down and 'reason' about a difficult query or conduct in-depth research on a topic, Ratner said. But even when it comes to building specialized evaluations, Snorkel faces fierce competition— new and old. The top AI companies have released a number of public benchmarks and open source datasets to evaluate their models. LMArena, a popular leaderboard for evaluating AI model performance, recently spun out as a new company and raised $100 million in seed funding from top investors at a hefty $600 million valuation, according to Bloomberg. Plus, companies like Scale, Turing and Invisible, all offer evaluation services. But Ratner said that unlike its rivals, Snorkel was built around human experts right from the start. Saam Motamedi, a partner at Greylock who participated in the round, said these new specialized dataset services are a fast-growing part of Snorkel's business as the industry shifts to what's called 'post training' — the process of tweaking the model's performance for certain applications. AI has already soaked up most of the internet data, making datasets custom-made by domain experts even more valuable. 'I think that market tailwind has proven to be a really good one for Snorkel,' he said. MORE FROM FORBES
Yahoo
29-05-2025
- Business
- Yahoo
Snorkel AI Announces $100 Million Series D and Expanded Platform to Power Next Phase of AI with Expert Data
Snorkel Evaluate and Snorkel Expert Data-as-a-Service empower enterprises to evaluate and tune specialized AI at scale REDWOOD CITY, Calif., May 29, 2025--(BUSINESS WIRE)--Today, Snorkel AI announced general availability of two new product offerings on the Snorkel AI Data Development Platform: Snorkel Evaluate and Snorkel Expert Data-as-a-Service. These launches advance its mission to turn knowledge into specialized AI—helping teams move from prototype to production at scale by leveraging Snorkel AI's programmatic data development technology. In addition, Snorkel AI announced it has raised $100 million in Series D funding at a $1.3 billion valuation, led by Addition. This new funding will fuel continued research and innovation in evaluating and tuning specialized AI systems with expert data. While large language models (LLMs) offer immense potential, enterprises cannot confidently deploy them "off the shelf" for specialized business cases. According to Gartner, through 2026, organizations that fail to establish scalable AI data practices will see over 60% of AI projects abandoned. Achieving production-ready AI requires domain-specific data for fine-grained evaluation and model tuning methodologies. "We are seeing a surge of momentum around agentic AI, but specialized enterprise agents aren't ready for production in most settings," said Alex Ratner, Co-founder and CEO of Snorkel AI. "Enterprises need domain-specific data and expertise to make this a reality. We're excited to deliver on this need and help AI innovators develop expert data to bring their LLM and agentic systems into production with our new offerings, which round out Snorkel's unified AI data development stack." Snorkel Evaluate Snorkel AI is expanding its AI Data Development Platform with the general availability of Snorkel Evaluate, enabling users to build specialized, fine-grained evaluation of models and agents. Powered by Snorkel AI's unique programmatic approach to curating AI ready data, this new offering allows enterprises to scale their evaluation workflows to confidently deploy AI systems to production. Snorkel Evaluate includes programmatic tooling for benchmark dataset creation, the development of specialized evaluators, and error mode correction. These tools help users go beyond generic datasets and off-the-shelf "LLM-as-a-judge" approaches to efficiently build actionable, domain-specific evaluations. "To unlock Claude's full potential, we need new evaluation approaches with domain expertise and human feedback," said Kate Jensen, Head of Revenue at Anthropic. "Anthropic is committed to working with innovators like Snorkel AI to ensure AI systems are refined, reliable, and aligned to enterprise needs." Snorkel Expert Data-as-a-Service Snorkel Expert Data-as-a-Service is a white-glove solution to deliver expert datasets for frontier AI system evaluation and tuning to enterprises. Leading LLM developers are already partnering with Snorkel AI to create datasets for advanced reasoning, agentic tool use, multi-turn user interaction, and domain-specific knowledge. The offering combines Snorkel's network of highly trained subject matter experts with its unique programmatic technology platform for data labeling and quality control, enabling efficient delivery of specialized datasets. Snorkel Expert Data-as-a-Service equips enterprises to mix in-house expertise and data with proprietary datasets developed using outsourced expertise. Snorkel AI's Series D Funding and Market Momentum The rollout of these new offerings underscores Snorkel AI's commercial momentum. Today, the company also announced it has raised $100 million in Series D funding at a $1.3 billion valuation, led by Addition, with participation from Prosperity 7 Ventures, existing investors Greylock and Lightspeed, and existing strategic investors including BNY and QBE Ventures. The round brings Snorkel AIʼs total funding to $237 million since its founding in 2019. This fresh capital supports the company's expansion of its engineering, research, and go-to-market efforts for its unified AI Data Development Platform. "With innovations like Snorkel Expert Data-as-a-Service and Snorkel Evaluate, Snorkel AI enables organizations to build AI models more efficiently and ensure they perform at the highest levels in specialized, real-world applications," said Todd Arfman, Partner at Addition. "This powerful, data-centric approach is accelerating the deployment of reliable AI at scale — and we're proud to partner with Snorkel AI as they redefine what's possible in enterprise AI." The latest round follows Snorkel AI's strong growth trajectory across the Fortune 500 and AI startups, and its wide AI industry recognition, including features in Fast Company's Most Innovative Companies list and Forbes' AI 50. Resources Join Snorkel AI and innovators from Accenture, Comcast, Stanford University, QBE, University of Wisconsin-Madison, and more on June 26 for the virtual live event. Watch the launch video featuring Snorkel's Co-founder and CEO and customer speak on the real-world impact of Snorkel Expert Data-as-a-Service and Snorkel Evaluate. Read the blog post from Snorkel's CEO, expanding on the announcement and what it means for the future of enterprise AI. See how Snorkel Evaluate and Snorkel Expert Data-as-a-Service are used to evaluate and develop a specialized agentic AI system for an enterprise use case in this blog post. About Snorkel AI Snorkel AI is building the Snorkel AI Data Development Platform for evaluating and tuning specialized AI at scale. Snorkel AI's offerings, including Snorkel Evaluate and Snorkel Expert Data-as-a-Service, accelerate evaluation and tuning of specialized AI systems with expert data—helping teams move from prototype to production at scale by leveraging Snorkel AI's programmatic data development technology. Launched out of the Stanford AI Lab, Snorkel AI's platform is used in production by Fortune 500 companies, including BNY, Wayfair, and Chubb, as well as across the U.S. federal government, including the U.S. Air Force. Visit and follow on LinkedIn or @SnorkelAI on X for more information. View source version on Contacts Casey RennerSnorkel AIsnorkel@
Business Wire
29-05-2025
- Business
- Business Wire
Snorkel AI Announces $100 Million Series D and Expanded Platform to Power Next Phase of AI with Expert Data
REDWOOD CITY, Calif.--(BUSINESS WIRE)--Today, Snorkel AI announced general availability of two new product offerings on the Snorkel AI Data Development Platform: Snorkel Evaluate and Snorkel Expert Data-as-a-Service. These launches advance its mission to turn knowledge into specialized AI—helping teams move from prototype to production at scale by leveraging Snorkel AI's programmatic data development technology. In addition, Snorkel AI announced it has raised $100 million in Series D funding at a $1.3 billion valuation, led by Addition. This new funding will fuel continued research and innovation in evaluating and tuning specialized AI systems with expert data. While large language models (LLMs) offer immense potential, enterprises cannot confidently deploy them 'off the shelf' for specialized business cases. According to Gartner, through 2026, organizations that fail to establish scalable AI data practices will see over 60% of AI projects abandoned. Achieving production-ready AI requires domain-specific data for fine-grained evaluation and model tuning methodologies. 'We are seeing a surge of momentum around agentic AI, but specialized enterprise agents aren't ready for production in most settings,' said Alex Ratner, Co-founder and CEO of Snorkel AI. 'Enterprises need domain-specific data and expertise to make this a reality. We're excited to deliver on this need and help AI innovators develop expert data to bring their LLM and agentic systems into production with our new offerings, which round out Snorkel's unified AI data development stack.' Snorkel Evaluate Snorkel AI is expanding its AI Data Development Platform with the general availability of Snorkel Evaluate, enabling users to build specialized, fine-grained evaluation of models and agents. Powered by Snorkel AI's unique programmatic approach to curating AI ready data, this new offering allows enterprises to scale their evaluation workflows to confidently deploy AI systems to production. Snorkel Evaluate includes programmatic tooling for benchmark dataset creation, the development of specialized evaluators, and error mode correction. These tools help users go beyond generic datasets and off-the-shelf 'LLM-as-a-judge' approaches to efficiently build actionable, domain-specific evaluations. 'To unlock Claude's full potential, we need new evaluation approaches with domain expertise and human feedback,' said Kate Jensen, Head of Revenue at Anthropic. 'Anthropic is committed to working with innovators like Snorkel AI to ensure AI systems are refined, reliable, and aligned to enterprise needs.' Snorkel Expert Data-as-a-Service Snorkel Expert Data-as-a-Service is a white-glove solution to deliver expert datasets for frontier AI system evaluation and tuning to enterprises. Leading LLM developers are already partnering with Snorkel AI to create datasets for advanced reasoning, agentic tool use, multi-turn user interaction, and domain-specific knowledge. The offering combines Snorkel's network of highly trained subject matter experts with its unique programmatic technology platform for data labeling and quality control, enabling efficient delivery of specialized datasets. Snorkel Expert Data-as-a-Service equips enterprises to mix in-house expertise and data with proprietary datasets developed using outsourced expertise. Snorkel AI's Series D Funding and Market Momentum The rollout of these new offerings underscores Snorkel AI's commercial momentum. Today, the company also announced it has raised $100 million in Series D funding at a $1.3 billion valuation, led by Addition, with participation from Prosperity 7 Ventures, existing investors Greylock and Lightspeed, and existing strategic investors including BNY and QBE Ventures. The round brings Snorkel AIʼs total funding to $237 million since its founding in 2019. This fresh capital supports the company's expansion of its engineering, research, and go-to-market efforts for its unified AI Data Development Platform. 'With innovations like Snorkel Expert Data-as-a-Service and Snorkel Evaluate, Snorkel AI enables organizations to build AI models more efficiently and ensure they perform at the highest levels in specialized, real-world applications,' said Todd Arfman, Partner at Addition. 'This powerful, data-centric approach is accelerating the deployment of reliable AI at scale — and we're proud to partner with Snorkel AI as they redefine what's possible in enterprise AI.' The latest round follows Snorkel AI's strong growth trajectory across the Fortune 500 and AI startups, and its wide AI industry recognition, including features in Fast Company's Most Innovative Companies list and Forbes' AI 50. Resources Join Snorkel AI and innovators from Accenture, Comcast, Stanford University, QBE, University of Wisconsin-Madison, and more on June 26 for the virtual live event. Watch the launch video featuring Snorkel's Co-founder and CEO and customer speak on the real-world impact of Snorkel Expert Data-as-a-Service and Snorkel Evaluate. Read the blog post from Snorkel's CEO, expanding on the announcement and what it means for the future of enterprise AI. See how Snorkel Evaluate and Snorkel Expert Data-as-a-Service are used to evaluate and develop a specialized agentic AI system for an enterprise use case in this blog post. About Snorkel AI Snorkel AI is building the Snorkel AI Data Development Platform for evaluating and tuning specialized AI at scale. Snorkel AI's offerings, including Snorkel Evaluate and Snorkel Expert Data-as-a-Service, accelerate evaluation and tuning of specialized AI systems with expert data—helping teams move from prototype to production at scale by leveraging Snorkel AI's programmatic data development technology. Launched out of the Stanford AI Lab, Snorkel AI's platform is used in production by Fortune 500 companies, including BNY, Wayfair, and Chubb, as well as across the U.S. federal government, including the U.S. Air Force. Visit and follow on LinkedIn or @SnorkelAI on X for more information.
