Latest news with #UnityCatalog
Techday NZ
7 minutes ago
- Business
- Techday NZ
Amperity launches Chuck Data AI agent for Databricks users
Amperity has introduced Chuck Data, an AI agent designed for customer data engineering within Databricks environments. Purpose-built for data engineering Chuck Data is positioned as the first AI assistant specifically tailored for customer data engineering tasks. The agent applies Amperity's identity resolution models, which are based on experience with billions of data sets from over 400 enterprise brands, to streamline and optimise common engineering processes. Chuck operates directly in the terminal and integrates with users' Databricks lakehouse environments. By leveraging native compute and large language model (LLM) endpoints, the agent facilitates workflows such as identity resolution, data profiling, compliance tagging, and personal data identification. According to Amperity, the reliance on manual coding and rules-based systems for preparing customer data has remained a significant bottleneck, even as data infrastructure has advanced. Chuck is intended to address these issues by enabling natural language command "vibe coding", allowing data engineers to delegate tasks to the AI assistant in plain English. Key features and workflow The feature set of Chuck Data centres on efficiency and compliance. Users can access a natural language interface for a range of data engineering operations, including: Identity resolution using Amperity Stitch on Databricks compute infrastructure Personal identifiable information (PII) tagging and customer profiling, interacting with Unity Catalog Zero-copy architecture, ensuring that Chuck does not move or replicate customer data in the process Compliance support through streamlined and accurate PII tagging inside Databricks Derek Slager, Co-Founder and Chief Technology Officer at Amperity, explained the motivation for building Chuck Data and the impact it is expected to have for engineers: "Customer data engineering is full of repetitive, painful work, so we built Chuck to get rid of it. Chuck understands your data and helps you get stuff done faster, whether you're stitching identities or tagging PII. No orchestration, no UI gymnastics—it's just fast, contextual, and command-driven." Chuck can be installed with a single command. Engineers are then able to execute natural language tasks that ordinarily require complex coding, reducing manual effort and expediting the creation of accurate customer profiles at scale. Integration and identity resolution A distinctive feature of Chuck Data is the ability to run Amperity's identity resolution algorithms directly in the user's Databricks environment, replicating the technology from Amperity's established enterprise customer data platform. During its research preview phase, customers can use these capabilities without charge for datasets up to 1 million records, with additional credits provided for larger datasets. Paid options will unlock unlimited data processing, access to Amperity's stable ID algorithms, and the provision of enterprise support for organisations with more demanding requirements. Live demonstrations and capabilities Amperity will be offering live demonstrations of Chuck Data's capabilities including resolving large volumes of customer identities rapidly, generating detailed customer ID graphs, and using artificial intelligence to streamline data engineering workflows. The Chuck Data platform's intended function is to assist organisations to prepare and manage their customer data more efficiently, reducing reliance on manual coding and helping engineers to create business-ready insights in less time.
Cision Canada
22-05-2025
- Business
- Cision Canada
Databricks Announces 2025 Data + AI Summit Keynote Lineup and Data Intelligence Programming
The Data Intelligence for All themed event will feature keynotes from co-founders Ali Ghodsi, Matei Zaharia, Arsalan Tavakoli-Shiraji and Reynold Xin Attendees will hear from Jamie Dimon, Chairman and CEO, JPMorgan Chase; Dario Amodei, Co-founder and CEO, Anthropic; and Satya Nadella, Chairman and CEO, Microsoft SAN FRANCISCO, May 22, 2025 /CNW/ -- Databricks, the Data and AI company, today announced the full agenda and lineup of featured speakers for this year's Data + AI Summit, a global event for the data and AI community. From June 9-12, more than 20,000 data and AI practitioners, leaders, and visionaries from over 160 countries are expected to convene, both at San Francisco's Moscone Center, and tens of thousands more virtually, to discover the latest developments in generative AI, machine learning, analytics and data governance, alongside Databricks' latest product innovations. This year's Summit underscores Databricks' deep and ongoing commitment to San Francisco, building on the company's recent announcement to invest $1 billion into the city over the next three years. Tickets are still available; register here to join data leaders, open source enthusiasts as well as Databricks customers and partners. Data + AI Summit will feature keynotes from Databricks co-founders — and the original creators of Apache Spark™, Delta Lake, MLflow, and Unity Catalog — Ali Ghodsi, Matei Zaharia and Reynold Xin. Attendees will also hear from a broad lineup of data and AI luminaries, open source pioneers and global thought leaders, including: Jamie Dimon, Chairman and CEO, JPMorgan Chase Dario Amodei, Co-founder and CEO, Anthropic Satya Nadella, Chairman and CEO, Microsoft, in a pre-recorded, virtual fireside chat This year's theme, Data Intelligence for All, will showcase how every organization can harness the power of data to develop its own AI apps and agent systems. Attendees can expect to hear from top experts, researchers and open source contributors as they share actionable best practices and compelling insights about their data journeys. Highlights include thought-provoking sessions from data leaders from pioneering companies like Adobe, Apple, AT&T, Block, Doordash, Doctors Without Borders, GM, Joby, Mastercard, Meta, NVIDIA, SAP, Unilever, U.S. Department of Veterans Affairs, Virgin Atlantic and Walmart. The annual event will feature a compelling program including technical training sessions, open source community meetups, networking opportunities and industry-specific breakout events, including the following highlights: 700+ breakout sessions highlighting data intelligence, generative AI, data sharing, data governance and industry trends. Speakers will cover the latest innovations in Databricks AI/BI, Databricks SQL, Delta Sharing, Lakeflow, Mosaic AI, Unity Catalog and more in keynotes, lightning talks and hands-on training. Attendees will also receive technical deep dives on leading open source projects and technologies like Apache Spark™, Delta Lake, MLflow and more. Sessions covering everything from data management and governance to building AI agent systems in practice. Hear from Databricks experts and industry leaders on how they're using data intelligence to drive real business transformation. Industry-specific content tracks that dive into the power of data intelligence within the Financial Services, Healthcare and Life Sciences, Public Sector, Retail and Consumer Goods, Manufacturing & Transportation, Energy & Utilities, Communications, Media and Advertising, Gaming and Tech industries. These forums and breakouts will highlight industry-specific data and AI use cases, customer panels, interactive demos and opportunities to connect with peers and partners in the Industry Lounge. Training and certifications with 30+ paid trainings, instructor-led courses and certification options. Courses will cover everything in the Databricks Data Intelligence Platform, from advanced data engineering to Gen AI model deployment — all hosted by industry-leading technical experts. Networking events for attendees to interact and collaborate with other industry experts. A Welcome Reception will be held on Tuesday, June 10, at 6:00 pm PT, along with additional partner networking events, executive networking events and dozens of evening receptions. Additionally, Databricks' annual party, Data After Hours, will be held at 7 pm PT on Wednesday, June 11. Databricks' annual Women in Data + AI meetup to honor women's remarkable contributions and achievements in artificial intelligence, open source and software development. Learn more about data and AI as panelists share their career journeys, demonstrating how they blazed their own trail in the data and AI field. The new Marketing Forum gathers industry experts and innovators to explore how data and AI are transforming marketing. Discover real-world use cases, customer panels and best practices for data-driven marketing. All-day AI Agents Hackathon to kick off the first day of Summit, welcoming data scientists, engineers and analysts to join forces to create a novel proof of concept or unique technique on the development of innovative AI Agents using the Databricks Data Intelligence Platform! Data + AI Summit will also showcase nearly 200 sponsors and partners, including AWS, Accenture, Deloitte, Google Cloud and Microsoft. Check out the event's full agenda to learn more. Register here. About Databricks Databricks is the Data and AI company. More than 10,000 organizations worldwide — including Block, Comcast, Condé Nast, Rivian, Shell and over 60% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to take control of their data and put it to work with AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake, MLflow, and Unity Catalog. To learn more, follow Databricks on X, LinkedIn and Facebook.
TECHx
17-02-2025
- Business
- TECHx
Confluent & Databricks Unite for AI-Ready Real-Time Data - TECHx Media Confluent & Databricks Unite for AI-Ready Real-Time Data
Confluent, Inc. (NASDAQ:CFLT), a data streaming company, and Databricks, the Data and AI company, have announced an expanded partnership aimed at accelerating AI-driven decision-making with real-time data. The integration of Confluent's Data Streaming Platform with Databricks' Data Intelligence Platform will enable enterprises to streamline data governance and build AI applications more efficiently. A key highlight of this collaboration is the bidirectional integration between Confluent's Tableflow and Databricks' Unity Catalog, ensuring seamless governance across operational and analytical systems. This enhancement allows businesses to access real-time, secure, and discoverable data for AI applications. 'Real-time data is the fuel for AI,' said Jay Kreps, co-founder and CEO of Confluent. 'Together with Databricks, we're ensuring businesses can harness the power of real-time data to build sophisticated AI-driven applications for their most critical use cases.' Databricks CEO and co-founder Ali Ghodsi emphasized the importance of integrating data, AI, analytics, and governance in a unified system. 'We are excited that Confluent has embraced Unity Catalog and Delta Lake as its open governance and storage solutions of choice, and we look forward to delivering long-term value for our customers.' With these new capabilities, businesses will benefit from a more connected data ecosystem. Tableflow's integration with Delta Lake ensures operational data is immediately available for AI tools such as Apache Spark, Trino, Polars, DuckDB, and Daft. Additionally, automatic metadata synchronization between Tableflow and Unity Catalog enhances AI application development by making operational data easily discoverable and actionable. This expanded partnership between Confluent and Databricks represents a major step in bridging the gap between enterprise applications, analytics, and governance—empowering organizations to drive AI innovation at scale.
Mid East Info
17-02-2025
- Business
- Mid East Info
Confluent and Databricks Partner to Usher in New Age of Real-Time AI - Middle East Business News and Information
Confluent, Inc. (NASDAQ:CFLT), the data streaming pioneer, and Databricks, the Data and AI company, today announced a major expansion in their partnership that brings together Confluent's complete Data Streaming Platform and Databricks' Data Intelligence Platform to empower enterprises with real-time data for AI-driven decision-making. New integrations between Confluent's Tableflow and Databricks Unity Catalog will seamlessly govern data across operational and analytical systems, allowing businesses to build AI applications more efficiently. 'Real-time data is the fuel for AI,' said Jay Kreps, co-founder and CEO, Confluent. 'But too often, enterprises are held back by disconnected systems that fail to deliver the data they need, in the format they need, at the moment they need it. Together with Databricks, we're ensuring businesses can harness the power of real-time data to build sophisticated AI-driven applications for their most critical use cases.' 'For companies to maximize returns on their AI investments, they need their data, AI, analytics and governance all in one place,' said Ali Ghodsi, co-founder and CEO, Databricks. 'As we help more organizations build data intelligence, trusted enterprise data sits at the center. We are excited that Confluent has embraced Unity Catalog and Delta Lake as its open governance and storage solutions of choice, and we look forward to working together to deliver long-term value for our customers.' Real-time Data, Ready for AI To bridge the data divide, Confluent and Databricks are announcing new integrations to ensure real-time interoperability and empower teams across the business to collaborate successfully. A bidirectional integration between Confluent's Tableflow with Delta Lake and Databricks' Unity Catalog, a unified and open governance solution for data and AI, will provide consistent, real-time data across operational and analytical systems that is discoverable, secure, and trustworthy. Delta Lake, an open-format storage layer pioneered by Databricks, was originally developed for streaming use cases with fast writes. It has become the most adopted lakehouse format, proven out at a massive scale – processing over 10 exabytes of data daily. Now, Tableflow with Delta Lake makes operational data available immediately to Delta Lake's rich ecosystem. Confluent and Databricks customers will be able to bring any engine or AI tool such as Apache Spark, Trino, Polars, DuckDB and Daft to their data in Unity Catalog. Further, custom integrations between Tableflow and Databricks' Unity Catalog will ensure metadata – a critical enabler for AI applications – is automatically applied to data exchanged between platforms. This makes operational data discoverable and actionable for data scientists and analysts working in Databricks while ensuring analytical data is equally accessible and useful for application developers and streaming engineers in Confluent. Additionally, Confluent's Stream Governance suite will provide upstream governance and metadata to enhance fine-grained governance, end-to-end stream lineage, and automated data quality monitoring in Unity Catalog. With these new capabilities, operational data from Confluent becomes a first-class citizen in Databricks, and Databricks data is easily accessible by any processor in the enterprise. The streaming data topics that AI applications consume and the tables that data analysts use will now have consistent views of the same real-time data, enabling faster, smarter AI-driven decision-making across the organization. This seamless integration between enterprise applications, analytics, and governance is critical for AI innovation at scale.
