Matillion launches Maia to automate & simplify data engineering
Matillion has introduced Maia, a suite of artificial intelligence-powered data agents designed to streamline data engineering workflows and enhance productivity for data professionals.
Maia acts as a team of AI data engineers that supports the work of existing data professionals, spanning the entire spectrum of data engineering activities. The tool is positioned to ease the manual work typically associated with data pipeline creation, while also making these processes more accessible to users without deep technical expertise.
According to Matillion, Maia agents enable the rapid development of complex, end-to-end data pipelines from natural language prompts. This capability is intended to accelerate project timelines and empower a broader range of users to engage directly in data engineering tasks.
Matthew Scullion, Co-Founder and Chief Executive Officer at Matillion, commented: "Data engineering is centered on repetitive work that is important, but often gritty and sometimes boring. Imagine what could be achieved if the heavy-lifting of that gritty work was taken away so data engineers could focus instead on driving real business value and impact. That is exactly what Maia does - data engineering at the speed of thought."
He added: "Maia takes AI capabilities in data engineering far beyond generating code, working end-to-end across the full workflow of data engineering, including ingestion, transformation, orchestration, data quality, DataOps, management and beyond."
Building on Matillion's Data Productivity Cloud, Maia has been designed with cloud-based data and AI architectures in mind, with the aim of providing trust, speed, and scalability. The forthcoming availability of Maia through the Snowflake Marketplace is expected to expand access for users already utilising the Snowflake data ecosystem.
Kieran Kennedy, Vice President, Data Cloud Products at Snowflake, said: "Maia allows joint Matillon and Snowflake users to do more with their data and AI, regardless of their technical capabilities. Its architecture means that the technology is trusted by design, providing users peace of mind alongside significant productivity gains. We look forward to seeing how users harness Maia to boost data productivity and free up data engineers to innovate and ideate."
Beyond supporting human data teams, Maia also enables collaboration with other AI agents, which can independently request the creation of data pipelines for particular business objectives. This feature is intended to further reduce workflow bottlenecks and facilitate agile data management across various departments and business cases.
Matillion has established a record of integrating AI functionalities into its platform, with Maia following a series of previous AI-focused releases. Earlier offerings began in 2023, with ongoing product efforts in 2024 encompassing integrations with Snowflake Cortex AI and Snowpark Container Services.
The company is currently making Maia available by invitation, allowing selected users to request exclusive access and provide feedback during the early phase of roll-out. Matillion plans to gradually extend access to Maia for its broader user community as development progresses.
Matillion's platform is used globally by enterprises across sectors including technology, finance, energy, and communications for a wide range of data-driven needs, from business analytics to machine learning and AI use cases. Maia is expected to expand these capabilities by automating repetitive work and broadening participation in data engineering.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Techday NZ
2 days ago
- Techday NZ
Snowflake boosts AI with real-time licensed content access
Snowflake has introduced Cortex Knowledge Extensions, allowing enterprises to supplement their AI agents with real-time, licensed content from third-party publishers, with Stack Overflow among the first partners to join the Snowflake Marketplace. The introduction of Cortex Knowledge Extensions enables enterprise customers to enrich their AI applications and agents with updated, reliable content from publishers such as Stack Overflow, USA TODAY, and Packt. This approach ensures proper attribution and licensing of content, distinguishing it from other systems that use scraped material without consent from original publishers. According to Snowflake, this new capability is designed to address challenges faced by both enterprises and publishers. Enterprises often struggle to gain access to timely external information for their AI systems, limiting accuracy and depth of insight. Meanwhile, publishers are seeking a secure and fair way to allow their content to be used by enterprise AI, with assurance of both compensation and control. "Building powerful AI apps and agents at scale hinges on enterprises having access to a wealth of internal and external data that adds rich context to AI outputs. Snowflake is raising the bar on enterprise-wide collaboration to make it even easier for customers to fuel their AI initiatives with AI-ready data and harness the power of agentic apps — regardless of whether the data and apps reside within their own four walls or come from trusted third-party sources. Our latest innovations enable teams to turn possibilities into reality with data and AI, all without worrying about security and governance risk," Prasanna Krishanan, Head of Apps & Collaboration and Horizon at Snowflake, commented on the launch. With Cortex Knowledge Extensions, publishers are able to list their content, such as news articles, textbooks, and research papers, on the Snowflake Marketplace. Enterprises can then purchase this content and integrate it into their AI-powered apps and agents, including Cortex Agents, Cortex Search, and the soon-to-be-available Snowflake Intelligence. This functionality enables AI systems to provide responses informed by timely and relevant information while allowing publishers to monetise their intellectual property under agreed licensing terms. The mechanism for delivering content through Cortex Knowledge Extensions relies on retrieval-augmented generation and is underpinned by Snowflake's Zero-ETL Sharing functionality. This setup empowers publishers to revoke access to content if necessary, while always displaying clear attribution and links to the original source, thereby enhancing reliability and provenance. Alongside Cortex Knowledge Extensions, Snowflake has introduced Semantic Model Sharing, which is currently in private preview. Semantic Model Sharing allows enterprises to integrate and interact with AI-ready structured data within their Snowflake Cortex AI applications — whether the data originates from internal sources or third-party providers. The use of semantic models helps ensure consistency in how data and business concepts are defined and applied across different systems, contributing to more trustworthy and accurate AI outputs. By mapping internal data to standardised semantic models, enterprises can accelerate insights, support more uniform decision-making, and access industry-standard metrics while maintaining governance and version control. Snowflake reports that these advances are intended to eliminate the manual effort required to create semantic models internally, while supporting high-quality, context-rich, and accurate AI responses. Users can directly interact with their data using Semantic Model Sharing in Cortex AI, including Cortex Analyst, Cortex Agents, and Snowflake Intelligence. In addition to content and model sharing, Snowflake is adding support for Agentic Native Apps in its marketplace. This feature provides customers with access to third-party agentic applications, which can securely combine provider and consumer data within the enterprise's governance framework. Data remains within the customer's environment while agents perform tasks such as portfolio management and optimisation, using proprietary algorithms and datasets. Currently, Snowflake Marketplace connects enterprises with over 750 providers, offering more than 3,000 live data, application, and AI products. The introduction of Agentic Native Apps is intended to give providers new ways to distribute and monetise their offerings while allowing enterprises to drive additional value from their data without compromising privacy or security.
Techday NZ
3 days ago
- Techday NZ
Matillion launches Maia to automate & simplify data engineering
Matillion has introduced Maia, a suite of artificial intelligence-powered data agents designed to streamline data engineering workflows and enhance productivity for data professionals. Maia acts as a team of AI data engineers that supports the work of existing data professionals, spanning the entire spectrum of data engineering activities. The tool is positioned to ease the manual work typically associated with data pipeline creation, while also making these processes more accessible to users without deep technical expertise. According to Matillion, Maia agents enable the rapid development of complex, end-to-end data pipelines from natural language prompts. This capability is intended to accelerate project timelines and empower a broader range of users to engage directly in data engineering tasks. Matthew Scullion, Co-Founder and Chief Executive Officer at Matillion, commented: "Data engineering is centered on repetitive work that is important, but often gritty and sometimes boring. Imagine what could be achieved if the heavy-lifting of that gritty work was taken away so data engineers could focus instead on driving real business value and impact. That is exactly what Maia does - data engineering at the speed of thought." He added: "Maia takes AI capabilities in data engineering far beyond generating code, working end-to-end across the full workflow of data engineering, including ingestion, transformation, orchestration, data quality, DataOps, management and beyond." Building on Matillion's Data Productivity Cloud, Maia has been designed with cloud-based data and AI architectures in mind, with the aim of providing trust, speed, and scalability. The forthcoming availability of Maia through the Snowflake Marketplace is expected to expand access for users already utilising the Snowflake data ecosystem. Kieran Kennedy, Vice President, Data Cloud Products at Snowflake, said: "Maia allows joint Matillon and Snowflake users to do more with their data and AI, regardless of their technical capabilities. Its architecture means that the technology is trusted by design, providing users peace of mind alongside significant productivity gains. We look forward to seeing how users harness Maia to boost data productivity and free up data engineers to innovate and ideate." Beyond supporting human data teams, Maia also enables collaboration with other AI agents, which can independently request the creation of data pipelines for particular business objectives. This feature is intended to further reduce workflow bottlenecks and facilitate agile data management across various departments and business cases. Matillion has established a record of integrating AI functionalities into its platform, with Maia following a series of previous AI-focused releases. Earlier offerings began in 2023, with ongoing product efforts in 2024 encompassing integrations with Snowflake Cortex AI and Snowpark Container Services. The company is currently making Maia available by invitation, allowing selected users to request exclusive access and provide feedback during the early phase of roll-out. Matillion plans to gradually extend access to Maia for its broader user community as development progresses. Matillion's platform is used globally by enterprises across sectors including technology, finance, energy, and communications for a wide range of data-driven needs, from business analytics to machine learning and AI use cases. Maia is expected to expand these capabilities by automating repetitive work and broadening participation in data engineering.
Techday NZ
3 days ago
- Techday NZ
Ataccama ONE brings document AI to Snowflake for better data
Ataccama has announced the integration of its unified data trust platform, Ataccama ONE, with Document AI on the Snowflake Marketplace, allowing businesses to transform unstructured content into structured data for analytics and artificial intelligence applications. The announcement from Ataccama enables enterprises to extract, structure, govern, and monitor the quality of unstructured data, making a greater proportion of their information usable for analytics, AI, and business operations. With the majority of enterprise information now classed as unstructured data and continuing to grow rapidly, many organisations struggle to manage this resource effectively. Industry research from IDC indicates that unstructured data accounts for most enterprise data and is expanding by more than 55% annually. According to market findings, 95% of businesses face difficulties in managing their unstructured data, with over half citing it as the most challenging type of information to govern. Unstructured data frequently remains siloed and difficult to leverage, creating operational risk and impacting the reliability of AI systems as these systems increasingly rely on such data for powering large language models and retrieval-augmented generation applications. Through the integration of Ataccama ONE and Document AI within the Snowflake environment, enterprises can convert documents such as contracts, invoices, and PDFs into structured records. Natural language prompts—such as, "What is the effective date of the contract?"—are processed by the Arctic-TILT large language model developed by Snowflake, generating structured outputs stored directly in Snowflake tables. Ataccama ONE then connects to the resulting data tables to profile the data, perform quality checks, and manage governance policies on the structured outputs. The system also allows companies to follow the data through analytics, reporting, and AI workflows by capturing lineage at the table level. Additional metadata can be added from the original documents to increase traceability where required. This process aims to reduce manual intervention, build trust in the data, and enable repeatable workflows for business teams. Speaking to the importance of unlocking value from unstructured data, Sam Wong, Senior Director of Data & AI at a global beverage company, said: "Unstructured data is an untapped data source as real business context lives there, but it's also the hardest to govern. Documents, contracts, and communications contain the terms, conditions, and risks that structured systems miss. Without a way to extract, validate, and manage that information at scale, AI lacks the foundation it needs to be reliable. With Ataccama ONE and Document AI inside Snowflake, organizations can turn thousands of documents into trusted, structured data. That will give us improved analytics, enhanced data quality, and a better foundation for powerful and trustworthy AI." This integration offers several capabilities for users. Companies can extract structured data from documents using natural language, specifying prompts such as "What is the payment term?" to convert unstructured information into structured outputs without the need for custom code. The extracted data is immediately available for use in reporting, analytics, and AI activities, as it is saved directly into Snowflake tables, ready for consumption by business intelligence tools and model pipelines without further transformation. Ataccama ONE provides automated profiling and rule-based validation to monitor the quality of unstructured data on a continual basis, assisting teams in detecting inconsistencies and managing risks early. Document AI models can be trained and reused within Snowsight, allowing for standardised extraction across various document types at scale, including contracts, invoices, and policies. All processes, validation, and governance are performed natively in Snowflake, reducing integration complexity and improving security. Jay Limburn, Chief Product Officer at Ataccama, said: "Unstructured data remains a black box for most organizations, even as it becomes critical for AI and business operations. Without a way to structure, govern, and trust that information, enterprises risk missing the full value of their data. Ataccama ONE combines data quality, governance, observability, lineage, and master data management in a single platform and now extends those capabilities to unstructured content. This allows organizations to improve trust and confidence in all their data, structured and unstructured alike, and build a stronger foundation for AI, analytics, and operational decision-making." Kieran Kennedy, Vice President, Data Cloud Products at Snowflake, said: "Ataccama's presence on Snowflake Marketplace reinforces the value of our integrated platform approach that allows our partners to bring their innovative solutions to market within the Snowflake environment. With this solution, joint customers have the power to streamline document extraction, ensure data quality, and accelerate insight delivery, all within a governed and scalable environment."
