logo
Stack Overflow, Databricks partner to boost AI knowledge

Stack Overflow, Databricks partner to boost AI knowledge

Techday NZ3 days ago

Stack Overflow has entered into a partnership with Databricks to make its Knowledge Solutions datasets available through the Databricks Marketplace.
This integration, supported by Delta Sharing, provides customers with direct access to technical knowledge and code verified by millions of contributors across the Stack Overflow platform and Stack Exchange Network.
According to the companies, the collaboration will give Databricks Marketplace users access to what is described as a comprehensive and trusted resource for technical knowledge, which can be used alongside internal knowledge sources within enterprises.
Stack Overflow stated that it remains focused on supporting its community of public platform users, enterprise customers, and partners by evolving its offerings and ensuring knowledge sets are available within ecosystems and marketplaces dedicated to data, analytics, and AI solutions.
The Stack Overflow public platform's body of knowledge, which the company says is continuously updated through community contributions and user feedback, will form part of the knowledge-as-a-service offering within the Databricks Marketplace.
Jay Bhankharia, Senior Director of Marketplace and Data Partnerships at Databricks, said: "As enterprise demand for data intelligence grows, we're thrilled to integrate Stack Overflow's Knowledge Solutions datasets into the Databricks Marketplace. Stack Overflow has long been a pillar of developer knowledge and collaboration, and this integration brings that trusted expertise directly into the data and AI ecosystem. This partnership reflects our shared vision of empowering data-driven enterprises with high-quality, context-rich intelligence that evolves with the needs of both the community and the industry."
Prashanth Chandrasekar, Chief Executive Officer of Stack Overflow, said: "Whether it's using Stack Overflow for Teams, integrated development environments, or in chat apps we continue to strive to support our community in meeting them wherever and however they like to work to deliver a world-class experience that makes their lives easier. Our goal is to set new standards with vetted, trusted, and accurate data that will be the foundation on which technology solutions are built and delivered. By joining the Databricks Marketplace, we expand this ecosystem enabling communities to continue to share knowledge while redirecting LLM providers and AI product developers to have pathways for fair and responsible use of community content."
Databricks Marketplace offers data, analytics, and AI assets from a range of providers, with Delta Sharing enabling cross-platform and multi-cloud data access with security and governance.
The introduction of Stack Overflow Knowledge Solutions follows other recent integrations of Stack Overflow data into the Moveworks AI Agent Marketplace and Snowflake Marketplace earlier this year.
Stack Overflow continues to play a pivotal role in supporting developers and technologists worldwide through its public and private platforms. As one of the most visited websites globally, Stack Overflow enables millions of users to ask questions, share insights, and access technical knowledge exactly when they need it.
Its flagship collaboration tool, Stack Overflow for Teams, is used by more than 20,000 organisations to streamline knowledge distribution, boost operational efficiency, and accelerate innovation. The platform's focus on community-driven learning and real-time support has solidified its position as a market leader in developer enablement and technical collaboration.
Follow us on:
Share on:

Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

CData launches accelerator to simplify Databricks integration
CData launches accelerator to simplify Databricks integration

Techday NZ

time4 hours ago

  • Techday NZ

CData launches accelerator to simplify Databricks integration

CData Software has introduced a new integration accelerator designed to simplify and speed up enterprise data integration for organisations utilising Databricks environments. The CData Databricks Integration Accelerator aims to eliminate traditional data pipeline bottlenecks and shorten integration timelines, enabling companies to make more efficient use of their Databricks Lakehouse investments. Databricks Lakehouse Platform combines data warehousing and artificial intelligence with a unified system for real-time analytics and machine learning. However, integrating data from varied systems can be problematic for enterprises, particularly due to fragmented legacy ETL tools and hybrid environments spanning on-premises and multi-cloud infrastructure. The new accelerator addresses these issues by providing a no-code framework for building scalable ingestion pipelines. It is also designed to simplify transformation tasks and support compliance with data governance frameworks such as Unity Catalogue. "Integrating enterprise data into Databricks often requires extensive custom code and manual configuration, which can introduce delays and increase maintenance overhead," said Manish Patel, Chief Product Officer at CData. "Our Integration Accelerator eliminates those inefficiencies by providing prebuilt connectors, automated pipeline orchestration, and real-time data availability, enabling teams to operationalise data faster and focus on driving value through analytics and AI." The CData Databricks Integration Accelerator is built around four toolkits, each designed to address specific integration challenges. Delta Lake integration The Delta Lake Integration Toolkit allows organisations to ingest data using a no-code approach and supports Change Data Capture (CDC) from over 270 sources. The toolkit provides live data access to business systems — including sales, marketing and finance — using Databricks Lakehouse Federation, while supporting governance through Unity Catalogue. Delta Live Tables The Delta Live Tables (DLT) Extension Toolkit expands connectivity to a broader range of business applications, creating a unified SQL data model via Databricks Spark for straightforward data integration. This toolkit also offers authentication and pagination support for any application programming interface (API), as well as server-side pushdown to improve speed and efficiency. Databricks-Microsoft connectivity With the Databricks-Microsoft Connectivity Toolkit, users can establish standards-based connections between Databricks and the Microsoft software ecosystem. This supports direct integration with products such as SSAS, SSRS and SSIS, maintaining live data connections and Unity Catalogue compatibility. Agentic data pipelines The Agentic Data Pipelines Toolkit focuses on automating data ingestion for agentic workloads, offering programmatic access to serverless PostgreSQL compatible with Databricks serverless deployments. The toolkit enables the instant availability of enterprise data for use by AI agents, provides programmatic orchestration of data pipelines, and processes real-time data from any source using Change Data Capture (CDC). "Everyone needs a good way to load data into their data lake," said Eric Newcomer, CTO and Principal Analyst, Intellyx. "CData has been developing and delivering a broad and deep set of data connectors for more than a decade. Now, Databricks users can leverage not only the proven CData suite of connectors, but also the integration toolkits built on top of them, including SQL data models, Microsoft-specific connections, and MCP servers for AI agent automations." Customer deployment and outcomes NJM Insurance, a provider of personal and commercial insurance policies, has deployed CData's Databricks Integration Accelerator to overhaul its marketing analytics operations. The company reported a 90% reduction in integration build time and saved 66% in project costs by replacing traditional, code-heavy ETL processes with CData's no-code solution. This allowed for quicker insight generation on customer acquisition and lifetime value. "With CData, we were able to ingest our marketing data into Databricks 10 times faster, allowing us to make data-driven decisions more quickly," said Ameya Narvekar, Data Insights Supervisor at NJM Insurance. The CData Databricks Integration Accelerator is now available for organisations seeking to reduce the time and complexity associated with enterprise data integration projects. Follow us on: Share on:

Databricks launches Lakebase Postgres database for AI era
Databricks launches Lakebase Postgres database for AI era

Techday NZ

time9 hours ago

  • Techday NZ

Databricks launches Lakebase Postgres database for AI era

Databricks has launched Lakebase, a fully managed Postgres database designed specifically for artificial intelligence (AI) applications, and made it available in Public Preview. Lakebase integrates an operational database layer into Databricks' Data Intelligence Platform, with the goal of enabling developers and enterprises to build data applications and AI agents more efficiently on a single multi-cloud environment. Purpose-built for AI workloads Operational databases, commonly known as Online Transaction Processing (OLTP) systems, are fundamental to application development across industries. The market for these databases is estimated at over USD $100 billion. However, many OLTP systems are based on architectures developed decades ago, which makes them challenging to manage, inflexible, and expensive. The current shift towards AI-driven applications has introduced new technical requirements, including the need for real-time data handling and scalable architecture that supports AI workloads at speed and scale. Lakebase, which leverages Neon technology, delivers operational data to the lakehouse architecture — combining low-cost data storage with computing resources that automatically scale to meet workload requirements. This design allows for the convergence of operational and analytical systems, reducing latency for AI processes and offering enterprises current data for real-time decision-making. "We've spent the past few years helping enterprises build AI apps and agents that can reason on their proprietary data with the Databricks Data Intelligence Platform," said Ali Ghodsi, Co-founder and CEO of Databricks. "Now, with Lakebase, we're creating a new category in the database market: a modern Postgres database, deeply integrated with the lakehouse and today's development stacks. As AI agents reshape how businesses operate, Fortune 500 companies are ready to replace outdated systems. With Lakebase, we're giving them a database built for the demands of the AI era." Key features Lakebase separates compute and storage, supporting independent scaling for diverse workloads. Its cloud-native architecture offers low latency (under 10 milliseconds), high concurrency (over 10,000 queries per second), and is designed for high-availability transactional operations. The service is built on Postgres, an open source database engine widely used by developers and supported by a rich ecosystem. For AI workloads, Lakebase launches in under a second and operates on a consumption-based payment model, so users only pay for the resources they use. Branching capabilities allow developers to create copy-on-write database clones, supporting safe testing and experimentation by both humans and AI agents. Lakebase automatically syncs data with lakehouse tables and provides an online feature store for machine learning model serving. It also integrates with other Databricks services, including Databricks Apps and Unity Catalog. The database is managed entirely by Databricks, with features such as encrypted data at rest, high availability, point-in-time recovery, and enterprise-grade compliance and security. Market adoption and customer perspectives According to the company, hundreds of enterprises participated in the Private Preview stage of Lakebase. Potential applications for the technology span sectors, from personalised product recommendations in retail to clinical trial workflow management in healthcare. Jelle Van Etten, Head of Global Data Platform at Heineken, commented: "At Heineken, our goal is to become the best-connected brewer. To do that, we needed a way to unify all of our datasets to accelerate the path from data to value. Databricks has long been our foundation for analytics, creating insights such as product recommendations and supply chain enhancements. Our analytical data platform is now evolving to be an operational AI data platform and needs to deliver those insights to applications at low latency." Anjan Kundavaram, Chief Product Officer at Fivetran, said: "Lakebase removes the operational burden of managing transactional databases. Our customers can focus on building applications instead of worrying about provisioning, tuning and scaling." David Menninger, Executive Director at ISG Software Research, said: "Our research shows that the data and insights from analytical processes are the most critical data to enterprises' success. In order to act on that information, they must be able to incorporate it into operational processes via their business applications. These two worlds are no longer separate. By offering a Postgres-compatible, lakehouse-integrated system designed specifically for AI-native and analytical workloads, Databricks is giving customers a unified, developer-friendly stack that reduces complexity and accelerates innovation. This combination will help enterprises maximise the value they derive across their entire data estate — from storage to AI-enabled application deployment." Integration and partner network Lakebase is launching with support from a network of partners, including technology vendors and system integrators such as Accenture, Deloitte, Cloudflare, Informatica, Qlik, and Redis, among others. These partnerships are designed to ease data integration, enhance business intelligence, and support governance for customers as they adopt Lakebase as part of their operational infrastructure. Lakebase is now available in Public Preview with further enhancements planned in the coming months. Customers can access the preview directly through their Databricks workspace.

Databricks One launches to bring AI tools to all employees
Databricks One launches to bring AI tools to all employees

Techday NZ

time9 hours ago

  • Techday NZ

Databricks One launches to bring AI tools to all employees

Databricks has announced the launch of Databricks One, a new platform designed to make data and artificial intelligence tools available to all business users within an organisation, regardless of technical background. Databricks One introduces a code-free interface enabling users such as executives, frontline employees, and team members in finance, marketing, and sales to interact with their data using natural language queries. This update is part of a move to broaden access beyond engineers and data scientists. Accessible analytics The new offering allows employees to explore insights using AI-driven business intelligence dashboards and conversational tools such as AI/BI Genie. These features enable users to ask questions like "Why did sales spike in April?" or "Which region is underperforming and why?", with responses provided in plain language and supplemented by interactive data visualisations. With this new release, the interface has been redesigned to suit non-technical users, making it easier for them to access and interpret the data relevant to their roles. The move aligns with Databricks' stated mission to make data and AI accessible at every organisational level. "Our mission at Databricks is to democratise data + AI. Every person of every skill level should have equal access to work with data and use AI. With Databricks One, we want to make our experience for non-technical users as amazing as our experience for technical users. This is our first step of making this true so that everyone across the organisation can unlock the full value of their data and drive innovation." Ali Ghodsi, Co-founder and Chief Executive Officer of Databricks, underscored the company's aim of putting data-driven decision-making into the hands of all employees. Platform functionality Databricks One incorporates AI/BI Dashboards, allowing teams to generate visualisations and perform analytics such as forecasting and key driver analysis. Notably, none of this requires users to write code. The Genie assistant provides contextual insights and can answer questions using business-specific semantics, with future updates planned for "Deep Research," a feature to assist users in understanding root causes and summarising findings from the data. Alongside analytics, Databricks One incorporates access to Databricks Apps, which are tools organisations can use to integrate workflows that blend analytics, AI, and transactional operations in applications tailored to business needs. Underlying technology Databricks One is built atop the Databricks Data Intelligence Platform. This foundation brings several administrative and technical benefits, including a governance model supported by Unity Catalog, which enables centralised, fine-grained access controls, the organisation of resources by business domain, and consumption auditing. Identity management is managed through direct integration with identity providers such as Entra AD and Okta, and the platform is free from seat-based licensing restrictions. The platform utilises a serverless compute infrastructure to support interactive use at enterprise scale, which, according to Databricks, is offered at a competitive price-to-performance ratio. Customer experiences Organisations trialling Databricks One have highlighted the benefits of making dashboards and data tools available to a broader range of users. Christina Mottolo, Vice President of Business Applications at Wineshipping, remarked, "Through Databricks AI/BI, we developed a suite of dashboards—each of which could benefit any member of Wineshipping. With Databricks One, we will be able to securely deliver these dashboards in an environment that is intuitive and accessible for all users." At HP, the new capabilities have been implemented to speed up and simplify access to insights. Bruce Hillsberg, Vice President of Data Engineering & Insights, Technology & Innovation at HP, said, "Genie is changing how we empower teams at HP. With its intuitive natural language interface, we're enabling users to instantly access critical data, no coding required, making data-driven insights faster and more efficiently." Shahmeer Mirza, Senior Director of Data, AI/ML, and R&D at 7-Eleven, explained how the platform has shifted the internal workflow: "Our business teams have always relied on analysts for sales data and insights. Now, with Unity Catalog and Genie, we're empowering them to access data directly." Availability Databricks One is currently available in Private Preview for customers using the Databricks Data Intelligence Platform and is planned for a broader Beta release to all customers at no additional cost later in the summer.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into the world of global news and events? Download our app today from your preferred app store and start exploring.
app-storeplay-store