Confluent Announces New Cloud Capabilities For Data Streaming
'Agentic AI is moving from hype to enterprise adoption as organizations look to gain a competitive edge and win in today's market,' said Shaun Clowes, Chief Product Officer at Confluent. 'But without high-quality data, even the most advanced systems can't deliver real value. The new Confluent Cloud for Apache Flink features make it possible to blend real-time and batch data so that enterprises can trust their agentic AI to drive real change.'
Bridging the Real-Time and Batch Divide
'The rise of agentic AI orchestration is expected to accelerate, and companies need to start preparing now,' said Stewart Bond, Vice President of Data Intelligence and Integration Software at IDC. 'To unlock agentic AI's full potential, companies should seek solutions that unify disparate data types, including structured, unstructured, real-time, and historical information, in a single environment. This allows AI to derive richer insights and drive more impactful outcomes.'
Agentic AI is driving widespread change in business operations by increasing efficiency and powering faster decision-making by analyzing data to uncover valuable trends and insights. However, for AI agents to make the right decisions, they need historical context about what happened in the past and insight into what's happening right now. For example, for fraud detection, banks need real-time data to react in the moment and historical data to see if a transaction fits a customer's usual patterns. Hospitals need real-time vitals alongside patient medical history to make safe, informed treatment decisions. But to leverage both past and present data, teams often have to use separate tools and develop manual workarounds, resulting in time-consuming work and broken workflows. Additionally, it's important to secure the data that's used for analytics and agentic AI; this ensures trustworthy results and prevents sensitive data from being accessed.
Snapshot Queries Unify Processing on One Platform
In Confluent Cloud, snapshot queries let teams unify historical and streaming data with a single product and language, enabling consistent, intelligent experiences for both analytics and agentic AI. With seamless Tableflow integration, teams can easily gain context from past data. Snapshot queries allow teams to explore, test, and analyze data without spinning up new workloads. This makes it easier to supply agents with context from historic and real-time data or conduct an audit to understand key trends and patterns. Snapshot queries are now available in early access.
CCN Routing Simplifies Private Networking for Flink
Private networking is important for organizations that require an additional layer of security. Confluent offers a streamlined private networking solution by reusing existing CCNs that teams have already created for Apache Kafka clusters. Teams can use CCN to securely connect their data to any Flink workload, such as streaming pipelines, AI agents, or analytics. CCN routing is now generally available on Amazon Web Services (AWS) in all regions where Flink is supported.
IP Filtering Protects Flink Workloads in Hybrid Environments
Many organizations that operate in hybrid environments need more control over which data can be publicly accessed. IP Filtering for Flink helps teams restrict internet traffic to allowed IPs and improves visibility into unauthorized access attempts by making it easier to track the attempts. IP Filtering is generally available for all Confluent Cloud users.
Now organizations can more easily turn the promise of agentic AI into a competitive advantage. To learn more about the other new Confluent Cloud features, including the Snowflake source connector, cross-cloud Cluster Linking, and new Schema Registry private networking features, check out the launch blog. 0 0
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The National
5 days ago
- The National
Data centre storage games: Winning the AI race
The UAE is known for meeting ambitious development goals, and this certainly applies to the country's digital transformation and its goal of becoming an AI leader. The region, which appointed the world's first minister of AI in 2017 and established the world's first university dedicated to AI research in 2019, has attracted international interest, with initiatives such as the UAE-US AI Campus or the MGX Fund to mobilise up to $100 billion investment in AI infrastructure. When building these AI ecosystems, the focus is on generative AI models (GenAI), graphics processing units (GPUs), central processing units (CPUs), fast data storage, and highly skilled workers. However, fundamental IT infrastructures such as hard disk drive-based storage are often undervalued, even though they store huge unstructured data sets cost-effectively. To tap into the full potential of AI and keep the region at the forefront of technological advancements, regional CIOs and IT decision-makers need to look beyond processing power and rethink their storage approach to AI data workflows. The importance of HDDs for AI AI revolves around unstructured data — from ingestion and data preparation (including vectorisation, labelling) to training, interference, content generation and monitoring – and every step needs and creates more data. Given the global AI boom, the amount of information is exploding. According to IDC, the annual volume of data generated is expected to more than double to 527.5 zettabytes in 2029. To illustrate: if this data were to be stored on an HDD with 32 terabytes, 16.48 billion drives would be required. Stacked, they would build a 438.5km tall tower, stretching nearly eleven times around the Earth. To store this unimaginable amount, there is one technology that performs this task cost-effectively and energy efficiently while remaining powerful at scale. Maintaining a share of 80 per cent in the cloud by 2028, according to IDC, high-capacity HDDs with up to 32TB are becoming indispensable in AI data centres just like GPUs and CPUs. To fully enable effective storage systems for these data-hungry pipelines, IT decision makers and CIOs should consider: Highly Dense Architectures HDDs with innovations such as energy-assisted magnetic recording (EAMR), shingled magnetic recording (SMR), and helium-sealing are fuelling capacity increases without expanding the physical footprint of data centres. This saves on server racks or storage enclosures and can decrease cooling and power consumption costs. In fact, HDDs are approximately six times more cost-efficient than flash solutions. Moving from 26TB to 32TB drives to deploy one exabyte of storage, for example, can lead to 18.7 per cent fewer racks, 18.8 per cent fewer drives, and 18.8 per cent lower total power consumption, including a boost in cooling and power usage effectiveness. While results vary depending on workload requirements and setup, such efficiencies can reduce the total cost of ownership, helping IT teams meet performance demands without building more or bigger facilities and increasing costs. Energy efficiency and sustainability With AI systems scaling up, so does the environmental cost of working with unstructured data. Modern technologies consume enormous amounts of energy when processing and storing the constantly growing information volumes. According to current estimates, the electricity demand of data centres worldwide will more than double to around 945 terawatt hours (TWh) by 2030 – roughly equivalent to the total electricity consumption of the UAE between 2017 and 2023 (952 TWh). While this may sound bleak, it can be an opportunity to lead the way in sustainability and help meet regional net-zero targets. Again, HDDs can play a pivotal role in this transformation. To help reduce power consumption and emissions, IT decision makers must improve hardware efficiency. As high-capacity HDDs are the foundation of today's cloud environments, any effort to consolidate more capacity in the same 3.5in footprint can go a long way. Over the past years, HDD manufacturers have constantly innovated the technology to enable even lower energy use per TB (kW/TB). Drives from Western Digital with up to 32TB, for example, leverage the latest generation of HelioSeal technology. This innovation helps to reduce the total power consumption (including energy and cooling costs) of these HDDs by up to 28 per cent compared to standard air-filled drives. Ultimately, this can contribute to greater sustainability in the data centre and extend the hardware lifespan. Disaggregated storage In addition to HDD-based storage, disaggregated storage based on Non-Volatile Memory Express over Fabric (NVMe-oFTM ) is a transformative approach to modern data centres. The concept is no longer confined to hyperscalers; it's rapidly gaining traction to help support AI and accelerate workloads. Disaggregated infrastructures enable right-sized, independent scaling of compute, storage, and networking, eliminating the need for costly overprovisioning. Unlike traditional storage architectures that require adding entire servers when only one element needs expansion, disaggregated storage separates the GPU, CPU, and storage servers to better meet the different power, cooling, and space requirements. This gives customers better flexibility, unlocks further efficiencies, and lowers the overall TCO compared to tightly coupled HCI environments. The future of the UAE IT infrastructure is about building and using resources smartly. CIOs who embrace innovative HDD storage solutions and disaggregated storage architectures today will be best positioned to scale effectively without waste, unlocking the full potential of their AI investments for the future.
Zawya
7 days ago
- Zawya
700 young South Africans to enter real estate through new incubator
In a bold move to tackle South Africa's youth unemployment challenges and transform the country's real estate sector, Property Point has launched the Real Estate Incubator Programme. The incubator programme has been established through support from the National Pathway Management Network (NPMN) Innovation Fund, a grant initiative led by the Department of Employment and Labour (DEL), under the auspices of the Presidential Youth Employment Initiative (PYEI). This fund is administered by the Industrial Development Corporation (IDC). The programme will empower 699 young South Africans with industry-specific training, tools, and financial support to launch sustainable careers in real estate. Participants will gain access to employment and entrepreneurial opportunities through a structured pathway that removes long-standing barriers to entry. Real estate remains one of South Africa's least transformed sectors. High licensing costs, lack of monthly income security, and limited industry access have historically excluded young and marginalised young people with talent. This programme directly addresses these barriers through: - Paid stipends during ramp-up, - Licensing and equipment support, - Personal training and development programmes, - Hands-on mentorship with top real estate brands, - Market access/facilitation-research, procurement and business linkages for the young entrants. With South Africa's youth unemployment rate at a staggering 62.4% (ages 15 - 24), this initiative is not just a job creation programme - it's a movement toward inclusive transformation in one of the country's least transformed industries. Shawn Theunissen, founder of Property Point, leads this vision: 'We're not just creating jobs - we're building futures, businesses, and ownership opportunities where none existed before." Key outcomes of this initiative include: - 699 youth who will be trained and placed nationally or establish their own property business. - Strategic partnerships with leading real-estate brands. - Income-generating pathways in sales, rentals, and managed leases. - A scalable model for national replication and long-term industry impact. Young people who want to join the real estate industry, can apply on Property Point's digital platform. Importantly, no previous real-estate experience is required. However, only those with a keen interest and passion for selling and letting properties, will stand a chance in becoming the future industry leaders in the real estate sector. With youth unemployment at crisis levels, initiatives like this go beyond temporary job placement. The Real Estate Incubator Programme reimagines how young people engage with work, positioning them as future landlords, developers, property managers, and entrepreneurs. By offering paid learning, real income, and structured mentorship, the initiative sows the seeds for long-term wealth creation and sector transformation. As South Africa seeks scalable models to address youth unemployment, the Real Estate Incubator is more than a pilot, it is a blueprint for transforming industries through inclusive innovation. It also reflects the growing momentum behind the Innovation Fund's mission: to back ideas that unlock economic pathways for the youth of our country. Said Sonja Loggenberg who heads the IDC's partnership programme: 'At a time when South Africa's youth unemployment is as high as it is, the need for bold, practical, and scalable interventions has never been more urgent. Youth unemployment is more than an economic issue, it is a national emergency threatening to undermine the country's long-term stability, growth, and social cohesion. 'The Innovation Fund was created to unlock bold solutions to youth unemployment, and this is a good example of how reimagined industries can become engines of both transformation and inclusion,' said Mapaseka Setlhodi who is the NPMN lead, PYEI.
TECHx
01-08-2025
- TECHx
NETSCOUT Enhances DDoS Defense with AI-Powered Features
Home » Emerging technologies » Cyber Security » NETSCOUT Enhances DDoS Defense with AI-Powered Features NETSCOUT SYSTEMS, INC. (NASDAQ: NTCT) observability, AIOps, and cybersecurity solutions, has announced new AI-driven enhancements to its NETSCOUT Arbor Edge Defense and Arbor Enterprise Manager platforms. These updates aim to help customers automate operations, improve reporting, and strengthen defenses against evolving Distributed Denial of Service (DDoS) threats. The enhancements leverage artificial intelligence to accelerate detection and response, offering stronger protection for critical applications and services. The solutions are powered by the ATLAS Intelligence Feed. This feed monitors over 700 Tbps of global internet traffic across more than 500 ISPs and 2,000 enterprise sites in over 100 countries. It provides real-time threat intelligence, enabling NETSCOUT products to mitigate up to 80% of DDoS attacks without the need for additional analysis. According to IDC, 41% of organizations report online attacks, including DDoS incidents, cost them over $100,000. About 5% have reported losses exceeding $1 million. The increasing use of AI/ML in launching attacks underscores the need for automated, intelligent defense systems. New capabilities include: Scoped user access for better data segmentation and team visibility. Automated IP protocol flooding detection and mitigation. Enhanced DDoS dashboards for improved operational insights. On-demand reporting for streamlined communication across security teams. Scott Iekel-Johnson, area vice president of DDoS and threat intelligence at NETSCOUT, said these innovations reflect the company's commitment to helping enterprises stay ahead of complex threats while simplifying management. The company reiterated its Adaptive DDoS Protection strategy as critical to tackling the growing scale and sophistication of cyberattacks.
