How unsanctioned staff AI use exposes firms to data breach?
As chat bots that continue to grow in prominence across the globe and grab the attention of billions of people, a silent problem of privacy breaches is brewing, putting at risk companies that process scores of personal data.
Cybersecurity firm Harmonic Security analysed over 176,000 prompts input by about 8,000 users into popular generative (gen) AI platforms like ChatGPT, Google's Gemini, Perplexity AI, and Microsoft's Copilot, and found that troves of sensitive information make their way into the platforms through the prompts.
In the quarter to March 2025, about 6.7 percent of the prompts tracked contained sensitive information including customer personal data, employee data, company confidential legal and finance details, or even sensitive code.
About 30 percent of the sensitive data were legal and finance data on companies' planned mergers or acquisitions, investment portfolio, legal discourse, billing and payment, sales pipeline, or even financial projections.
Read: AIdentity crisis: How tech is easing online fraudCustomer data like credit card numbers, transactions, or profiles also made their way to these platforms through the prompts, as did employee information like payroll details and employment profiles.
Developers seeking to improve or perfect their codes using genAI tools also inadvertently passed on copyrighted or intellectual property material, security keys, and network information into the bots, exposing their companies to fraudsters.
Asked about the safety of such information, chat bots like ChatGPT always say the information is safe and is not shared with third parties. Even their terms of service say as much, but experts have a warning.
While the information may seem secure within the bots and pose no threat of breach, the experts say it is time companies start checking and restricting what information their employees feed into these platforms, or risk massive data breaches.'One of the privacy risks when using AI platforms is unintentional data leakage,' warns Anna Collard, senior vice president for content strategy at cybersecurity firm KnowBe4 Africa. 'Many people don't realise just how much sensitive information they're inputting.''Cyber hygiene now includes AI hygiene. This should include restricting access to genAI tools without oversight or only allowing those approved by the company.'While a majority of companies around the globe now acknowledge the importance of AI in their operations and are beginning to adopt it, only a few organisations have policies or checks for AI output.
According to McKinsey's latest State of AI survey that interviewed business leaders across the globe, only 27 percent of companies fully review content generated by AI. Forty three percent of companies check less than 40 percent of such content.
But AI use is growing by the minute. Large language Models (LLMs) like ChatGPT have trampled social media apps that have long been digital magnets in user visits and hours of daily interactions.
Read: 'Godfather of AI' now fears it's unsafe. Proposes plan to rein it inMultiple studies, including the one by McKinsey, show that today, nearly three in four employees use genAI to complete simple tasks like writing a speech, proofreading a write-up, writing an email, analysing a document, generating a quotation, or even writing computer programmes.
The rapid proliferation of Chinese-based LLMs like Deepseek is also seen increasing the threat of data breaches to companies. Over the past year, there has been an avalanche of new Chinese chat bots, including Baidu chat, Ernie Bot, Qwen chat, Manus, and Kimi Moonshot among others.'The Chinese government can likely just request access to this data, and data shared with them should be considered property of the Chinese Communist Party,' notes Harmonic in a recent report.
© Copyright 2022 Nation Media Group. All Rights Reserved. Provided by SyndiGate Media Inc. (Syndigate.info).
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The National
31 minutes ago
- The National
Sheikh Khaled chairs Adnoc executive committee meeting
Sheikh Khaled bin Mohamed, Crown Prince of Abu Dhabi and Chairman of the Abu Dhabi Executive Council, on Tuesday chaired a meeting of the executive committee of Adnoc's board of directors. During the meeting, Sheikh Khaled reviewed Adnoc's financial performance in the first quarter of 2025 while being updated on the company's progress in maximising Abu Dhabi's oil and gas resources. The company's new AI tool, MEERAi, was introduced at the meeting. It will be used across Adnoc to enable smarter and quicker decision-making, state news agency Wam reported. Sheikh Khaled was also briefed on Adnoc's participation in the Make it in the Emirates Forum 2025, held in the capital in May, before he highlighted the company's efforts to boost local manufacturing and strengthen the country's industrial base. Adnoc's efforts to support the development of future Emirati leaders in the company was also discussed. Attending the meeting were Dr Sultan Al Jaber, Minister of Industry and Advanced Technology, and Adnoc managing director and group CEO; Ahmed Al Sayegh, Minister of State; Khaldoon Khalifa Al Mubarak, managing director and group CEO of Mubadala Investment Company; and Jassem Mohamed Bu Ataba Al Zaabi, chairman of the Abu Dhabi Department of Finance.
Arabian Business
34 minutes ago
- Arabian Business
AB Majlis podcast: Bayut CEO reveals how AI and transparency are reshaping UAE's real estate market
The UAE's real estate market is undergoing a technological revolution that's fundamentally changing how properties are bought, sold, and valued, according to Haider Khan, CEO of Bayut and Dubizzle, he said on the latest episode of the AB Majlis podcast. Khan, who leads the region's largest property portal, revealed how artificial intelligence, blockchain tokenisation, and enhanced transparency measures are creating a more efficient and trustworthy marketplace while addressing longstanding industry challenges. The property listing accuracy problem that once plagued Dubai's market has significantly improved through sophisticated backend integrations with the Dubai Land Department (DLD), Khan explained during the podcast discussion. 'We've been working very closely with the land department, and there's strong technology integrations that exist in the back end that you don't see in the front end, where we ensure that all the properties that are there have a valid permit,' Khan said. The platform has implemented a comprehensive verification system where brokers must obtain permits from DLD before listings go live. 'We check in the back end from the Land Department if it's a valid permit, and if it is then the listing goes live, otherwise it doesn't,' he added. Beyond permit verification, Bayut introduced TruCheck, a geolocation-based system requiring agents to physically visit properties and submit geotagged photos. 'We essentially ask the agent or the broker to go to the property and take a snapshot which is geotagged, so that we know that they also have accessibility to the property,' Khan explained. Elevating broker standards through recognition The platform's True Broker program represents the first recognition and rewards system of its kind in the region, designed to highlight top-performing agents based on multiple performance metrics. 'We wanted to take the best brokers in the market and highlight them, because the people who provide the best quality of service should hopefully close more business,' Khan said. The system evaluates responsiveness, listing quality, lead interaction speed, and property accessibility. The program has created an organic marketplace for property sellers. 'There are people looking to sell properties [who] don't necessarily know where to start. It's become a very good tool for organically reaching out to brokers to actually sell your property as well,' he noted. Dubai's sustainable growth trajectory Addressing concerns about market overheating, Khan expressed confidence in Dubai's continued growth potential, citing comparative affordability and strong fundamentals. 'If you start looking at price per square foot and you compare to some similar cities across the world, Dubai is still very affordable from that angle,' he said. 'The last two, I would say three years have really been fantastic and remarkable in terms of the growth that we've seen in the industry, but I think there's more room left.' Khan pointed to publicly available bubble index reports showing Dubai at extremely low risk levels. 'Dubai is extremely low on the risk side, it's a lot of it is in the green side. So that gives us a lot of excitement about what's to come in the future.' Supply dynamics also support continued growth, particularly in the villa segment. 'If I look at the villa side, there's not that many units hitting the market in the next year or a couple of years, and I think the absorption on that side should be pretty good,' he explained. Fractional ownership and regulatory innovation The Dubai Land Department's recent launch of fractional ownership experiments represents a significant regulatory evolution that could democratise property investment access. 'DLD launched this experiment which is fractional ownership, or tokenising real estate, and that's going to be interesting,' Khan said. 'It opens up this asset class to a lot of people which historically haven't had access to this, because properties are not cheap, but once you break it down to smaller chunks, it becomes pretty interesting.' While acknowledging the need for proper financial product regulation, Khan expressed optimism about the potential market expansion this could enable. Bayut has emerged as a regional pioneer in AI-powered property search, launching the first conversational AI tool allowing users to describe their property requirements in natural language. 'We launched Bayut GPT which is you can just have a conversation with it in terms of how you want to look for your property, and that gives us a lot of insights into what people are actually looking for,' Khan explained. 'When you can converse with somebody, it's very interesting because you actually start understanding what they're really after.' The platform has also introduced AI-powered listing generation across its broader marketplace. 'We have this feature which is 'sell with AI', so all you need to do is just take a snapshot and it really generates the listing for you. It generates the ad for you, even guides you in terms of how you should price it.' The future of real estate agents Despite AI advances, Khan firmly believes human agents remain irreplaceable in high-value transactions like real estate. 'AI is not going to take your job, but is your job going to be the same job that you do every day today? No. Should you be more productive? Yes. Do you know how to use AI to your benefit? Yes, you should,' he said. The human element becomes crucial for expensive purchases requiring trust and guidance. 'Property is perhaps one of the most expensive things that people buy in their lives. You need a certain factor of trust, and I think that really the human touch is important, somebody giving you that reassurance and even guiding you through the process.' Virtual tours vs. traditional methods Contrary to industry expectations, virtual reality and 3D property tours haven't achieved widespread adoption, with traditional photography remaining the preferred medium for initial property screening. 'The main medium that we've seen over the years that hasn't changed is pictures,' Khan noted. 'You can get a lot more from pictures in a very short amount of time than you can from a video or VR.' Consumer behaviour analysis shows efficiency preferences drive this trend. 'You can go through 10 properties very quickly [with pictures]. If you start watching VR for each one, that can be pretty taxing time-wise,' he explained. Advanced valuation and market intelligence The platform operates eight to ten different AI models for its TruEstimate property valuation tool, while recent acquisition of Property Monitor enhances market intelligence capabilities. 'We're pretty excited about what we can build on top of that and just not show you transaction data, but also start showing you what the demand looks like,' Khan said of the Property Monitor integration. Looking ahead, Khan revealed ambitious AI development plans, including room-level inventory management. 'Wouldn't it be nice if you just take a picture of the entire room and you can pick up all the items and you don't need to create 10 items? We can create that room sale for you.' Market evolution and future outlook Khan positioned the real estate portal evolution from simple classified advertising to sophisticated data platforms providing market insights and predictive analytics. 'We can become very strong data platforms or insight platforms,' he said. 'The point is how can we educate the user at the same time and the brokers and everybody to build that stronger connection that's based on actual factual information.' The technological transformation reflects broader market maturation, with transparency, efficiency, and user experience becoming key competitive differentiators in the UAE's dynamic real estate landscape. Tune in to a new episode of AB Majlis every Monday To listen to the full episode and gain a comprehensive understanding of doing business in the Gulf region, visit our RSS feed or check out AB Majlis on Spotify, Apple Podcasts, and other platforms. Episodes are also available on: Tune in every Monday for weekly episodes that will help you stay ahead of the curve and enrich your understanding of the Gulf region.
Web Release
an hour ago
- Web Release
Moro Hub Signs Strategic Agreement with OpenText to Accelerate Digital Transformation Across UAE
Moro Hub, a subsidiary of Digital DEWA, the digital arm of Dubai Electricity and Water Authority (PJSC), announced a strategic agreement with OpenText™ (NASDAQ/TSX: OTEX), the global leader in Information Management solutions. The agreement empowers Moro Hub to resell OpenText's comprehensive portfolio of AI-enabled solutions and services across the UAE, reinforcing both companies' commitment to driving digital transformation in alignment with the 'We the UAE 2031 Vision. Through this collaboration, Moro Hub will offer public and private sector organizations access to OpenText's best-in-class technologies, including solutions for Content Services, Digital Experience, Security, and advanced Analytics. These offerings will enable customers to modernize operations, enhance data-driven decision-making, and meet the growing demands of a digitally connected world. 'We are excited to work with OpenText, a global leader in information management, to enhance our portfolio and extend even greater value to our customers. This agreement not only strengthens our service offering but also contributes directly to the UAE's smart infrastructure development, setting new benchmarks in efficiency, security, and sustainability,' said Mohammed bin Sulaiman, CEO of Moro Hub. With AI adoption in the Middle East expected to contribute over $320 billion to the regional economy by 2030 (PwC), this partnership positions Moro Hub and OpenText at the forefront of innovation, enabling the delivery of secure, intelligent, and scalable services to businesses and government entities. 'This partnership between OpenText and Moro Hub reflects our shared vision to empower organizations in the UAE to drive innovation through AI-powered technologies. Together, we aim to support national digital transformation efforts and deliver secure, intelligent solutions that enable future-ready operations. Moro Hub is a key digital transformation enabler in the UAE, and we are proud to collaborate with them to help customers modernize and achieve better outcomes,' said Harald Adams, Sales Vice President of Emerging Markets at OpenText. Moro Hub's state-of-the-art data centers—the first in the world to be fully powered by solar energy—align with the UAE's sustainability and innovation goals. Combined with OpenText's leadership in Information Management, this partnership is set to revolutionize the way businesses in the region leverage technology to achieve operational excellence and digital resilience.
