Perilous prompts: How generative Artificial Intelligence (AI) is leaking companies' secrets
Beneath the surface of GenAI's outputs lies a massive, mostly unregulated engine powered by data – your data. And whether it's through innocent prompts or habitual oversharing, users are feeding these machines with information that, in the wrong hands, becomes a security time bomb.
A recent Harmonic report (https://apo-opa.co/3Sw1K4N) found that 8.5% of employee prompts to generative AI tools like ChatGPT and Copilot included sensitive data – most notably customer billing and authentication information – raising serious security, compliance, and privacy risks.
Since ChatGPT's 2022 debut, generative AI has exploded in popularity and value – surpassing $25 billion in 2024 (https://apo-opa.co/3Z7wOf2) – but its rapid rise brings risks many users and organisations still overlook.
'One of the privacy risks when using AI platforms is unintentional data leakage,' warns Anna Collard, SVP Content Strategy&Evangelist at KnowBe4 Africa. 'Many people don't realise just how much sensitive information they're inputting.'
Your data is the new prompt
It's not just names or email addresses that get hoovered up. When an employee asks a GenAI assistant to 'rewrite this proposal for client X' or 'suggest improvements to our internal performance plan,' they may be sharing proprietary data, customer records, or even internal forecasts. If done via platforms with vague privacy policies or poor security controls, that data may be stored, processed, or – worst-case scenario – exposed.
And the risk doesn't end there. 'Because GenAI feels casual and friendly, people let their guard down,' says Collard. 'They might reveal far more than they would in a traditional work setting – interests, frustrations, company tools, even team dynamics.'
In aggregate, these seemingly benign details can be stitched into detailed profiles by cybercriminals or data brokers – fuelling targeted phishing, identity theft, and sophisticated social engineering.
A surge of niche platforms, a bunch of new risks
Adding fuel to the fire is the rapid proliferation of niche AI platforms. Tools for generating product mock-ups, social posts, songs, resumes, or legalese are sprouting up at speed – many of them developed by small teams using open-source foundation models. While these platforms may be brilliant at what they do, they may not offer the hardened security architecture of enterprise-grade tools. 'Smaller apps are less likely to have been tested for edge-case privacy violations or undergone rigorous penetration tests and security audits,' says Collard. 'And many have opaque or permissive data usage policies.'
Even if an app's creators have no malicious intent, weak oversight can lead to major leaks. Collard warns that user data could end up in:
● Third-party data broker databases
● AI training sets without consent
● Cybercriminal marketplaces following a breach
In some cases, the apps might themselves be fronts for data-harvesting operations.
From individual oversights to corporate exposure
The consequences of oversharing aren't limited to the person typing the prompt. 'When employees feed confidential information into public GenAI tools, they can inadvertently expose their entire company,' (https://apo-opa.co/3Hked9o) explains Collard. 'That includes client data, internal operations, product strategies – things that competitors, attackers, or regulators would care deeply about.'
While unauthorised shadow AI remains a major concern, the rise of semi-shadow AI – paid tools adopted by business units without IT oversight – is increasingly risky, with free-tier generative AI apps like ChatGPT responsible for 54% of sensitive data leaks due to permissive licensing and lack of controls, according to the Harmonic report.
So, what's the solution?
Responsible adoption starts with understanding the risk – and reining in the hype. 'Businesses must train their employees on which tools are ok to use, and what's safe to input and what isn't," says Collard. 'And they should implement real safeguards – not just policies on paper.
'Cyber hygiene now includes AI hygiene.'
'This should include restricting access to generative AI tools without oversight or only allowing those approved by the company.'
'Organisations need to adopt a privacy-by-design approach (https://apo-opa.co/3Ze1hbj) when it comes to AI adoption,' she says. 'This includes only using AI platforms with enterprise-level data controls and deploying browser extensions that detect and block sensitive data from being entered.'
As a further safeguard, she believes internal compliance programmes should align AI use with both data protection laws and ethical standards. 'I would strongly recommend companies adopt ISO/IEC 42001 (https://apo-opa.co/3HmoD8l), an international standard that specifies requirements for establishing, implementing, maintaining and continually improving an Artificial Intelligence Management System (AIMS),' she urges.
Ultimately, by balancing productivity gains with the need for data privacy and maintaining customer trust, companies can succeed in adopting AI responsibly.
As businesses race to adopt these tools to drive productivity, that balance – between 'wow' and 'whoa' – has never been more crucial.
Distributed by APO Group on behalf of KnowBe4.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Zawya
8 hours ago
- Zawya
Zimbabwe's Gas Future Gains Momentum as Invictus Energy Joins African Energy Week (AEW) 2025
Scott Macmillan, Founder and Managing Director of Invictus Energy, will speak at African Energy Week (AEW): Invest in African Energies – taking place September 29 to October 3 in Cape Town -, bringing critical insight into Zimbabwe's burgeoning upstream sector. His participation comes at a pivotal time, as Invictus spearheads Zimbabwe's first confirmed commercial gas discovery at the Cabora Bassa Basin, marking a major milestone in the country's pursuit of energy self-sufficiency and regional trade integration. The Mukuyu gas field, located in the Cabora Bassa project area, represents Zimbabwe's entrance into the league of African gas producers. Following successful exploration results and the award of Environmental and Social Impact Assessment approvals, Invictus is now advancing the project towards commercialization. The company recently secured the green light to begin pilot production activities, including supplying gas to the Eureka Gold Mine gas-to-power project – a step that not only monetizes gas resources but also supports domestic power generation. Building on this momentum, Invictus has selected the Musuma-1 well for its next high-impact drilling campaign. Situated outside the Mukuyu discovery area, the well targets an estimated 1.2 trillion cubic feet of gas and 73 million barrels of condensate, unlocking further potential within the greater Cabora Bassa Basin. This next phase aims to de-risk additional stacked targets and expand Zimbabwe's upstream footprint in a region with significant geological potential. 'Invictus Energy's progress in unlocking Zimbabwe's natural gas potential exemplifies the critical role upstream exploration and development play in Africa's energy transition. The Cabora Bassa project is a flagship example of how new resources can power economic growth while supporting cleaner energy solutions,' said NJ Ayuk, Executive Chairman of the African Energy Chamber. Invictus' progress aligns with the broader goals of AEW: Invest in African Energies 2025 – the continent's premier platform for energy investment and project development. As Zimbabwe works to diversify its energy mix and leverage its natural resources for industrial growth, the participation of companies like Invictus sends a clear message to global investors: Zimbabwe is open for energy business. With a focus on exploration, development and monetization of African gas, Invictus Energy's involvement at AEW: Invest in African Energies 2025 will showcase the company's strategic vision, technical capability and role in unlocking new frontiers for investment. Distributed by APO Group on behalf of African Energy Chamber. About African Energy Week (AEW): AEW: Invest in African Energies is the platform of choice for project operators, financiers, technology providers and government, and has emerged as the official place to sign deals in African energy. Visit for more information about this exciting event.
Khaleej Times
9 hours ago
- Khaleej Times
'We sleep much better': Why Zayed Sustainability Prize winner lit up remote Africa
Spending the first five years of her life in the turmoil of Lebanon's civil war in the early 1980s, Angela Homsi remembers a world without electricity and basic luxuries. That memory shaped her mission to bring clean, sustainable energy to underserved communities, especially in Africa. Now, over four decades later, Homsi is leading Ignite Power, a renewable energy company she co-founded, from a new global headquarters in Abu Dhabi. 'We cannot be more excited by this latest development,' Homsi, winner of the 2024 Zayed Sustainability Prize in the Energy category, told Khaleej Times. 'There's no nation out there in the world more aligned with what we want to do and achieve with our impacts than the UAE.' Ignite Power provides solar-powered electricity and internet to some of Africa's most remote communities. The company currently operates in 15 countries and is aiming to reach 100 million people over the next five years. 'We're on a very high growth path, and the UAE is really at the centre of 2.5 to 3 billion people. It's a very strategic location for logistics, economic power, and influence.' Lighting up lives The impact of Ignite's work is far-reaching. In rural Rwanda, the arrival of solar home systems has transformed daily life for families. 'Now, with the lights, we sleep much better,' said Mukande Qwe, a mother of three in Gisagara. 'We used to sleep with the cows before because it wasn't safe to leave them outside due to the many thefts after dark. Now, thanks to the light, we keep them outside, and everybody has more room to sleep comfortably.' Beneficiaries across the country echoed similar stories of transformation. Nakabonye Daforosa, a 70-year-old resident of Rulindo, said: 'My granddaughter is able to do her homework after dark and is getting higher grades. The radio helps me stay updated… the solar torch allows me to walk outside after dark.' Odetta Musabyimana, 58, lives alone in Gisagara. 'I feel much safer with the lights on… I also save 100 francs a month since I don't have to buy petrol anymore. I have time to make mattresses, giving them to neighbours and friends who cannot afford to buy one.' Other households have seen a boost in agricultural output and income. 'Before we had light, we sold 20kg of beans and 30kg of maize, and now we are selling 40kg of beans and 60kg of maize,' said Tasiana Irikunze, a mother of two from Kabunjwiri village. 'When we didn't have light, we lost crops due to rotting. Now we have more time to process them.' Solar-powered irrigation has also made a difference. 'We used to sell 200kg, and now it is 500kg,' said Mukamparaye Jeanne from Kivomo. 'Before, we used a generator and petrol to fuel it, 5L per day… extremely expensive and not even half as beneficial.' For Nsabimana Deogen, a farmer and mother in Rulindo, the benefits are personal and financial. 'With proper light, I can cook clean food, and my family's health has gotten much better for it. The light has given my children time to study and do their homework, their grades are rising, and they have much higher motivation to succeed.' Homsi, now 44, was born in Lebanon in 1980 and moved to Cairo at age five. She later lived in Europe and pursued a career in investment, working with Goldman Sachs and Generation Investment Management, the sustainability fund chaired by former US Vice President Al Gore. 'I always wanted to make an impact on the wider continent,' she said. 'To do something that will change the direction of Africa and the Middle East.' Ignite began not as a company, but as a white paper. 'Most countries in Africa only had around 20 per cent of their population with access to electricity,' Homsi explained. 'Eighty percent were using kerosene lamps, damaging to health, education, and economic development.' The first project was launched in Rwanda after Homsi and her team presented a vision to the country's president. 'We supported writing a proper socio-economic feasibility study on how Rwanda could become the first fully connected country in Africa.' Growth through Abu Dhabi Since receiving the Zayed Sustainability Prize, Homsi said Ignite has grown eightfold. 'That's huge. Above and beyond our own expectation,' she said. The award helped raise visibility and credibility. 'We've always had our head on the ground, making sure every single dollar goes to the deepest possible impact." "The prize helped us tell our story.' One of the company's most promising initiatives is the solar-plus-internet deployment in schools. 'We deployed the first 30 schools right after the prize,' she said. 'That pilot is now shaping the way for the next 10,000 schools in multiple countries.' Homsi believes Abu Dhabi offers the infrastructure and values to support the firm's ambitious growth. 'We've already incorporated in the UAE, finalised office spaces, and started hiring. The office will host our senior management, R&D, business development, procurement, and public affairs roles — functions that cover multi-country operations.' She also plans to deepen ties with UAE universities. 'I dedicate a large amount of my time to education, advocacy, teaching… we need more youth to be inspired, to take over the flame, and carry on the mission.' For Homsi, impact and scale go hand in hand. 'You cannot scale the amount of people you will impact… if you cannot scale your business. It has to be a strong business that attracts top talent and achieves deep, lasting change,' she concluded.
Zawya
9 hours ago
- Zawya
Eswatini is embracing untapped European Union (EU) export opportunities
As global trade shifts and new tariffs emerge, Eswatini is turning challenge into opportunity by deepening its trade ties with the European Union. With significant untapped export potential, the country is working with ITC and the EU to boost competitiveness, create jobs, and empower local entrepreneurs. As global trade dynamics shift and new tariff barriers emerge, Eswatini is leveraging its strengths and seizing fresh opportunities – particularly with the European Union (EU). Under the EU–SADC Economic Partnership Agreement (EPA), Eswatini has duty-free, quota-free access to the EU market and an estimated $114 million in untapped export potential. The International Trade Centre (ITC), in partnership with the EU and the Government of Eswatini, is working to unlock that potential through the 'Promoting Growth through Competitive Alliances' programme. While Eswatini faces indirect pressure from the recent 10% U.S. tariff hike – largely due to its economic integration with South Africa – its trade with the EU remains a source of resilience and growth. 'The current trade climate is a concern, but it also creates an opening for Eswatini to reposition itself as a stable and competitive export hub,' says Mawenzi Dlamini, ITC's Project Operations Manager in Eswatini. Eswatini's exports to the EU hit $106.4 million in 2024, and there's room to grow. ITC's programme is addressing key constraints to competitiveness by supporting trade policy, market access, and institutional capacity. 'We're strengthening the regulatory environment, building national dialogue platforms, and helping define a clear investment roadmap,' explains Owen Skae, Consultant to the programme. At the enterprise level, the programme is fostering inclusive growth by supporting smallholder producers, artisans, and entrepreneurs – especially women and youth – to meet EU standards and access new buyers. From sustainable agri-processing to emerging artisan brands like Tintsaba and Indzaba Yami, Eswatini's producers are showcasing their talent, heritage, and quality on international stages such as Paris Design Week. Through tailored training, digital tools like the Export Potential Map, and connections with EU buyers, ITC is helping Eswatini build long-term competitiveness. Over 6,000 entrepreneurs have been supported so far, with 2,200 new jobs created across high-potential value chains like textiles, crafts, food processing, and tourism. 'The market is there. We're helping businesses seize these opportunities, move up the value chain, and tackle unemployment head-on,' says Sibusiso Mnisi, Manager of External Trade at the Eswatini Investment Promotion Authority. In an uncertain trade environment, Eswatini is turning its EPA access into a platform for sustainable growth, job creation, and global relevance. Distributed by APO Group on behalf of International Trade Centre.
