What is AI bias?
0
This content has been selected, created and edited by the Finextra editorial team based upon its relevance and interest to our community.
The term 'AI bias' refers to situations whereby an artificial intelligence (AI) system produces prejudiced results, as a consequence of flaws in its machine learning process. Often, AI bias mirrors society's inequalities, be they around race, gender, class, nationality, and so on.
In this instalment of Finextra's Explainer series, we ask where bias in AI originates, the consequence of feeding models skewed data, and how the risks can be mitigated.
The sources of bias
AI bias can develop in three key areas, namely:
1. The data fed to the model
If the data used to train an AI is not representative of the real world, and contains existing societal biases, the model will ingrain these prejudices and perpetuate them in its decisioning.
2. The algorithms
The very design of an AI algorithm can also introduce bias and misrepresentation. Some algorithms may overstate or understate patterns in data – resulting in skewed predictions.
3. The programmed objectives
The goals that an AI system is programmed to achieve can also be biased. If objectives are not designed with fairness and equity in mind, the engine may discriminate against certain groups.
Loan applications: A case study
So, what relevance does AI bias have to the financial services industry?
Tools powered by AI are currently being rolled out by financial institution (FI)s across the globe. Indeed, AI is being deployed to automate operations; detect fraud; manage economic risk; trade algorithmically; design personalised products; support data analytics and reporting; and even improve customer services. This technology is embedding itself in bank operations, and our dependency on it will only become deeper. It is vital for the integrity of our financial systems, therefore, that AI bias is identified, understood, and controlled.
For example, in the world of loan applications AI-powered approval systems are increasingly being leveraged to streamline banks' back-office processes. In some cases, loans have been denied to individuals from certain socioeconomic backgrounds, as a result of bias baked into AI models' data or algorithms.
In 2021, an investigation by The Markup found lenders were more likely to deny mortgages to people of colour than to white people with similar financial characteristics. Indeed, AI-powered mortgage approval systems meant that 80% of black applicants were more likely to be rejected, along with 40% of Latinos, and 70% of Native Americans.
Unchecked AI bias and its consequences
Failing to address AI bias is not just discriminatory for the end-users of financial services. It can also result in legal liabilities, reputational damage, financial and operational risks, as well as regulatory non-compliance, for the institutions.
The European Union (EU)'s AI Act compels providers of AI systems to ensure their training, validation, and testing datasets stand up to an appropriate examination of biases and correction measures. Failure to meet this instruction could trigger penalties and fines.
Operational and ethical issues aside, allowing bias in AI to fester is simply bad for business. Indeed, bias can reduce the overall accuracy and effectiveness of AI tools – hindering their potential to deliver on the outcomes they were designed to.
Mitigating the risks
The fuel of today's industrial revolution, also known as Industry 4.0, is data – and the locomotive that it powers is the intelligent system. If the fuel is not refined (and bias-free) it will damage both AI's ability to run efficiently and consumers' trust in the technology itself.
Though bias in datasets may never be entirely erased, it is incumbent on AI providers and the institutions that deploy it to mitigate the risks. Banks must strive for data diversity to ensure training data is representative. Algorithm design must be reviewed to guarantee processes are fair and equitable, and all AI systems should become transparent and explainable, so that any flaws can be ironed out. Supporting banks' efforts with these challenges are bias detection and mitigation tools, which help to flag and remedy cases of AI bias, as and when they appear.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Times
an hour ago
- Times
Wait a minute before you sack your fund manager
I f the football world were to follow in the footsteps of investment funds, you would no longer see suited and booted managers on the sidelines of many pitches. Instead, there would be a machine standing in the technical area, gesturing frantically to the players and swearing at the referee. Active fund managers (human stockpickers who run an investment fund) have fallen out of favour. Many investors now prefer tracker funds, cheaper alternatives that track an index without a person at the helm. Personally, I like a mix of the two. The bulk — about 80 per cent — of my portfolio is in a low-cost global tracker fund, and the rest is split between two individual companies (which are free to invest in), one active fund and one investment trust (which is actively managed).
The Sun
an hour ago
- The Sun
Secret zero-effort iPhone hack helped me lose nearly 4 stone – it'll make your weight drop faster too
WITH constantly buzzing smartphones and gadgets around the house it's harder than ever to get a moment's peace from tech these days. And little do many people realise they have an impact on your weight too - unless you make some easy changes like I have. 11 11 It's well-known that sleep and weight are linked. Any scientist will tell you a good night's kip is essential because it regulates the hormones affecting hunger and appetite. Using a number of gadgets, I've been able to shed almost four stone. But to get that all important sleep, I tap my iPhone three times and I nod straight off, all thanks to a feature that almost no one knows about. Even if you've had an iPhone since the very beginning, you'll find it impossible to absorb every single trick, hack, and hidden setting. Gadgets are just too complicated these days to truly master. It's literally my job as The Sun's tech editor, and even I struggle to keep up. However, one feature you should be taking full advantage of is Background Sounds. It's a special iPhone feature tucked deep inside your Accessibility settings. Unless you have a specific Accessibility need, there's a good chance you've never even looked in there. Background Sounds is meant to deliver soothing noises to you. This can be while you're sleeping, but also while you're working, listening to a podcast, or doing almost anything. Apple explains: 'Play background sounds to mask unwanted environmental noise. 'These sounds can minimise distractions and help you to focus, be calm, or rest.' There's a selection of different sounds on there, depending on your needs, and some clever ways to quickly activate the feature. The good news is that you don't need to go into Accessibility settings every single time. HOW TO SET UP First, go into Settings > Accessibility > Audio & Visual > Background Sounds. Now tap on Sound and choose one. I like Rain, but some people swear by Stream, or Fire, or the ominous but effective 'Dark Noise'. The full list right now is: Balanced Noise Bright Noise Dark Noise Ocean Rain Stream Night Fire I don't know why I love rain so much. Maybe it's just in my nature as a Brit. There's probably a horrified Aussie out there who can only use Ocean and finds rain sounds terrifying. Now go back and select a volume for your background sound. You can also set it up to play when media is playing. 11 This is great if you're trying to listen to a podcast in headphones somewhere noisy. It can help dim the din. You can have it so that the volume is lower with media, so it doesn't drown out what you're actually trying to listen to. Tap on Play Sample if you want to test the volume before committing. And finally, there's an option to Stop Sounds When Locked. I keep that switched off, as I like using it for sleep. But it's your choice. HOW TO USE Once that's done, you can then choose how you want to activate your Background Sounds. My favourite way is with a triple-click of the Side Button (the one for locking your phone) to turn Background Sounds on or off. Go to Settings > Accessibility > Accessibility Shortcut and then choose Background Sounds. Then you're good to go. Another option is to add it to your Control Centre. That's the panel of quick-access icons that appears when you swipe down from the top-right corner of your iPhone (or from the bottom on older models with a Home Button). Tap on the plus symbol in the corner, add Background Sounds, and then you can tap the new icon whenever you need it. I turn it on just before I go to bed if I'm feeling stressed, and it helps send me to the land of nod. But it's also a lifesaver in the office when it's noisy and I really need to finish writing a story about an iPhone feature called Background Sounds. Maybe you work from home and the neighbour's dog won't stop barking, or you want a bit of peace from colleagues on your lunch break. Just slap some Rain on and away you go. You're in the rainforest, a world apart from stress. ANOTHER SECRET BUTTON TO TRY... If you like the iPhone 'triple click' trick, wait until you try this... You can actually turn the back of your iPhone into a button. Yes, that Apple logo on the rear isn't just for good looks. Go into Settings > Accessibility > Touch > Back Tap. Then you can set functions to both a Double Tap and Triple Tap off the back of your phone. So you could set Double Tap to Screenshot, allowing you to quickly snap a screengrab. And you could set Triple Tap to Shazam so you can work out what song is playing nearby with minimal faff. There are dozens of combinations to choose from, so pick what you like from the list. You can launch the camera, activate the torch, lock your phone's screen rotation, or even link it to your own custom "Shortcut". And if you decide you hate it, you can just turn it off again and your iPhone's rear will go back to normal. Picture Credit: Apple / The Sun Of course if you're trying to sleep, you don't need to wear headphones. You can have Background Sounds come straight out of your phone speaker. But if you're at work, it's probably best to use headphones – or you risk having everyone reaching for their umbrellas on a sunny day. BONUS IPHONE SLEEP TRICKS If you're struggling to sleep, there are two other tricks I'd recommend. The first is called Sleep Focus, which is a variant of Do Not Disturb. You can find your iPhone's Focus modes by going into Settings > Focus. Now tap on Sleep and you'll find a whole selection of different options. They're all designed to help you sleep in peace – minus the distractions. So, for a start, you can set it to block all notifications. You won't be buzzed, and they'll remain hidden until you pop out of Sleep Focus in the morning – so they're not there right away. As well as that, you can add exceptions. So I've set mine to allow notifications from my wife, brother, mum and dad to break through. That way I won't miss something important if there's an emergency. When you're in Sleep Focus, you can set your iMessage up to show an alert to anyone texting you that you have notifications silenced. That way, they'll be put off from bothering you in the night – or at least know that you're not intentionally ignoring you. You can set up a Sleep Focus schedule so that it kicks in automatically. And you can choose a zen colour for your Lock Screen background while in Sleep Focus – like a nighttime blue. It'll work across all of your Apple devices (if you have an Apple Watch or iPad, for example) too. To turn it on or off (if you don't want a schedule), just swipe into the Control Centre from the top-right of your screen, tap on the Do Not Disturb icon, and then choose Sleep Focus. My second trick is called StandBy Mode. This one is easily missed, though there's a chance you've accidentally stumbled across it and not realised what's going on. 11 If you place your iPhone on charge (plugged in or on a floating MagSafe magnetic charger) and turn it so it's horizontal (landscape orientation), StandBy Mode will kick in. This effectively turns your iPhone into a desk clock. It'll show the time and date, but you can customise it to include a calendar, or photos, or whatever else takes your fancy. Then when your room gets dark, StandBy Mode will shift into a gentle red. That way, it doesn't strain your eyes in the night. It'll shut off and then wake up if it notices you moving, like if you're looking across to check the time. So it means your iPhone can double up as a bedside clock that doesn't strain your eyes, isn't constantly running, and won't take up extra space on the nightstand. I use it every night, but loads of people have no idea this secret iPhone mode exists – all because the method of activating it isn't that obvious. Now you know, it'll be sweet dreams tonight. STAYING motivated is hard, The Sun's Sean Keach writes, even with the help of gadgets… The problem with gaining unwanted weight is that it usually doesn't happen all at once. It's a slow thickening over months and years – until one day you realise you're now very thick indeed, and have a lot of work to do. That's daunting. I remember the sinking feeling. I was 210lbs at 6ft, giving me a BMI of 28.5 – firmly in the "overweight" category. And if it took months to gain, it was probably going to take months to lose, I thought. But I had to remind myself that it wouldn't just be six or seven months of pure misery. There would be wins along the way. Thankfully I was right. I felt stairs become easier to climb and brisk walks could be brisker still. Jumpers and shirts that were just a little too tight suddenly looked how I'd hoped they would. Once-tight jeans were now loose, giving me a nice excuse to buy a fresh pair. They were knackered anyway. All of this – plus taking regular progress pictures and tracking the pounds – was fantastic motivation. So whether you've got weeks, months, or years ahead, just remember that there's plenty of joy to be had on the journey – long before you hit your goal.
Reuters
3 hours ago
- Reuters
UK's Halma hits record high after profit beat, upbeat revenue forecast
June 12 (Reuters) - British health and safety device maker Halma (HLMA.L), opens new tab on Thursday forecast higher revenue growth for fiscal year 2026 and beat annual profit expectations, sending its shares to a record high. At a time when global companies are taking action to mitigate the costs of tariffs imposed by U.S. President Donald Trump, the British firm said it expects minimal impact on its operations due to a strong local manufacturing footprint. Halma operates in over 20 countries, and it counts the United States as its biggest revenue contributor. "With around 90% of U.S. sales produced domestically and over 45 subsidiaries sourcing locally, the company has a natural hedge against cross-border trade disruptions," finance chief Carole Cran told Reuters in an interview. Shares of the company were up as much 5.64% at 3334 pence. The stock was the top gainer on the benchmark FTSE 100 index (.FTSE), opens new tab. Halma expects organic revenue growth for the current year in "upper single-digits", compared with estimates of a 6% rise, as per a company-compiled consensus. The firm, which operates over 45 businesses across safety, healthcare and environmental & analysis, said its responses to tariffs included passing surcharges or adjusting sourcing, Cran said. The various companies under Halma are affected differently, Cran said, adding that some relied on local manufacturing, while others source from China. "Achieving such a performance in varied and fast changing conditions is exceptional in terms of really giving us confidence as we move forward," CEO Marc Ronchetti said. The company expects adjusted operating profit margin to be "modestly above" the mid-point of its 19%-23% target range. The Buckinghamshire-headquartered firm's adjusted pretax profit rose 16% to 459.4 million pounds ($621.8 million) for the year to March 31, ahead of a company-compiled consensus of 447 million pounds. It lifted its annual dividend by 7% to 23.12 pence per share. ($1 = 0.7388 pounds)
