Grab calls for voice samples from users to fine-tune app feature for the visually impaired
Peter Lim, who is visually impaired, uses the AI voice assistant to book a Grab ride from his home to a nearby mall on July 18.
SINGAPORE – Getting a ride to his destination became easier for Mr Peter Lim in June, after Grab rolled out a voice assistant powered by artificial intelligence (AI) on its app.
Mr Lim, who is visually impaired, welcomed this development, since it meant he could book a ride simply by using his voice.
However, the 59-year-old call centre operator said that booking a ride to some places, such as Kalidasa Avenue and Lim Ah Pin Road, still poses a challenge.
The voice assistant has trouble at times understanding Singaporean speech patterns, so Mr Lim sometimes gives just the postal code of his destination.
Recognising this, Grab launched an open call in late June for voice samples from its users
to fine-tune its AI model.
Built on OpenAI's GPT-4.1 large language model and fine-tuned with 80,000 voice samples provided by Grab employees, the model's accuracy in understanding Singaporean accents and names of places is already 89 per cent.
But further work needs to be done to account for the numerous ways in which locations across Singapore can be pronounced.
For instance, Hougang can be articulated with or without the letter 'h', while Clementi can be pronounced as 'Kle-man-tee' or 'Klair-men-tee'.
While there is no target set on how many voice samples Grab wants to collect by Dec 31, it aims to bring the accuracy up to 95 per cent, a Grab spokesperson told The Sunday Times.
'This involves having a greater variety and volume of voice samples that vocalise places of interest in different pitches, tones, accents and styles,' said the spokesperson.
The top 85 per cent most commonly selected locations in Singapore were chosen for the invited voice samples from users.
'Participants will be shown a randomised selection of places of interest from this list for them to vocalise the names accordingly,' said the spokesperson.
The company has already received nearly 10,000 voice recordings from users.
The voice assistant has been helpful, especially when combined with the app's ability to suggest possible locations that the user might want to go to at different times of the day, said Mr Lim.
ST PHOTO: GAVIN FOO
Wallich Manor, 80 Dunbar Walk, and 31 Jalan Mutiara Latitude were among locations that this ST reporter was asked to record herself saying to improve speech pattern recognition on the app.
The voice assistant has been helpful, especially when combined with the app's ability to suggest possible locations that the user might want to go to at different times of the day, said Mr Lim.
'It will ask me if I want to go home, or if I want to go to church on Sunday mornings. If I say no, I can tell it where I want to go instead,' he added.
'It is around 90 per cent accurate in understanding me so far.'
The AI voice assistant is available to users with the talkback feature enabled on their phones.
Members of the Singapore Association of the Visually Handicapped (SAVH) participated in focus group discussions and were involved in testing the feature before it was rolled out.
Ms Lyn Loh, who heads SAVH's accessibility services department, said the voice assistant was initially not very responsive when given voice commands during the testing phase. It took a few tries for it to understand what she was saying.
'But now, it is much better,' said Ms Loh.
The feature will be very useful if it can be used to order food delivery via the app as well, said Ms Loh, who added that she has given feedback to Grab about this.
During the Covid-19 pandemic, she had to learn how to order food, as she could not see the markings pasted on floors and seats that dictated where people could queue and sit.
'We never know when the next pandemic will happen,' said Ms Loh.
The voice assistant has trouble at times understanding Singaporean speech patterns.
ST PHOTO: GAVIN FOO
Grab also tested the feature's performance during the developmental phase by benchmarking it against Meralion –
an AI model that can understand at least eight regional languages , and Singlish – developed by the A*Star Institute for Infocomm Research.
'While both models are designed for Singlish-speaking users, Meralion focuses on natural language understanding, while Grab's voice assistant is tailored specifically to help users identify locations and points of interest in Singapore,' said Grab's spokesperson.
Recordings collected are encrypted and stored for a year in a secure server, and are not linked to any personal identifiers such as the user's name or mobile number, said the spokesperson.
Mr Lim and Ms Loh expressed hope that this voice assistant will help not only the visually impaired, but also the elderly and people with physical disabilities.
'If it is improved, it can help many other people that just want to talk and not type,' said Mr Lim.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Straits Times
4 hours ago
- Straits Times
Priority for singles, higher quota for second-timer families to kick in from HDB's July BTO exercise
Find out what's new on ST website and app. The July exercise will also see enhancements to the Deferred Income Assessment scheme and the Fresh Start Housing Grant take effect. SINGAPORE – A slew of policy changes will kick in, starting with the upcoming HDB's Build-To-Order (BTO) flat sales exercise in July, benefiting singles as well as families looking to upgrade or right-size their homes. Laying out the changes in a statement on July 20, the Housing Board said the one benefiting singles involves a previously announced new F amily C are S cheme , meant to also provide singles with priority access to BTO flats when they buy one near or with their parents. Prime Minister Lawrence Wong had announced the scheme in his first National Day Rally speech in 2024 as a means to bolster intergenerational support among families. Without the update, priority access would remain reserved only for married couples and their parents. HDB on July 20 said first-time single buyers currently have up to 65 per cent of two-room flexi BTO flats and up to 5 per cent of Sale of Balance Flats (SBFs) set aside for them after such flats are allocated to seniors. Within these quotas, up to 30 per cent of two-room flexi BTO flats and up to 2 per cent of SBFs will be set aside for first-timer singles applying under the new scheme. The remaining quotas will be for other first-timer singles, HDB said. Top stories Swipe. Select. Stay informed. Singapore 1 in 3 vapes here laced with etomidate; MOH working with MHA to list it as illegal drug: Ong Ye Kung Singapore HSA extends hotline hours, launches new platform to report vaping offences Singapore 2-in-1 airport police robot on trial can patrol and serve as PMD with ride-hailing feature Asia Tearful relatives await news of victims in Vietnam boat capsize Singapore ComfortDelDro to discipline driver who flung relative's wheelchair out of taxi Multimedia How to make the most out of small homes in Singapore Asia Over 380,000 people affected by autogate glitch at JB checkpoint over 2 days Singapore Minor Issues: Why I didn't send my daughters to my brand-name primary school HDB, meanwhile, specified that there will be no change to the existing priority access for married couples and seniors. The new scheme has a second component which grants singles priority if they jointly apply for two units in the same BTO project with their parents. But this would kick in only from the October sales exercise, HDB said. The change pertaining to families is for those applying for a BTO for the second time. HDB said it will increase the allocation quota of three-room and larger flats for this group by 5 percentage points from the July exercise . This is to support these families' 'upgrading aspirations and right-sizing plans', it stated. With the change, up to 20 per cent of three-room Standard flats and up to 10 per cent of three-room Plus and Prime flats and four-room and larger flats would be set aside for second-timer families. First-timer families would, however, still have at least 80 to 90 per cent of three-room and larger flats set aside for them, HDB noted. The July exercise would also see enhancements to the Deferred Income Assessment (DIA) scheme and the Fresh Start Housing Grant take effect, HDB said. The DIA scheme lets couples defer their income assessment until nearer the key collection date, so they can qualify for a bigger loan as their incomes are likely to be more stable and higher by then, without deferring their flat application. Under the enhanced DIA scheme, only one of the two parties needs to be a recent or current full-time student or national serviceman before a couple can apply for a new flat with its help. Previously, both parties needed to meet this requirement. The increase of the Fresh Start Housing Grant from $50,000 to $75,000 for second-timer public rental households with children was announced at the Ministry of National Development's Committee of Supply debate earlier this year. HDB said this change, also to kick in from the July exercise, will help eligible second-timer families use the increased grant to buy a new two-room flexi or three-room standard BTO, or SBF flat, on a shorter lease. About 5,500 BTO flats in Bukit Merah, Bukit Panjang, Clementi, Sembawang, Tampines, Toa Payoh and Woodlands will be launched in the July exercise, HDB said. Some 5,030 flats were launched in the last BTO exercise on Feb 10 . More than 4,600 SBF units will also be up for picks in the concurrent SBF exercise to take place in July, it added. 'We will continue to refine our public housing policies to keep public housing affordable, accessible and inclusive for Singaporeans,' HDB said.
Straits Times
5 hours ago
- Straits Times
Crypto exchange Tokenize Xchange to shut down Singapore operations
Find out what's new on ST website and app. Tokenize Xchange founder and chief executive Hong Qi Yu declined to comment on why the firm was denied a licence by the MAS. SINGAPORE – Cryptocurrency exchange Tokenize Xchange will cease its operations here from September 30, just over a year after raising US$11.5 million (S$14.9 million) in funding and announcing plans to ramp up hiring. The Singapore-headquartered firm said on July 20 that it will shut down the business following the Monetary Authority of Singapore's (MAS) decision not to grant it a licence to offer digital payment token services here. Tokenize was previously operating under an exemption. The firm said it will shift its operations to Labuan, a federal territory in Malaysia, where it is in the process of acquiring a company that holds a Digital Financial Services License issued by the Labuan Financial Services Authority. The deal is expected to close by September 30. It will also seek regulatory approval from the Abu Dhabi Global Market, an international financial centre and free economic zone located in Abu Dhabi, the capital of the United Arab Emirates. Tokenize said all 15 of its employees in Singapore have been given notice and will leave the company by September 30. When contacted, Tokenize founder and chief executive Hong Qi Yu declined to comment on why the firm was denied a licence by the MAS. But he told The Straits Times on July 20 that Labuan will allow Tokenize to operate under a 'recognised regulatory framework tailored for cross-border digital asset services'. '(Labuan) also offers greater flexibility, tax efficiency, and access to international markets, supporting the platform's global growth ambitions,' he said. Tokenize said its Singapore customers can no longer buy or sell cryptocurrencies on its platform, and may only transfer their cryptocurrency holdings to other exchanges, where they can convert them to cash and make withdrawals. But users can continue to withdraw cash directly from the exchange based on the Singapore dollar value of each user's portfolio, which includes both fiat and cryptocurrency holdings This value, viewable in users' wallets, determines the withdrawal tier they are placed in under a phased schedule. Users with portfolios below $10,000 have been able to withdraw the cash portion of their holdings and transfer their cryptocurrencies to other exchanges since July 17. Those with portfolios between $10,000 and $99,999 may do so from August 1, while users with $100,000 and above can start from September 1. All withdrawals and transfers must be completed by September 30. ST has reached out to the MAS for comment. While Tokenize serves retail and institutional investors in Singapore and overseas - including Malaysia and Vietnam - its exit from the Republic comes after the MAS said on June 6 that digital token service providers targeting only overseas customers must be licensed by June 30 or cease operations . ST understands that the move has triggered an exodus of unlicensed cryptocurrency exchanges from Singapore. More than 500 staff - from management to junior levels across firms supporting the Republic's fintech ecosystem - are expected to relocate to the United Arab Emirates or Hong Kong, where regulators are seen to take a softer stance on digital assets.
Straits Times
6 hours ago
- Straits Times
Ride-hailing robot on trial for airport police is 2-in-1 patrol robot and PMD
Find out what's new on ST website and app. The Singapore Police Force showcasing the hybrid human-rideable robot called Gibson, at Changi Airport Terminal 4, on July 16. SINGAPORE - A police patrol robot that doubles up as a personal mobility device (PMD) for officers is being trialled at Changi Airport Terminal 4. The autonomous robot, called Gibson, is outfitted with multiple cameras and sensors to help it avoid obstacles and people. Officers can also use it for transportation, to cover long distances at the airport quickly. The Home Team Science and Technology Agency (HTX) developed Gibson in collaboration with the A*Star Institute for Infocomm Research. The trial began in early July. 'Gibson was inspired by the concept of creating a buddy robot for our officers,' said HTX engineer Seah Qi Yan, from the Ground Systems, Robotics, Automation and Unmanned Systems Centre of Expertise. 'They can use it as a PMD in their operations and transform it into an autonomous robot when not in use.' Gibson was developed to advance human-robot collaborations in the Home Team, Ms Seah added. Its ride-hailing function is a key feature that was developed in-house. Using their phone or tablet to access the robotics platform, officers can call for an available robot to meet them at a nearby pick-up point. While travelling aboard Gibson, they can select the autonomous function to reach their destination as they tend to other matters, such as reviewing incidents on their devices. Alternatively, officers may choose to drive it manually by using a physical key. Two of the robots were shown to the media on July 16 at Terminal 4. Each robot has a battery life of about four hours, and have safety features such as an automatic stop if someone attempts to get on it while it is moving . Attempts to block Gibson intentionally as it is patrolling will cause it to sound a horn. Named after inventor Arthur Hugo Cecil Gibson, who made the first motorised scooter in the early 1900s, it is the second type of police robot to be used at the airport. The first police patrol robots were introduced at the airport in April 2023, after more than five years of trials and smaller-scale roll-outs. Superintendent of Police Patrick Pang, an operations officer for planning and readiness from the Airport Police Division, said Gibson will complement existing police patrols and enhance police presence in the airport. He said: 'The ride-hailing function makes it convenient for officers to summon Gibson without having to manually search for one. 'And with the autonomous mode, our officers do not have to worry about where to park, as it can resume its patrols without returning to a designated parking lot.'
