
EXCLUSIVE: Cybersmart founder owns the internet outage
The criticism for the outage that brought Cybersmart customers to a digital standstill earlier this week, came swiftly. And so did an apology – and then, unusually, an unvarnished account of what really went wrong.
Cybersmart reached out to Daily Maverick to let founder and CTO Laurie Fialkov pull back the curtain on 39 sleepless hours that nearly broke the network, the business, and a few engineers along the way. (Spoiler: it was not a cable break.)
'We did screw up,' he admitted. 'That kind of outage is long in this industry.'
The Cape Town-based ISP and fibre network operator experienced a near-total service disruption starting around midday on Monday, 12 May. What followed was a cascade of misdiagnoses, desperate rewiring, and a rude awakening to the dangers of old hardware lurking in even the most redundant systems.
From café to carrier
Fialkov's internet journey began in a Sea Point internet café called Inthenet in 1996. Back then, a 33.6kbps modem counted as high-speed.
Cybersmart, as the business became known in 1998, grew slowly and steadily. It's now a national network operator with thousands of businesses and residential customers, a fleet of fibre infrastructure and what was – until this week – a 22-year record of uninterrupted uptime.
'We spend so much time trying to be the ISP that never goes down,' Fialkov said. 'We've got everything. Multiple cable systems, battery redundancy, ringed networks… and we just never had an outage.'
But this week, everything went down – silently.
Phantom signals
It started quietly. Customers called Fialkov directly – just a few at first. Network monitoring showed all systems green. 'I can reach the whole network. It's impossible that we are down,' he recalled thinking. 'But then you get 15 calls in five minutes, and it's got to be an issue.'
Outside-looking diagnostics (via 'looking glasses' – remote tools that simulate connectivity from various points) revealed the horror: Cybersmart's Autonomous System Number, AS36874, had essentially vanished from parts of the global internet.
'Like this shell on the internet – completely isolated.'
A Denial-of-Service attack seemed a likely culprit. NexusGuard, Cybersmart's DDoS mitigation partner, was called in – only to say: Not a DOS.
Then, the real enemy emerged: old gear.
The ghost in the chassis
The culprit? Legacy Cisco 6500 routers – high-end switches that formed the spine of Cybersmart's original network.
'These things have been working for 15 years. End of life, yes. But working. We were meant to replace them. But… if it ain't broke, right?'
Until it broke. Hard.
One router in Johannesburg froze. Another in Cape Town followed.
'Too coincidental,' Fialkov said. Then more went dark. 'It was like a cancer – six machines, six different places, all failing.'
The root cause? A global routing table explosion. New peers (China Telecom, Hurricane Electric, Saudi Telecom) dumped an extra 150,000 routes into the internet's core. The old routers couldn't cope – they choked and silently failed.
With no support (Cisco dropped them years ago) and no viable fix, the team made a call: rip them all out.
Wait, what is a 'routing table explosion'?
At the core of the internet is a global 'routing table' – a constantly updated map showing how data travels between networks.
On Monday, three major networks (China Telecom, Hurricane Electric, and Saudi Telecom) suddenly added around 150,000 new routes to that map.
The result? A routing table 'explosion'.
Older routers – like these legacy Cisco 6500s still used in parts of Cybersmart's network – couldn't cope. These machines rely on specialised memory with strict limits. When overloaded, they didn't crash loudly; they just stopped forwarding traffic, silently dropping data.
These left parts of the internet unreachable, even though the hardware appeared 'green' and online.
It wasn't a cyberattack or a power cut. Just old infrastructure overwhelmed by a sudden global change – and management not retiring it soon enough.
The first cut, and the deepest
That decision triggered a national network reconfiguration. More than 180 switches and 65 PPE servers had to be re-patched, reconfigured and brought back online.
Fialkov described the operation as 'cutting out the cancer'.
The operation took 39 hours and 16 minutes – a truly Herculean effort.
'There are some guys who haven't slept for 40 hours now. They really showed up for us,' he said.
By Wednesday morning, most services were restored. But not without a cost – to Cybersmart's reputation and its customers' businesses.
Lessons in humility
'This has been a life lesson,' Fialkov said. 'You get too arrogant. Twenty-two years without an outage, and you start to believe your own myth.'
He admitted that the company had been sitting on a known problem: ageing infrastructure, flagged for replacement years ago.
'We'd been looking at the same thing for four years. Working perfectly. Until it didn't. Took us out at the knees.'
Still, he insists the issue wasn't a lack of contingency. 'We've got spares. We've got redundancy. This was human complacency. We left something broken in the network for too long.'
Heartfelt apology to the 'R399'
Interestingly, he says the customers hardest hit weren't the big corporates – it was the small businesses.
'The R399 customer? That's the guy who might be running his whole business off one link,' Fialkov said. 'An outage like this could be the end of him.'
He told Daily Maverick how he spent 11 hours on a support call with one such customer, trying to assure them their business would survive.
That sobering reality drove home what Cybersmart had become. 'Ten years ago, no one would've noticed if we went down. Now? The whole country feels it.'
Where to now?
There are still issues being resolved, and some customers are wrongly blaming Cybersmart for unrelated faults. But for the most part, the network is back.
Fialkov's candour in this moment of failure is unusual in South Africa's telecoms industry – and maybe even refreshing.
'You owe your customers a service,' he said. 'And if you can't deliver it, you must be called out on that.'
And then, just like that, the fibre was (mostly) back – but the scar remains. DM

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles

IOL News
5 hours ago
- IOL News
Quilter anticipates steady second half following strong first half performance
UK-based Quilter raised its interim dividend 18% to 2 pence. Adjusted diluted earnings per share for the six months to June 30 came to 5.4 pence, up 4% from 5.2 pence. Image: Timothy Bernard/African News Agency (ANA) Quilter, the UK wealth manager with listings in London and on the JSE, increased first half profit by 3% to £100 million and anticipates the second half result to be much in line due to stepped up brand spend and business investment plans. The interim dividend was raised 18% to 2 pence from 17 pence at the same time last year. Adjusted diluted earnings per share came to 5.4 pence, up 4% from 5.2 pence. 'We have delivered strong flow momentum across the business with core net inflows up 160% to £4.5 billion,' CEO Steven Levin said in a statement. The company reported an operating margin of 30% despite lower interest rates reducing investment income on shareholders' funds. The company's Affluent business segment saw net inflows of 9% of opening assets (H1 2024: 5%), with the Platform flows maintaining strong momentum from the second half of 2024, with improved net promoter scores as well as winning awards for service. First half Platform net inflows were up 92% to £4.2bn. The High Net Worth segment saw net inflows to 3% of opening assets. New inflows were stable at £1.5bn, with an easing of outflows leading to a much better performance at the net level of £464m (up from £107m). A £76m provision was reduced to £70m after initial conversations with the UK financial services regulator about the Skilled Person Review of advice by appointed representative firms in the Quilter Financial Planning network. Video Player is loading. Play Video Play Unmute Current Time 0:00 / Duration -:- Loaded : 0% Stream Type LIVE Seek to live, currently behind live LIVE Remaining Time - 0:00 This is a modal window. Beginning of dialog window. Escape will cancel and close the window. Text Color White Black Red Green Blue Yellow Magenta Cyan Transparency Opaque Semi-Transparent Background Color Black White Red Green Blue Yellow Magenta Cyan Transparency Opaque Semi-Transparent Transparent Window Color Black White Red Green Blue Yellow Magenta Cyan Transparency Transparent Semi-Transparent Opaque Font Size 50% 75% 100% 125% 150% 175% 200% 300% 400% Text Edge Style None Raised Depressed Uniform Dropshadow Font Family Proportional Sans-Serif Monospace Sans-Serif Proportional Serif Monospace Serif Casual Script Small Caps Reset restore all settings to the default values Done Close Modal Dialog End of dialog window. Advertisement Next Stay Close ✕ Ad loading Levin said once the ongoing advice remediation program was confirmed with the regulator, a review of capital needs would be undertaken at Quilter, to consider whether it has excess capital and if the current distribution strategy is appropriate. He said the group was approaching the end of its second 'Simplification' program, which by the end of June had delivered £43m of cost savings, and which were expected to deliver the remainder of the £50m target by end 2025. Some 1 450 Quilter advisers wrote around £2.5bn of new business in the first half, broadly similar to 2024, and investments were being made to enhance client relationships with integrated support tools. The Advice Transformation program, to be implemented over the next couple of years, would also allow advisers to service a larger number of clients under a range of service and charging models. The Advice Guidance Boundary Review regulatory changes, which introduce 'Targeted Support' in the UK retail financial services market, should favour integrated firms like Quilter, which can use scale efficiencies in platform and investment solutions to deliver a targeted support proposition for clients. 'The acquisition of NuWealth last year allows us to accelerate development of a targeted support proposition for self-directed investors,' said Levin. The High Net Worth business was planned to evolve from being largely investment-driven towards being recognised as a leading integrated wealth management business.


eNCA
6 hours ago
- eNCA
Trump orders space regulations eased in win for Musk
WASHINGTON - US President Donald Trump signed an executive order Wednesday easing regulations for the private space industry, including eliminating some environmental reviews, in a move likely to please his erstwhile advisor Elon Musk. The executive order, which said it aimed to "substantially" increase the number of space launches in the United States, was described by an environmental group as "reckless." Since returning to the White House in January, Trump has talked up several space missions including sending humans to the Moon and Mars. The Moon and Mars missions are planned to get a ride on the massive Starship rocket of Musk's private firm SpaceX. However, Starship has had a series of setbacks, with its latest routine test ending in a fiery explosion in June. AFP/File | TIMOTHY A. CLARY SpaceX dominates the global launch market, with its various-sized rockets blasting off more than 130 times last year - and that number looks set to rise after Trump's executive order. "It is the policy of the United States to enhance American greatness in space by enabling a competitive launch marketplace and substantially increasing commercial space launch cadence" by 2030, the order read. The change could well benefit Musk, who has long advocated for deregulation of the space industry. The world's richest man was previously a close advisor to Trump before the pair had a dramatic, public falling out in July. The executive order also called on Transportation Secretary Sean Duffy - who was at the signing and is currently NASA's administrator - "to eliminate or expedite the Department of Transportation's environmental reviews" for launches. SpaceX has been repeatedly criticised over the environmental impact at the sites where Starship, the largest and most powerful rocket in history, blasts off. The US-based nonprofit Centre for Biological Diversity said Trump's new executive order "paves the way for the massive destruction of protected plants and animals." "This reckless order puts people and wildlife at risk from private companies launching giant rockets that often explode and wreak devastation on surrounding areas," the centre's Jared Margolis said in a statement. Musk's dreams of colonising Mars rely on the success of Starship, and SpaceX has been betting that its "fail fast, learn fast" ethos will eventually pay off. The Federal Aviation Administration approved an increase in annual Starship rocket launches from five to 25 in early May, stating that the increased frequency would not adversely affect the environment.

IOL News
18 hours ago
- IOL News
MI Cape Town captain Rashid Khan set to keep a close eye on Dewald Brevis at SA20 auction
MI Cape Town captain Rashid Khan is hoping welcome Dewald Brevis back to Newlands for the Betway SA20 next season. Picture: Sportzpics Image: Sportzpics MI Cape Town captain Rashid Khan is hoping the Betway SA20 champions will be able to retain Proteas star Dewald Brevis at next month's auction in Johannesburg. Brevis has been playing alongside the Afghanistan superstar Khan since SA20's inception three seasons ago, while they were also on the winning side together for MI New York in the inaugural Major League Cricket Season. However, it was last season when Khan saw the best of the talented youngster after Brevis played a pivotal role in guiding the Newlands-based franchise to their first SA20 title with 291 runs at an average of 48.50 and strike-rate of 184.17. Coupled with a few stunning catches in the outfield, it earned Brevis the SA20 Rising Star award. But this was still not enough to entice the MI Cape Town hierarchy to keep hold of Brevis when the franchise's pre-list signing list was unveiled last month, which includes Khan, Kagiso Rabada, Ryan Rickelton, George Linde, New Zealand swing bowler Trent Boult and West Indies blaster Nicholas Pooran. Brevis, though, sent a timely reminder with a blistering 125 not out off 56 balls in the second T20I against Australia this week. The mega six-hitting display saw Brevis become the holder of the highest individual T20I score by a Proteas batter - surpassing Faf du Plessis's mark set back in 2015. Khan, who was recently unveiled as a Red Bull global ambassador, was unable to provide clarity on Brevis' release, but was hoping to be reunited. 'It's a difficult question,' Khan said in an exclusive interview with Independent Media organised by the Austrian energy drinks supplier. 'I don't know how things happen, why not. But, you know, it's always, there is something that goes there and here. 'But hopefully, Brevis has performed really well for us in the last couple of years and three years, you know, that we deliver always the best. 'Hopefully, we get him back and in the team where he finishes the game for us.' MI Cape Town are likely to face a bidding war for Brevis' services when the players go under the hammer on September 9 with Pretoria Capitals' a potential suitor. The Capitals have a major advantage over MI Cape Town as they have a vastly superior R32.5million spending power in comparison to the defending champions' R11.5 million. This financial scenario could even place MI Cape Town out of the reckoning with the newly-applied 'Right To Match' card that teams are able to utilise when wanting to keep a player that has represented them in the past. Khan will still be keeping a close eye on the auction proceedings, especially after thoroughly enjoying leading MI Cape Town to their first-ever title last season. 'My first trophy as a captain was massive. For me it gave me lots of relief. You know, we didn't manage it in the first year I was a captain and then, you know, I got back surgery, didn't come for the second year and could see the result,' he said.