DeepSeek founder provides clue on start-up's AI priorities in new study
Published: 8:00pm, 19 Feb 2025 DeepSeek has signalled its next development priorities in a new technical study, with founder and chief executive Liang Wenfeng among 15 co-authors, that delves on 'native sparse attention' (NSA) – a system that is touted to make artificial intelligence (AI) models more efficient when processing vast amounts of data. The study, titled 'Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention', was published by DeepSeek on Sunday via arXiv – an online forum for professional members of the scientific community – just a day before Liang, 40, took part in a symposium with tech entrepreneurs hosted by Chinese President Xi Jinping in Beijing . DeepSeek has sharpened its focus on research, as worldwide attention on the Hangzhou -based start-up has increased, and is in no rush to conduct any fundraising and new commercial activities, according to a person with knowledge of the matter who declined to be identified. The study shows how Liang and DeepSeek's young team of scientists are continuing to push the envelope in their industry, following the start-up 's breakthrough development of advanced open-source AI models, V3 and R1 , at a fraction of the cost and computing power that major tech companies typically require for large language model (LLM) projects.
'With optimised design for modern [computing] hardware, NSA speeds up inference while reducing pre-training costs – without compromising performance,' the study said.
Inference refers to a situation when an AI model, which has been trained to see patterns in curated data sets, starts to recognise those patterns in data it has never seen before. As a result, the AI model can reason and make predictions that mimic a human's abilities. DeepSeek founder and chief executive Liang Wenfeng, second from left, exchanges greetings with President Xi Jinping at a symposium held in Beijing on Monday. Photo: CCTV
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
RTHK
an hour ago
- RTHK
US stocks end mostly up as markets eye trade talks
US stocks end mostly up as markets eye trade talks US stocks barely moved, with the Dow down 0.15 percent, the S&P 500 up 0.08 percent, and the Nasdaq up 0.30 percent. File photo: AFP Wall Street stocks edged higher on Monday as US and Chinese representatives held high-stakes trade talks and markets looked ahead to key economic data. Trade representatives for the world's two biggest economies plan a second day of talks on Tuesday following an opening round on Monday. Although there were no breakthroughs, the market has welcomed the negotiations. "There's hopes that they're inching closer to some sort of a deal," said Peter Cardillo of Spartan Capital Securities. The Dow Jones Industrial Average finished flat at 42,761. The broad-based S&P 500 climbed 0.1 percent to 6,005, while the tech-rich Nasdaq Composite Index added 0.3 percent at 19,591. Treasury Secretary Scott Bessent, Commerce Secretary Howard Lutnick and Trade Representative Jamieson Greer are leading the US delegation, while China's team included Commerce Minister Wang Wentao and China International Trade Representative Li Chenggang. Among individual companies, Apple fell 1.2 percent after company executives emphasised its artificial intelligence efforts at the tech giant's annual developers conference, including allowing app makers to directly access a device's AI capabilities. Apple has lagged some rivals in introducing AI-advancing updates to its Siri voice assistant and other programs. Warner Brothers Discovery finished down 3 percent after unveiling a plan to split itself into two companies to better position for the streaming era. The entertainment giant will break itself into two publicly traded companies: one covering "Streaming & Studios" and the other "Global Networks." The shift, designed to enable each venture to "maximize its potential," is expected to be completed by mid-2026, the company said. This week's agenda includes releases on consumer and producer prices, and key benchmarks on inflation. (AFP)
HKFP
16 hours ago
- HKFP
Chinese aircraft carrier enters Japan's economic waters, Tokyo says
A Chinese aircraft carrier group entered Japan's economic waters over the weekend, before exiting to conduct drills involving fighter jets, Tokyo's defence ministry said Monday. The Liaoning carrier, two missile destroyers and one fast combat supply ship sailed around 300 kilometres (190 miles) southwest of Japan's easternmost island of Minamitori on Saturday, a ministry statement said. It was the first time a Chinese aircraft carrier had entered that part of Japan's exclusive economic zone (EEZ), a Japanese defence ministry spokesman told AFP. 'We think the Chinese military is trying to improve its operational capability and ability to conduct operations in distant areas,' the spokesman said. China's growing military clout and use of naval and air assets to press disputed territorial claims have rattled the United States and its allies in the Asia-Pacific region. Tokyo's chief cabinet secretary Yoshimasa Hayashi told reporters on Monday that the government had 'conveyed an appropriate message to the Chinese side' without saying it had lodged a formal protest. After the Liaoning and its accompanying vessels exited Japan's EEZ, fighter jets and helicopters conducted take-offs and landings on Sunday, the ministry statement said. Japan deployed its warship Haguro to the area to monitor the situation, it added. Last month, the Liaoning sailed between two southern Japanese islands within the EEZ, from the East China Sea into the Pacific while conducting take-offs and landings on deck, the ministry said. The carrier in September last year sailed between two Japanese islands near Taiwan and entered Japan's contiguous waters, an area up to 24 nautical miles from its coast. At the time Tokyo called the move 'unacceptable' and expressed 'serious concerns' to Beijing. Under international law, a state has rights to the management of natural resources and other economic activities within its EEZ, which is within 200 nautical miles (370 kilometres) of its coastline. Late last month, Tokyo accused Beijing of conducting unnotified maritime scientific research within its EEZ, near the remote Pacific atoll of Okinotori.
RTHK
16 hours ago
- RTHK
Sino-US talks hope fuels strong rise for HK stocks
Sino-US talks hope fuels strong rise for HK stocks The Hang Seng Index finished strongly up 388.89 points, or 1.63 percent, for the day at 24,181.43. File photo: RTHK Asian stocks rallied on Monday on hopes that a fresh round of China-US trade talks later in the day will ease tensions between the economic superpowers, while investors were also cheered by forecast-topping US jobs data. In Hong Kong, the benchmark Hang Seng Index ended strongly up 388.89 points, or 1.63 percent, for the day at 24,181.43. Across the border, Chinese stocks closed higher, with the benchmark Shanghai Composite Index up 0.43 percent to 3,399.77. The Shenzhen Component Index closed 0.65 percent higher at 10,250. The ChiNext Index, tracking China's Nasdaq-style board of growth enterprises, gained 1.07 percent to close at 2,061.29. Regional gains extended a run-up across global markets in recent weeks as fears about US President Donald Trump's tariff blitz subside and countries make deals with Washington. All eyes are on London, where top officials from China and the United States are due to meet for more negotiations aimed at preserving a fragile truce agreed last month that slashed eye-watering tit-for-tat levies. The talks come days after President Xi Jinping and Trump held their first publicly announced telephone talks since the Republican returned to the White House. They were helped by news that Beijing had on Saturday approved some applications for rare-earth exports, while aviation giant Boeing will start sending commercial jets to China for the first time since April. The impact of the trade row was highlighted on Monday in data showing Chinese exports to the United States sank more than 34 percent year on year in May and almost 13 percent from the previous month. However, shipments to other regions including the European Union and the Association of Southeast Asian Nations surged. Separate data showed Chinese consumer prices fell in May for the fourth straight month. Optimism that the two sides will make a breakthrough boosted other markets such as Tokyo, Seoul, Singapore, Mumbai, Bangkok and Manila also advanced. In Japan, the Nikkei share average advanced ahead of Sino-US trade talks in London later in the day, with investors watching for any easing of restrictions on semiconductor shipments. The Nikkei rose 0.92 percent to 38,088.57 at the close. The broader Topix rose 0.58 percent. A sub-index of growth shares rallied 0.79 percent, outpacing a 0.38 percent rise in value shares. Chip-testing equipment maker and Nvidia supplier Advantest was the Nikkei's biggest gainer in index-point terms with a 4.86 percent climb. Another chip company, Socionext, soared 7.34 percent to be the top performer in percentage terms. (Reuters/Xinhua)
