Drones could soon become more intrusive than ever
But new technology from a team at Michigan State University (MSU) seeks to change all that and extend the spying powers of artificial intelligence (AI) into the skies. The system, known as FarSight, suggests that long-range aerial surveillance could soon become far more accurate—and intrusive—than ever before.
The project is funded by the Intelligence Advanced Research Projects Activity (IARPA), part of the American government responsible for marshalling fanciful spy-gadget ideas into real-world use. Other current IARPA projects include an effort to build a device that can modulate a voice in real-time in order to avoid detection by speech-recognition tools, as well as an initiative to make snooping devices small and pliable enough to be woven directly into clothing.
FarSight works with a similarly crafty technique known as 'whole-body biometric recognition'. Rather than trying to recognise a subject from their face alone, the system uses a combination of biometric-recognition algorithms that run in parallel.
One set of algorithms discerns a person's gait. Another generates a 3D reconstruction of their body. Xiaoming Liu, a professor of computer science and engineering at MSU who leads the project, likens it to essentially undressing subjects in order to generate an accurate model of their anatomy, regardless of what they happen to be wearing.
A third set of algorithms runs the subject's face through a turbulence model that seeks to undo the refractive effects of the choppy air on the light that comes into the camera. This returns the image gathered by the drone to a simulated undistorted state, from which a detailed mapping of the subject's features is then extracted.
Once captured, the three biometric markers—gait, body shape and face—are fused into a combined profile. This profile can be matched to those of known individuals or, if the target is new, saved for future matching. The entire operation happens in about a third of a second, says Dr Liu. His team is working to scale down the system so that it could fit on a quadcopter
Though it is still an experimental system, FarSight's early results are impressive. The National Institute of Standards and Technology (NIST), America's standards body, which has been rating facial-recognition systems for more than a decade, tested FarSight on a set of tricky low-resolution images and videos collected at hundreds of metres, in many cases from a high angle. FarSight outperformed all other systems tested on the same set.
The project also illustrates how large vision models (LVMs), a variant of large language models, could be useful for surveillance. The MSU team used CLIP, a model made by OpenAI, to annotate images of thousands of subjects with textual descriptions—'Muscular-slender, long torso', 'Short torso', 'High-waisted', 'Low-waisted'—which it then used to train the body-shape reconstruction system. The gait-recognition feature is based on a different large vision model, called DINOv2, which was released last year by Meta.
Dr Liu says that LVMs could have even broader applications in the years ahead. This is because LVMs achieve high-performance recognition without requiring big training-data sets, which are difficult and expensive to produce. FarSight's training and testing data, much of which were collected by Oak Ridge National Laboratory, a scientific-research facility, consists of 876,000 videos and photos of about 3,000 subjects. An LVM, by comparison, is already pre-trained on billions of images and videos, and may require only minimal fine-tuning before it can be used for surveillance-video analytics.
FarSight is not yet ready for the field. Although it outperforms other systems on long-range recognition, its accuracy, as well as its false-positive and false-negative rates, remain 'far behind the performance that would be required to make the system deployable', says Josef Kittler, a professor working on biometrics and computer vision at the University of Surrey, who was not involved in the research.
The system has other limitations, too. A person's gait, for instance, can change drastically if they carry a heavy load or have suffered an injury, says Dr Kittler. In a second NIST test on a wider data set, FarSight was not the best performer. Dr Liu says that FarSight's performance also drops considerably if the camera's angle is very high, if the weather is warm (which causes fiercer turbulence) or if the distance to the target exceeds a kilometre.
Should these shortcomings be resolved, though, it is not hard to imagine how such a system might end up overhead. According to contracting documents, IARPA is looking to create a technology not only for drones but any high or distant camera, such as those mounted on tall buildings or border-surveillance towers. The agency has noted that the outcomes of the programme—which is known as BRIAR and has at least one other active research team, led by an American company called Science and Technology Research—are also intended for 'protection of critical infrastructure and transportation facilities'.
'That implies its routine use on civilian populations,' says Jay Stanley at the American Civil Liberties Union, and 'creates serious risks of abuse and chilling effects on people's sense of freedom'. In cities like London or New York, where CCTV cameras are ubiquitous but not contiguous, whole-body recognition could help track individuals across long distances. Veritone, an American company, already markets a system that can match individuals according to such attributes as body shape and hairstyle. In May the company's boss, Ryan Steelberg, told MIT Technology Review, a magazine, that the tool could be useful in cities where facial recognition is banned.
Those who take matters of privacy into their own hands might also find their personal powers of evasion diminished in the face of whole-body biometrics. Someone wishing to evade a tool like FarSight could no longer just rely on an outfit change or a big hat. They would also need to adjust their gait and, somehow, present a different body shape to cameras. In other words, Dr Liu says, 'the whole enchilada'.
Curious about the world? To enjoy our mind-expanding science coverage, sign up to Simply Science, our weekly subscriber-only newsletter.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
&w=3840&q=100)
Business Standard
2 hours ago
- Business Standard
China's rapid expansion of solar farms helps bring down carbon emissions
High on the Tibetan plateau, Chinese government officials last month showed off what they say will be the world's largest solar farm when completed 610 sq km, the size of the American city of Chicago. China has been installing solar panels at a blistering pace, far faster than anywhere else in the world, and the investment is starting to pay off. A study released Thursday found that the country's carbon emissions edged down 1 per cent in the first six months of the year compared to a year earlier, extending a trend that began in March 2024. The good news is China's carbon emissions may have peaked well ahead of a government target of doing so before 2030. But China, the world's biggest emitter of greenhouse gases, will need to bring them down much more sharply to play its part in slowing global climate change. We're talking really for the first time about a structural declining trend in China's emissions, he said. China installed 212 gigawatts of solar capacity in the first six months of the year, more than America's entire capacity of 178 gigawatts as of the end of 2024, the study said. Electricity from solar has overtaken hydropower in China and is poised to surpass wind this year to become the country's largest source of clean energy. Some 51 gigawatts of wind power was added from January to June. Li Shuo, the director of the China Climate Hub at the Asia Society Policy Institute in Washington, described the plateauing of China's carbon emissions as a turning point in the effort to combat climate change. This is a moment of global significance, offering a rare glimmer of hope in an otherwise bleak climate landscape, he wrote in an email response. It also shows that a country can cut emissions while still growing economically, he said. But Li cautioned that China's heavy reliance on coal remains a serious threat to progress on climate and said the economy needs to shift to less resource-intensive sectors. There's still a long road ahead, he said. One solar farm can power 5 million households A seemingly endless expanse of solar panels stretches toward the horizon on the Tibetan plateau. White two-story buildings rise above them at regular intervals. Sheep graze on the scrubby vegetation that grows under them. Solar panels have been installed on about two-thirds of the land. When completed, it will have more than 7 million panels and be capable of generating enough power for 5 million households. Like many of China's solar and wind farms, it was built in the relatively sparsely populated west. A major challenge is getting electricity to the population centres and factories in China's east. The distribution of green energy resources is perfectly misaligned with the current industrial distribution of our country, Zhang Jinming, the vice governor of Qinghai province, told journalists on a government-organised tour. Part of the solution is building transmission lines traversing the country. One connects Qinghai to Henan province. Two more are planned, including one to Guangdong province in the southeast, almost at the opposite corner of the country. Making full use of the power is hindered by the relatively inflexible way that China's electricity grid is managed, tailored to the steady output of coal plants rather than more variable and less predictable wind and solar, Myllyvirta said. This is an issue that the policymakers have recognized and are trying to manage, but it does require big changes to the way coal-fired power plants operate and big changes to the way the transmission network operates, he said. So it's no small task.
Economic Times
3 hours ago
- Economic Times
China rushes to build out solar, and emissions edge downward
Synopsis China's carbon emissions have decreased by 1% in the first half of the year, signaling a potential peak well before the 2030 target, driven by massive solar installations. The country added 212 gigawatts of solar capacity, exceeding the entire US capacity, and is building the world's largest solar farm on the Tibetan plateau. AP A solar farm is visible in Hainan prefecture of western China's Qinghai province on Tuesday, July 1, 2025. High on the Tibetan plateau, Chinese government officials last month showed off what they say will be the world's largest solar farm when completed - 610 sq km, the size of the American city of Chicago. China has been installing solar panels at a blistering pace, far faster than anywhere else in the world, and the investment is starting to pay off. A study released Thursday found that the country's carbon emissions edged down 1% in the first six months of the year compared to a year earlier, extending a trend that began in March 2024. The good news is China's carbon emissions may have peaked well ahead of a government target of doing so before 2030. But China, the world's biggest emitter of greenhouse gases, will need to bring them down much more sharply to play its part in slowing global climate change. For China to reach its declared goal of carbon neutrality by 2060, emissions would need to fall 3% on average over the next 35 years, said Lauri Myllyvirta, the Finland-based author of the study and lead analyst at the Centre for Research on Energy and Clean Air. "China needs to get to that 3% territory as soon as possible," he said. China's emissions have fallen even as it uses more electricity China's emissions have fallen before during economic slowdowns. What's different this time is electricity demand is growing - up 3.7% in the first half of this year - but the increase in power from solar, wind and nuclear has easily outpaced that, according to Myllyvirta, who analyses the most recent data in a study published on the UK-based Carbon Brief website. "We're talking really for the first time about a structural declining trend in China's emissions," he said. China installed 212 gigawatts of solar capacity in the first six months of the year, more than America's entire capacity of 178 gigawatts as of the end of 2024, the study said. Electricity from solar has overtaken hydropower in China and is poised to surpass wind this year to become the country's largest source of clean energy. Some 51 gigawatts of wind power was added from January to June. Li Shuo, the director of the China Climate Hub at the Asia Society Policy Institute in Washington, described the plateauing of China's carbon emissions as a turning point in the effort to combat climate change. "This is a moment of global significance, offering a rare glimmer of hope in an otherwise bleak climate landscape," he wrote in an email response. It also shows that a country can cut emissions while still growing economically, he said. But Li cautioned that China's heavy reliance on coal remains a serious threat to progress on climate and said the economy needs to shift to less resource-intensive sectors. "There's still a long road ahead," he said. One solar farm can power 5 million households A seemingly endless expanse of solar panels stretches toward the horizon on the Tibetan plateau. White two-story buildings rise above them at regular intervals. Sheep graze on the scrubby vegetation that grows under them. Solar panels have been installed on about two-thirds of the land. When completed, it will have more than 7 million panels and be capable of generating enough power for 5 million households. Like many of China's solar and wind farms, it was built in the relatively sparsely populated west. A major challenge is getting electricity to the population centres and factories in China's east. "The distribution of green energy resources is perfectly misaligned with the current industrial distribution of our country," Zhang Jinming, the vice governor of Qinghai province, told journalists on a government-organised tour. Part of the solution is building transmission lines traversing the country. One connects Qinghai to Henan province. Two more are planned, including one to Guangdong province in the southeast, almost at the opposite corner of the country. Making full use of the power is hindered by the relatively inflexible way that China's electricity grid is managed, tailored to the steady output of coal plants rather than more variable and less predictable wind and solar, Myllyvirta said. "This is an issue that the policymakers have recognized and are trying to manage, but it does require big changes to the way coal-fired power plants operate and big changes to the way the transmission network operates," he said. "So it's no small task."
Time of India
4 hours ago
- Time of India
China rushes to build out solar, and emissions edge downward
High on the Tibetan plateau, Chinese government officials last month showed off what they say will be the world's largest solar farm when completed - 610 sq km, the size of the American city of Chicago. China has been installing solar panels at a blistering pace, far faster than anywhere else in the world, and the investment is starting to pay off. A study released Thursday found that the country's carbon emissions edged down 1% in the first six months of the year compared to a year earlier, extending a trend that began in March 2024. The good news is China's carbon emissions may have peaked well ahead of a government target of doing so before 2030. But China, the world's biggest emitter of greenhouse gases, will need to bring them down much more sharply to play its part in slowing global climate change. For China to reach its declared goal of carbon neutrality by 2060, emissions would need to fall 3% on average over the next 35 years, said Lauri Myllyvirta, the Finland-based author of the study and lead analyst at the Centre for Research on Energy and Clean Air. Live Events "China needs to get to that 3% territory as soon as possible," he said. China's emissions have fallen even as it uses more electricity China's emissions have fallen before during economic slowdowns. What's different this time is electricity demand is growing - up 3.7% in the first half of this year - but the increase in power from solar, wind and nuclear has easily outpaced that, according to Myllyvirta, who analyses the most recent data in a study published on the UK-based Carbon Brief website. "We're talking really for the first time about a structural declining trend in China's emissions," he said. China installed 212 gigawatts of solar capacity in the first six months of the year, more than America's entire capacity of 178 gigawatts as of the end of 2024, the study said. Electricity from solar has overtaken hydropower in China and is poised to surpass wind this year to become the country's largest source of clean energy. Some 51 gigawatts of wind power was added from January to June. Li Shuo, the director of the China Climate Hub at the Asia Society Policy Institute in Washington, described the plateauing of China's carbon emissions as a turning point in the effort to combat climate change. "This is a moment of global significance, offering a rare glimmer of hope in an otherwise bleak climate landscape," he wrote in an email response. It also shows that a country can cut emissions while still growing economically, he said. But Li cautioned that China's heavy reliance on coal remains a serious threat to progress on climate and said the economy needs to shift to less resource-intensive sectors. "There's still a long road ahead," he said. One solar farm can power 5 million households A seemingly endless expanse of solar panels stretches toward the horizon on the Tibetan plateau. White two-story buildings rise above them at regular intervals. Sheep graze on the scrubby vegetation that grows under them. Solar panels have been installed on about two-thirds of the land. When completed, it will have more than 7 million panels and be capable of generating enough power for 5 million households. Like many of China's solar and wind farms, it was built in the relatively sparsely populated west. A major challenge is getting electricity to the population centres and factories in China's east. "The distribution of green energy resources is perfectly misaligned with the current industrial distribution of our country," Zhang Jinming, the vice governor of Qinghai province, told journalists on a government-organised tour. Part of the solution is building transmission lines traversing the country. One connects Qinghai to Henan province. Two more are planned, including one to Guangdong province in the southeast, almost at the opposite corner of the country. Making full use of the power is hindered by the relatively inflexible way that China's electricity grid is managed, tailored to the steady output of coal plants rather than more variable and less predictable wind and solar, Myllyvirta said. "This is an issue that the policymakers have recognized and are trying to manage, but it does require big changes to the way coal-fired power plants operate and big changes to the way the transmission network operates," he said. "So it's no small task."
