Latest news with #AMathematicalTheoryofCommunication
Yahoo
11-02-2025
- Business
- Yahoo
Arvind Krishna Celebrates the Work of a Pioneer
Arvind Krishna, chief executive officer of International Business Machines Corporation (IBM), in San Francisco, July 13, 2022. Credit - David Paul Morris—Bloomberg/Getty Images Arvind Krishna, CEO, chairman and president of IBM, used his acceptance speech at the TIME100 AI Impact Awards on Monday to acknowledge pioneering computer scientist and mathematician Claude Shannon, calling him one of the 'unsung heroes of today.' Krishna, who accepted his award at a ceremony in Dubai alongside musician Grimes, California Institute of Technology professor Anima Anandkumar, and artist Refik Anadol, said of Shannon, 'He would come up with the ways that you can convey information, all of which has stood the test until today.' In 1948, Shannon—now known as the father of the information age—published 'A Mathematical Theory of Communication,' a transformative paper that, by proposing a simplified way of quantifying information via bits, would go on to fundamentally shape the development of information technology—and thus, our modern era. In his speech, Krishna also pointed to Shannon's work building robotic mice that solved mazes as an example of his enjoyment of play within his research. Krishna, of course, has some familiarity with what it takes to be at the cutting edge. Under his leadership, IBM, known as a pioneer in artificial intelligence itself, is carving its own niche in specialized AI and invests heavily in quantum computing research—the mission to build a machine based on quantum principles, which could carry out calculations much faster than existing computers. The business also runs a cloud computing service, designs software, and operates a consulting business. Krishna said that he most enjoyed Shannon's work because the researcher's 'simple insights' have helped contribute to the 'most sophisticated communication systems' of today, including satellites. Speaking about Shannon's theoretical work, which Krishna said was a precursor to neural networks, he noted, 'I think we can give him credit for building the first elements of artificial intelligence.' The TIME100 AI Impact Awards Dubai was presented by the World Government Summit and the Museum of the Future. Write to Ayesha Javed at
Yahoo
07-02-2025
- Science
- Yahoo
Sacred laws of entropy also work in the quantum world, suggests study
According to the second law of thermodynamics, the entropy of an isolated system tends to increase over time. Everything around us follows this law; for instance, the melting of ice, a room becoming messier, hot coffee cooling down, and aging — all are examples of entropy increasing over time. Until now, scientists believed that quantum physics is an exception to this law. This is because about 90 years ago, mathematician John von Neumann published a series of papers in which he mathematically showed that if we have complete knowledge of a system's quantum state, its entropy remains constant over time. However, a new study from researchers at the Vienna University of Technology (TU Wien) challenges this notion. It suggests that the entropy of a closed quantum system also increases over time until it reaches its peak level. 'It depends on what kind of entropy you look at. If you define the concept of entropy in a way that is compatible with the basic ideas of quantum physics, then there is no longer any contradiction between quantum physics and thermodynamics,' the TU Wien team notes. The study authors highlighted an important detail in Neumann's explanation. He stated that entropy for a quantum system doesn't change when we have full information about the system. However, the quantum theory itself tells us that it's impossible to have complete knowledge of a quantum system, as we can only measure certain properties with uncertainty. This means that von Neumann entropy isn't the correct approach to looking at the randomness and chaos in quantum systems. So then, what's the right way? Well, 'instead of calculating the von Neumann entropy for the complete quantum state of the entire system, you could calculate an entropy for a specific observable,' the study authors explain. This can be achieved using Shannon entropy, a concept proposed by mathematician Claude Shannon in 1948 in his paper titled A Mathematical Theory of Communication. Shannon entropy measures the uncertainty in the outcome of a specific measurement. It tells us how much new information we gain when observing a quantum system. "If there is only one possible measurement result that occurs with 100% certainty, then the Shannon entropy is zero. You won't be surprised by the result, you won't learn anything from it. If there are many possible values with similarly large probabilities, then the Shannon entropy is large," Florian Meier, first author of the study and a researcher at TU Wien, said. When we reimagine the entropy of a quantum system through the lens of Claude Shannon, we begin with a quantum system in a state of low Shannon entropy, meaning that the system's behavior is relatively predictable. For example, imagine you have an electron, and you decide to measure its spin (which can be up or down). If you already know the spin is 100% up, the Shannon entropy is zero—we learn nothing new from the measurement. In case the spin is 50% up and 50% down, then Shannon entropy is high because we are equally likely to get either result, and the measurement gives us new information. As more time passes, the entropy increases as you're never sure about the outcome. However, eventually, the entropy reaches a point where it levels off, meaning the system's unpredictability stabilizes. This mirrors what we observe in classical thermodynamics, where entropy increases until it reaches equilibrium and then stays constant. According to the study, this case of entropy also stands valid for quantum systems involving many particles and producing multiple outcomes. "This shows us that the second law of thermodynamics is also true in a quantum system that is completely isolated from its environment. You just have to ask the right questions and use a suitable definition of entropy," Marcus Huber, senior study author and an expert in quantum information science at TU Wien, said. The study is published in the journal PRX Quantum.
