Speaking in Washington, DC on Tuesday, former US secretary of state Henry Kissinger said he’s convinced of AI’s potential to fundamentally alter human consciousness – including changes in our self-perception and strategic decision-making. He also slammed AI developers for insufficiently thinking through the implications of their creations.
Kissinger, now 96, was speaking at the “Strength Through Innovation” conference run by the US National Security Commission on Artificial Intelligence, which was set up by Congress to evaluate the future of AI in the US with regard to national security.
Kissinger, who served under President Richard Nixon during the Vietnam War, is a controversial figure who many argue is an unconvicted war criminal. That he’s speaking at conferences and not locked in a cold jail cell is understandably offensive to some observers.
“I’ve become convinced that AI and the surrounding disciplines are going to bring a change in human consciousness, like the Enlightenment.”
Moderator Nadia Schadlow, who in 2018 served in the Trump administration as the Assistant to the President and as Deputy National Security Advisor for Strategy, asked Kissinger about his take on militarised artificial intelligence and how it might affect global security and strategic decision-making.
“I don’t look at it as a technical person,” said Kissinger. “I am concerned with the historical, philosophical, strategic aspect of it, and I’ve become convinced that AI and the surrounding disciplines are going to bring a change in human consciousness, like the Enlightenment,” he said, adding: “That’s why I’m here.” His invocation of the 18th-century European Enlightenment was a reference to the paradigmatic intellectual shift that occurred during this important historical period, wherein science, rationalism, and humanism largely replaced religious and faith-based thinking.
Though Kissinger didn’t elaborate on this point, he may have been referring to a kind of philosophical or existential shift in our thinking once AI reaches a sufficiently advanced level of sophistication – a development that will irrevocably alter the way we engage with ourselves and our machines, not necessarily for the better.
Kissinger with moderator Nadia Schadlow. (Image: DVIDS)
Kissinger said he’s not “arguing against AI” and that it’s something that might even “save us,” without elaborating on the details.
He said he recently spoke to university students about the perils of AI and that he told them, ‘You work on the applications, I work on the implications.’” He said computer scientists aren’t doing enough to figure out what it will mean “if mankind is surrounded by automatic actions” that cannot be explained or fully understood by humans, a conundrum AI researchers refer to as the black box problem.
Artificial intelligence, he said, “is bound to change the nature of strategy and warfare,” but many stakeholders and decision-makers are still treating it as a “new technical departure.” They haven’t yet understood that AI “must bring a change in the philosophical perception of the world,” and that it will “fundamentally affect human perceptions.”
A primary concern of Kissinger's was how militarised AI might cause diplomacy to break down. The secret, ephemeral nature of AI means it’s not something state actors can simply “put on the table” as an obvious threat, unlike conventional weapons, said Kissinger. In the strategic field, “we are moving into an area where you can imagine an extraordinary capability” and the “enemy may not know where the threat came from for a while.”
This confusion could cause undue chaos on a battlefield, or a country could mistake the source of an attack. Even scarier, a 2018 report from the RAND Corporation warned that AI could eventually heighten the risk of nuclear war. This means we’ll also have to “rethink the element of arms control” and “rethink even how the concept of arms control” might apply to this future world, said Kissinger.
Kissinger said he’s “sort of obsessed” with the work being done by Google’s DeepMind, and the development of AlphaGo and AlphaZero in particular – artificially intelligent systems capable of defeating the world’s best chess and Go players. He was taken aback by how AlphaGo learned “a form of chess that no human being in all of history ever developed,” and how pre-existing chess-playing computers pitted against this AlphaGo were “defenceless.” He said we need to know what this means in the larger scheme of things, and that we should study this concern – that we’re creating things we don’t really understand. “We’re not conscious of this yet as a society,” he said.
Kissinger is confident that AI algorithms will eventually become a part of military decision-making, but strategic planners will “have to test themselves in war games and even in actual situations to ensure the degree of reliability we can afford to these algorithms, while also having to think through the consequences.”
Kissinger said the situation may eventually be analogous to the onset of World War I, in which a series of logical steps led to many unanticipated and unwanted consequences.
AI will be the “philosophical challenge of the future.”
“If you don’t see through the implications of the technologies... including your emotional capacities to handle unpredictable consequences, then you’re going to fail on the strategic side,” said Kissinger. It’s not clear, he said, how state actors will be able to conduct diplomacy when they can’t be sure what the other side is thinking, or if they’ll even be able to reassure the other side “even if you wanted to,” he said. “This topic is very important to think about – as you develop weapons of great capacity...how do you talk about it, and how do you build restraint on their use?”
To which he added: “Your weapons in a way become your partner, and if they’re designed for a certain task, how can you modify them under certain conditions? These questions need to be answered.” AI will be the “philosophical challenge of the future,” said Kissinger, because we’ll be partnered with generally intelligent objects that have “never been conceived before, and the limitations are so vast.”
Scary words from a scary guy. The future looks like a very precarious place.
Featured image: DVIDS