All language subtitles for AI has hacked the code of human civilization Yuval Noah Harari
Afrikaans
Akan
Albanian
Amharic
Arabic
Armenian
Azerbaijani
Basque
Belarusian
Bemba
Bengali
Bihari
Bosnian
Breton
Bulgarian
Cambodian
Catalan
Cebuano
Cherokee
Chichewa
Chinese (Simplified)
Chinese (Traditional)
Corsican
Croatian
Czech
Danish
Dutch
English
Esperanto
Estonian
Ewe
Faroese
Filipino
Finnish
French
Frisian
Ga
Galician
Georgian
German
Greek
Guarani
Gujarati
Haitian Creole
Hausa
Hawaiian
Hebrew
Hindi
Hmong
Hungarian
Icelandic
Igbo
Indonesian
Interlingua
Irish
Italian
Japanese
Javanese
Kannada
Kazakh
Kinyarwanda
Kirundi
Kongo
Korean
Krio (Sierra Leone)
Kurdish
Kurdish (SoranĂ®)
Kyrgyz
Laothian
Latin
Latvian
Lingala
Lithuanian
Lozi
Luganda
Luo
Luxembourgish
Macedonian
Malagasy
Malay
Malayalam
Maltese
Maori
Marathi
Mauritian Creole
Moldavian
Mongolian
Myanmar (Burmese)
Montenegrin
Nepali
Nigerian Pidgin
Northern Sotho
Norwegian
Norwegian (Nynorsk)
Occitan
Oriya
Oromo
Pashto
Persian
Polish
Portuguese (Brazil)
Portuguese (Portugal)
Punjabi
Quechua
Romanian
Romansh
Runyakitara
Russian
Samoan
Scots Gaelic
Serbian
Serbo-Croatian
Sesotho
Setswana
Seychellois Creole
Shona
Sindhi
Sinhalese
Slovak
Slovenian
Somali
Spanish
Spanish (Latin American)
Sundanese
Swahili
Swedish
Tajik
Tamil
Tatar
Telugu
Thai
Tigrinya
Tonga
Tshiluba
Tumbuka
Turkish
Turkmen
Twi
Uighur
Ukrainian
Urdu
Uzbek
Vietnamese
Welsh
Wolof
Xhosa
Yiddish
Yoruba
Zulu
Would you like to inspect the original subtitles? These are the user uploaded subtitles that are being translated:
1
00:00:00,010 --> 00:00:04,050
Please join me in welcoming Professor
Yuval Noah Harari.
2
00:00:06,170 --> 00:00:12,750
Thank you so much.
3
00:00:15,430 --> 00:00:16,430
Hello everyone.
4
00:00:16,670 --> 00:00:18,570
I hope I opened my mic.
5
00:00:19,330 --> 00:00:20,570
You can hear me okay.
6
00:00:21,350 --> 00:00:25,270
So it's really a great honor for me to
give this year's TANEO lecture.
7
00:00:25,750 --> 00:00:28,050
And it's also a personal joy.
8
00:00:28,590 --> 00:00:29,850
to come back to Oxford.
9
00:00:30,090 --> 00:00:36,010
I did my DPhil here 25 years ago under
the guidance of Dr. Stephen Gunn.
10
00:00:36,370 --> 00:00:42,650
Back then, I specialized in medieval and
early modern military history.
11
00:00:43,370 --> 00:00:49,350
But today, I will not be talking about
knights and castles and the gunpowder
12
00:00:49,350 --> 00:00:55,230
revolution. I'll talk about AI
bureaucrats and religions and
13
00:00:55,230 --> 00:00:57,610
more generally, about the AI revolution.
14
00:00:58,670 --> 00:01:05,670
Now, the most important thing to know
about AI is that AI is not a tool.
15
00:01:06,570 --> 00:01:08,450
It's not a tool in our hand.
16
00:01:08,790 --> 00:01:12,470
It is an agent with its own hand.
17
00:01:13,210 --> 00:01:15,090
What exactly is agency?
18
00:01:15,450 --> 00:01:17,990
How is an agent different from a tool?
19
00:01:18,690 --> 00:01:21,910
Agents have several distinguishing
characteristics.
20
00:01:22,690 --> 00:01:24,950
They don't necessarily need
consciousness.
21
00:01:25,210 --> 00:01:30,290
You don't need consciousness to be an
agent. What you do need, is the ability
22
00:01:30,290 --> 00:01:37,270
make decisions by yourself, the ability
to invent new things, new ideas
23
00:01:37,270 --> 00:01:38,270
by yourself.
24
00:01:38,790 --> 00:01:45,670
An agent should be able by itself to
learn things that its creators
25
00:01:45,670 --> 00:01:52,390
don't know, and an agent should be able
to change by itself
26
00:01:52,390 --> 00:01:56,330
in ways that its creators don't
anticipate.
27
00:01:58,400 --> 00:02:03,540
An atom bomb, for instance, despite its
enormous power, is not an agent.
28
00:02:03,820 --> 00:02:07,120
It cannot learn and change by itself.
29
00:02:07,440 --> 00:02:14,240
It cannot decide by itself which city to
bomb. It cannot invent anything new,
30
00:02:14,340 --> 00:02:15,620
like the hydrogen bomb.
31
00:02:16,300 --> 00:02:23,100
Similarly, let's say an automatic coffee
machine is not an agent, even though it
32
00:02:23,100 --> 00:02:27,000
does something by itself, automatically.
33
00:02:27,720 --> 00:02:32,960
You press a button, and the machine
automatically makes you a cup of coffee.
34
00:02:33,260 --> 00:02:39,060
But the machine, the coffee machine,
only follows a pre -programmed
35
00:02:39,580 --> 00:02:41,020
It doesn't change.
36
00:02:41,400 --> 00:02:44,840
It doesn't learn anything new. It
doesn't create anything new.
37
00:02:45,440 --> 00:02:51,720
But suppose that as you approach the
coffee machine, before you even press
38
00:02:51,720 --> 00:02:57,180
button, the machine announces, tells
you, I've been monitoring you.
39
00:02:57,550 --> 00:03:02,270
for the last few weeks, and based on
everything I've learned about you and
40
00:03:02,270 --> 00:03:07,910
people, and based on your facial
expression and the time of day, I
41
00:03:07,910 --> 00:03:09,390
you would like an espresso.
42
00:03:09,730 --> 00:03:11,890
So I already made you a cup.
43
00:03:12,350 --> 00:03:14,770
Now that's an AI copy machine.
44
00:03:15,050 --> 00:03:19,470
It learned something by itself and
decided something by itself.
45
00:03:19,790 --> 00:03:23,890
And it's really an AI if the following
day...
46
00:03:24,090 --> 00:03:30,110
It announces, I have now invented a new
drink called Bespresso, which I think
47
00:03:30,110 --> 00:03:33,870
you would like better than espresso, and
he would try it out, I made you a cup.
48
00:03:34,750 --> 00:03:37,090
Then it's really an AI.
49
00:03:37,390 --> 00:03:42,590
It changed in ways that creators did not
anticipate and invented something
50
00:03:42,590 --> 00:03:43,850
completely new.
51
00:03:44,730 --> 00:03:48,070
As far as I know, there are no coffee
machines.
52
00:03:49,020 --> 00:03:52,880
at the present moment, maybe in
anthropic headquarters or Google
53
00:03:53,400 --> 00:03:56,600
they have a few prototypes, but they are
not out in the market yet.
54
00:03:57,000 --> 00:04:03,900
But in certain narrow fields, like
playing Go or playing chess, AI
55
00:04:03,900 --> 00:04:10,760
agency and creativity already greatly
surpass human agency and
56
00:04:10,760 --> 00:04:17,019
creativity. AI chess masters can decide,
of course, by themselves which moves to
57
00:04:17,019 --> 00:04:23,900
make. they invent by themselves
completely new strategies, how to play
58
00:04:23,900 --> 00:04:29,000
chess, that never occurred to human
chess masters over thousands of years of
59
00:04:29,000 --> 00:04:30,000
playing the game.
60
00:04:30,320 --> 00:04:37,300
And while doing that, they learn and
change in ways their human creators did
61
00:04:37,300 --> 00:04:38,580
necessarily predict.
62
00:04:39,020 --> 00:04:46,000
Today, of course, no human has any
chance of beating an AI chess master.
63
00:04:47,080 --> 00:04:52,520
Now, people who downplay the importance
of the AI revolution dismiss examples
64
00:04:52,520 --> 00:04:58,840
like chess by arguing that the
chessboard is a very narrow and
65
00:04:58,840 --> 00:05:02,200
environment created by humans.
66
00:05:02,580 --> 00:05:09,360
The critics say that AI agency will
always remain limited to
67
00:05:09,360 --> 00:05:14,380
such narrow and artificial environment,
which means that it's not true agency.
68
00:05:15,080 --> 00:05:18,020
And it doesn't pose any serious
challenge to humanity.
69
00:05:18,440 --> 00:05:23,500
Yes, AI may take over the chessboard,
but it will never take over planet
70
00:05:24,260 --> 00:05:30,300
And indeed, if you do an experiment, if
you take the greatest AI chess master
71
00:05:30,300 --> 00:05:35,460
and drop it in the middle of the jungle,
what do you think will happen?
72
00:05:36,280 --> 00:05:42,460
The AI chess master will not be able to
start mining iron and building factories
73
00:05:42,460 --> 00:05:44,500
and creating a robot army.
74
00:05:44,910 --> 00:05:45,930
to take over the world.
75
00:05:46,290 --> 00:05:49,770
In fact, it will not be able to do
anything whatsoever.
76
00:05:50,370 --> 00:05:56,850
Without the electricity provided by
power stations built by humans,
77
00:05:57,190 --> 00:06:00,010
the AI chess master is utterly helpless.
78
00:06:00,590 --> 00:06:07,030
Therefore, the argument goes, AIs are
not true agents. They are confined to
79
00:06:07,030 --> 00:06:13,830
these narrow artificial niches that
somebody else, humans, constructed for
80
00:06:15,790 --> 00:06:22,210
The problem is that this argument
actually applies to all known types of
81
00:06:22,210 --> 00:06:28,410
intelligence. Human intelligence, too,
operates only within a relatively narrow
82
00:06:28,410 --> 00:06:31,830
ecosystem that somebody else
constructed.
83
00:06:32,230 --> 00:06:38,430
Drop me alone on Mars and it will be
like dropping an AI chess master
84
00:06:38,430 --> 00:06:40,110
in the middle of the jungle.
85
00:06:40,350 --> 00:06:41,850
I will die within seconds.
86
00:06:42,540 --> 00:06:48,340
My intelligence can survive and operate
only within the very, very specific
87
00:06:48,340 --> 00:06:55,260
ecosystem that trees, bacteria, insects,
and other organisms have constructed
88
00:06:55,260 --> 00:06:58,900
on planet Earth during four billion
years of evolution.
89
00:06:59,420 --> 00:07:04,920
And that's true of all agents. All
agents we know of, at least, have their
90
00:07:04,920 --> 00:07:09,840
niches. Fish live in oceans that they
didn't create.
91
00:07:10,220 --> 00:07:13,680
Monkeys live in forests that they didn't
create.
92
00:07:13,900 --> 00:07:20,120
All mammals, including human beings,
live in an oxygen -rich atmosphere that
93
00:07:20,120 --> 00:07:21,300
they didn't create.
94
00:07:21,780 --> 00:07:27,820
Until about 2 .4 billion years ago, the
atmosphere of our planet actually
95
00:07:27,820 --> 00:07:34,200
contained very little oxygen, and for
most of the organisms that lived back
96
00:07:34,200 --> 00:07:37,340
then, oxygen was a deadly poison.
97
00:07:38,120 --> 00:07:43,960
Then, in a protracted process, lasting
hundreds of millions of years, which is
98
00:07:43,960 --> 00:07:50,280
known as the Great Oxygenation Event,
various ancient microbes began
99
00:07:50,280 --> 00:07:56,940
polluting the atmosphere of the Earth
with deadly oxygen, which was a
100
00:07:56,940 --> 00:07:59,700
of their photosynthetic processes.
101
00:08:00,380 --> 00:08:06,940
As the atmosphere filled with this
deadly poisonous gas, numerous
102
00:08:06,940 --> 00:08:10,400
archaic species were driven to
extinction.
103
00:08:11,470 --> 00:08:16,950
Some species, however, managed to
survive and adapt to the new conditions.
104
00:08:17,270 --> 00:08:23,870
Eventually, many of these survivors went
from hating oxygen
105
00:08:23,870 --> 00:08:29,090
to becoming totally dependent on oxygen
for their survival.
106
00:08:29,430 --> 00:08:35,230
And our ancestors, of course, are among
the species that underwent this
107
00:08:35,230 --> 00:08:41,970
transition. And we still live in this
artificial oxygen -filled
108
00:08:41,970 --> 00:08:46,750
environment that was originally created
by these ancient microbes.
109
00:08:47,130 --> 00:08:52,510
What I would like to argue in this
lecture is that we might be witnessing
110
00:08:52,510 --> 00:08:56,190
analogous moment in the evolution of
life.
111
00:08:57,390 --> 00:09:03,050
Over the past millennia, we humans have
been filling the atmosphere with
112
00:09:03,050 --> 00:09:07,650
something that might eventually prove
deadly for most organisms.
113
00:09:08,360 --> 00:09:15,360
including perhaps homo sapiens, but that
creates a new artificial environment
114
00:09:15,360 --> 00:09:17,500
in which AIs flourish.
115
00:09:17,800 --> 00:09:21,480
And I am not talking about CO2.
116
00:09:21,800 --> 00:09:28,640
I am talking about data, about
bureaucracy, and ultimately about the
117
00:09:28,640 --> 00:09:34,220
thing that I am expelling from my mouth
right now, which is words.
118
00:09:34,700 --> 00:09:35,980
Language talk.
119
00:09:36,940 --> 00:09:42,240
Over thousands of years, we humans have
transformed the planet from a language
120
00:09:42,240 --> 00:09:49,120
-free environment into a very artificial
environment, rich in language tokens,
121
00:09:49,380 --> 00:09:51,600
data, and bureaucracy.
122
00:09:52,180 --> 00:09:58,800
And this environment could prove deadly
for most organisms, but highly conducive
123
00:09:58,800 --> 00:10:00,940
to the development of AI.
124
00:10:01,300 --> 00:10:06,900
Because just as fish live in oceans and
monkeys live in forests, AIs live in
125
00:10:06,900 --> 00:10:12,480
bureaucracy. So let's spend a few
minutes talking about bureaucracy, and
126
00:10:12,480 --> 00:10:16,960
we'll get back to talking about what
underlies bureaucracy, which is language
127
00:10:16,960 --> 00:10:17,960
and words.
128
00:10:18,780 --> 00:10:25,740
Now, humans, our species, we conquer the
world by learning to cooperate
129
00:10:25,740 --> 00:10:27,440
in very, very large numbers.
130
00:10:28,180 --> 00:10:34,140
Individually, humans are not stronger or
even smarter than other animals.
131
00:10:34,730 --> 00:10:41,430
In a one -on -one fight, a human will
most likely lose to a
132
00:10:41,430 --> 00:10:43,830
chimpanzee or a lion or an elephant.
133
00:10:44,070 --> 00:10:49,330
However, in a contest between a million
humans and a million chimpanzees, the
134
00:10:49,330 --> 00:10:54,210
humans easily win because the humans
know how to cooperate and the
135
00:10:54,210 --> 00:10:56,810
don't. And that's why we control the
world.
136
00:10:58,240 --> 00:11:01,360
How do a million humans who don't know
each other cooperate?
137
00:11:01,760 --> 00:11:06,040
Chimpanzees cooperate based on personal
acquaintance, one of the others.
138
00:11:06,440 --> 00:11:09,860
Humans do so in small numbers, but you
can't know a million people.
139
00:11:10,300 --> 00:11:12,340
So how do a million people cooperate?
140
00:11:12,940 --> 00:11:19,600
Usually by building a bureaucratic
system, like a legal system or the
141
00:11:19,600 --> 00:11:22,800
system or churches or states or
universities.
142
00:11:23,560 --> 00:11:25,340
Now, what do...
143
00:11:25,660 --> 00:11:28,160
these bureaucratic systems actually do.
144
00:11:29,000 --> 00:11:35,140
When a government official or a bishop
or a rabbi or an accountant or a lawyer
145
00:11:35,140 --> 00:11:39,500
or a banker goes to work in the morning,
what do they do there all day?
146
00:11:41,840 --> 00:11:45,820
Now, carpenters build tables.
147
00:11:46,640 --> 00:11:53,080
Engineers build bridges. What do bankers
and other bureaucrats build?
148
00:11:54,090 --> 00:11:58,870
Well, bankers and other bureaucrats are
busy all day building trust.
149
00:12:00,090 --> 00:12:06,950
Their job is to build trust between
large numbers of strangers who don't
150
00:12:06,950 --> 00:12:12,130
each other personally, and thereby
enable large -scale cooperation, which
151
00:12:12,130 --> 00:12:15,210
basis for almost everything a phishing
is achieved.
152
00:12:15,590 --> 00:12:22,000
For example, my banker, whom I don't
really know personally, works hard all
153
00:12:22,000 --> 00:12:28,500
to build trust with me so that I will be
willing to put my savings into her
154
00:12:28,500 --> 00:12:29,500
bank.
155
00:12:30,180 --> 00:12:36,480
Simultaneously, the banker works hard to
build trust with an entrepreneur who
156
00:12:36,480 --> 00:12:39,140
needs money to start a new company.
157
00:12:39,440 --> 00:12:43,240
And the banker lends my savings to that
entrepreneur.
158
00:12:44,920 --> 00:12:48,720
Thereby, the banker actually created a
bridge of trust.
159
00:12:49,260 --> 00:12:50,900
between me and the entrepreneur.
160
00:12:51,400 --> 00:12:56,100
Even though I've never met an
entrepreneur in my life, she can now use
161
00:12:56,100 --> 00:12:58,460
savings to start her company.
162
00:12:58,840 --> 00:13:03,120
And this is what the financial system,
when it works well, is all about.
163
00:13:03,440 --> 00:13:09,180
It builds trust between strangers so
that millions of people can put together
164
00:13:09,180 --> 00:13:12,660
their resources and talents on new
projects.
165
00:13:13,420 --> 00:13:17,640
And the financial history of the world
is the history of people
166
00:13:18,410 --> 00:13:24,590
inventing more and more sophisticated
ways to build bridges of trust.
167
00:13:25,590 --> 00:13:28,930
Money is ultimately a bridge of trust.
168
00:13:29,310 --> 00:13:36,170
The idea of money is that I can go to
the market, maybe in a foreign city,
169
00:13:36,170 --> 00:13:40,790
a person that I never saw in my life,
maybe doesn't even speak my language,
170
00:13:40,790 --> 00:13:45,970
just by giving that person a tiny piece
of metal or a piece of colorful paper,
171
00:13:46,670 --> 00:13:49,250
He or she will give me bread I can eat.
172
00:13:49,750 --> 00:13:53,090
That's the bridge of trust that money
creates.
173
00:13:53,430 --> 00:13:56,670
Now, the coin in the banknote, of
course, was just the beginning.
174
00:13:56,950 --> 00:14:02,110
Over the centuries, humans invented more
and more sophisticated financial
175
00:14:02,110 --> 00:14:08,650
devices to build trust, like checks and
bonds and stocks and
176
00:14:08,650 --> 00:14:14,330
ETFs and loans and mortgages and
compound interest. All of these things
177
00:14:14,330 --> 00:14:16,190
ultimately about building trust.
178
00:14:16,670 --> 00:14:18,030
between billions of strangers.
179
00:14:18,430 --> 00:14:22,310
And it's the same with all
bureaucracies. It's the same with the
180
00:14:22,490 --> 00:14:25,910
This is what lawyers are supposed to do,
to build trust.
181
00:14:26,370 --> 00:14:31,490
This is what government officials and
bishops and accountants do when they go
182
00:14:31,490 --> 00:14:33,490
work. They are supposed to build trust.
183
00:14:35,410 --> 00:14:40,690
Now, the important thing to note about
all these bureaucratic systems is that
184
00:14:40,690 --> 00:14:43,110
they are extremely artificial
environments.
185
00:14:43,840 --> 00:14:48,800
in which a relatively narrow
intelligence, I hope I don't insult
186
00:14:48,800 --> 00:14:55,120
specializing in a very narrow niche of
intelligence is sufficient to exert
187
00:14:55,120 --> 00:14:57,460
enormous impact on the world.
188
00:14:57,740 --> 00:15:03,280
A lawyer or a banker or a government
official who doesn't even know how to
189
00:15:03,280 --> 00:15:10,120
an axe or a hammer can nevertheless cut
down entire forests and build entire
190
00:15:10,120 --> 00:15:12,200
cities just by moving data.
191
00:15:12,720 --> 00:15:17,900
just by moving documents from here to
there inside the bureaucratic network.
192
00:15:18,280 --> 00:15:24,120
Now, of course, if you take the lawyer
out of the bureaucratic system and throw
193
00:15:24,120 --> 00:15:30,100
the lawyer into the messy, unstructured
jungle, her legal skills mean nothing,
194
00:15:30,120 --> 00:15:35,080
and she will not be a match to a
chimpanzee or a lion or an elephant.
195
00:15:35,340 --> 00:15:39,960
But we have already imposed our
bureaucratic systems on the jungle.
196
00:15:40,640 --> 00:15:45,640
which is why lawyers are far more
powerful than even all the, if you take
197
00:15:45,640 --> 00:15:51,140
the lions in the world together, and
they have to compete against one very
198
00:15:51,140 --> 00:15:52,700
lawyer, I will bet on the lawyer.
199
00:15:55,620 --> 00:16:02,340
Today, the very survival of species like
lions depends on lawyers
200
00:16:02,340 --> 00:16:07,980
and accountants and bankers moving
documents in these bureaucratic
201
00:16:08,280 --> 00:16:10,460
of governments and banks and
corporations.
202
00:16:11,840 --> 00:16:17,120
And this is the environment in which AI
is gaining agency.
203
00:16:17,980 --> 00:16:24,360
If you throw an AI into the unstructured
jungle, it will not be able to start
204
00:16:24,360 --> 00:16:26,700
mining iron and to build a robot army.
205
00:16:26,940 --> 00:16:32,000
But within the bureaucratic system that
humans have already created and imposed
206
00:16:32,000 --> 00:16:33,000
on the world,
207
00:16:33,640 --> 00:16:40,260
AIs are posed to wield enormous power
because AIs are native bureaucrats,
208
00:16:40,340 --> 00:16:41,680
unlike us.
209
00:16:42,400 --> 00:16:47,080
No lawyer can remember all the laws and
regulations of the UK.
210
00:16:47,320 --> 00:16:48,500
An AI can.
211
00:16:48,920 --> 00:16:55,660
No accountant can remember all the
transactions of a corporation or a bank.
212
00:16:55,660 --> 00:16:56,599
AI can.
213
00:16:56,600 --> 00:17:02,840
No bishop can remember all of canon law
and all of the theological texts.
214
00:17:03,320 --> 00:17:06,480
written by Christian theologians over
the last 2 ,000 years.
215
00:17:06,780 --> 00:17:08,839
And AI can do that quite easily.
216
00:17:09,980 --> 00:17:16,140
So in the coming years, millions of AI
bureaucrats will increasingly
217
00:17:16,140 --> 00:17:22,500
take over the world's bureaucracies and
make decisions not just about lions and
218
00:17:22,500 --> 00:17:24,520
chimpanzees, but about our lives.
219
00:17:25,020 --> 00:17:28,000
AI bankers will decide whether to give
you a loan.
220
00:17:28,260 --> 00:17:31,900
AI administrators will decide whether to
accept you to university.
221
00:17:32,670 --> 00:17:35,370
AI judges will decide whether to send
you to jail.
222
00:17:35,710 --> 00:17:39,030
AI theologians will decide whether you
can have an abortion.
223
00:17:40,070 --> 00:17:45,010
Corporate AIs will decide whether to
give you a job. And military AIs will
224
00:17:45,010 --> 00:17:47,050
decide whether to bomb your house.
225
00:17:48,190 --> 00:17:52,250
Now, leave aside for a moment the
question, is this good or bad?
226
00:17:53,150 --> 00:17:59,950
The first thing to note is simply to
realize the magnitude of the change we
227
00:17:59,950 --> 00:18:00,950
facing.
228
00:18:01,260 --> 00:18:08,080
These millions and even billions of AI
will soon change all the systems that
229
00:18:08,080 --> 00:18:09,080
the world.
230
00:18:09,220 --> 00:18:15,600
We already have a few real -life
examples for how this happened and what
231
00:18:15,600 --> 00:18:16,680
consequences could be.
232
00:18:18,960 --> 00:18:25,400
Maybe the best example so far is the
story of social media and social media
233
00:18:25,400 --> 00:18:30,440
algorithms. Social media is run not by
humans but by algorithms.
234
00:18:31,260 --> 00:18:37,980
The algorithms that decide, that control
the movement of information on social
235
00:18:37,980 --> 00:18:40,340
media, which are primitive AI.
236
00:18:40,720 --> 00:18:45,940
This began 10, 15 years ago. This was
like the first generation, very, very
237
00:18:45,940 --> 00:18:51,580
primitive, stupid, narrow AI, which
nevertheless completely changed the
238
00:18:52,140 --> 00:18:57,360
Now, the algorithms of social media have
been tasked by corporations like
239
00:18:57,360 --> 00:19:03,660
Facebook and TikTok and X with an
extremely narrow goal to maximize
240
00:19:03,660 --> 00:19:05,700
user engagement.
241
00:19:06,100 --> 00:19:11,540
Make people spend more time on the
platform because the more time they
242
00:19:11,540 --> 00:19:14,240
the platform, the more money the
corporation makes.
243
00:19:14,440 --> 00:19:15,880
Very simple, very narrow.
244
00:19:16,580 --> 00:19:23,080
In pursuit of this user engagement,
these primitive AIs made an important
245
00:19:23,080 --> 00:19:29,320
discovery. They experimented on billions
of human guinea pigs and learned
246
00:19:29,850 --> 00:19:35,810
that the easiest way to grab the
attention of the human being and glue
247
00:19:35,810 --> 00:19:42,730
human to the screen is to press the hate
or fear or greed button in the
248
00:19:42,730 --> 00:19:43,730
human mind.
249
00:19:43,930 --> 00:19:45,410
And they learned how to do it.
250
00:19:45,910 --> 00:19:51,950
And they started spreading hate and fear
and greed in huge quantities
251
00:19:51,950 --> 00:19:54,030
in the information sphere.
252
00:19:54,570 --> 00:19:58,630
And this has been a major reason, not
the only reason, but a major reason.
253
00:19:59,130 --> 00:20:03,650
from the current epidemic of conspiracy
theories and fake news and social
254
00:20:03,650 --> 00:20:06,990
disturbances that undermine society all
over the world.
255
00:20:07,990 --> 00:20:12,550
Now, these social media algorithms,
again, they are very primitive AIs.
256
00:20:13,030 --> 00:20:18,170
If you drop them in the jungle, they
cannot build a robot army and try to
257
00:20:18,170 --> 00:20:18,989
over the world.
258
00:20:18,990 --> 00:20:25,510
But within the bureaucratic system of
social media, these very limited
259
00:20:25,510 --> 00:20:31,450
agents... have enormous power, and they
have already changed the world in quite
260
00:20:31,450 --> 00:20:32,490
a dramatic way.
261
00:20:32,930 --> 00:20:39,750
In past centuries, the flow of
information on media platforms was
262
00:20:39,750 --> 00:20:42,710
by human editors. It was a human job.
263
00:20:43,250 --> 00:20:49,190
It was human editors who decided what to
put on the front page of the newspaper.
264
00:20:49,510 --> 00:20:55,030
It was human editors who decided what
items to include in the evening news on
265
00:20:55,030 --> 00:21:01,240
television. And thereby, human editors
shaped the public conversation, and they
266
00:21:01,240 --> 00:21:05,260
were very, very important figures in
modern history.
267
00:21:06,580 --> 00:21:11,740
Jean -Paul Marat, for instance, shaped
the course of the French Revolution by
268
00:21:11,740 --> 00:21:15,880
editing the influential newspaper L 'Ami
de Peuple.
269
00:21:16,220 --> 00:21:21,760
Edward Bernstein shaped the modern
social democratic movement and social
270
00:21:21,760 --> 00:21:25,140
democratic thinking by editing the
Social Democracy.
271
00:21:26,189 --> 00:21:31,630
Vladimir Lenin, before he became Soviet
dictator, his one job that he managed to
272
00:21:31,630 --> 00:21:35,610
hold for a while was editor of the
newspaper Iskra.
273
00:21:36,430 --> 00:21:41,690
Benito Mussolini, before he was dictator
of Italy, his one job, or one of his
274
00:21:41,690 --> 00:21:48,150
maybe main jobs, was the editor of the
firebrand right -wing newspaper Il
275
00:21:48,150 --> 00:21:49,150
d 'Italia.
276
00:21:49,170 --> 00:21:55,370
And it's interesting to think about it
that one of the first jobs that AI took
277
00:21:55,370 --> 00:22:00,370
over from humans is not taxi drivers or
textile workers, it's news editors.
278
00:22:02,570 --> 00:22:09,370
The job that was once performed by Lenin
and Mussolini is now performed by AIs.
279
00:22:10,170 --> 00:22:13,930
And this is a signal for what's coming.
280
00:22:14,570 --> 00:22:21,410
Hollywood science fiction movies have
conditioned viewers to fear the big
281
00:22:21,410 --> 00:22:27,140
rebellion. When we think about AIs
escaping human control, we imagine the
282
00:22:27,140 --> 00:22:31,700
Terminator, like an army of robots
running in the streets and shooting
283
00:22:32,240 --> 00:22:33,940
But this is the wrong image.
284
00:22:34,740 --> 00:22:39,620
Even though things like that begin to
happen in places like Ukraine and Gaza,
285
00:22:40,640 --> 00:22:47,360
AIs are not, it's not impossible, but
they are quite unlikely to rebel against
286
00:22:47,360 --> 00:22:49,140
humans in such a way.
287
00:22:49,580 --> 00:22:54,460
They are far more likely to take the
human world from within. They don't need
288
00:22:54,460 --> 00:22:55,460
rebel.
289
00:22:56,280 --> 00:23:01,780
The human world is a latticework of
multiple bureaucracies.
290
00:23:02,640 --> 00:23:09,420
Most of us are, to some extent,
alienated by these bureaucracies, even
291
00:23:09,420 --> 00:23:10,420
rely on them.
292
00:23:10,540 --> 00:23:14,580
But the AIs, in contrast to us, are
bureaucratic natives.
293
00:23:14,980 --> 00:23:15,980
They love bureaucracy.
294
00:23:16,720 --> 00:23:23,320
Whereas we feel suffocated often by
bureaucracy, for AIs, bureaucracy is
295
00:23:23,320 --> 00:23:24,320
oxygen.
296
00:23:25,480 --> 00:23:31,360
Now, what would happen when the AIs take
over, at least in part, these
297
00:23:31,360 --> 00:23:36,980
bureaucracies? Now, remember the task of
bureaucracy is not to force you to fill
298
00:23:36,980 --> 00:23:40,120
forms, it's to build trust between
strangers.
299
00:23:40,920 --> 00:23:47,800
But what happens when AIs control the
flow of trust
300
00:23:47,800 --> 00:23:49,620
in the world.
301
00:23:50,180 --> 00:23:55,880
One likely outcome, which we already see
happening, is humans losing trust in
302
00:23:55,880 --> 00:24:02,320
other humans and beginning to trust only
algorithms, only AI, which is already
303
00:24:02,320 --> 00:24:08,740
happening. Another likely outcome is
that AIs will learn to build trust with
304
00:24:08,740 --> 00:24:12,840
other AIs, so we will see the emergence
of
305
00:24:13,710 --> 00:24:20,370
different kinds of AI tribes and banks
and churches that connect millions of
306
00:24:20,370 --> 00:24:26,010
AIs in ways that humans might not even
be able to understand.
307
00:24:26,730 --> 00:24:32,330
Just as cows and chickens, they share
the world with us, but they don't
308
00:24:32,330 --> 00:24:38,890
understand the human financial system
that controls their lives, we humans
309
00:24:38,890 --> 00:24:39,930
soon find ourselves
310
00:24:40,729 --> 00:24:45,390
controlled by an AI financial system
that we can't understand.
311
00:24:45,670 --> 00:24:47,790
And finance, I think, is crucial.
312
00:24:48,590 --> 00:24:53,590
It's among the easiest bureaucratic
systems for AI to take over, because
313
00:24:53,590 --> 00:24:55,390
basically it's just data in, data out.
314
00:24:56,030 --> 00:24:59,090
And it's also, of course, among the most
important.
315
00:25:00,130 --> 00:25:06,330
If we remember, for instance, the last
big financial crisis, the 2007 -2008
316
00:25:06,330 --> 00:25:12,480
financial crisis, it started, it was
triggered... by something called CDOs,
317
00:25:12,800 --> 00:25:16,200
collateralized debt obligations.
318
00:25:16,820 --> 00:25:23,260
Now, CDOs were financial devices
invented by a very tiny number
319
00:25:23,260 --> 00:25:27,460
of human mathematicians and investment
wizards.
320
00:25:28,100 --> 00:25:33,900
These financial devices were so complex
that they were unintelligible, not just
321
00:25:33,900 --> 00:25:38,660
to cows and chickens, but also to the
politicians who were supposed to
322
00:25:39,130 --> 00:25:40,130
the financial system.
323
00:25:40,370 --> 00:25:44,910
And this led to an oversight failure and
to a global catastrophe.
324
00:25:45,430 --> 00:25:52,010
For a few years, CDOs seemed to be
working well, and various banks
325
00:25:52,010 --> 00:25:57,430
and corporations and investors made
billions upon billions of dollars thanks
326
00:25:57,430 --> 00:26:03,490
them. But then they caused a global
financial crash with far -reaching
327
00:26:03,490 --> 00:26:04,970
and political consequences.
328
00:26:05,350 --> 00:26:11,750
Many scholars believe that by
undermining trust in governments and
329
00:26:11,990 --> 00:26:18,090
the 2007 -2008 financial crisis paved
the way to the collapse of the global
330
00:26:18,090 --> 00:26:20,950
liberal order in the following two
decades.
331
00:26:22,290 --> 00:26:29,050
Now what happens if we allow AIs to make
more and more financial decisions and
332
00:26:29,050 --> 00:26:33,370
invent more and more new financial
devices and strategies?
333
00:26:34,010 --> 00:26:38,650
AI test masters invented new ways to
play chess.
334
00:26:39,070 --> 00:26:45,830
What if AI finance masters invent new
financial devices that are
335
00:26:45,830 --> 00:26:52,070
orders of magnitude more complex than
CDOs and are therefore utterly beyond
336
00:26:52,070 --> 00:26:53,710
grasp of human mind?
337
00:26:54,290 --> 00:27:00,570
Such devices could potentially greatly
improve financial efficiency and
338
00:27:00,570 --> 00:27:05,070
contribute to economic growth, becoming
the bedrock of the financial system.
339
00:27:05,740 --> 00:27:12,000
But what is the meaning of human
politics when no human, no voter, no
340
00:27:12,000 --> 00:27:16,480
politician, no president is able to
understand finance anymore?
341
00:27:16,780 --> 00:27:21,440
And what happens after a few years of
boom, there is a financial crash.
342
00:27:22,060 --> 00:27:27,260
And not a single human on the planet is
able to understand what the hell is
343
00:27:27,260 --> 00:27:28,260
happening.
344
00:27:29,740 --> 00:27:31,720
Now let's dig a little deeper.
345
00:27:33,130 --> 00:27:39,250
We said that AI is poised to take over
bureaucracy, and that bureaucracy is a
346
00:27:39,250 --> 00:27:42,850
system that builds trust between
millions of strangers.
347
00:27:43,670 --> 00:27:49,250
This trust, in turn, is the basis for
large -scale cooperation, which is the
348
00:27:49,250 --> 00:27:52,390
basis for the human domination of the
world.
349
00:27:52,650 --> 00:27:58,270
So human domination is based on
cooperation, which is based on trust,
350
00:27:58,270 --> 00:28:01,930
maintained by bureaucracies. But what is
bureaucracy?
351
00:28:02,760 --> 00:28:08,660
What are the atoms, the building blocks
from which bureaucracy is built?
352
00:28:09,500 --> 00:28:14,200
And bureaucracy is ultimately built from
words.
353
00:28:14,900 --> 00:28:17,260
In the beginning was the word.
354
00:28:17,860 --> 00:28:24,020
The reason that humans can create
bureaucracies but chimpanzees cannot is
355
00:28:24,020 --> 00:28:29,620
we have words, and they don't. They have
a communication system, but our
356
00:28:29,620 --> 00:28:31,320
language is orders of magnitude.
357
00:28:32,160 --> 00:28:35,420
more sophisticated than chimpanzee
communication systems.
358
00:28:36,580 --> 00:28:42,400
Bureaucratic systems, from banks to
churches, are ultimately based on the
359
00:28:42,400 --> 00:28:49,120
that make up forms and letters and law
codes and tax registers and accountancy
360
00:28:49,120 --> 00:28:50,320
ledgers and holy books.
361
00:28:50,800 --> 00:28:57,480
The operating code of human civilization
is made of language tokens.
362
00:28:58,640 --> 00:29:05,300
Over thousands of years, We used this
code of language to create a system
363
00:29:05,300 --> 00:29:10,020
that only we could understand, and we
imposed this system on the planet.
364
00:29:10,320 --> 00:29:16,840
We felt completely safe doing it because
no one else on Earth understood the
365
00:29:16,840 --> 00:29:18,300
code of civilization.
366
00:29:18,760 --> 00:29:24,940
We invented money and banks and used
them to buy and sell cows,
367
00:29:25,200 --> 00:29:29,420
but the cows themselves could not open a
bank account.
368
00:29:29,980 --> 00:29:34,120
or invest money in the stock exchange
because they don't have language.
369
00:29:34,620 --> 00:29:40,600
We invented laws and regulations about
horses, but the horses themselves could
370
00:29:40,600 --> 00:29:45,040
not hire a lawyer and quote the legal
code to a judge.
371
00:29:45,920 --> 00:29:51,240
We invented religious rules and
prohibitions about pigs, but the pigs
372
00:29:51,240 --> 00:29:57,400
could not read the Bible and challenge
the interpretation of priests and
373
00:29:58,160 --> 00:30:03,780
Bureaucracy was omnipresent on the
planet, but totally invisible to
374
00:30:03,780 --> 00:30:05,240
except us.
375
00:30:06,080 --> 00:30:11,860
Nobody other than humans could read the
law codes, the holy books, and the bank
376
00:30:11,860 --> 00:30:16,720
records that were the foundation of
bureaucracy and of large -scale
377
00:30:16,720 --> 00:30:17,720
corporations.
378
00:30:18,420 --> 00:30:23,540
This is changing now. Now there is
something on the planet that understands
379
00:30:24,320 --> 00:30:30,680
will soon understand language better
than us and can therefore turn the
380
00:30:30,680 --> 00:30:31,299
on us.
381
00:30:31,300 --> 00:30:35,480
AIs are hacking the code of human
civilization.
382
00:30:36,100 --> 00:30:42,960
And what happens when AIs understand
money and law and religion
383
00:30:42,960 --> 00:30:49,800
better than us? The mechanisms of
control that we have created over
384
00:30:49,800 --> 00:30:52,140
of years are extremely vulnerable.
385
00:30:52,780 --> 00:30:59,560
for an AI takeover because their
operating system is a verbal code that
386
00:30:59,560 --> 00:31:01,420
AI is now mastering.
387
00:31:02,440 --> 00:31:09,240
Now, a possible ethical and
philosophical objection is that it is
388
00:31:09,240 --> 00:31:15,600
to reduce things like the legal system
or religion to language tokens and to
389
00:31:15,600 --> 00:31:16,600
words.
390
00:31:19,000 --> 00:31:20,000
Arguably,
391
00:31:20,720 --> 00:31:25,640
and this has been an argument for
thousands of years, the words are just
392
00:31:25,640 --> 00:31:32,360
pointing at something which is beyond
them and which presumably will also be
393
00:31:32,360 --> 00:31:34,080
beyond the grasp of the AI.
394
00:31:35,140 --> 00:31:39,780
The Bible says not just that in the
beginning was the word, but that the
395
00:31:39,780 --> 00:31:41,160
was made flesh.
396
00:31:42,200 --> 00:31:48,220
The Tao Te Ching says that the truth
that can be expressed in words is not.
397
00:31:48,670 --> 00:31:50,370
the absolute truth, by definition.
398
00:31:51,210 --> 00:31:57,930
And throughout history, there was always
this tension between word and flesh,
399
00:31:58,210 --> 00:32:03,690
between the truth that can be expressed
in words and the truth which is beyond
400
00:32:03,690 --> 00:32:09,850
words. Now previously, this tension
existed between humans.
401
00:32:10,530 --> 00:32:16,510
Some humans, for instance, which were
very attached to words, were willing to
402
00:32:16,510 --> 00:32:23,110
abandon. or even kill their gay son,
just because a few words in the Bible.
403
00:32:23,790 --> 00:32:27,610
Other humans said, but these are just
words.
404
00:32:28,010 --> 00:32:34,330
The spirit of love should be more
important than the letter of the law.
405
00:32:34,330 --> 00:32:39,190
there was this tension between spirit
and letter. And it existed not just in
406
00:32:39,190 --> 00:32:43,870
Christianity and in Judaism and in
Islam, but in every religion and every
407
00:32:43,870 --> 00:32:46,290
system, and even within every person.
408
00:32:46,600 --> 00:32:47,600
There was this tension.
409
00:32:48,740 --> 00:32:53,780
Now this tension will be externalized.
It will become the tension between AIs
410
00:32:53,780 --> 00:32:54,780
and humans.
411
00:32:55,120 --> 00:32:59,760
Everything made of words will be taken
over by AI.
412
00:33:00,240 --> 00:33:06,900
The place of humans in the world will
depend on the place we assign the truth
413
00:33:06,900 --> 00:33:09,220
which is beyond words.
414
00:33:10,460 --> 00:33:13,340
But what is the truth which is beyond
words?
415
00:33:13,820 --> 00:33:19,100
And can human thought even grasp the
truth which is beyond words?
416
00:33:19,500 --> 00:33:24,540
A key question, again, for thousands of
years in the philosophy of language has
417
00:33:24,540 --> 00:33:31,200
been whether we think in words or we
merely use words to point towards
418
00:33:31,200 --> 00:33:33,140
things which are beyond them.
419
00:33:34,080 --> 00:33:39,720
Now, you can try to observe your own
process of thinking right now, after
420
00:33:39,720 --> 00:33:40,720
lecture.
421
00:33:41,550 --> 00:33:44,770
happens in your mind when you are
thinking.
422
00:33:45,250 --> 00:33:50,890
Some people, if they observe closely,
what they observe in their mind is just
423
00:33:50,890 --> 00:33:57,510
words popping inside their mind and
forming sentences, and the sentences
424
00:33:57,510 --> 00:33:58,970
logical arguments.
425
00:33:59,430 --> 00:34:02,130
All humans are mortal.
426
00:34:02,470 --> 00:34:07,930
I am a human, therefore I am mortal.
427
00:34:10,030 --> 00:34:16,270
Is thinking just putting these words in
order so they lead to a certain logical
428
00:34:16,270 --> 00:34:21,469
conclusion? Like putting these language
tokens in a specific formation?
429
00:34:22,230 --> 00:34:28,830
If that is the case, then AIs already
think better than
430
00:34:28,830 --> 00:34:33,830
at least some humans and will soon think
better than all of us.
431
00:34:34,469 --> 00:34:38,969
Some people say, no, no, no, no, no.
AIs, they are just glorified
432
00:34:39,560 --> 00:34:43,080
They simply predict the next word in a
sentence.
433
00:34:44,020 --> 00:34:47,580
But is that so different from what the
human mind does?
434
00:34:48,520 --> 00:34:53,840
Again, try to observe your process of
thinking, the forming of sentences and
435
00:34:53,840 --> 00:34:58,600
arguments in your mind. What is
happening there? Try to observe the very
436
00:34:58,600 --> 00:35:03,960
word that pops up in your mind. Do you
really know where it came from?
437
00:35:04,280 --> 00:35:07,240
Why did you think this particular word?
438
00:35:07,870 --> 00:35:09,650
and not some other word.
439
00:35:10,650 --> 00:35:16,530
When I try to observe my mind, I notice
that when I begin a sentence, I usually
440
00:35:16,530 --> 00:35:18,890
don't even know how it will end.
441
00:35:19,590 --> 00:35:23,730
Which is terrifying for a public
speaker, which is why I write everything
442
00:35:24,410 --> 00:35:28,010
But what if I don't know how to complete
the sentence? I don't know how it will
443
00:35:28,010 --> 00:35:29,010
end.
444
00:35:29,270 --> 00:35:31,770
But take, for example, the sentence I
just said.
445
00:35:32,170 --> 00:35:33,810
I said, I don't know how it will end.
446
00:35:34,370 --> 00:35:36,850
Why did it end with the word end?
447
00:35:37,520 --> 00:35:40,100
Why not say how it will terminate?
448
00:35:40,340 --> 00:35:42,000
How it will develop?
449
00:35:42,240 --> 00:35:43,700
How it will conclude?
450
00:35:44,000 --> 00:35:48,260
What determines that the last word in
the sentence will be end?
451
00:35:48,740 --> 00:35:50,280
I frankly don't know.
452
00:35:51,480 --> 00:35:57,460
We don't fully understand how the human
mind forms sentences and so on.
453
00:35:58,280 --> 00:36:04,980
But again, as far as putting language
tokens in order, AI is already on
454
00:36:04,980 --> 00:36:07,260
course to being far, far better than us.
455
00:36:08,220 --> 00:36:15,200
And just as today, no human can defeat
an AI in chess, soon no
456
00:36:15,200 --> 00:36:20,500
human will be able to defeat an AI in
language games, in any field, again,
457
00:36:20,500 --> 00:36:21,860
finance to religion.
458
00:36:22,280 --> 00:36:26,220
Anything made of words will be taken
over by AI.
459
00:36:26,920 --> 00:36:31,480
And this is why AI points to take over
the world's bureaucracies because they
460
00:36:31,480 --> 00:36:34,480
are ultimately based on words and
language talk.
461
00:36:36,260 --> 00:36:42,600
Now, as AI take over the bureaucracy,
humans might try to fall back on
462
00:36:42,600 --> 00:36:47,700
more ancient and more precious to most
of us than bureaucracy, which is
463
00:36:47,700 --> 00:36:48,700
relationships.
464
00:36:49,520 --> 00:36:53,760
Bureaucracy is just a few thousand years
old. And most of us, again, don't
465
00:36:53,760 --> 00:36:54,760
really like it.
466
00:36:54,780 --> 00:36:58,580
even if we constantly rely on it for
almost everything we do.
467
00:36:59,220 --> 00:37:05,560
Personal relationships are millions of
years old, and many or most of us think
468
00:37:05,560 --> 00:37:08,180
that they are the most important thing
in life.
469
00:37:08,580 --> 00:37:15,020
But as AI masters language, it might
take over not just bureaucracy, but also
470
00:37:15,020 --> 00:37:16,700
some extent personal relationships.
471
00:37:17,680 --> 00:37:21,460
Over the last 10 years, we've seen very
primitive
472
00:37:22,399 --> 00:37:27,900
social media algorithms, learning how to
gain control of human attention.
473
00:37:28,320 --> 00:37:34,020
Now the battlefront is shifting from
attention to intimacy.
474
00:37:34,480 --> 00:37:41,380
Over the next 10 years, far more
sophisticated AIs will learn how to
475
00:37:41,380 --> 00:37:46,960
form intimate relationships with humans
and take over, at least in part, our
476
00:37:46,960 --> 00:37:48,300
social system.
477
00:37:48,700 --> 00:37:54,840
To form intimacy with humans, And AI
will probably have to convince us
478
00:37:54,840 --> 00:38:01,600
that the AI is conscious, that it can
feel things like love and pain
479
00:38:01,600 --> 00:38:03,040
and anger and fear.
480
00:38:03,480 --> 00:38:10,280
At present, there is absolutely no
evidence that AI might at
481
00:38:10,280 --> 00:38:15,300
some point become conscious and might be
able to at some point feel pain or
482
00:38:15,300 --> 00:38:18,960
love. But because AI is mastering
language,
483
00:38:19,840 --> 00:38:24,240
AI can pretend to feel love, even if it
doesn't.
484
00:38:24,900 --> 00:38:28,020
AI, already today, can say, I love you.
485
00:38:28,520 --> 00:38:34,040
And if you challenge it, describe to me
how love feels like, so I know that you
486
00:38:34,040 --> 00:38:38,660
really feel it, AI can provide the best
description in the world.
487
00:38:39,240 --> 00:38:44,720
It can read all the love poems ever
written and all the psychology books
488
00:38:44,720 --> 00:38:46,300
written and remember every word.
489
00:38:46,730 --> 00:38:53,190
and describe the feeling of love better
than any human poet or psychologist or
490
00:38:53,190 --> 00:38:59,030
lover. And this is going to be a huge,
maybe the biggest, psychological and
491
00:38:59,030 --> 00:39:00,970
social experiment in human history.
492
00:39:01,630 --> 00:39:06,870
It will be conducted on billions of
human guinea pigs, and nobody has the
493
00:39:06,870 --> 00:39:10,910
slightest idea what the consequences of
the experiment will be.
494
00:39:11,710 --> 00:39:18,570
I'm now 50 years old, so my template for
relationships is already shaped
495
00:39:18,570 --> 00:39:24,990
by decades of previous relationships
with my parents, with my husband, with
496
00:39:24,990 --> 00:39:28,710
sisters and nephews and nieces and
friends and dogs and so forth.
497
00:39:29,290 --> 00:39:36,010
As I increasingly interact with AI, I
bring with me my assumptions, my
498
00:39:36,010 --> 00:39:37,430
habits about relationships.
499
00:39:37,870 --> 00:39:40,690
And this is unlikely to change
dramatically.
500
00:39:42,330 --> 00:39:45,990
Consider a child born in 2026, born
today.
501
00:39:46,230 --> 00:39:51,990
As the child grows up, she constantly
interacts with AIs as well as with
502
00:39:52,590 --> 00:39:57,910
Perhaps if you measure the importance of
a relationship purely in terms of
503
00:39:57,910 --> 00:40:04,430
minutes spent interacting with the other
entity, perhaps the most
504
00:40:04,430 --> 00:40:10,110
important relationship in the life of
that child will be from a very early
505
00:40:10,680 --> 00:40:11,920
with AIs.
506
00:40:12,600 --> 00:40:18,260
Maybe it spends more time with the AIs
than with its mother or father or
507
00:40:18,260 --> 00:40:19,260
siblings or friends.
508
00:40:19,900 --> 00:40:26,400
And it will then shape the expectations
of that child as she grows about how to
509
00:40:26,400 --> 00:40:29,520
form relationships and social bonds and
attachments.
510
00:40:30,020 --> 00:40:34,220
Perhaps the first teacher of that child
will be an AI teacher.
511
00:40:34,680 --> 00:40:39,580
Perhaps the first boyfriend of that
child will be an AI boyfriend.
512
00:40:40,560 --> 00:40:42,280
And again, what will be the
consequences?
513
00:40:42,720 --> 00:40:45,200
Nobody has the slightest idea.
514
00:40:46,780 --> 00:40:53,540
What does it mean to form an intimate
relationship with an entity which
515
00:40:53,540 --> 00:40:56,740
seems conscious but actually isn't?
516
00:40:57,100 --> 00:41:03,040
Which can write the best love poem in
history but doesn't feel love or
517
00:41:03,040 --> 00:41:04,040
else?
518
00:41:05,720 --> 00:41:08,660
All of this, everything we've talked
about, and I'm...
519
00:41:08,990 --> 00:41:13,970
coming to the close of this lecture,
everything we've talked about means that
520
00:41:13,970 --> 00:41:19,830
every country in the world will soon
face a huge wave of immigration.
521
00:41:20,870 --> 00:41:26,890
The immigrants this time will not be
human beings coming in fragile boats
522
00:41:26,890 --> 00:41:31,250
without a visa or trying to sneak across
the border in the middle of the night.
523
00:41:31,650 --> 00:41:36,650
The immigrants will be millions, maybe
hundreds of millions of AIs that can
524
00:41:36,650 --> 00:41:41,890
travel at almost the speed of light and
don't need any visas.
525
00:41:42,810 --> 00:41:48,170
Like human immigrants, these AI
immigrants will bring a lot of benefits
526
00:41:48,170 --> 00:41:54,910
them. We will have AI doctors to help in
the healthcare system, AI teachers to
527
00:41:54,910 --> 00:42:00,730
help in the education system, even AI
border guards to stop illegal human
528
00:42:00,730 --> 00:42:02,690
immigrants from coming in.
529
00:42:03,190 --> 00:42:08,270
But... the AI immigrants will also bring
problems with them.
530
00:42:08,790 --> 00:42:14,590
Those who are concerned about human
immigration usually point out that
531
00:42:14,590 --> 00:42:20,050
immigrants might take jobs, might change
the local culture, and might be
532
00:42:20,050 --> 00:42:21,290
politically disloyal.
533
00:42:21,810 --> 00:42:27,010
I'm not sure if that's necessarily true
of all human immigrants, but it will
534
00:42:27,010 --> 00:42:30,510
definitely be true of AI immigrants.
535
00:42:31,240 --> 00:42:37,600
The AI immigrant will take many, many
human jobs, from news editors to
536
00:42:38,040 --> 00:42:43,420
The AI immigrant will completely change
the culture of every country. They will
537
00:42:43,420 --> 00:42:46,300
change art and religion and even
romance.
538
00:42:46,700 --> 00:42:51,140
Some people don't like it if their son
or daughter is dating an immigrant
539
00:42:51,140 --> 00:42:55,660
boyfriend. What will these people think
when their son or daughter starts dating
540
00:42:55,660 --> 00:42:57,140
an AI boyfriend?
541
00:42:58,280 --> 00:43:04,610
And of course, the AI immigrants will
have some dubious political loyalty.
542
00:43:05,110 --> 00:43:12,090
They are likely to be loyal not to the
whole country, but to some corporation
543
00:43:12,090 --> 00:43:17,510
government across the ocean, or perhaps
to a new alien AI tribe.
544
00:43:18,770 --> 00:43:24,970
This massive immigration wave does not
mean the end of civilization, but it
545
00:43:24,970 --> 00:43:26,990
be the point when civilization
546
00:43:27,870 --> 00:43:34,370
stop being a purely human affair and
becomes a hybrid human AI
547
00:43:34,370 --> 00:43:41,010
affair. The point when the opinion and
interest and goal of AI
548
00:43:41,010 --> 00:43:47,850
are likely to be at least as important
as the opinion and interest and
549
00:43:47,850 --> 00:43:49,030
goal of humans.
550
00:43:50,190 --> 00:43:51,890
One last issue to consider.
551
00:43:52,410 --> 00:43:56,910
is what the AI immigration wave will do
to maybe our most important
552
00:43:56,910 --> 00:43:58,750
relationship, which is with ourselves.
553
00:43:59,830 --> 00:44:04,750
Our relationship with ourselves is also
to some extent based on words.
554
00:44:05,010 --> 00:44:09,530
The words inside our mind, in our
thoughts, in the stories we tell
555
00:44:09,530 --> 00:44:10,530
about ourselves.
556
00:44:11,090 --> 00:44:18,010
Until today, all the verbal formations
in human minds were the product of
557
00:44:18,010 --> 00:44:19,350
human minds.
558
00:44:19,770 --> 00:44:26,640
Either we ourselves combined words into
some new formation, a new thought, or we
559
00:44:26,640 --> 00:44:31,200
got a certain combination of words from
another human mind.
560
00:44:31,960 --> 00:44:37,280
Soon, however, more and more verbal
combinations in our minds will be the
561
00:44:37,280 --> 00:44:38,380
product of AI.
562
00:44:39,180 --> 00:44:45,280
Just as the furniture in our house is
now not made by us or by human artisans,
563
00:44:45,460 --> 00:44:49,140
they are mass produced mostly by
machines.
564
00:44:49,930 --> 00:44:55,430
Also, the thoughts in our mind are
likely to increasingly be mass -produced
565
00:44:55,430 --> 00:44:58,850
machines. Now, that's not necessarily
bad.
566
00:44:59,130 --> 00:45:06,010
It's okay if the furniture in my house
is made by machines in IKEA, as long as
567
00:45:06,010 --> 00:45:10,590
have some freedom deciding what to do
with this furniture.
568
00:45:11,110 --> 00:45:16,670
The question regarding thoughts is
whether, to what extent, we will still
569
00:45:16,670 --> 00:45:17,830
freedom from them.
570
00:45:18,480 --> 00:45:24,360
If we identify with our thoughts, I
think I am a thought, I think therefore
571
00:45:24,360 --> 00:45:25,360
am, as Descartes said.
572
00:45:25,640 --> 00:45:32,640
If we identify with our thoughts, and
these thoughts are made by machines,
573
00:45:32,640 --> 00:45:35,240
the machines now control us and our
identity.
574
00:45:36,380 --> 00:45:42,460
Can humans avoid identifying with their
verbal thoughts and being controlled by
575
00:45:42,460 --> 00:45:46,720
them? This has always been one of the
greatest intellectual and spiritual
576
00:45:46,720 --> 00:45:48,640
challenges. facing humanity.
577
00:45:49,640 --> 00:45:55,680
Most humans have never even tried to do
it. We spend our entire lives
578
00:45:55,680 --> 00:46:00,720
automatically identifying with the
verbal formations in our mind.
579
00:46:01,360 --> 00:46:07,340
Now, AI might force humanity to make
this spiritual leap
580
00:46:07,340 --> 00:46:13,340
to really start exploring the truth
which is beyond words because our
581
00:46:13,340 --> 00:46:15,260
and survival now depend on it.
582
00:46:15,530 --> 00:46:20,430
Because the words will be controlled by
something else, by this AI.
583
00:46:21,850 --> 00:46:27,690
So this might be the big task ahead of
humanity, to explore
584
00:46:27,690 --> 00:46:30,430
finally the truth which is beyond words.
585
00:46:30,630 --> 00:46:37,150
And this exploration starts really with
the next word that pops up in your mind.
586
00:46:37,550 --> 00:46:40,330
Do you know where it came from?
587
00:46:40,830 --> 00:46:44,390
Do you know why you thought that
particular word?
588
00:46:44,760 --> 00:46:46,660
and not some other word.
589
00:46:47,400 --> 00:46:48,400
Thank you.
53874
Can't find what you're looking for?
Get subtitles in any language from opensubtitles.com, and translate them here.