Would you like to inspect the original subtitles? These are the user uploaded subtitles that are being translated:
1
00:00:00,010 --> 00:00:04,050
Please join me in welcoming Professor
Yuval Noah Harari.
2
00:00:06,170 --> 00:00:12,750
Thank you so much.
3
00:00:15,430 --> 00:00:16,430
Hello everyone.
4
00:00:16,670 --> 00:00:18,570
I hope I opened my mic.
5
00:00:19,330 --> 00:00:20,570
You can hear me okay.
6
00:00:21,350 --> 00:00:25,270
So it's really a great honor for me to
give this year's TANEO lecture.
7
00:00:25,750 --> 00:00:28,050
And it's also a personal joy.
8
00:00:28,590 --> 00:00:29,850
to come back to Oxford.
9
00:00:30,090 --> 00:00:36,010
I did my DPhil here 25 years ago under
the guidance of Dr. Stephen Gunn.
10
00:00:36,370 --> 00:00:42,650
Back then, I specialized in medieval and
early modern military history.
11
00:00:43,370 --> 00:00:49,350
But today, I will not be talking about
knights and castles and the gunpowder
12
00:00:49,350 --> 00:00:55,230
revolution. I'll talk about AI
bureaucrats and religions and
13
00:00:55,230 --> 00:00:57,610
more generally, about the AI revolution.
14
00:00:58,670 --> 00:01:05,670
Now, the most important thing to know
about AI is that AI is not a tool.
15
00:01:06,570 --> 00:01:08,450
It's not a tool in our hand.
16
00:01:08,790 --> 00:01:12,470
It is an agent with its own hand.
17
00:01:13,210 --> 00:01:15,090
What exactly is agency?
18
00:01:15,450 --> 00:01:17,990
How is an agent different from a tool?
19
00:01:18,690 --> 00:01:21,910
Agents have several distinguishing
characteristics.
20
00:01:22,690 --> 00:01:24,950
They don't necessarily need
consciousness.
21
00:01:25,210 --> 00:01:30,290
You don't need consciousness to be an
agent. What you do need, is the ability
22
00:01:30,290 --> 00:01:37,270
make decisions by yourself, the ability
to invent new things, new ideas
23
00:01:37,270 --> 00:01:38,270
by yourself.
24
00:01:38,790 --> 00:01:45,670
An agent should be able by itself to
learn things that its creators
25
00:01:45,670 --> 00:01:52,390
don't know, and an agent should be able
to change by itself
26
00:01:52,390 --> 00:01:56,330
in ways that its creators don't
anticipate.
27
00:01:58,400 --> 00:02:03,540
An atom bomb, for instance, despite its
enormous power, is not an agent.
28
00:02:03,820 --> 00:02:07,120
It cannot learn and change by itself.
29
00:02:07,440 --> 00:02:14,240
It cannot decide by itself which city to
bomb. It cannot invent anything new,
30
00:02:14,340 --> 00:02:15,620
like the hydrogen bomb.
31
00:02:16,300 --> 00:02:23,100
Similarly, let's say an automatic coffee
machine is not an agent, even though it
32
00:02:23,100 --> 00:02:27,000
does something by itself, automatically.
33
00:02:27,720 --> 00:02:32,960
You press a button, and the machine
automatically makes you a cup of coffee.
34
00:02:33,260 --> 00:02:39,060
But the machine, the coffee machine,
only follows a pre -programmed
35
00:02:39,580 --> 00:02:41,020
It doesn't change.
36
00:02:41,400 --> 00:02:44,840
It doesn't learn anything new. It
doesn't create anything new.
37
00:02:45,440 --> 00:02:51,720
But suppose that as you approach the
coffee machine, before you even press
38
00:02:51,720 --> 00:02:57,180
button, the machine announces, tells
you, I've been monitoring you.
39
00:02:57,550 --> 00:03:02,270
for the last few weeks, and based on
everything I've learned about you and
40
00:03:02,270 --> 00:03:07,910
people, and based on your facial
expression and the time of day, I
41
00:03:07,910 --> 00:03:09,390
you would like an espresso.
42
00:03:09,730 --> 00:03:11,890
So I already made you a cup.
43
00:03:12,350 --> 00:03:14,770
Now that's an AI copy machine.
44
00:03:15,050 --> 00:03:19,470
It learned something by itself and
decided something by itself.
45
00:03:19,790 --> 00:03:23,890
And it's really an AI if the following
day...
46
00:03:24,090 --> 00:03:30,110
It announces, I have now invented a new
drink called Bespresso, which I think
47
00:03:30,110 --> 00:03:33,870
you would like better than espresso, and
he would try it out, I made you a cup.
48
00:03:34,750 --> 00:03:37,090
Then it's really an AI.
49
00:03:37,390 --> 00:03:42,590
It changed in ways that creators did not
anticipate and invented something
50
00:03:42,590 --> 00:03:43,850
completely new.
51
00:03:44,730 --> 00:03:48,070
As far as I know, there are no coffee
machines.
52
00:03:49,020 --> 00:03:52,880
at the present moment, maybe in
anthropic headquarters or Google
53
00:03:53,400 --> 00:03:56,600
they have a few prototypes, but they are
not out in the market yet.
54
00:03:57,000 --> 00:04:03,900
But in certain narrow fields, like
playing Go or playing chess, AI
55
00:04:03,900 --> 00:04:10,760
agency and creativity already greatly
surpass human agency and
56
00:04:10,760 --> 00:04:17,019
creativity. AI chess masters can decide,
of course, by themselves which moves to
57
00:04:17,019 --> 00:04:23,900
make. they invent by themselves
completely new strategies, how to play
58
00:04:23,900 --> 00:04:29,000
chess, that never occurred to human
chess masters over thousands of years of
59
00:04:29,000 --> 00:04:30,000
playing the game.
60
00:04:30,320 --> 00:04:37,300
And while doing that, they learn and
change in ways their human creators did
61
00:04:37,300 --> 00:04:38,580
necessarily predict.
62
00:04:39,020 --> 00:04:46,000
Today, of course, no human has any
chance of beating an AI chess master.
63
00:04:47,080 --> 00:04:52,520
Now, people who downplay the importance
of the AI revolution dismiss examples
64
00:04:52,520 --> 00:04:58,840
like chess by arguing that the
chessboard is a very narrow and
65
00:04:58,840 --> 00:05:02,200
environment created by humans.
66
00:05:02,580 --> 00:05:09,360
The critics say that AI agency will
always remain limited to
67
00:05:09,360 --> 00:05:14,380
such narrow and artificial environment,
which means that it's not true agency.
68
00:05:15,080 --> 00:05:18,020
And it doesn't pose any serious
challenge to humanity.
69
00:05:18,440 --> 00:05:23,500
Yes, AI may take over the chessboard,
but it will never take over planet
70
00:05:24,260 --> 00:05:30,300
And indeed, if you do an experiment, if
you take the greatest AI chess master
71
00:05:30,300 --> 00:05:35,460
and drop it in the middle of the jungle,
what do you think will happen?
72
00:05:36,280 --> 00:05:42,460
The AI chess master will not be able to
start mining iron and building factories
73
00:05:42,460 --> 00:05:44,500
and creating a robot army.
74
00:05:44,910 --> 00:05:45,930
to take over the world.
75
00:05:46,290 --> 00:05:49,770
In fact, it will not be able to do
anything whatsoever.
76
00:05:50,370 --> 00:05:56,850
Without the electricity provided by
power stations built by humans,
77
00:05:57,190 --> 00:06:00,010
the AI chess master is utterly helpless.
78
00:06:00,590 --> 00:06:07,030
Therefore, the argument goes, AIs are
not true agents. They are confined to
79
00:06:07,030 --> 00:06:13,830
these narrow artificial niches that
somebody else, humans, constructed for
80
00:06:15,790 --> 00:06:22,210
The problem is that this argument
actually applies to all known types of
81
00:06:22,210 --> 00:06:28,410
intelligence. Human intelligence, too,
operates only within a relatively narrow
82
00:06:28,410 --> 00:06:31,830
ecosystem that somebody else
constructed.
83
00:06:32,230 --> 00:06:38,430
Drop me alone on Mars and it will be
like dropping an AI chess master
84
00:06:38,430 --> 00:06:40,110
in the middle of the jungle.
85
00:06:40,350 --> 00:06:41,850
I will die within seconds.
86
00:06:42,540 --> 00:06:48,340
My intelligence can survive and operate
only within the very, very specific
87
00:06:48,340 --> 00:06:55,260
ecosystem that trees, bacteria, insects,
and other organisms have constructed
88
00:06:55,260 --> 00:06:58,900
on planet Earth during four billion
years of evolution.
89
00:06:59,420 --> 00:07:04,920
And that's true of all agents. All
agents we know of, at least, have their
90
00:07:04,920 --> 00:07:09,840
niches. Fish live in oceans that they
didn't create.
91
00:07:10,220 --> 00:07:13,680
Monkeys live in forests that they didn't
create.
92
00:07:13,900 --> 00:07:20,120
All mammals, including human beings,
live in an oxygen -rich atmosphere that
93
00:07:20,120 --> 00:07:21,300
they didn't create.
94
00:07:21,780 --> 00:07:27,820
Until about 2 .4 billion years ago, the
atmosphere of our planet actually
95
00:07:27,820 --> 00:07:34,200
contained very little oxygen, and for
most of the organisms that lived back
96
00:07:34,200 --> 00:07:37,340
then, oxygen was a deadly poison.
97
00:07:38,120 --> 00:07:43,960
Then, in a protracted process, lasting
hundreds of millions of years, which is
98
00:07:43,960 --> 00:07:50,280
known as the Great Oxygenation Event,
various ancient microbes began
99
00:07:50,280 --> 00:07:56,940
polluting the atmosphere of the Earth
with deadly oxygen, which was a
100
00:07:56,940 --> 00:07:59,700
of their photosynthetic processes.
101
00:08:00,380 --> 00:08:06,940
As the atmosphere filled with this
deadly poisonous gas, numerous
102
00:08:06,940 --> 00:08:10,400
archaic species were driven to
extinction.
103
00:08:11,470 --> 00:08:16,950
Some species, however, managed to
survive and adapt to the new conditions.
104
00:08:17,270 --> 00:08:23,870
Eventually, many of these survivors went
from hating oxygen
105
00:08:23,870 --> 00:08:29,090
to becoming totally dependent on oxygen
for their survival.
106
00:08:29,430 --> 00:08:35,230
And our ancestors, of course, are among
the species that underwent this
107
00:08:35,230 --> 00:08:41,970
transition. And we still live in this
artificial oxygen -filled
108
00:08:41,970 --> 00:08:46,750
environment that was originally created
by these ancient microbes.
109
00:08:47,130 --> 00:08:52,510
What I would like to argue in this
lecture is that we might be witnessing
110
00:08:52,510 --> 00:08:56,190
analogous moment in the evolution of
life.
111
00:08:57,390 --> 00:09:03,050
Over the past millennia, we humans have
been filling the atmosphere with
112
00:09:03,050 --> 00:09:07,650
something that might eventually prove
deadly for most organisms.
113
00:09:08,360 --> 00:09:15,360
including perhaps homo sapiens, but that
creates a new artificial environment
114
00:09:15,360 --> 00:09:17,500
in which AIs flourish.
115
00:09:17,800 --> 00:09:21,480
And I am not talking about CO2.
116
00:09:21,800 --> 00:09:28,640
I am talking about data, about
bureaucracy, and ultimately about the
117
00:09:28,640 --> 00:09:34,220
thing that I am expelling from my mouth
right now, which is words.
118
00:09:34,700 --> 00:09:35,980
Language talk.
119
00:09:36,940 --> 00:09:42,240
Over thousands of years, we humans have
transformed the planet from a language
120
00:09:42,240 --> 00:09:49,120
-free environment into a very artificial
environment, rich in language tokens,
121
00:09:49,380 --> 00:09:51,600
data, and bureaucracy.
122
00:09:52,180 --> 00:09:58,800
And this environment could prove deadly
for most organisms, but highly conducive
123
00:09:58,800 --> 00:10:00,940
to the development of AI.
124
00:10:01,300 --> 00:10:06,900
Because just as fish live in oceans and
monkeys live in forests, AIs live in
125
00:10:06,900 --> 00:10:12,480
bureaucracy. So let's spend a few
minutes talking about bureaucracy, and
126
00:10:12,480 --> 00:10:16,960
we'll get back to talking about what
underlies bureaucracy, which is language
127
00:10:16,960 --> 00:10:17,960
and words.
128
00:10:18,780 --> 00:10:25,740
Now, humans, our species, we conquer the
world by learning to cooperate
129
00:10:25,740 --> 00:10:27,440
in very, very large numbers.
130
00:10:28,180 --> 00:10:34,140
Individually, humans are not stronger or
even smarter than other animals.
131
00:10:34,730 --> 00:10:41,430
In a one -on -one fight, a human will
most likely lose to a
132
00:10:41,430 --> 00:10:43,830
chimpanzee or a lion or an elephant.
133
00:10:44,070 --> 00:10:49,330
However, in a contest between a million
humans and a million chimpanzees, the
134
00:10:49,330 --> 00:10:54,210
humans easily win because the humans
know how to cooperate and the
135
00:10:54,210 --> 00:10:56,810
don't. And that's why we control the
world.
136
00:10:58,240 --> 00:11:01,360
How do a million humans who don't know
each other cooperate?
137
00:11:01,760 --> 00:11:06,040
Chimpanzees cooperate based on personal
acquaintance, one of the others.
138
00:11:06,440 --> 00:11:09,860
Humans do so in small numbers, but you
can't know a million people.
139
00:11:10,300 --> 00:11:12,340
So how do a million people cooperate?
140
00:11:12,940 --> 00:11:19,600
Usually by building a bureaucratic
system, like a legal system or the
141
00:11:19,600 --> 00:11:22,800
system or churches or states or
universities.
142
00:11:23,560 --> 00:11:25,340
Now, what do...
143
00:11:25,660 --> 00:11:28,160
these bureaucratic systems actually do.
144
00:11:29,000 --> 00:11:35,140
When a government official or a bishop
or a rabbi or an accountant or a lawyer
145
00:11:35,140 --> 00:11:39,500
or a banker goes to work in the morning,
what do they do there all day?
146
00:11:41,840 --> 00:11:45,820
Now, carpenters build tables.
147
00:11:46,640 --> 00:11:53,080
Engineers build bridges. What do bankers
and other bureaucrats build?
148
00:11:54,090 --> 00:11:58,870
Well, bankers and other bureaucrats are
busy all day building trust.
149
00:12:00,090 --> 00:12:06,950
Their job is to build trust between
large numbers of strangers who don't
150
00:12:06,950 --> 00:12:12,130
each other personally, and thereby
enable large -scale cooperation, which
151
00:12:12,130 --> 00:12:15,210
basis for almost everything a phishing
is achieved.
152
00:12:15,590 --> 00:12:22,000
For example, my banker, whom I don't
really know personally, works hard all
153
00:12:22,000 --> 00:12:28,500
to build trust with me so that I will be
willing to put my savings into her
154
00:12:28,500 --> 00:12:29,500
bank.
155
00:12:30,180 --> 00:12:36,480
Simultaneously, the banker works hard to
build trust with an entrepreneur who
156
00:12:36,480 --> 00:12:39,140
needs money to start a new company.
157
00:12:39,440 --> 00:12:43,240
And the banker lends my savings to that
entrepreneur.
158
00:12:44,920 --> 00:12:48,720
Thereby, the banker actually created a
bridge of trust.
159
00:12:49,260 --> 00:12:50,900
between me and the entrepreneur.
160
00:12:51,400 --> 00:12:56,100
Even though I've never met an
entrepreneur in my life, she can now use
161
00:12:56,100 --> 00:12:58,460
savings to start her company.
162
00:12:58,840 --> 00:13:03,120
And this is what the financial system,
when it works well, is all about.
163
00:13:03,440 --> 00:13:09,180
It builds trust between strangers so
that millions of people can put together
164
00:13:09,180 --> 00:13:12,660
their resources and talents on new
projects.
165
00:13:13,420 --> 00:13:17,640
And the financial history of the world
is the history of people
166
00:13:18,410 --> 00:13:24,590
inventing more and more sophisticated
ways to build bridges of trust.
167
00:13:25,590 --> 00:13:28,930
Money is ultimately a bridge of trust.
168
00:13:29,310 --> 00:13:36,170
The idea of money is that I can go to
the market, maybe in a foreign city,
169
00:13:36,170 --> 00:13:40,790
a person that I never saw in my life,
maybe doesn't even speak my language,
170
00:13:40,790 --> 00:13:45,970
just by giving that person a tiny piece
of metal or a piece of colorful paper,
171
00:13:46,670 --> 00:13:49,250
He or she will give me bread I can eat.
172
00:13:49,750 --> 00:13:53,090
That's the bridge of trust that money
creates.
173
00:13:53,430 --> 00:13:56,670
Now, the coin in the banknote, of
course, was just the beginning.
174
00:13:56,950 --> 00:14:02,110
Over the centuries, humans invented more
and more sophisticated financial
175
00:14:02,110 --> 00:14:08,650
devices to build trust, like checks and
bonds and stocks and
176
00:14:08,650 --> 00:14:14,330
ETFs and loans and mortgages and
compound interest. All of these things
177
00:14:14,330 --> 00:14:16,190
ultimately about building trust.
178
00:14:16,670 --> 00:14:18,030
between billions of strangers.
179
00:14:18,430 --> 00:14:22,310
And it's the same with all
bureaucracies. It's the same with the
180
00:14:22,490 --> 00:14:25,910
This is what lawyers are supposed to do,
to build trust.
181
00:14:26,370 --> 00:14:31,490
This is what government officials and
bishops and accountants do when they go
182
00:14:31,490 --> 00:14:33,490
work. They are supposed to build trust.
183
00:14:35,410 --> 00:14:40,690
Now, the important thing to note about
all these bureaucratic systems is that
184
00:14:40,690 --> 00:14:43,110
they are extremely artificial
environments.
185
00:14:43,840 --> 00:14:48,800
in which a relatively narrow
intelligence, I hope I don't insult
186
00:14:48,800 --> 00:14:55,120
specializing in a very narrow niche of
intelligence is sufficient to exert
187
00:14:55,120 --> 00:14:57,460
enormous impact on the world.
188
00:14:57,740 --> 00:15:03,280
A lawyer or a banker or a government
official who doesn't even know how to
189
00:15:03,280 --> 00:15:10,120
an axe or a hammer can nevertheless cut
down entire forests and build entire
190
00:15:10,120 --> 00:15:12,200
cities just by moving data.
191
00:15:12,720 --> 00:15:17,900
just by moving documents from here to
there inside the bureaucratic network.
192
00:15:18,280 --> 00:15:24,120
Now, of course, if you take the lawyer
out of the bureaucratic system and throw
193
00:15:24,120 --> 00:15:30,100
the lawyer into the messy, unstructured
jungle, her legal skills mean nothing,
194
00:15:30,120 --> 00:15:35,080
and she will not be a match to a
chimpanzee or a lion or an elephant.
195
00:15:35,340 --> 00:15:39,960
But we have already imposed our
bureaucratic systems on the jungle.
196
00:15:40,640 --> 00:15:45,640
which is why lawyers are far more
powerful than even all the, if you take
197
00:15:45,640 --> 00:15:51,140
the lions in the world together, and
they have to compete against one very
198
00:15:51,140 --> 00:15:52,700
lawyer, I will bet on the lawyer.
199
00:15:55,620 --> 00:16:02,340
Today, the very survival of species like
lions depends on lawyers
200
00:16:02,340 --> 00:16:07,980
and accountants and bankers moving
documents in these bureaucratic
201
00:16:08,280 --> 00:16:10,460
of governments and banks and
corporations.
202
00:16:11,840 --> 00:16:17,120
And this is the environment in which AI
is gaining agency.
203
00:16:17,980 --> 00:16:24,360
If you throw an AI into the unstructured
jungle, it will not be able to start
204
00:16:24,360 --> 00:16:26,700
mining iron and to build a robot army.
205
00:16:26,940 --> 00:16:32,000
But within the bureaucratic system that
humans have already created and imposed
206
00:16:32,000 --> 00:16:33,000
on the world,
207
00:16:33,640 --> 00:16:40,260
AIs are posed to wield enormous power
because AIs are native bureaucrats,
208
00:16:40,340 --> 00:16:41,680
unlike us.
209
00:16:42,400 --> 00:16:47,080
No lawyer can remember all the laws and
regulations of the UK.
210
00:16:47,320 --> 00:16:48,500
An AI can.
211
00:16:48,920 --> 00:16:55,660
No accountant can remember all the
transactions of a corporation or a bank.
212
00:16:55,660 --> 00:16:56,599
AI can.
213
00:16:56,600 --> 00:17:02,840
No bishop can remember all of canon law
and all of the theological texts.
214
00:17:03,320 --> 00:17:06,480
written by Christian theologians over
the last 2 ,000 years.
215
00:17:06,780 --> 00:17:08,839
And AI can do that quite easily.
216
00:17:09,980 --> 00:17:16,140
So in the coming years, millions of AI
bureaucrats will increasingly
217
00:17:16,140 --> 00:17:22,500
take over the world's bureaucracies and
make decisions not just about lions and
218
00:17:22,500 --> 00:17:24,520
chimpanzees, but about our lives.
219
00:17:25,020 --> 00:17:28,000
AI bankers will decide whether to give
you a loan.
220
00:17:28,260 --> 00:17:31,900
AI administrators will decide whether to
accept you to university.
221
00:17:32,670 --> 00:17:35,370
AI judges will decide whether to send
you to jail.
222
00:17:35,710 --> 00:17:39,030
AI theologians will decide whether you
can have an abortion.
223
00:17:40,070 --> 00:17:45,010
Corporate AIs will decide whether to
give you a job. And military AIs will
224
00:17:45,010 --> 00:17:47,050
decide whether to bomb your house.
225
00:17:48,190 --> 00:17:52,250
Now, leave aside for a moment the
question, is this good or bad?
226
00:17:53,150 --> 00:17:59,950
The first thing to note is simply to
realize the magnitude of the change we
227
00:17:59,950 --> 00:18:00,950
facing.
228
00:18:01,260 --> 00:18:08,080
These millions and even billions of AI
will soon change all the systems that
229
00:18:08,080 --> 00:18:09,080
the world.
230
00:18:09,220 --> 00:18:15,600
We already have a few real -life
examples for how this happened and what
231
00:18:15,600 --> 00:18:16,680
consequences could be.
232
00:18:18,960 --> 00:18:25,400
Maybe the best example so far is the
story of social media and social media
233
00:18:25,400 --> 00:18:30,440
algorithms. Social media is run not by
humans but by algorithms.
234
00:18:31,260 --> 00:18:37,980
The algorithms that decide, that control
the movement of information on social
235
00:18:37,980 --> 00:18:40,340
media, which are primitive AI.
236
00:18:40,720 --> 00:18:45,940
This began 10, 15 years ago. This was
like the first generation, very, very
237
00:18:45,940 --> 00:18:51,580
primitive, stupid, narrow AI, which
nevertheless completely changed the
238
00:18:52,140 --> 00:18:57,360
Now, the algorithms of social media have
been tasked by corporations like
239
00:18:57,360 --> 00:19:03,660
Facebook and TikTok and X with an
extremely narrow goal to maximize
240
00:19:03,660 --> 00:19:05,700
user engagement.
241
00:19:06,100 --> 00:19:11,540
Make people spend more time on the
platform because the more time they
242
00:19:11,540 --> 00:19:14,240
the platform, the more money the
corporation makes.
243
00:19:14,440 --> 00:19:15,880
Very simple, very narrow.
244
00:19:16,580 --> 00:19:23,080
In pursuit of this user engagement,
these primitive AIs made an important
245
00:19:23,080 --> 00:19:29,320
discovery. They experimented on billions
of human guinea pigs and learned
246
00:19:29,850 --> 00:19:35,810
that the easiest way to grab the
attention of the human being and glue
247
00:19:35,810 --> 00:19:42,730
human to the screen is to press the hate
or fear or greed button in the
248
00:19:42,730 --> 00:19:43,730
human mind.
249
00:19:43,930 --> 00:19:45,410
And they learned how to do it.
250
00:19:45,910 --> 00:19:51,950
And they started spreading hate and fear
and greed in huge quantities
251
00:19:51,950 --> 00:19:54,030
in the information sphere.
252
00:19:54,570 --> 00:19:58,630
And this has been a major reason, not
the only reason, but a major reason.
253
00:19:59,130 --> 00:20:03,650
from the current epidemic of conspiracy
theories and fake news and social
254
00:20:03,650 --> 00:20:06,990
disturbances that undermine society all
over the world.
255
00:20:07,990 --> 00:20:12,550
Now, these social media algorithms,
again, they are very primitive AIs.
256
00:20:13,030 --> 00:20:18,170
If you drop them in the jungle, they
cannot build a robot army and try to
257
00:20:18,170 --> 00:20:18,989
over the world.
258
00:20:18,990 --> 00:20:25,510
But within the bureaucratic system of
social media, these very limited
259
00:20:25,510 --> 00:20:31,450
agents... have enormous power, and they
have already changed the world in quite
260
00:20:31,450 --> 00:20:32,490
a dramatic way.
261
00:20:32,930 --> 00:20:39,750
In past centuries, the flow of
information on media platforms was
262
00:20:39,750 --> 00:20:42,710
by human editors. It was a human job.
263
00:20:43,250 --> 00:20:49,190
It was human editors who decided what to
put on the front page of the newspaper.
264
00:20:49,510 --> 00:20:55,030
It was human editors who decided what
items to include in the evening news on
265
00:20:55,030 --> 00:21:01,240
television. And thereby, human editors
shaped the public conversation, and they
266
00:21:01,240 --> 00:21:05,260
were very, very important figures in
modern history.
267
00:21:06,580 --> 00:21:11,740
Jean -Paul Marat, for instance, shaped
the course of the French Revolution by
268
00:21:11,740 --> 00:21:15,880
editing the influential newspaper L 'Ami
de Peuple.
269
00:21:16,220 --> 00:21:21,760
Edward Bernstein shaped the modern
social democratic movement and social
270
00:21:21,760 --> 00:21:25,140
democratic thinking by editing the
Social Democracy.
271
00:21:26,189 --> 00:21:31,630
Vladimir Lenin, before he became Soviet
dictator, his one job that he managed to
272
00:21:31,630 --> 00:21:35,610
hold for a while was editor of the
newspaper Iskra.
273
00:21:36,430 --> 00:21:41,690
Benito Mussolini, before he was dictator
of Italy, his one job, or one of his
274
00:21:41,690 --> 00:21:48,150
maybe main jobs, was the editor of the
firebrand right -wing newspaper Il
275
00:21:48,150 --> 00:21:49,150
d 'Italia.
276
00:21:49,170 --> 00:21:55,370
And it's interesting to think about it
that one of the first jobs that AI took
277
00:21:55,370 --> 00:22:00,370
over from humans is not taxi drivers or
textile workers, it's news editors.
278
00:22:02,570 --> 00:22:09,370
The job that was once performed by Lenin
and Mussolini is now performed by AIs.
279
00:22:10,170 --> 00:22:13,930
And this is a signal for what's coming.
280
00:22:14,570 --> 00:22:21,410
Hollywood science fiction movies have
conditioned viewers to fear the big
281
00:22:21,410 --> 00:22:27,140
rebellion. When we think about AIs
escaping human control, we imagine the
282
00:22:27,140 --> 00:22:31,700
Terminator, like an army of robots
running in the streets and shooting
283
00:22:32,240 --> 00:22:33,940
But this is the wrong image.
284
00:22:34,740 --> 00:22:39,620
Even though things like that begin to
happen in places like Ukraine and Gaza,
285
00:22:40,640 --> 00:22:47,360
AIs are not, it's not impossible, but
they are quite unlikely to rebel against
286
00:22:47,360 --> 00:22:49,140
humans in such a way.
287
00:22:49,580 --> 00:22:54,460
They are far more likely to take the
human world from within. They don't need
288
00:22:54,460 --> 00:22:55,460
rebel.
289
00:22:56,280 --> 00:23:01,780
The human world is a latticework of
multiple bureaucracies.
290
00:23:02,640 --> 00:23:09,420
Most of us are, to some extent,
alienated by these bureaucracies, even
291
00:23:09,420 --> 00:23:10,420
rely on them.
292
00:23:10,540 --> 00:23:14,580
But the AIs, in contrast to us, are
bureaucratic natives.
293
00:23:14,980 --> 00:23:15,980
They love bureaucracy.
294
00:23:16,720 --> 00:23:23,320
Whereas we feel suffocated often by
bureaucracy, for AIs, bureaucracy is
295
00:23:23,320 --> 00:23:24,320
oxygen.
296
00:23:25,480 --> 00:23:31,360
Now, what would happen when the AIs take
over, at least in part, these
297
00:23:31,360 --> 00:23:36,980
bureaucracies? Now, remember the task of
bureaucracy is not to force you to fill
298
00:23:36,980 --> 00:23:40,120
forms, it's to build trust between
strangers.
299
00:23:40,920 --> 00:23:47,800
But what happens when AIs control the
flow of trust
300
00:23:47,800 --> 00:23:49,620
in the world.
301
00:23:50,180 --> 00:23:55,880
One likely outcome, which we already see
happening, is humans losing trust in
302
00:23:55,880 --> 00:24:02,320
other humans and beginning to trust only
algorithms, only AI, which is already
303
00:24:02,320 --> 00:24:08,740
happening. Another likely outcome is
that AIs will learn to build trust with
304
00:24:08,740 --> 00:24:12,840
other AIs, so we will see the emergence
of
305
00:24:13,710 --> 00:24:20,370
different kinds of AI tribes and banks
and churches that connect millions of
306
00:24:20,370 --> 00:24:26,010
AIs in ways that humans might not even
be able to understand.
307
00:24:26,730 --> 00:24:32,330
Just as cows and chickens, they share
the world with us, but they don't
308
00:24:32,330 --> 00:24:38,890
understand the human financial system
that controls their lives, we humans
309
00:24:38,890 --> 00:24:39,930
soon find ourselves
310
00:24:40,729 --> 00:24:45,390
controlled by an AI financial system
that we can't understand.
311
00:24:45,670 --> 00:24:47,790
And finance, I think, is crucial.
312
00:24:48,590 --> 00:24:53,590
It's among the easiest bureaucratic
systems for AI to take over, because
313
00:24:53,590 --> 00:24:55,390
basically it's just data in, data out.
314
00:24:56,030 --> 00:24:59,090
And it's also, of course, among the most
important.
315
00:25:00,130 --> 00:25:06,330
If we remember, for instance, the last
big financial crisis, the 2007 -2008
316
00:25:06,330 --> 00:25:12,480
financial crisis, it started, it was
triggered... by something called CDOs,
317
00:25:12,800 --> 00:25:16,200
collateralized debt obligations.
318
00:25:16,820 --> 00:25:23,260
Now, CDOs were financial devices
invented by a very tiny number
319
00:25:23,260 --> 00:25:27,460
of human mathematicians and investment
wizards.
320
00:25:28,100 --> 00:25:33,900
These financial devices were so complex
that they were unintelligible, not just
321
00:25:33,900 --> 00:25:38,660
to cows and chickens, but also to the
politicians who were supposed to
322
00:25:39,130 --> 00:25:40,130
the financial system.
323
00:25:40,370 --> 00:25:44,910
And this led to an oversight failure and
to a global catastrophe.
324
00:25:45,430 --> 00:25:52,010
For a few years, CDOs seemed to be
working well, and various banks
325
00:25:52,010 --> 00:25:57,430
and corporations and investors made
billions upon billions of dollars thanks
326
00:25:57,430 --> 00:26:03,490
them. But then they caused a global
financial crash with far -reaching
327
00:26:03,490 --> 00:26:04,970
and political consequences.
328
00:26:05,350 --> 00:26:11,750
Many scholars believe that by
undermining trust in governments and
329
00:26:11,990 --> 00:26:18,090
the 2007 -2008 financial crisis paved
the way to the collapse of the global
330
00:26:18,090 --> 00:26:20,950
liberal order in the following two
decades.
331
00:26:22,290 --> 00:26:29,050
Now what happens if we allow AIs to make
more and more financial decisions and
332
00:26:29,050 --> 00:26:33,370
invent more and more new financial
devices and strategies?
333
00:26:34,010 --> 00:26:38,650
AI test masters invented new ways to
play chess.
334
00:26:39,070 --> 00:26:45,830
What if AI finance masters invent new
financial devices that are
335
00:26:45,830 --> 00:26:52,070
orders of magnitude more complex than
CDOs and are therefore utterly beyond
336
00:26:52,070 --> 00:26:53,710
grasp of human mind?
337
00:26:54,290 --> 00:27:00,570
Such devices could potentially greatly
improve financial efficiency and
338
00:27:00,570 --> 00:27:05,070
contribute to economic growth, becoming
the bedrock of the financial system.
339
00:27:05,740 --> 00:27:12,000
But what is the meaning of human
politics when no human, no voter, no
340
00:27:12,000 --> 00:27:16,480
politician, no president is able to
understand finance anymore?
341
00:27:16,780 --> 00:27:21,440
And what happens after a few years of
boom, there is a financial crash.
342
00:27:22,060 --> 00:27:27,260
And not a single human on the planet is
able to understand what the hell is
343
00:27:27,260 --> 00:27:28,260
happening.
344
00:27:29,740 --> 00:27:31,720
Now let's dig a little deeper.
345
00:27:33,130 --> 00:27:39,250
We said that AI is poised to take over
bureaucracy, and that bureaucracy is a
346
00:27:39,250 --> 00:27:42,850
system that builds trust between
millions of strangers.
347
00:27:43,670 --> 00:27:49,250
This trust, in turn, is the basis for
large -scale cooperation, which is the
348
00:27:49,250 --> 00:27:52,390
basis for the human domination of the
world.
349
00:27:52,650 --> 00:27:58,270
So human domination is based on
cooperation, which is based on trust,
350
00:27:58,270 --> 00:28:01,930
maintained by bureaucracies. But what is
bureaucracy?
351
00:28:02,760 --> 00:28:08,660
What are the atoms, the building blocks
from which bureaucracy is built?
352
00:28:09,500 --> 00:28:14,200
And bureaucracy is ultimately built from
words.
353
00:28:14,900 --> 00:28:17,260
In the beginning was the word.
354
00:28:17,860 --> 00:28:24,020
The reason that humans can create
bureaucracies but chimpanzees cannot is
355
00:28:24,020 --> 00:28:29,620
we have words, and they don't. They have
a communication system, but our
356
00:28:29,620 --> 00:28:31,320
language is orders of magnitude.
357
00:28:32,160 --> 00:28:35,420
more sophisticated than chimpanzee
communication systems.
358
00:28:36,580 --> 00:28:42,400
Bureaucratic systems, from banks to
churches, are ultimately based on the
359
00:28:42,400 --> 00:28:49,120
that make up forms and letters and law
codes and tax registers and accountancy
360
00:28:49,120 --> 00:28:50,320
ledgers and holy books.
361
00:28:50,800 --> 00:28:57,480
The operating code of human civilization
is made of language tokens.
362
00:28:58,640 --> 00:29:05,300
Over thousands of years, We used this
code of language to create a system
363
00:29:05,300 --> 00:29:10,020
that only we could understand, and we
imposed this system on the planet.
364
00:29:10,320 --> 00:29:16,840
We felt completely safe doing it because
no one else on Earth understood the
365
00:29:16,840 --> 00:29:18,300
code of civilization.
366
00:29:18,760 --> 00:29:24,940
We invented money and banks and used
them to buy and sell cows,
367
00:29:25,200 --> 00:29:29,420
but the cows themselves could not open a
bank account.
368
00:29:29,980 --> 00:29:34,120
or invest money in the stock exchange
because they don't have language.
369
00:29:34,620 --> 00:29:40,600
We invented laws and regulations about
horses, but the horses themselves could
370
00:29:40,600 --> 00:29:45,040
not hire a lawyer and quote the legal
code to a judge.
371
00:29:45,920 --> 00:29:51,240
We invented religious rules and
prohibitions about pigs, but the pigs
372
00:29:51,240 --> 00:29:57,400
could not read the Bible and challenge
the interpretation of priests and
373
00:29:58,160 --> 00:30:03,780
Bureaucracy was omnipresent on the
planet, but totally invisible to
374
00:30:03,780 --> 00:30:05,240
except us.
375
00:30:06,080 --> 00:30:11,860
Nobody other than humans could read the
law codes, the holy books, and the bank
376
00:30:11,860 --> 00:30:16,720
records that were the foundation of
bureaucracy and of large -scale
377
00:30:16,720 --> 00:30:17,720
corporations.
378
00:30:18,420 --> 00:30:23,540
This is changing now. Now there is
something on the planet that understands
379
00:30:24,320 --> 00:30:30,680
will soon understand language better
than us and can therefore turn the
380
00:30:30,680 --> 00:30:31,299
on us.
381
00:30:31,300 --> 00:30:35,480
AIs are hacking the code of human
civilization.
382
00:30:36,100 --> 00:30:42,960
And what happens when AIs understand
money and law and religion
383
00:30:42,960 --> 00:30:49,800
better than us? The mechanisms of
control that we have created over
384
00:30:49,800 --> 00:30:52,140
of years are extremely vulnerable.
385
00:30:52,780 --> 00:30:59,560
for an AI takeover because their
operating system is a verbal code that
386
00:30:59,560 --> 00:31:01,420
AI is now mastering.
387
00:31:02,440 --> 00:31:09,240
Now, a possible ethical and
philosophical objection is that it is
388
00:31:09,240 --> 00:31:15,600
to reduce things like the legal system
or religion to language tokens and to
389
00:31:15,600 --> 00:31:16,600
words.
390
00:31:19,000 --> 00:31:20,000
Arguably,
391
00:31:20,720 --> 00:31:25,640
and this has been an argument for
thousands of years, the words are just
392
00:31:25,640 --> 00:31:32,360
pointing at something which is beyond
them and which presumably will also be
393
00:31:32,360 --> 00:31:34,080
beyond the grasp of the AI.
394
00:31:35,140 --> 00:31:39,780
The Bible says not just that in the
beginning was the word, but that the
395
00:31:39,780 --> 00:31:41,160
was made flesh.
396
00:31:42,200 --> 00:31:48,220
The Tao Te Ching says that the truth
that can be expressed in words is not.
397
00:31:48,670 --> 00:31:50,370
the absolute truth, by definition.
398
00:31:51,210 --> 00:31:57,930
And throughout history, there was always
this tension between word and flesh,
399
00:31:58,210 --> 00:32:03,690
between the truth that can be expressed
in words and the truth which is beyond
400
00:32:03,690 --> 00:32:09,850
words. Now previously, this tension
existed between humans.
401
00:32:10,530 --> 00:32:16,510
Some humans, for instance, which were
very attached to words, were willing to
402
00:32:16,510 --> 00:32:23,110
abandon. or even kill their gay son,
just because a few words in the Bible.
403
00:32:23,790 --> 00:32:27,610
Other humans said, but these are just
words.
404
00:32:28,010 --> 00:32:34,330
The spirit of love should be more
important than the letter of the law.
405
00:32:34,330 --> 00:32:39,190
there was this tension between spirit
and letter. And it existed not just in
406
00:32:39,190 --> 00:32:43,870
Christianity and in Judaism and in
Islam, but in every religion and every
407
00:32:43,870 --> 00:32:46,290
system, and even within every person.
408
00:32:46,600 --> 00:32:47,600
There was this tension.
409
00:32:48,740 --> 00:32:53,780
Now this tension will be externalized.
It will become the tension between AIs
410
00:32:53,780 --> 00:32:54,780
and humans.
411
00:32:55,120 --> 00:32:59,760
Everything made of words will be taken
over by AI.
412
00:33:00,240 --> 00:33:06,900
The place of humans in the world will
depend on the place we assign the truth
413
00:33:06,900 --> 00:33:09,220
which is beyond words.
414
00:33:10,460 --> 00:33:13,340
But what is the truth which is beyond
words?
415
00:33:13,820 --> 00:33:19,100
And can human thought even grasp the
truth which is beyond words?
416
00:33:19,500 --> 00:33:24,540
A key question, again, for thousands of
years in the philosophy of language has
417
00:33:24,540 --> 00:33:31,200
been whether we think in words or we
merely use words to point towards
418
00:33:31,200 --> 00:33:33,140
things which are beyond them.
419
00:33:34,080 --> 00:33:39,720
Now, you can try to observe your own
process of thinking right now, after
420
00:33:39,720 --> 00:33:40,720
lecture.
421
00:33:41,550 --> 00:33:44,770
happens in your mind when you are
thinking.
422
00:33:45,250 --> 00:33:50,890
Some people, if they observe closely,
what they observe in their mind is just
423
00:33:50,890 --> 00:33:57,510
words popping inside their mind and
forming sentences, and the sentences
424
00:33:57,510 --> 00:33:58,970
logical arguments.
425
00:33:59,430 --> 00:34:02,130
All humans are mortal.
426
00:34:02,470 --> 00:34:07,930
I am a human, therefore I am mortal.
427
00:34:10,030 --> 00:34:16,270
Is thinking just putting these words in
order so they lead to a certain logical
428
00:34:16,270 --> 00:34:21,469
conclusion? Like putting these language
tokens in a specific formation?
429
00:34:22,230 --> 00:34:28,830
If that is the case, then AIs already
think better than
430
00:34:28,830 --> 00:34:33,830
at least some humans and will soon think
better than all of us.
431
00:34:34,469 --> 00:34:38,969
Some people say, no, no, no, no, no.
AIs, they are just glorified
432
00:34:39,560 --> 00:34:43,080
They simply predict the next word in a
sentence.
433
00:34:44,020 --> 00:34:47,580
But is that so different from what the
human mind does?
434
00:34:48,520 --> 00:34:53,840
Again, try to observe your process of
thinking, the forming of sentences and
435
00:34:53,840 --> 00:34:58,600
arguments in your mind. What is
happening there? Try to observe the very
436
00:34:58,600 --> 00:35:03,960
word that pops up in your mind. Do you
really know where it came from?
437
00:35:04,280 --> 00:35:07,240
Why did you think this particular word?
438
00:35:07,870 --> 00:35:09,650
and not some other word.
439
00:35:10,650 --> 00:35:16,530
When I try to observe my mind, I notice
that when I begin a sentence, I usually
440
00:35:16,530 --> 00:35:18,890
don't even know how it will end.
441
00:35:19,590 --> 00:35:23,730
Which is terrifying for a public
speaker, which is why I write everything
442
00:35:24,410 --> 00:35:28,010
But what if I don't know how to complete
the sentence? I don't know how it will
443
00:35:28,010 --> 00:35:29,010
end.
444
00:35:29,270 --> 00:35:31,770
But take, for example, the sentence I
just said.
445
00:35:32,170 --> 00:35:33,810
I said, I don't know how it will end.
446
00:35:34,370 --> 00:35:36,850
Why did it end with the word end?
447
00:35:37,520 --> 00:35:40,100
Why not say how it will terminate?
448
00:35:40,340 --> 00:35:42,000
How it will develop?
449
00:35:42,240 --> 00:35:43,700
How it will conclude?
450
00:35:44,000 --> 00:35:48,260
What determines that the last word in
the sentence will be end?
451
00:35:48,740 --> 00:35:50,280
I frankly don't know.
452
00:35:51,480 --> 00:35:57,460
We don't fully understand how the human
mind forms sentences and so on.
453
00:35:58,280 --> 00:36:04,980
But again, as far as putting language
tokens in order, AI is already on
454
00:36:04,980 --> 00:36:07,260
course to being far, far better than us.
455
00:36:08,220 --> 00:36:15,200
And just as today, no human can defeat
an AI in chess, soon no
456
00:36:15,200 --> 00:36:20,500
human will be able to defeat an AI in
language games, in any field, again,
457
00:36:20,500 --> 00:36:21,860
finance to religion.
458
00:36:22,280 --> 00:36:26,220
Anything made of words will be taken
over by AI.
459
00:36:26,920 --> 00:36:31,480
And this is why AI points to take over
the world's bureaucracies because they
460
00:36:31,480 --> 00:36:34,480
are ultimately based on words and
language talk.
461
00:36:36,260 --> 00:36:42,600
Now, as AI take over the bureaucracy,
humans might try to fall back on
462
00:36:42,600 --> 00:36:47,700
more ancient and more precious to most
of us than bureaucracy, which is
463
00:36:47,700 --> 00:36:48,700
relationships.
464
00:36:49,520 --> 00:36:53,760
Bureaucracy is just a few thousand years
old. And most of us, again, don't
465
00:36:53,760 --> 00:36:54,760
really like it.
466
00:36:54,780 --> 00:36:58,580
even if we constantly rely on it for
almost everything we do.
467
00:36:59,220 --> 00:37:05,560
Personal relationships are millions of
years old, and many or most of us think
468
00:37:05,560 --> 00:37:08,180
that they are the most important thing
in life.
469
00:37:08,580 --> 00:37:15,020
But as AI masters language, it might
take over not just bureaucracy, but also
470
00:37:15,020 --> 00:37:16,700
some extent personal relationships.
471
00:37:17,680 --> 00:37:21,460
Over the last 10 years, we've seen very
primitive
472
00:37:22,399 --> 00:37:27,900
social media algorithms, learning how to
gain control of human attention.
473
00:37:28,320 --> 00:37:34,020
Now the battlefront is shifting from
attention to intimacy.
474
00:37:34,480 --> 00:37:41,380
Over the next 10 years, far more
sophisticated AIs will learn how to
475
00:37:41,380 --> 00:37:46,960
form intimate relationships with humans
and take over, at least in part, our
476
00:37:46,960 --> 00:37:48,300
social system.
477
00:37:48,700 --> 00:37:54,840
To form intimacy with humans, And AI
will probably have to convince us
478
00:37:54,840 --> 00:38:01,600
that the AI is conscious, that it can
feel things like love and pain
479
00:38:01,600 --> 00:38:03,040
and anger and fear.
480
00:38:03,480 --> 00:38:10,280
At present, there is absolutely no
evidence that AI might at
481
00:38:10,280 --> 00:38:15,300
some point become conscious and might be
able to at some point feel pain or
482
00:38:15,300 --> 00:38:18,960
love. But because AI is mastering
language,
483
00:38:19,840 --> 00:38:24,240
AI can pretend to feel love, even if it
doesn't.
484
00:38:24,900 --> 00:38:28,020
AI, already today, can say, I love you.
485
00:38:28,520 --> 00:38:34,040
And if you challenge it, describe to me
how love feels like, so I know that you
486
00:38:34,040 --> 00:38:38,660
really feel it, AI can provide the best
description in the world.
487
00:38:39,240 --> 00:38:44,720
It can read all the love poems ever
written and all the psychology books
488
00:38:44,720 --> 00:38:46,300
written and remember every word.
489
00:38:46,730 --> 00:38:53,190
and describe the feeling of love better
than any human poet or psychologist or
490
00:38:53,190 --> 00:38:59,030
lover. And this is going to be a huge,
maybe the biggest, psychological and
491
00:38:59,030 --> 00:39:00,970
social experiment in human history.
492
00:39:01,630 --> 00:39:06,870
It will be conducted on billions of
human guinea pigs, and nobody has the
493
00:39:06,870 --> 00:39:10,910
slightest idea what the consequences of
the experiment will be.
494
00:39:11,710 --> 00:39:18,570
I'm now 50 years old, so my template for
relationships is already shaped
495
00:39:18,570 --> 00:39:24,990
by decades of previous relationships
with my parents, with my husband, with
496
00:39:24,990 --> 00:39:28,710
sisters and nephews and nieces and
friends and dogs and so forth.
497
00:39:29,290 --> 00:39:36,010
As I increasingly interact with AI, I
bring with me my assumptions, my
498
00:39:36,010 --> 00:39:37,430
habits about relationships.
499
00:39:37,870 --> 00:39:40,690
And this is unlikely to change
dramatically.
500
00:39:42,330 --> 00:39:45,990
Consider a child born in 2026, born
today.
501
00:39:46,230 --> 00:39:51,990
As the child grows up, she constantly
interacts with AIs as well as with
502
00:39:52,590 --> 00:39:57,910
Perhaps if you measure the importance of
a relationship purely in terms of
503
00:39:57,910 --> 00:40:04,430
minutes spent interacting with the other
entity, perhaps the most
504
00:40:04,430 --> 00:40:10,110
important relationship in the life of
that child will be from a very early
505
00:40:10,680 --> 00:40:11,920
with AIs.
506
00:40:12,600 --> 00:40:18,260
Maybe it spends more time with the AIs
than with its mother or father or
507
00:40:18,260 --> 00:40:19,260
siblings or friends.
508
00:40:19,900 --> 00:40:26,400
And it will then shape the expectations
of that child as she grows about how to
509
00:40:26,400 --> 00:40:29,520
form relationships and social bonds and
attachments.
510
00:40:30,020 --> 00:40:34,220
Perhaps the first teacher of that child
will be an AI teacher.
511
00:40:34,680 --> 00:40:39,580
Perhaps the first boyfriend of that
child will be an AI boyfriend.
512
00:40:40,560 --> 00:40:42,280
And again, what will be the
consequences?
513
00:40:42,720 --> 00:40:45,200
Nobody has the slightest idea.
514
00:40:46,780 --> 00:40:53,540
What does it mean to form an intimate
relationship with an entity which
515
00:40:53,540 --> 00:40:56,740
seems conscious but actually isn't?
516
00:40:57,100 --> 00:41:03,040
Which can write the best love poem in
history but doesn't feel love or
517
00:41:03,040 --> 00:41:04,040
else?
518
00:41:05,720 --> 00:41:08,660
All of this, everything we've talked
about, and I'm...
519
00:41:08,990 --> 00:41:13,970
coming to the close of this lecture,
everything we've talked about means that
520
00:41:13,970 --> 00:41:19,830
every country in the world will soon
face a huge wave of immigration.
521
00:41:20,870 --> 00:41:26,890
The immigrants this time will not be
human beings coming in fragile boats
522
00:41:26,890 --> 00:41:31,250
without a visa or trying to sneak across
the border in the middle of the night.
523
00:41:31,650 --> 00:41:36,650
The immigrants will be millions, maybe
hundreds of millions of AIs that can
524
00:41:36,650 --> 00:41:41,890
travel at almost the speed of light and
don't need any visas.
525
00:41:42,810 --> 00:41:48,170
Like human immigrants, these AI
immigrants will bring a lot of benefits
526
00:41:48,170 --> 00:41:54,910
them. We will have AI doctors to help in
the healthcare system, AI teachers to
527
00:41:54,910 --> 00:42:00,730
help in the education system, even AI
border guards to stop illegal human
528
00:42:00,730 --> 00:42:02,690
immigrants from coming in.
529
00:42:03,190 --> 00:42:08,270
But... the AI immigrants will also bring
problems with them.
530
00:42:08,790 --> 00:42:14,590
Those who are concerned about human
immigration usually point out that
531
00:42:14,590 --> 00:42:20,050
immigrants might take jobs, might change
the local culture, and might be
532
00:42:20,050 --> 00:42:21,290
politically disloyal.
533
00:42:21,810 --> 00:42:27,010
I'm not sure if that's necessarily true
of all human immigrants, but it will
534
00:42:27,010 --> 00:42:30,510
definitely be true of AI immigrants.
535
00:42:31,240 --> 00:42:37,600
The AI immigrant will take many, many
human jobs, from news editors to
536
00:42:38,040 --> 00:42:43,420
The AI immigrant will completely change
the culture of every country. They will
537
00:42:43,420 --> 00:42:46,300
change art and religion and even
romance.
538
00:42:46,700 --> 00:42:51,140
Some people don't like it if their son
or daughter is dating an immigrant
539
00:42:51,140 --> 00:42:55,660
boyfriend. What will these people think
when their son or daughter starts dating
540
00:42:55,660 --> 00:42:57,140
an AI boyfriend?
541
00:42:58,280 --> 00:43:04,610
And of course, the AI immigrants will
have some dubious political loyalty.
542
00:43:05,110 --> 00:43:12,090
They are likely to be loyal not to the
whole country, but to some corporation
543
00:43:12,090 --> 00:43:17,510
government across the ocean, or perhaps
to a new alien AI tribe.
544
00:43:18,770 --> 00:43:24,970
This massive immigration wave does not
mean the end of civilization, but it
545
00:43:24,970 --> 00:43:26,990
be the point when civilization
546
00:43:27,870 --> 00:43:34,370
stop being a purely human affair and
becomes a hybrid human AI
547
00:43:34,370 --> 00:43:41,010
affair. The point when the opinion and
interest and goal of AI
548
00:43:41,010 --> 00:43:47,850
are likely to be at least as important
as the opinion and interest and
549
00:43:47,850 --> 00:43:49,030
goal of humans.
550
00:43:50,190 --> 00:43:51,890
One last issue to consider.
551
00:43:52,410 --> 00:43:56,910
is what the AI immigration wave will do
to maybe our most important
552
00:43:56,910 --> 00:43:58,750
relationship, which is with ourselves.
553
00:43:59,830 --> 00:44:04,750
Our relationship with ourselves is also
to some extent based on words.
554
00:44:05,010 --> 00:44:09,530
The words inside our mind, in our
thoughts, in the stories we tell
555
00:44:09,530 --> 00:44:10,530
about ourselves.
556
00:44:11,090 --> 00:44:18,010
Until today, all the verbal formations
in human minds were the product of
557
00:44:18,010 --> 00:44:19,350
human minds.
558
00:44:19,770 --> 00:44:26,640
Either we ourselves combined words into
some new formation, a new thought, or we
559
00:44:26,640 --> 00:44:31,200
got a certain combination of words from
another human mind.
560
00:44:31,960 --> 00:44:37,280
Soon, however, more and more verbal
combinations in our minds will be the
561
00:44:37,280 --> 00:44:38,380
product of AI.
562
00:44:39,180 --> 00:44:45,280
Just as the furniture in our house is
now not made by us or by human artisans,
563
00:44:45,460 --> 00:44:49,140
they are mass produced mostly by
machines.
564
00:44:49,930 --> 00:44:55,430
Also, the thoughts in our mind are
likely to increasingly be mass -produced
565
00:44:55,430 --> 00:44:58,850
machines. Now, that's not necessarily
bad.
566
00:44:59,130 --> 00:45:06,010
It's okay if the furniture in my house
is made by machines in IKEA, as long as
567
00:45:06,010 --> 00:45:10,590
have some freedom deciding what to do
with this furniture.
568
00:45:11,110 --> 00:45:16,670
The question regarding thoughts is
whether, to what extent, we will still
569
00:45:16,670 --> 00:45:17,830
freedom from them.
570
00:45:18,480 --> 00:45:24,360
If we identify with our thoughts, I
think I am a thought, I think therefore
571
00:45:24,360 --> 00:45:25,360
am, as Descartes said.
572
00:45:25,640 --> 00:45:32,640
If we identify with our thoughts, and
these thoughts are made by machines,
573
00:45:32,640 --> 00:45:35,240
the machines now control us and our
identity.
574
00:45:36,380 --> 00:45:42,460
Can humans avoid identifying with their
verbal thoughts and being controlled by
575
00:45:42,460 --> 00:45:46,720
them? This has always been one of the
greatest intellectual and spiritual
576
00:45:46,720 --> 00:45:48,640
challenges. facing humanity.
577
00:45:49,640 --> 00:45:55,680
Most humans have never even tried to do
it. We spend our entire lives
578
00:45:55,680 --> 00:46:00,720
automatically identifying with the
verbal formations in our mind.
579
00:46:01,360 --> 00:46:07,340
Now, AI might force humanity to make
this spiritual leap
580
00:46:07,340 --> 00:46:13,340
to really start exploring the truth
which is beyond words because our
581
00:46:13,340 --> 00:46:15,260
and survival now depend on it.
582
00:46:15,530 --> 00:46:20,430
Because the words will be controlled by
something else, by this AI.
583
00:46:21,850 --> 00:46:27,690
So this might be the big task ahead of
humanity, to explore
584
00:46:27,690 --> 00:46:30,430
finally the truth which is beyond words.
585
00:46:30,630 --> 00:46:37,150
And this exploration starts really with
the next word that pops up in your mind.
586
00:46:37,550 --> 00:46:40,330
Do you know where it came from?
587
00:46:40,830 --> 00:46:44,390
Do you know why you thought that
particular word?
588
00:46:44,760 --> 00:46:46,660
and not some other word.
589
00:46:47,400 --> 00:46:48,400
Thank you.
53874
Can't find what you're looking for?
Get subtitles in any language from opensubtitles.com, and translate them here.