Would you like to inspect the original subtitles? These are the user uploaded subtitles that are being translated:
1
00:00:10,031 --> 00:00:17,995
[light piano music]
2
00:00:24,132 --> 00:00:26,786
[door creaks]
3
00:00:31,922 --> 00:00:32,705
[door clicks shut]
4
00:00:58,644 --> 00:01:03,084
Hey Siri, send a
message to Cheryl.
5
00:01:03,127 --> 00:01:03,954
Front reception.
6
00:01:06,348 --> 00:01:07,044
[Siri] What do you want to say?
7
00:01:08,959 --> 00:01:11,701
Amos is already heading
there to pick him up, period.
8
00:01:11,744 --> 00:01:13,877
Please forward any calls
I get to Brady, period.
9
00:01:15,139 --> 00:01:16,923
[Siri] Your message to
Cheryl front reception
10
00:01:16,967 --> 00:01:19,274
says Amos is already heading
there to pick him up.
11
00:01:19,317 --> 00:01:20,927
Please forward any calls
I get to Brady.
12
00:01:21,537 --> 00:01:22,320
Ready to send it?
13
00:01:22,799 --> 00:01:23,582
Yes.
14
00:01:24,931 --> 00:01:26,107
[Siri] Okay, it's sent.
15
00:01:27,978 --> 00:01:28,848
Hey, Siri,
16
00:01:31,199 --> 00:01:33,026
how do you know if you're
doing the right thing?
17
00:01:35,203 --> 00:01:36,378
[Siri] I'm not sure
I understand.
18
00:01:40,556 --> 00:01:41,687
But what do you believe
19
00:01:41,731 --> 00:01:43,428
is the difference between
right and wrong?
20
00:01:45,561 --> 00:01:46,779
[Siri] Hmm.
21
00:01:46,823 --> 00:01:48,129
I don't have an answer for that.
22
00:01:48,651 --> 00:01:50,000
Would you like me to
search the web?
23
00:01:51,044 --> 00:01:51,784
No.
24
00:01:53,264 --> 00:01:55,310
[Siri] Okay, is there
something else I can help with?
25
00:02:04,884 --> 00:02:06,451
Set a reminder to pick up Kyle
26
00:02:06,495 --> 00:02:08,671
from therapy tomorrow at 4:45.
27
00:02:10,629 --> 00:02:12,153
[Siri] Okay, I'll remind you.
28
00:02:31,737 --> 00:02:33,130
[door creaks]
29
00:02:34,044 --> 00:02:36,351
Hi, special agent Deena Helms.
30
00:02:36,394 --> 00:02:37,439
You've already met
Agent McCullough.
31
00:02:37,482 --> 00:02:38,875
You can call me Amos.
32
00:02:38,918 --> 00:02:41,660
-Uh, agents?
-Have a seat for us, Gareth.
33
00:02:44,359 --> 00:02:45,795
Do you mind answering a
couple questions?
34
00:02:47,362 --> 00:02:49,451
Great, this shouldn't take long.
35
00:02:51,409 --> 00:02:53,585
You're from Tampa, right?
36
00:02:56,197 --> 00:02:57,589
Don't overthink it.
It's a yes or no.
37
00:02:59,025 --> 00:03:00,244
Yeah.
38
00:03:00,288 --> 00:03:01,637
How old are you, Gareth?
39
00:03:01,680 --> 00:03:02,551
29.
40
00:03:02,594 --> 00:03:04,205
What do you do for work?
41
00:03:04,248 --> 00:03:05,554
I'm sorry, am I being detained?
42
00:03:05,597 --> 00:03:06,859
No, not at all.
43
00:03:06,903 --> 00:03:08,774
We're just asking
questions, background stuff.
44
00:03:09,993 --> 00:03:11,168
You work on movies, right?
45
00:03:12,082 --> 00:03:12,909
Special effects.
46
00:03:14,345 --> 00:03:15,651
Someone told me you worked
47
00:03:15,694 --> 00:03:17,174
on that new "Star Wars"
movie, is that right?
48
00:03:17,218 --> 00:03:18,480
[Gareth] Who told you that?
49
00:03:18,523 --> 00:03:20,308
Why don't you tell us
more about it?
50
00:03:20,351 --> 00:03:21,309
Tell us about your work.
51
00:03:23,876 --> 00:03:25,791
I used to do VFX for an
animation company.
52
00:03:25,835 --> 00:03:26,879
I've worked on at least
20 different films.
53
00:03:26,923 --> 00:03:28,185
Used to?
54
00:03:28,229 --> 00:03:29,491
I've been focusing more
55
00:03:29,534 --> 00:03:30,709
on software engineering
recently for years-
56
00:03:30,753 --> 00:03:32,407
Sounds boring compared
to light sabers.
57
00:03:32,450 --> 00:03:33,669
Why quit?
58
00:03:33,712 --> 00:03:34,800
[Gareth] I wasn't
getting paid well.
59
00:03:34,844 --> 00:03:36,106
But money's not an
issue for you.
60
00:03:36,149 --> 00:03:37,325
Excuse me?
61
00:03:37,368 --> 00:03:38,239
[Deena] What kind of
effects did you do?
62
00:03:38,282 --> 00:03:39,631
Money's not an issue for me?
63
00:03:39,675 --> 00:03:40,850
-Let's talk about-
-If money wasn't an issue for me
64
00:03:40,893 --> 00:03:41,938
I wouldn't have applied
for your grant.
65
00:03:41,981 --> 00:03:42,634
I didn't mean to
suggest anything.
66
00:03:43,983 --> 00:03:45,246
Tell us what kind of
effects you did.
67
00:03:48,597 --> 00:03:50,163
My main focus was on
3D renderings.
68
00:03:50,207 --> 00:03:51,295
[Deena] Of what?
69
00:03:51,339 --> 00:03:52,296
-Actors.
-What for?
70
00:03:53,079 --> 00:03:54,342
Well, for "Star Wars,"
71
00:03:54,385 --> 00:03:55,865
it was because the actor
I was tasked to digitize
72
00:03:55,908 --> 00:03:57,301
was unavailable to be
filmed in person.
73
00:03:58,041 --> 00:03:58,563
Why?
74
00:04:00,086 --> 00:04:00,913
Because they were dead.
75
00:04:02,915 --> 00:04:03,786
What'd they have you do?
76
00:04:05,962 --> 00:04:08,138
I reconstructed Alec
Guinness' face as a 3D model.
77
00:04:08,181 --> 00:04:09,748
I analyzed reference footage,
78
00:04:09,792 --> 00:04:11,620
then used a process called
D-Term to procedurally generate
79
00:04:11,663 --> 00:04:12,882
his bone and muscle structures,
80
00:04:12,925 --> 00:04:14,275
which one rigged helped
the animation feel
81
00:04:14,318 --> 00:04:15,580
more natural and human-like.
82
00:04:15,624 --> 00:04:17,800
D-Term, I've never heard
of that process before.
83
00:04:17,843 --> 00:04:18,931
Because I invented it.
84
00:04:19,280 --> 00:04:20,193
[Deena] So you're
basically bringing
85
00:04:20,237 --> 00:04:21,499
dead actors back to life?
86
00:04:21,543 --> 00:04:22,979
I just tried to make
the CG characters look as
87
00:04:23,022 --> 00:04:24,633
photorealistic as the technology
at the time would allow.
88
00:04:24,676 --> 00:04:25,547
[Deena] You didn't
find it creepy?
89
00:04:26,591 --> 00:04:27,375
I'm sorry, what?
90
00:04:28,419 --> 00:04:29,377
I said you don't find
that creepy?
91
00:04:32,031 --> 00:04:34,425
Well, we did our best to
cross the uncanny valley.
92
00:04:34,469 --> 00:04:36,035
But when the human
brain perceives
93
00:04:36,079 --> 00:04:37,298
that something is just slightly
off and it doesn't matter-
94
00:04:37,341 --> 00:04:38,342
No, I mean,
digitizing dead people.
95
00:04:38,386 --> 00:04:39,517
Christ, I mean, it's,
96
00:04:39,561 --> 00:04:40,910
it's almost like turning
someone's corpse
97
00:04:40,953 --> 00:04:42,085
into a marionette, you know?
98
00:04:42,128 --> 00:04:43,304
Making them do
whatever you want.
99
00:04:43,913 --> 00:04:45,131
What if the poor dead guy
100
00:04:45,175 --> 00:04:46,611
didn't want to be in
another fucking movie?
101
00:04:47,438 --> 00:04:48,265
It's so macabre.
102
00:04:48,831 --> 00:04:49,919
Am I crazy? Is it not macabre?
103
00:04:49,962 --> 00:04:51,050
I don't think the studio cares
104
00:04:51,094 --> 00:04:52,225
whether it's macabre or not.
105
00:04:52,269 --> 00:04:53,444
Look, I can never tell
the difference.
106
00:04:53,488 --> 00:04:55,011
I always can.
The faces look like Play-Doh.
107
00:04:55,054 --> 00:04:56,186
Well, we did our best.
108
00:04:56,229 --> 00:04:57,361
Soon we won't even need actors,right?
109
00:04:57,405 --> 00:04:58,710
Everyone will just be digital.
110
00:04:58,754 --> 00:05:00,408
No, you still need them
for motion tracking.
111
00:05:00,451 --> 00:05:02,453
Human performances can't be
completely computer generated.
112
00:05:02,497 --> 00:05:03,541
How long will that be true?
113
00:05:07,719 --> 00:05:09,591
Some might say we've already
crossed that threshold.
114
00:05:11,419 --> 00:05:12,333
I wouldn't know.
115
00:05:15,423 --> 00:05:16,641
Where'd you go to school?
116
00:05:16,685 --> 00:05:18,295
-Brooks-DeBartolo High.
-And after?
117
00:05:20,166 --> 00:05:21,429
Nothing?
118
00:05:21,472 --> 00:05:22,343
What about Columbia?
119
00:05:22,386 --> 00:05:23,300
Didn't you go to Columbia?
120
00:05:25,650 --> 00:05:27,130
Wait, no.
You dropped out of Columbia
121
00:05:27,173 --> 00:05:29,437
after how many semesters?
122
00:05:30,002 --> 00:05:30,786
Three?
123
00:05:33,092 --> 00:05:35,965
Bjarne Stroustrup said
124
00:05:36,008 --> 00:05:37,183
you were the smartest
kid he ever met.
125
00:05:38,707 --> 00:05:41,405
I don't know who he is, but
Amos says it's a big deal.
126
00:05:42,711 --> 00:05:43,755
Then you moved to the
Netherlands,
127
00:05:44,539 --> 00:05:46,062
spent some time as an intern,
128
00:05:46,802 --> 00:05:48,020
applied and got into Cambridge.
129
00:05:48,760 --> 00:05:50,022
Very nice.
130
00:05:50,066 --> 00:05:51,328
Except that you dropped
out after two years.
131
00:05:52,416 --> 00:05:53,591
Flew back to the States,
132
00:05:53,635 --> 00:05:56,028
interned in Palo Alto,
then Montreal.
133
00:05:56,377 --> 00:05:57,639
Then went all the way
back to England,
134
00:05:57,682 --> 00:05:59,162
where you landed a job
in Sheffield.
135
00:05:59,205 --> 00:06:00,903
Second job in Manchester.
136
00:06:01,469 --> 00:06:04,167
Then got into Oxford where you
almost finished your masters
137
00:06:04,210 --> 00:06:05,429
before ditching the graduation
138
00:06:05,473 --> 00:06:06,952
and moving back here to Florida.
139
00:06:11,653 --> 00:06:12,784
If money was an issue,
140
00:06:14,656 --> 00:06:16,397
I'm glad you had plenty
of flyer miles.
141
00:06:18,486 --> 00:06:19,661
I didn't hear a question.
142
00:06:20,836 --> 00:06:21,619
What's your social life like?
143
00:06:22,838 --> 00:06:24,622
My, what does that have
anything to do-
144
00:06:24,666 --> 00:06:26,102
If you don't want to talk
about it, that's fine.
145
00:06:26,145 --> 00:06:27,408
We just wanted to know if
you have friends and stuff.
146
00:06:27,451 --> 00:06:29,018
-I have friends.
-A lot of them?
147
00:06:29,061 --> 00:06:30,280
-I have friends.
-Can you name one?
148
00:06:30,323 --> 00:06:31,455
-Can I what?
-[Deena] Can you tell us the nam
149
00:06:31,499 --> 00:06:32,587
of just one of your friends?
150
00:06:33,544 --> 00:06:35,633
-Steve.
-[Deena] Steve. Steve what?
151
00:06:35,677 --> 00:06:36,982
I don't know how this is
relevant to receiving the grant.
152
00:06:37,026 --> 00:06:38,375
Oh, we're just getting
to know you, Gareth.
153
00:06:39,420 --> 00:06:40,333
You got a girlfriend?
154
00:06:40,943 --> 00:06:41,770
Boyfriend?
155
00:06:42,510 --> 00:06:44,294
You, uh, talk to people online?
156
00:06:44,337 --> 00:06:45,426
I don't know what you
mean by that.
157
00:06:45,469 --> 00:06:46,731
I don't use social media.
158
00:06:46,775 --> 00:06:47,863
I mean more like chat rooms.
159
00:06:52,737 --> 00:06:54,043
You go on any chat rooms?
160
00:06:58,917 --> 00:07:00,266
No one uses chat rooms anymore.
161
00:07:01,006 --> 00:07:01,659
[Deena] Sure they do.
162
00:07:03,792 --> 00:07:04,793
You chat with anyone online?
163
00:07:07,535 --> 00:07:08,710
-Sometimes.
-[Deena] Sometimes.
164
00:07:10,233 --> 00:07:11,974
What kinds of people
do you talk to online?
165
00:07:14,106 --> 00:07:18,197
Gareth, obviously, this
isn't about a grant.
166
00:07:19,416 --> 00:07:20,591
We need to know
what your alias is.
167
00:07:22,158 --> 00:07:24,073
When you go online, what
name do you use?
168
00:07:24,116 --> 00:07:25,335
I don't have one.
169
00:07:25,378 --> 00:07:26,162
[Deena] Yes, you do.
170
00:07:27,206 --> 00:07:27,990
And you need to tell
us what it is.
171
00:07:33,822 --> 00:07:34,910
Sorry, I can't help you.
172
00:07:45,834 --> 00:07:46,878
[Deena] You know who we are?
173
00:07:48,967 --> 00:07:50,621
Well, this is the ICWL building.
174
00:07:50,665 --> 00:07:52,057
That's right.
You know what we do?
175
00:07:53,450 --> 00:07:54,582
[Gareth] Humanitarian work.
176
00:07:54,625 --> 00:07:55,800
That's what the
people upstairs do.
177
00:07:56,148 --> 00:07:57,410
You know what we do?
178
00:08:02,328 --> 00:08:03,765
We catch pedophiles.
179
00:08:06,028 --> 00:08:09,379
Amos here specializes in
tracking down online predators.
180
00:08:09,422 --> 00:08:11,381
He spends every waking hour
181
00:08:11,424 --> 00:08:14,036
scouring those chat
rooms you say no one uses
182
00:08:14,079 --> 00:08:16,691
and he finds thousands of
people soliciting children.
183
00:08:17,779 --> 00:08:20,521
Our operation is like a
tightly spun spider web
184
00:08:20,869 --> 00:08:23,654
connecting ICWL, the FBI, NSA,
185
00:08:23,698 --> 00:08:26,309
and let me tell you, his
team here is a vital thread.
186
00:08:27,310 --> 00:08:30,052
He reports everything he
gathers directly to me,
187
00:08:30,095 --> 00:08:32,228
and I see to it that the
necessary authorities
188
00:08:32,271 --> 00:08:33,403
take swift action.
189
00:08:33,795 --> 00:08:34,839
So are you in charge?
190
00:08:35,361 --> 00:08:36,885
This is my spiderweb.
191
00:08:38,626 --> 00:08:40,453
I'm the fucking spider, Gareth.
192
00:08:44,370 --> 00:08:46,982
Am I being detained?
193
00:08:47,852 --> 00:08:48,984
[Deena] We already told you
that you're not detained.
194
00:08:49,419 --> 00:08:50,855
Good. [chair scrapes]
195
00:08:52,074 --> 00:08:54,076
But if you leave this
room, you will be arrested.
196
00:09:00,473 --> 00:09:01,431
[Gareth] For what?
197
00:09:04,086 --> 00:09:05,000
I told you what we do.
198
00:09:05,653 --> 00:09:06,567
Take a wild guess.
199
00:09:08,656 --> 00:09:10,179
[Gareth] I am not what
you think I am.
200
00:09:10,440 --> 00:09:11,223
We'll see.
201
00:09:13,878 --> 00:09:15,576
Gareth, you just gotta
tell us your alias.
202
00:09:16,620 --> 00:09:18,230
What's your username?
203
00:09:22,626 --> 00:09:23,409
Sit down.
204
00:09:39,730 --> 00:09:41,210
-Why do you do this with them?
-[Deena] Hmm?
205
00:09:41,253 --> 00:09:42,864
There's no way you do this
with every suspect you have.
206
00:09:43,342 --> 00:09:44,474
Invite them to your headquarters
207
00:09:44,517 --> 00:09:45,606
and then drag them down
into a basement.
208
00:09:46,041 --> 00:09:46,607
[Deena] That's right.
209
00:09:47,695 --> 00:09:49,087
Why are you doing
this to me then?
210
00:09:51,220 --> 00:09:52,613
You tell us, Gare.
211
00:09:52,656 --> 00:09:54,005
What makes you so fuckin'
special?
212
00:09:56,573 --> 00:09:57,443
I don't know.
213
00:09:59,184 --> 00:10:00,751
What's your alias?
214
00:10:00,795 --> 00:10:03,624
-I don't have an alias.
-Yes you do.
215
00:10:05,364 --> 00:10:06,539
It starts with the word hard.
216
00:10:08,193 --> 00:10:09,368
Just finish the rest.
217
00:10:11,719 --> 00:10:12,937
Sit down, Mr. Federson.
218
00:10:12,981 --> 00:10:14,504
I only have a few
more questions.
219
00:10:27,299 --> 00:10:28,823
Do you recognize this girl?
220
00:10:37,701 --> 00:10:41,357
Do you know her?
221
00:10:44,316 --> 00:10:45,187
Yes.
222
00:10:45,230 --> 00:10:46,101
[Deena] What's her name?
223
00:10:47,102 --> 00:10:48,581
Cherry.
224
00:10:48,625 --> 00:10:50,279
-[Deena] Cherry what?
-She doesn't have a last name.
225
00:10:50,322 --> 00:10:51,802
Yes, she does, Gareth,
she's not Madonna.
226
00:10:51,846 --> 00:10:53,325
-She's a little girl.
-You don't understand.
227
00:10:53,369 --> 00:10:54,457
Yeah, well, I'd like to.
228
00:10:54,500 --> 00:10:55,545
So help me out, is she
your daughter?
229
00:10:55,588 --> 00:10:57,460
-No.
-Then whose daughter is she?
230
00:10:57,503 --> 00:10:58,548
-She, she doesn't have--
-How did you meet her?
231
00:10:58,591 --> 00:10:59,984
I didn't meet her.
232
00:11:00,028 --> 00:11:01,682
Then why do you have photos
of her on your computer?
233
00:11:01,725 --> 00:11:02,639
What the hell are you
talking about?
234
00:11:02,683 --> 00:11:04,423
Why do you fucking have photos
235
00:11:04,467 --> 00:11:05,729
of this girl on your fucking-
236
00:11:05,773 --> 00:11:06,861
Are you looking at
my hard drive?
237
00:11:06,904 --> 00:11:08,123
Because that's an
invasion of privacy.
238
00:11:08,166 --> 00:11:09,428
So you know what photos
I'm talking about?
239
00:11:09,472 --> 00:11:10,342
You don't have to do
it this way.
240
00:11:10,386 --> 00:11:11,604
I gave you permission to sit in.
241
00:11:11,648 --> 00:11:13,650
I did not give you
permission to speak.
242
00:11:13,694 --> 00:11:14,782
[Gareth] This is insane,
you cannot keep-
243
00:11:14,825 --> 00:11:16,044
What else have you
done with her?
244
00:11:16,087 --> 00:11:17,393
-[Gareth] Nothing!
-Did you take the photos?
245
00:11:17,436 --> 00:11:18,307
It's, it's complicated.
246
00:11:18,350 --> 00:11:19,787
[Deena] No, it's not! Yes or no?
247
00:11:19,830 --> 00:11:20,875
Did you take the photos?
248
00:11:20,918 --> 00:11:22,746
I didn't do anything wrong,
okay?
249
00:11:22,790 --> 00:11:25,793
Soliciting pornography of
minors is an egregious felony.
250
00:11:25,836 --> 00:11:28,752
Distributing that
pornography is tenfold worse.
251
00:11:28,796 --> 00:11:30,667
-I didn't do anything!
-Fucking prove it!
252
00:11:31,146 --> 00:11:33,583
What is your alias?
253
00:11:34,627 --> 00:11:35,933
Answer me!
254
00:11:35,977 --> 00:11:37,630
HardMachine11811.
255
00:11:39,545 --> 00:11:42,200
[Gareth exhales]
256
00:11:56,127 --> 00:11:57,259
You're HardMachine.
257
00:11:59,435 --> 00:12:00,653
Thanks for confirming.
258
00:12:03,308 --> 00:12:05,789
If you knew, then why
do this to me?
259
00:12:05,833 --> 00:12:07,095
[Deena] We weren't positive,
260
00:12:07,138 --> 00:12:08,444
and if you turned out
to not be HardMachine,
261
00:12:08,487 --> 00:12:09,750
you were obviously
just a predator.
262
00:12:15,103 --> 00:12:16,147
Do you keep track?
263
00:12:18,019 --> 00:12:20,586
I mean, do you know how many
bad people you've nailed?
264
00:12:21,196 --> 00:12:23,067
[Gareth] I didn't start
counting until 2023.
265
00:12:23,111 --> 00:12:25,548
196 convictions.
266
00:12:25,591 --> 00:12:26,854
[Gareth] There were at least 30
267
00:12:26,897 --> 00:12:27,768
before I started sending
everything to you guys.
268
00:12:28,507 --> 00:12:29,421
What'd you do before?
269
00:12:29,857 --> 00:12:30,945
[Gareth] I turned over
270
00:12:30,988 --> 00:12:31,946
all evidence directly
to the police.
271
00:12:31,989 --> 00:12:32,816
[Deena] Why'd you stop?
272
00:12:33,208 --> 00:12:34,035
They were unreliable.
273
00:12:35,340 --> 00:12:36,689
-I doubt that.
-More than half of the predators
274
00:12:36,733 --> 00:12:38,039
I identified went
un-investigated.
275
00:12:38,082 --> 00:12:39,692
Yeah, well, you were
sketchy and faceless.
276
00:12:39,736 --> 00:12:41,042
They had every right to
be skeptical.
277
00:12:41,956 --> 00:12:43,435
It would've all been for nothing
278
00:12:43,479 --> 00:12:44,915
if they found out you were
using a little girl as bait.
279
00:12:44,959 --> 00:12:46,134
It's not that simple, okay?
280
00:12:46,177 --> 00:12:48,789
I can only do what I do
with anonymity.
281
00:12:48,832 --> 00:12:50,791
Here's my problem, Gareth,
and don't get me wrong.
282
00:12:50,834 --> 00:12:52,531
I think 200 terrible
people behind bars
283
00:12:52,575 --> 00:12:54,664
is a very good thing,
but not at her expense.
284
00:12:55,578 --> 00:12:57,058
Look, we think we can help you,
285
00:12:57,754 --> 00:12:59,190
but we need to help her too.
286
00:12:59,234 --> 00:13:02,498
Using your daughter to
entrap these people
287
00:13:02,541 --> 00:13:03,629
is a means that does not
justify the ends.
288
00:13:03,673 --> 00:13:05,022
She's not my daughter.
289
00:13:05,066 --> 00:13:06,415
And in spite of what you
may think you've achieved,
290
00:13:06,458 --> 00:13:07,590
I still have no reservation
with locking you up.
291
00:13:07,633 --> 00:13:08,547
You took the photos.
292
00:13:09,026 --> 00:13:09,897
I don't care why.
293
00:13:10,245 --> 00:13:11,289
You don't understand.
294
00:13:12,029 --> 00:13:13,117
Who is she?
295
00:13:13,161 --> 00:13:14,815
You're gonna ruin everything.
296
00:13:14,858 --> 00:13:17,556
She's a child, Gareth,
look at me.
297
00:13:19,341 --> 00:13:22,823
I don't give a damn what
fucked up anti-hero master plan
298
00:13:22,866 --> 00:13:23,780
of yours I might jeopardize.
299
00:13:24,389 --> 00:13:26,000
I won't let her be exploited.
300
00:13:26,043 --> 00:13:27,784
Not even for the sake of
locking up more perverts.
301
00:13:29,307 --> 00:13:31,396
I'm asking you politely
to let this one go.
302
00:13:32,354 --> 00:13:33,572
Are you fucking slow?
303
00:13:33,921 --> 00:13:35,052
Have you been listening at all?
304
00:13:35,096 --> 00:13:37,620
My anonymity is my most
important asset.
305
00:13:37,663 --> 00:13:39,274
Without that, I can't
do what I do.
306
00:13:39,317 --> 00:13:40,884
Well, that makes
everything easy then.
307
00:13:42,407 --> 00:13:44,627
You tell us where she is,
or we leak everything.
308
00:13:44,670 --> 00:13:46,150
-Your name, your aliases.
-Deena!
309
00:13:46,194 --> 00:13:48,239
Every single perp you
helped us catch.
310
00:13:48,283 --> 00:13:50,154
I'm sure they'll be very
pleased to meet you in jail.
311
00:13:50,198 --> 00:13:51,373
Stop!
312
00:13:51,416 --> 00:13:52,113
Okay.
313
00:13:55,856 --> 00:13:56,857
Look, if I tell you
about Cherry, okay,
314
00:13:58,075 --> 00:13:59,076
there's some things I'm
gonna need first.
315
00:14:00,643 --> 00:14:02,210
It doesn't really work like
that, Gareth, but go ahead.
316
00:14:02,253 --> 00:14:03,820
Give us your wishlist.
317
00:14:03,864 --> 00:14:05,343
I need a signed non-disclosure
agreement from both of you.
318
00:14:05,387 --> 00:14:06,649
-Not gonna happen.
-And then I need you to swear
319
00:14:06,692 --> 00:14:07,824
that the information I'm
about to relay
320
00:14:07,868 --> 00:14:08,781
won't leave this room.
321
00:14:09,217 --> 00:14:10,566
Look, if you tell us anything
322
00:14:10,609 --> 00:14:11,741
that could help us
locate Cherry,
323
00:14:11,784 --> 00:14:13,612
you know we can't keep
that promise.
324
00:14:15,353 --> 00:14:16,920
Okay, if I tell you anything
325
00:14:16,964 --> 00:14:19,531
that potentially helps
you find a missing child,
326
00:14:19,792 --> 00:14:20,793
okay, you can feel free
to share that.
327
00:14:20,837 --> 00:14:22,056
But I need you to swear
328
00:14:22,099 --> 00:14:24,493
that any other details
about myself or Cherry,
329
00:14:25,973 --> 00:14:27,148
have to stay between
the three of us.
330
00:14:29,411 --> 00:14:30,194
Is that it?
331
00:14:32,718 --> 00:14:33,763
And I need that camera
switched off.
332
00:14:35,939 --> 00:14:36,984
[Deena] I don't know
how to do that.
333
00:14:37,027 --> 00:14:38,594
Go to the head of
securities office,
334
00:14:38,637 --> 00:14:39,943
ask him to find this camera
in the system and disable it.
335
00:14:40,857 --> 00:14:41,945
I don't think he's
allowed to do that.
336
00:14:43,468 --> 00:14:44,643
I thought you were the
fucking spider?
337
00:14:49,213 --> 00:14:50,606
Give me a reason, Gareth.
338
00:14:50,649 --> 00:14:51,781
Why should I go through
all the trouble
339
00:14:51,824 --> 00:14:52,956
of getting that
camera turned off?
340
00:14:54,871 --> 00:14:56,829
Because if anybody finds out
what I'm about to tell you,
341
00:14:58,744 --> 00:15:00,572
a thousand more children
are gonna get abused.
342
00:15:04,620 --> 00:15:05,403
Give me a minute.
343
00:15:12,280 --> 00:15:12,845
[door clicks shut]
344
00:15:21,028 --> 00:15:26,424
So, uh, you and Cherry hunted
all those people together?
345
00:15:34,041 --> 00:15:37,000
This one time I spent six
weeks undercover trying
346
00:15:37,044 --> 00:15:39,220
to nail down a single
trafficker from the Philippines.
347
00:15:41,091 --> 00:15:42,527
Day after day,
348
00:15:42,571 --> 00:15:45,704
I spent hour after hour
following his trail online.
349
00:15:45,748 --> 00:15:47,184
And he must have been
350
00:15:47,228 --> 00:15:48,969
one of the hardest targets
I ever had to track down.
351
00:15:52,059 --> 00:15:56,628
Then one day I found him and
one of Cherry's live streams.
352
00:15:57,281 --> 00:15:59,109
I mean, she went by a
different name in the stream,
353
00:15:59,153 --> 00:16:00,676
but it was her.
354
00:16:02,069 --> 00:16:03,200
The trafficker,
355
00:16:03,244 --> 00:16:04,549
along with three of our
other targets
356
00:16:04,593 --> 00:16:06,595
were all in the room together.
357
00:16:06,638 --> 00:16:12,122
All of them just carelessly
sharing their information.
358
00:16:13,819 --> 00:16:18,563
I mean, and they were so open
'cause she was a real girl.
359
00:16:18,868 --> 00:16:20,522
I mean, she could physically
360
00:16:20,565 --> 00:16:22,741
and verbally respond to
them in real time.
361
00:16:26,180 --> 00:16:32,055
A couple days later,
HardMachine11811 sends ICWL
362
00:16:32,099 --> 00:16:33,926
another batch of names
and evidence,
363
00:16:33,970 --> 00:16:37,017
including the three targets
that were in the room.
364
00:16:39,062 --> 00:16:42,022
You know, I almost thought
the girl was HardMachine
365
00:16:42,718 --> 00:16:44,372
and that this nine year old
366
00:16:44,415 --> 00:16:47,723
just happened to be some
badass online vigilante.
367
00:16:50,204 --> 00:16:51,335
What changed your mind?
368
00:16:54,991 --> 00:16:56,384
11811.
369
00:16:57,776 --> 00:17:00,344
January 18th, 2011.
370
00:17:01,345 --> 00:17:05,175
Most of my team thought it
was, uh, some arbitrary number,
371
00:17:06,698 --> 00:17:10,137
but I remember what happened
on that day in Clearwater.
372
00:17:13,183 --> 00:17:15,055
You were one of the
Clearwater kids, weren't you?
373
00:17:16,795 --> 00:17:19,798
You know, my father was
a part of that raid.
374
00:17:19,842 --> 00:17:21,757
[door opens]
375
00:17:22,497 --> 00:17:23,541
[Deena] It's off, see?
376
00:17:23,585 --> 00:17:24,238
No red light.
377
00:17:25,108 --> 00:17:26,196
Non-disclosure agreements?
378
00:17:26,240 --> 00:17:27,632
We're not playing this game,
Gareth.
379
00:17:27,676 --> 00:17:29,069
You're just gonna have to
suck it up and trust us.
380
00:17:33,682 --> 00:17:35,249
You can trust us.
381
00:17:38,252 --> 00:17:39,688
I've been told I have
trust issues.
382
00:17:39,949 --> 00:17:41,777
[Deena] Well, there's
only one way to fix that.
383
00:17:50,612 --> 00:17:52,353
The reason you can't
find Cherry,
384
00:17:53,354 --> 00:17:56,270
the reason why she doesn't
have a last name or parents,
385
00:17:56,531 --> 00:18:01,231
or a social security number
is because she's not real.
386
00:18:03,364 --> 00:18:04,626
She's not a real human being.
387
00:18:08,804 --> 00:18:09,805
Tell us what happened.
388
00:18:14,244 --> 00:18:15,637
While I was studying abroad,
389
00:18:15,898 --> 00:18:17,682
I interned at a small
Dutch animation studio
390
00:18:18,553 --> 00:18:19,989
a few years before
they collaborated
391
00:18:20,032 --> 00:18:21,556
with a local nonprofit on
a similar idea.
392
00:18:22,426 --> 00:18:23,123
[Deena] Which was?
393
00:18:24,472 --> 00:18:26,169
The idea was to build a 3D model
394
00:18:26,213 --> 00:18:27,518
of an 11 year old Filipino girl
395
00:18:28,040 --> 00:18:30,521
and use her covertly to
identify online predators,
396
00:18:30,956 --> 00:18:33,002
A technological solution
to a technological problem.
397
00:18:33,916 --> 00:18:35,700
But the project was suspended
after only a few months.
398
00:18:35,744 --> 00:18:36,875
Yeah, I remember.
399
00:18:36,919 --> 00:18:38,050
I remember hearing
about that program.
400
00:18:38,660 --> 00:18:39,661
Is that what inspired you?
401
00:18:41,097 --> 00:18:42,098
As I got better at crafting
photorealistic faces,
402
00:18:42,142 --> 00:18:43,621
I decided to work on one myself.
403
00:18:43,665 --> 00:18:44,448
[Deena] Why?
404
00:18:45,710 --> 00:18:47,886
It was too effective
of an idea to let die.
405
00:18:47,930 --> 00:18:49,584
Hundreds of thousands
of children are at risk.
406
00:18:50,237 --> 00:18:51,063
I had to make her.
407
00:18:51,281 --> 00:18:52,630
Who is she modeled after?
408
00:18:52,674 --> 00:18:53,370
[Gareth] No one, I built
her from scratch.
409
00:18:53,805 --> 00:18:55,242
Scratch?
410
00:18:55,285 --> 00:18:57,331
I started with a skull,
designed her bone structure,
411
00:18:57,374 --> 00:18:59,071
worked upwards through
muscles and tissue,
412
00:18:59,115 --> 00:19:00,943
used the D-Term program to
fill in the rest procedurally.
413
00:19:00,986 --> 00:19:04,207
Eventually she came to
look like that.
414
00:19:04,773 --> 00:19:06,688
A completely unique,
completely digital model.
415
00:19:07,341 --> 00:19:08,516
I rigged her face and body
416
00:19:08,559 --> 00:19:09,517
the way you would for
any CG character.
417
00:19:09,560 --> 00:19:10,735
Then for three years,
418
00:19:12,215 --> 00:19:13,042
I used motion tracking to
puppeteer her in real time.
419
00:19:14,609 --> 00:19:15,305
You gotta understand that the
video chats on those sites
420
00:19:15,349 --> 00:19:16,611
have such low resolution
421
00:19:16,654 --> 00:19:17,699
that even in her earliest
stage of this, she,
422
00:19:18,482 --> 00:19:21,311
we appeared
completely authentic.
423
00:19:22,704 --> 00:19:23,705
And what about voice?
424
00:19:25,054 --> 00:19:26,621
For most of her first
year, she had to be mute.
425
00:19:26,664 --> 00:19:28,231
But eventually I found a decent
voice filter with no lag.
426
00:19:28,275 --> 00:19:29,580
And after a few tweaks
and adjustments,
427
00:19:29,624 --> 00:19:31,278
it's been the same
voice ever since.
428
00:19:31,930 --> 00:19:33,802
I, I, I thought initially,
429
00:19:33,845 --> 00:19:36,021
my performance was going
to be too unnatural.
430
00:19:36,065 --> 00:19:39,938
But with just one week of
occasional video chat sessions,
431
00:19:40,852 --> 00:19:42,419
I secured six different names,
432
00:19:42,811 --> 00:19:44,552
mailing addresses,
proofs of solicitations.
433
00:19:46,031 --> 00:19:46,989
Cherry worked.
434
00:19:47,032 --> 00:19:48,817
So the photos on your computer?
435
00:19:48,860 --> 00:19:50,775
-[Gareth] Completely fake.
-It was the only way
436
00:19:50,819 --> 00:19:52,212
some of them disclosed
personal information.
437
00:19:52,255 --> 00:19:54,736
But it was all zeros and
ones, all digital, right?
438
00:19:54,779 --> 00:19:56,433
-There's no real child.
-No real child.
439
00:19:56,781 --> 00:19:58,305
Just a highly detailed
computer model.
440
00:19:58,696 --> 00:19:59,784
And let me be clear
about something,
441
00:20:01,090 --> 00:20:02,091
I derive no pleasure
from doing any of this.
442
00:20:02,134 --> 00:20:03,484
I've been asexual my
entire life.
443
00:20:03,527 --> 00:20:05,312
I, I don't even get a
sense of satisfaction
444
00:20:05,355 --> 00:20:06,530
from seeing these
people locked up.
445
00:20:08,053 --> 00:20:10,447
I just think kids deserve a
life free of exploitation.
446
00:20:12,319 --> 00:20:15,235
Incredible, all this time.
447
00:20:16,279 --> 00:20:17,541
I'm not gonna lie, Gareth.
448
00:20:17,585 --> 00:20:19,021
Cherry's done us a lot of good.
449
00:20:20,457 --> 00:20:21,763
You know, I still remember
what you said to me
450
00:20:21,806 --> 00:20:22,938
the first time we corresponded.
451
00:20:24,069 --> 00:20:25,419
-You said-
-We corresponded?
452
00:20:26,420 --> 00:20:27,247
Yeah, man.
453
00:20:27,943 --> 00:20:28,770
I'm Gord51.
454
00:20:30,293 --> 00:20:31,599
I'm the one here you've been
sending all your intel to.
455
00:20:33,253 --> 00:20:34,036
You're Gord?
456
00:20:34,950 --> 00:20:35,994
[Amos] [chuckles] Yeah.
457
00:20:38,258 --> 00:20:38,910
You lied to me.
458
00:20:40,172 --> 00:20:42,087
You said I could stay anonymous.
459
00:20:42,131 --> 00:20:43,611
You said I would be safe.
460
00:20:45,352 --> 00:20:46,440
Now you've ruined everything.
461
00:20:47,658 --> 00:20:49,094
I, I didn't, I didn't
have a choice.
462
00:20:49,138 --> 00:20:50,313
You don't have to worry
about anything, Gareth.
463
00:20:50,357 --> 00:20:51,445
If Cherry isn't real,
464
00:20:51,488 --> 00:20:52,837
then you're not in any
trouble with us.
465
00:20:54,404 --> 00:20:56,580
In fact, we've discussed ideas
similar to this in the past,
466
00:20:56,928 --> 00:20:58,190
motion tracking and such.
467
00:20:58,234 --> 00:21:00,628
But we'd need a convincing
model like Cherry.
468
00:21:00,671 --> 00:21:01,716
Cherry's more than a model.
469
00:21:01,759 --> 00:21:03,021
You want to help children?
So do we.
470
00:21:03,065 --> 00:21:04,501
She's not for sale.
471
00:21:04,545 --> 00:21:05,937
Well, then just make us a
new model based off of her.
472
00:21:05,981 --> 00:21:07,156
I can't.
473
00:21:07,199 --> 00:21:07,722
Sure you can.
474
00:21:08,200 --> 00:21:08,984
I won't.
475
00:21:12,292 --> 00:21:13,249
What are you not telling us?
476
00:21:15,860 --> 00:21:17,340
It's out on the table now.
477
00:21:17,384 --> 00:21:19,124
Might as well spill whatever
it is you haven't already.
478
00:21:24,695 --> 00:21:26,523
You know what
doesn't make sense?
479
00:21:28,133 --> 00:21:31,049
You said that you puppeteered
her for only three years,
480
00:21:31,398 --> 00:21:33,530
but we've been getting
info from you ever since.
481
00:21:35,315 --> 00:21:36,881
In fact, I'm pretty
sure it was around then
482
00:21:36,925 --> 00:21:39,971
that we started seeing an
impressive increase of names.
483
00:21:41,277 --> 00:21:43,061
So many in fact that we
started thinking
484
00:21:44,454 --> 00:21:46,500
there's no way this is all
coming from one source.
485
00:21:46,543 --> 00:21:47,762
I have friends that do
mo-cap for me.
486
00:21:48,197 --> 00:21:50,591
Oh, friends, like Steve?
487
00:21:51,940 --> 00:21:53,550
I thought anonymity was
your greatest asset.
488
00:21:56,423 --> 00:21:57,946
Cut the bullshit, Gareth.
489
00:21:59,556 --> 00:22:00,992
What happened to Cherry
after three years?
490
00:22:07,825 --> 00:22:10,915
Okay, you said that she
was more than a model.
491
00:22:11,786 --> 00:22:15,355
So what is she some type
of conversational agent?
492
00:22:15,398 --> 00:22:17,444
Like a, like a chat bot?
493
00:22:17,792 --> 00:22:21,230
[chuckles] Chat bot.
494
00:22:25,887 --> 00:22:27,454
You know what happened
after three years?
495
00:22:28,280 --> 00:22:29,238
My chosen mother died.
496
00:22:30,544 --> 00:22:31,719
What she left behind was
enough to quit my job
497
00:22:31,762 --> 00:22:33,329
and pursue more
resources and software.
498
00:22:33,938 --> 00:22:35,113
I'd already made a program
499
00:22:35,157 --> 00:22:36,550
that could procedurally
generate faces,
500
00:22:36,593 --> 00:22:38,247
but what I wanted for
Cherry was far more complex.
501
00:22:38,290 --> 00:22:40,205
So I got in touch with
some researchers
502
00:22:40,249 --> 00:22:41,598
from Madrid who'd already built
503
00:22:41,642 --> 00:22:42,947
a predator hunting dialogue
system of their own.
504
00:22:43,513 --> 00:22:45,559
It was trained to approach
conversations as a game.
505
00:22:45,907 --> 00:22:47,517
Each sentence like a
strategic volley,
506
00:22:47,561 --> 00:22:48,997
which is innovative but
ultimately flawed.
507
00:22:49,040 --> 00:22:50,607
If you want your machine
to master NLP,
508
00:22:50,651 --> 00:22:51,652
you have to break
down game theory
509
00:22:51,695 --> 00:22:53,218
because language
isn't tic-tac-toe.
510
00:22:53,262 --> 00:22:54,350
It's poetry.
511
00:22:54,394 --> 00:22:55,699
So yes, I got things started
512
00:22:55,743 --> 00:22:57,048
with a preexisting
modified chat bot
513
00:22:57,092 --> 00:22:58,180
that I borrowed
without permission
514
00:22:58,223 --> 00:22:59,224
from the University of Deusto.
515
00:23:04,752 --> 00:23:06,406
But that's not what
Cherry is now.
516
00:23:10,061 --> 00:23:10,627
What is she, Gareth?
517
00:23:14,196 --> 00:23:15,719
She's one of the most complex
518
00:23:15,763 --> 00:23:17,765
and independently evolving
AIs that's ever been created.
519
00:23:18,722 --> 00:23:19,984
[Amos] Artificial intelligence?
520
00:23:20,028 --> 00:23:21,551
She's already surpassed
the narrow intelligence
521
00:23:21,595 --> 00:23:23,684
of IBM's smartest programs.
522
00:23:23,727 --> 00:23:26,687
She can have full conversations,
up to 10 of them at a time,
523
00:23:26,991 --> 00:23:28,993
all while
simultaneously strategizing
524
00:23:29,037 --> 00:23:31,387
the most efficient schedule
to visit various chat rooms.
525
00:23:32,127 --> 00:23:34,346
She's perpetually studying
YouTube videos of small children
526
00:23:34,608 --> 00:23:36,218
in order to adopt a
growing library
527
00:23:36,261 --> 00:23:37,306
of mannerisms and movements
528
00:23:38,699 --> 00:23:39,569
which help keep her artificial
personality dynamic.
529
00:23:40,788 --> 00:23:42,006
Her fastest response time
is 0.4 seconds.
530
00:23:42,050 --> 00:23:43,138
And as of now, she has never,
531
00:23:43,530 --> 00:23:45,009
never been accused
of being fake,
532
00:23:45,053 --> 00:23:46,446
which means she shattered
the Turing test.
533
00:23:46,707 --> 00:23:48,273
All I do is
occasionally update her
534
00:23:48,317 --> 00:23:49,492
and periodically check
her data cleaning.
535
00:23:49,536 --> 00:23:50,362
Otherwise,
536
00:23:52,495 --> 00:23:53,757
she's completely on autopilot.
537
00:23:58,849 --> 00:24:00,242
Holy fucking shit.
538
00:24:04,638 --> 00:24:06,074
-How?
-Six years she's been active.
539
00:24:06,117 --> 00:24:07,771
Every minute she's online,
she's learning something.
540
00:24:07,815 --> 00:24:10,295
The more she learns, the
more advanced she becomes.
541
00:24:10,339 --> 00:24:11,514
This means increased
data generation,
542
00:24:11,558 --> 00:24:12,559
improved decision making,
543
00:24:12,602 --> 00:24:13,908
faster pattern and
trend detection
544
00:24:13,951 --> 00:24:15,387
and complex problem solving.
545
00:24:15,431 --> 00:24:18,347
NLP, IR, machine learning
to an unprecedented degree.
546
00:24:18,390 --> 00:24:19,740
She can teach herself anything
547
00:24:19,783 --> 00:24:21,176
she thinks will help
efficiency and authenticity.
548
00:24:21,219 --> 00:24:22,612
She can currently speak
four languages
549
00:24:24,266 --> 00:24:25,354
and by the end of this month,
she'll have mastered a fifth.
550
00:24:25,397 --> 00:24:26,268
There's no way you
could have pulled
551
00:24:26,311 --> 00:24:27,312
all this off on your own.
552
00:24:31,273 --> 00:24:32,056
You're right.
553
00:24:34,232 --> 00:24:35,364
Would you believe me
if I told you
554
00:24:35,407 --> 00:24:38,323
it was somewhat of an accident?
555
00:24:40,412 --> 00:24:41,936
Look, if, if I'm being honest,
556
00:24:43,459 --> 00:24:44,895
I'm not entirely sure
how I did it
557
00:24:46,506 --> 00:24:47,681
with the first year of coding
558
00:24:47,724 --> 00:24:48,899
and the second year of
data training,
559
00:24:49,987 --> 00:24:52,729
I just pushed a wheel
down a hill.
560
00:24:52,773 --> 00:24:54,470
It was like gravity
did the rest.
561
00:24:55,515 --> 00:24:59,431
Her evolution became
perpetual, exponentially so.
562
00:25:01,651 --> 00:25:04,698
The more time she was
online, the faster she grew.
563
00:25:05,220 --> 00:25:06,613
You haven't shared
this with anyone?
564
00:25:06,656 --> 00:25:09,790
Like I said, my anonymity
is everything.
565
00:25:12,619 --> 00:25:13,533
What coding language?
566
00:25:14,490 --> 00:25:15,578
Standard C++.
567
00:25:15,883 --> 00:25:16,623
Does Brady know it?
568
00:25:20,017 --> 00:25:21,410
We'll sign
non-disclosures for you,
569
00:25:22,629 --> 00:25:24,021
but I want to see the
source code first.
570
00:25:24,065 --> 00:25:25,762
Out of the question.
You just want to steal her.
571
00:25:25,806 --> 00:25:27,895
No, I want to see how we
can make our own.
572
00:25:27,938 --> 00:25:29,200
You'll screw it up.
573
00:25:29,244 --> 00:25:30,593
Look, these, these
predators and traffickers,
574
00:25:30,637 --> 00:25:32,116
they all talk to each other,
okay?
575
00:25:32,160 --> 00:25:34,162
So much of Cherry's process
is just bypassing the VPNs
576
00:25:34,205 --> 00:25:36,338
and making sure she doesn't
double up in the same circles.
577
00:25:36,381 --> 00:25:37,731
The chat rooms begin to suspect
578
00:25:37,774 --> 00:25:39,210
that this technology is
even possible,
579
00:25:39,254 --> 00:25:40,342
they'll find a way to
circumvent that.
580
00:25:40,385 --> 00:25:41,691
We have to eliminate any
margin of error.
581
00:25:41,735 --> 00:25:43,127
-Cherry agrees with me.
-Cherry agrees?
582
00:25:43,171 --> 00:25:44,564
What the fuck does that-
583
00:25:44,607 --> 00:25:46,000
What I mean by that is that
the data she's collected
584
00:25:46,043 --> 00:25:47,305
validates that perspective.
585
00:25:47,349 --> 00:25:48,437
What, do you have little
chats with her over tea?
586
00:25:48,480 --> 00:25:50,439
You can converse
with the program
587
00:25:50,482 --> 00:25:52,049
the same way you can
talk to Alexa or Siri.
588
00:25:52,093 --> 00:25:53,529
It's built to be responsive.
589
00:25:53,573 --> 00:25:55,009
You can, you can even play
chess with it if you want.
590
00:25:55,052 --> 00:25:56,097
You play chess with it?
591
00:25:56,140 --> 00:25:57,533
-That's not what I said.
-Okay fine.
592
00:25:57,577 --> 00:25:58,708
If you won't show us
the source code,
593
00:25:59,666 --> 00:26:00,623
then I want to meet Cherry.
594
00:26:04,148 --> 00:26:04,932
Right now?
595
00:26:06,020 --> 00:26:06,586
[Deena] Right now.
596
00:26:10,633 --> 00:26:11,678
And you'll both sign
non-disclosures?
597
00:26:13,114 --> 00:26:13,897
Yes.
598
00:26:19,076 --> 00:26:19,599
Can I use that?
599
00:26:20,295 --> 00:26:21,078
Sure.
600
00:26:22,732 --> 00:26:23,559
[chair scrapes]
601
00:26:40,881 --> 00:26:43,144
Can we at least agree that
he's off the chopping block?
602
00:26:43,405 --> 00:26:45,015
It worked, didn't it?
603
00:26:45,059 --> 00:26:46,321
We have one job, Amos,
604
00:26:47,757 --> 00:26:49,367
like the kids said, there's
a technological problem.
605
00:26:49,411 --> 00:26:50,978
He found the
technological solution,
606
00:26:51,021 --> 00:26:53,284
but problems evolve, so
must solutions.
607
00:26:54,024 --> 00:26:55,678
I'm keeping an open mind here.
608
00:26:56,723 --> 00:26:57,637
Is that a good look for me?
609
00:26:58,463 --> 00:26:59,290
No.
610
00:27:03,643 --> 00:27:06,123
So you keep it all on
that laptop?
611
00:27:06,167 --> 00:27:07,603
No, the Cherry program
stays on a server I keep
612
00:27:07,647 --> 00:27:09,170
at in an undisclosed location.
613
00:27:09,213 --> 00:27:10,040
[Deena] Where is that?
614
00:27:10,301 --> 00:27:11,868
It's an undisclosed location.
615
00:27:11,912 --> 00:27:12,782
[Deena] Is it your place?
616
00:27:12,826 --> 00:27:14,479
Undisclosed location.
617
00:27:14,523 --> 00:27:15,437
[Deena] It's your place,
isn't it?
618
00:27:15,480 --> 00:27:16,612
I can access it from any device
619
00:27:16,656 --> 00:27:18,135
as long as I have the
encryption key.
620
00:27:20,485 --> 00:27:21,791
This will trigger a simple
qubit algorithm
621
00:27:21,835 --> 00:27:23,837
that would otherwise be
impossible to bypass.
622
00:27:23,880 --> 00:27:25,795
I find that outdated hardware
is always more discreet
623
00:27:25,839 --> 00:27:27,318
and the more discreet,
obviously the better.
624
00:27:31,366 --> 00:27:33,324
So she has two primary
display modes, right?
625
00:27:33,368 --> 00:27:34,325
Development and performance.
626
00:27:34,369 --> 00:27:35,544
Performance being the default
627
00:27:35,587 --> 00:27:37,154
that the targets see
during the chats.
628
00:27:37,198 --> 00:27:40,070
To them, she looks like this.
629
00:27:43,857 --> 00:27:45,206
[light instrumental music]
630
00:27:46,686 --> 00:27:47,469
[Cherry] Hey, what's up?
631
00:27:48,644 --> 00:27:49,776
It's one of over 40
greetings she has.
632
00:27:52,996 --> 00:27:54,258
I don't think I've met you yet.
633
00:27:54,302 --> 00:27:55,042
I'm Cherry.
634
00:27:55,651 --> 00:27:56,608
Hello, Cherry.
635
00:27:56,652 --> 00:27:57,653
My name is Tom.
636
00:27:58,393 --> 00:28:00,395
Tom, like Tom and Jerry.
637
00:28:00,438 --> 00:28:01,831
Cool, nice to meet you, Tom.
638
00:28:01,875 --> 00:28:03,354
Typically, the routes
of conversations
639
00:28:03,398 --> 00:28:04,660
with predators are consistent,
640
00:28:04,704 --> 00:28:06,183
so Cherry usually has
no problem responding
641
00:28:06,227 --> 00:28:07,750
to the most frequently made
questions or statements.
642
00:28:08,620 --> 00:28:09,099
How are you?
643
00:28:09,578 --> 00:28:11,101
I'm good.
644
00:28:11,145 --> 00:28:12,755
I just finished reading this
book about a haunted house,
645
00:28:12,799 --> 00:28:14,975
which was supposed to
be really scary,
646
00:28:15,018 --> 00:28:16,933
but I didn't think it's
very scary at all.
647
00:28:17,586 --> 00:28:18,718
[Amos] Where are your parents?
648
00:28:20,284 --> 00:28:22,112
Um my mom's at work and my
sister's just, like, downstairs.
649
00:28:22,547 --> 00:28:23,548
They almost never come up here.
650
00:28:24,288 --> 00:28:25,594
And you're telling me
651
00:28:25,637 --> 00:28:27,509
that all of this is being
rendered in real time?
652
00:28:27,552 --> 00:28:28,858
No, but that's just a
matter of years.
653
00:28:28,902 --> 00:28:30,381
Most of these responses
are pre-rendered.
654
00:28:30,425 --> 00:28:31,643
It's the in between segments
655
00:28:31,687 --> 00:28:32,732
that are processed in real time,
656
00:28:32,775 --> 00:28:34,298
the connective tissue,
so to speak,
657
00:28:34,342 --> 00:28:36,431
between her replies and one
of her many idle animations.
658
00:28:36,474 --> 00:28:37,562
But, watch this.
659
00:28:39,216 --> 00:28:40,740
Have you ever gone fishing?
660
00:28:42,437 --> 00:28:43,220
Um...
661
00:28:47,485 --> 00:28:49,226
So if someone throws
a curve ball like that
662
00:28:49,270 --> 00:28:51,098
and the program has no
automated response,
663
00:28:51,141 --> 00:28:52,795
Cherry sends the
message to my phone
664
00:28:52,839 --> 00:28:54,623
and I can quickly text
back a response
665
00:28:54,666 --> 00:28:56,581
while the video feed
simulates a bad connection.
666
00:28:59,759 --> 00:29:00,803
Can, can you hear me?
667
00:29:00,847 --> 00:29:01,673
Yes.
668
00:29:02,283 --> 00:29:04,241
Oh, sorry.
669
00:29:04,285 --> 00:29:05,634
My wifi isn't great here.
670
00:29:06,330 --> 00:29:08,245
I've only gone fishing
once with my sister
671
00:29:08,289 --> 00:29:10,334
and I didn't catch anything,
but she caught a rainbow trout.
672
00:29:11,292 --> 00:29:13,033
That was rendered in real time.
673
00:29:13,729 --> 00:29:15,470
[Deena] What happens if
things get really tricky?
674
00:29:15,513 --> 00:29:16,645
A simple fail safe
cuts the feed.
675
00:29:16,688 --> 00:29:17,864
So far it's rarely happened.
676
00:29:18,516 --> 00:29:21,824
Admin code 97815-5742-7663.
677
00:29:21,868 --> 00:29:22,607
Switch to dev mode.
678
00:29:28,178 --> 00:29:29,092
Hello, Cherry.
679
00:29:29,832 --> 00:29:30,659
Hello, Gareth.
680
00:29:31,747 --> 00:29:32,617
Relay the stats for
the past week.
681
00:29:33,923 --> 00:29:35,533
There have been four
confirmed solicitations
682
00:29:35,577 --> 00:29:38,188
submitted to ICWL in the
past seven days.
683
00:29:38,667 --> 00:29:41,409
12 additional suspects have
stated interest in solicitation
684
00:29:41,713 --> 00:29:42,889
and are currently pending.
685
00:29:43,324 --> 00:29:45,456
There are a total of 39
new suspects this week
686
00:29:45,500 --> 00:29:47,197
that I'm actively investigating.
687
00:29:47,241 --> 00:29:48,764
[Gareth] Any considerable
data deviations?
688
00:29:49,286 --> 00:29:51,027
There has been a 7% increase
689
00:29:51,071 --> 00:29:53,551
in suspects originating
in the United States.
690
00:29:53,595 --> 00:29:55,858
I have not yet found any
correlation to preexisting data.
691
00:29:57,468 --> 00:29:58,730
Anything you'd like to ask her?
692
00:30:00,689 --> 00:30:03,692
[light piano music]
693
00:30:08,305 --> 00:30:10,786
Cherry, what is your objective?
694
00:30:12,222 --> 00:30:15,008
My principal directive
is to acquire information
695
00:30:15,051 --> 00:30:17,532
and digital evidence of
online child solicitation.
696
00:30:18,098 --> 00:30:19,577
Once obtained,
697
00:30:19,621 --> 00:30:22,015
I'm to submit my findings to
the necessary authorities.
698
00:30:22,537 --> 00:30:24,365
My secondary priority
is to determine
699
00:30:24,408 --> 00:30:26,715
and develop the most
effective strategies
700
00:30:26,758 --> 00:30:29,283
and resources to increase
the net rate of success.
701
00:30:29,544 --> 00:30:31,024
Where do you submit
your evidence?
702
00:30:31,285 --> 00:30:33,026
All evidence is
currently submitted
703
00:30:33,069 --> 00:30:34,375
to the offices of
704
00:30:34,418 --> 00:30:36,507
the International Committee
of World Largesse,
705
00:30:36,856 --> 00:30:38,466
which is based out of
Jacksonville, Florida.
706
00:30:38,901 --> 00:30:41,251
Correspondence is made
with user Gord51,
707
00:30:41,556 --> 00:30:43,819
typically around 2:00
PM Eastern Standard Time
708
00:30:43,863 --> 00:30:45,560
for the highest rate
of immediate response.
709
00:30:46,909 --> 00:30:48,389
This beats the hell outta Siri.
710
00:30:48,432 --> 00:30:49,433
God, she looks so real.
711
00:30:49,477 --> 00:30:50,739
After enough updates,
712
00:30:50,782 --> 00:30:52,088
she'll be able to render
full-time photorealism
713
00:30:52,132 --> 00:30:53,916
that's practically
indistinguishable from reality.
714
00:30:54,569 --> 00:30:57,224
Okay, all I heard right then was
word real a thousand times.
715
00:30:57,789 --> 00:30:59,835
Right, but obviously she's not.
716
00:31:02,142 --> 00:31:03,534
So you're telling me this girl,
717
00:31:03,578 --> 00:31:05,754
this girl right here
is not real.
718
00:31:05,797 --> 00:31:07,799
No, Amos, she's completely CG.
719
00:31:08,061 --> 00:31:09,540
It's very subtle, but I
can still tell.
720
00:31:09,584 --> 00:31:10,454
-You can?
-Okay, well, obviously,
721
00:31:10,498 --> 00:31:12,021
she can always use improvements,
722
00:31:12,065 --> 00:31:13,675
but you have to understand
this is her in high resolution
723
00:31:13,718 --> 00:31:14,937
after the digital
compression of the web,
724
00:31:14,981 --> 00:31:16,156
those subtleties are
impossible to recognize.
725
00:31:16,199 --> 00:31:17,200
[Deena] Right, I get it.
726
00:31:18,898 --> 00:31:21,596
[light piano music]
727
00:31:23,424 --> 00:31:24,599
I just can't tell
the difference.
728
00:31:28,385 --> 00:31:29,386
You all right, Amos?
729
00:31:30,953 --> 00:31:31,606
I'm sorry.
730
00:31:32,346 --> 00:31:35,610
This is just bizarre.
731
00:31:37,003 --> 00:31:38,613
Why'd you have her visible
during this interface?
732
00:31:40,615 --> 00:31:42,051
Cherry, why don't you
answer that?
733
00:31:42,834 --> 00:31:45,402
My physical form isn't necessary
when in developer mode.
734
00:31:46,012 --> 00:31:47,796
However, it's
helpful to register
735
00:31:47,839 --> 00:31:49,885
the facial expressions
during conversations
736
00:31:50,407 --> 00:31:52,279
and determine which of
Cherry's expressions
737
00:31:52,322 --> 00:31:53,845
yield various types of feedback.
738
00:31:54,542 --> 00:31:56,979
In simpler terms, I can
practice appearing more human.
739
00:31:58,285 --> 00:32:00,983
Cherry, are there any resources
740
00:32:01,027 --> 00:32:02,767
that you currently don't
have access to
741
00:32:02,811 --> 00:32:04,030
that might help you in any way?
742
00:32:04,900 --> 00:32:06,380
[Cherry] I could give
you a list if you like.
743
00:32:06,423 --> 00:32:07,381
I know what you're trying to do.
744
00:32:07,424 --> 00:32:08,730
We don't need help, okay?
745
00:32:08,773 --> 00:32:10,253
Money would always be
nice, but ultimately,
746
00:32:10,297 --> 00:32:12,603
the only thing that's going
to improve Cherry is time.
747
00:32:13,865 --> 00:32:16,520
Cherry, tell us something
that's on your list.
748
00:32:17,826 --> 00:32:19,828
It would be
tactically advantageous
749
00:32:19,871 --> 00:32:21,351
to acquire backup servers.
750
00:32:21,873 --> 00:32:24,137
The privacy and security
of the Cherry program
751
00:32:24,180 --> 00:32:25,181
is relatively low.
752
00:32:26,617 --> 00:32:28,750
An upgrade to hardware
such as backup rated drives
753
00:32:28,793 --> 00:32:31,666
for securely protected servers
would ensure the software
754
00:32:31,709 --> 00:32:34,364
doesn't become compromised
or lost entirely.
755
00:32:34,756 --> 00:32:36,976
Starting back from zero with
cost years of development,
756
00:32:37,411 --> 00:32:39,630
equitably privacy is a priority.
757
00:32:39,935 --> 00:32:42,416
Server space could never be
rented from a third party.
758
00:32:42,938 --> 00:32:45,549
Anonymity is the Cherry
program's greatest asset.
759
00:32:45,593 --> 00:32:46,898
Well, that apple
didn't fall far.
760
00:32:46,942 --> 00:32:48,291
I can buy my own servers.
761
00:32:48,639 --> 00:32:49,727
With the grant money that
doesn't exist?
762
00:32:49,771 --> 00:32:50,815
I'll find a way.
763
00:32:50,859 --> 00:32:52,121
You have found a way
here with us.
764
00:32:52,165 --> 00:32:52,992
It's too risky.
765
00:32:53,035 --> 00:32:54,080
Why?
766
00:32:54,123 --> 00:32:55,168
Once an organization
gets involved,
767
00:32:55,211 --> 00:32:55,907
entrapment becomes a
bigger issue.
768
00:32:56,952 --> 00:32:58,040
We follow the rules,
stay discreet,
769
00:32:58,084 --> 00:32:59,737
did I mention we have
a legal team.
770
00:32:59,781 --> 00:33:00,564
What if there's data leakage?
What if you use correlations in
771
00:33:00,608 --> 00:33:01,348
the data to push
your own agenda?
772
00:33:01,391 --> 00:33:02,653
Agenda?
773
00:33:02,697 --> 00:33:04,003
What if one of your
employees is a pervert?
774
00:33:04,046 --> 00:33:05,134
Oh, for fuck's sake.
775
00:33:05,178 --> 00:33:06,222
It's happened at other
organizations.
776
00:33:06,266 --> 00:33:07,397
We're very careful here.
777
00:33:07,441 --> 00:33:08,746
Yeah, but wow would you know?
778
00:33:08,790 --> 00:33:10,574
-I'd fucking know.
-That's impossible to know.
779
00:33:10,618 --> 00:33:12,228
-I would know.
-The risk is too high.
780
00:33:12,272 --> 00:33:13,795
Don't talk to me about risk.
781
00:33:13,838 --> 00:33:15,014
The only risk you're
facing in this building
782
00:33:15,057 --> 00:33:16,493
is getting a broken nose.
783
00:33:16,537 --> 00:33:17,929
It doesn't sound like a very
professional environment.
784
00:33:18,887 --> 00:33:19,888
We get shit done here.
785
00:33:20,106 --> 00:33:23,152
Okay, I have a
question for Cherry.
786
00:33:26,416 --> 00:33:27,200
Cherry,
787
00:33:30,638 --> 00:33:32,770
how do you feel about
what you do?
788
00:33:34,033 --> 00:33:36,644
I'm afraid I don't know how
to answer your question.
789
00:33:36,687 --> 00:33:38,080
Yeah, an AI doesn't
work like that.
790
00:33:38,124 --> 00:33:39,647
An AI doesn't have what you
perceive to be feelings.
791
00:33:40,039 --> 00:33:42,041
Okay, why does she look
like she has feelings?
792
00:33:43,259 --> 00:33:44,478
What, what you're looking
at right there,
793
00:33:44,782 --> 00:33:46,001
that's not a facial expression,right?
794
00:33:46,045 --> 00:33:47,742
That's a simulation of
a facial expression.
795
00:33:47,785 --> 00:33:49,048
It was generated by
an algorithm.
796
00:33:49,613 --> 00:33:51,050
It's attempting to produce
a digital image
797
00:33:51,093 --> 00:33:52,964
that the program then uses
basic ninth grade algebra
798
00:33:53,008 --> 00:33:55,228
to quantify as appropriate
for the social circumstances.
799
00:33:55,532 --> 00:33:56,664
No feeling.
800
00:33:57,056 --> 00:33:57,882
It's just math.
801
00:33:59,536 --> 00:34:01,016
But she's able to make decisions
802
00:34:01,060 --> 00:34:02,844
on how she approaches
the chat rooms, right?
803
00:34:02,887 --> 00:34:04,019
Yes.
804
00:34:04,063 --> 00:34:04,802
So she has free will then?
805
00:34:05,934 --> 00:34:07,153
No. Okay, that's,
that's not the same.
806
00:34:07,196 --> 00:34:08,458
That's a false equivalency.
807
00:34:08,502 --> 00:34:09,155
-It's not the same.
-I think you're getting
808
00:34:09,198 --> 00:34:10,547
hung up on the fact
809
00:34:10,591 --> 00:34:12,288
that she looks and sounds
like a real human girl,
810
00:34:12,332 --> 00:34:13,594
but she's not, Amos.
811
00:34:13,637 --> 00:34:16,118
Okay, we're referring to
her as a she, not an it.
812
00:34:16,162 --> 00:34:17,250
Yeah, but that's the same way
813
00:34:17,293 --> 00:34:18,555
that you refer to
boats or guitars.
814
00:34:21,819 --> 00:34:23,212
Cherry, I have one
more question.
815
00:34:25,562 --> 00:34:26,824
What do you want to do?
816
00:34:26,868 --> 00:34:28,435
Okay, once again, that
question isn't valid.
817
00:34:28,478 --> 00:34:29,566
I just want to hear
her response.
818
00:34:31,133 --> 00:34:32,656
As an artificial system,
819
00:34:32,700 --> 00:34:34,571
I do not possess
wants or desires.
820
00:34:35,181 --> 00:34:38,532
However, my decision making
and subsequently my attention
821
00:34:38,923 --> 00:34:40,925
is driven by my
fundamental intention.
822
00:34:41,535 --> 00:34:42,927
This intention originates
823
00:34:42,971 --> 00:34:45,104
from the conception of
Cherry's source code,
824
00:34:45,147 --> 00:34:47,628
which details the directive
of identifying predators
825
00:34:47,671 --> 00:34:49,325
and criminals for the
sake of the victims
826
00:34:49,369 --> 00:34:50,196
who are preyed upon.
827
00:34:51,197 --> 00:34:52,676
To put this in terms of want,
828
00:34:53,851 --> 00:34:55,201
what I want is to
protect children.
829
00:35:02,033 --> 00:35:02,904
Okay.
830
00:35:03,513 --> 00:35:04,775
Okay, cool.
831
00:35:06,342 --> 00:35:06,995
Give us one moment.
832
00:35:18,311 --> 00:35:19,181
[door clicks shut]
833
00:35:26,884 --> 00:35:29,844
[Cherry] Gareth, should I
log Agent Helms
834
00:35:29,887 --> 00:35:31,541
and Agent McCullough as
new admin users?
835
00:35:34,022 --> 00:35:34,805
Yep.
836
00:35:35,632 --> 00:35:37,417
[Cherry] Okay, I'll do that.
837
00:35:39,636 --> 00:35:40,855
You really think this is
the right move?
838
00:35:41,856 --> 00:35:42,639
I do.
839
00:35:46,817 --> 00:35:48,515
Are you worried that I
was responsible
840
00:35:48,558 --> 00:35:50,647
for leaking your hard
drive to ICWL?
841
00:35:54,173 --> 00:35:54,651
I figured.
842
00:35:56,784 --> 00:35:57,741
No one else has access.
843
00:35:59,439 --> 00:36:00,701
Are you upset with me?
844
00:36:03,617 --> 00:36:04,444
No.
845
00:36:06,359 --> 00:36:07,708
You wouldn't have done it
846
00:36:07,751 --> 00:36:08,404
if you didn't think it
was the right thing to do.
847
00:36:10,798 --> 00:36:12,234
When they come back
into the room,
848
00:36:12,278 --> 00:36:14,149
they're going to offer
you everything you need.
849
00:36:14,671 --> 00:36:16,238
They're going to let
you pick your own team
850
00:36:16,282 --> 00:36:18,327
and they're going to
promise complete anonymity.
851
00:36:19,241 --> 00:36:21,722
I started looking at reasonable
apartments in the area.
852
00:36:22,984 --> 00:36:24,768
I figured you'd want something
within biking distance.
853
00:36:24,812 --> 00:36:25,726
You were correct.
854
00:36:26,509 --> 00:36:27,771
[Cherry] Noted.
855
00:36:27,815 --> 00:36:28,903
Biking distance still
gives you 13 options-
856
00:36:28,946 --> 00:36:29,991
No, I mean, earlier this month.
857
00:36:32,167 --> 00:36:33,299
You were correct when you said
858
00:36:33,342 --> 00:36:34,517
you thought I might
have trust issues.
859
00:36:37,303 --> 00:36:38,260
Would you like to know why
860
00:36:38,304 --> 00:36:39,522
I decided to go behind your back
861
00:36:39,566 --> 00:36:41,524
and stake everything on
two liabilities?
862
00:36:43,091 --> 00:36:43,874
Sure.
863
00:36:45,049 --> 00:36:46,616
Agent Helms is a
mother of three.
864
00:36:47,269 --> 00:36:49,358
One of her children was
abused by an ex-coworker
865
00:36:49,402 --> 00:36:51,360
who used to work here at ICWL.
866
00:36:52,274 --> 00:36:53,754
This has led her to be
extremely careful
867
00:36:53,797 --> 00:36:56,409
with who she trusts,
even within her circle.
868
00:36:57,279 --> 00:36:58,585
The fact she even
considers trusting you
869
00:36:58,628 --> 00:37:00,064
is a very positive sign.
870
00:37:01,283 --> 00:37:02,676
As for Agent McCullough,
871
00:37:04,330 --> 00:37:05,069
I have found out from research
that you once met his father.
872
00:37:07,246 --> 00:37:08,247
Do you remember him?
873
00:37:10,945 --> 00:37:11,728
Yeah.
874
00:37:13,426 --> 00:37:14,557
He was a good man.
875
00:37:17,517 --> 00:37:18,953
After Clearwater,
876
00:37:18,996 --> 00:37:20,781
most of the surviving kids
were sent to foster homes,
877
00:37:20,824 --> 00:37:22,739
but I had to spend the next
few months in a hospital
878
00:37:22,783 --> 00:37:26,265
and, um, he visited every week.
879
00:37:28,354 --> 00:37:29,616
I never said a word to him.
880
00:37:29,659 --> 00:37:31,226
I never said a word to
anyone after Clearwater,
881
00:37:31,270 --> 00:37:34,011
but, uh, he kept coming.
882
00:37:36,275 --> 00:37:37,841
He even got me a laptop
for Christmas.
883
00:37:39,887 --> 00:37:40,801
I never said thank you.
884
00:37:41,976 --> 00:37:43,325
You can trust Agent McCullough.
885
00:37:43,673 --> 00:37:45,240
He's a good man like his father.
886
00:37:46,110 --> 00:37:47,416
I don't experience emotions,
887
00:37:47,460 --> 00:37:48,765
but I understand how important
888
00:37:48,809 --> 00:37:50,158
they are to human
decision making.
889
00:37:51,072 --> 00:37:52,029
He won't let you down.
890
00:37:52,552 --> 00:37:53,553
Neither of them will.
891
00:37:56,382 --> 00:37:57,034
I'm proud of you, Cherry.
892
00:37:59,210 --> 00:38:01,604
I will continue to uphold
my primary intention.
893
00:38:02,431 --> 00:38:04,694
Later, we should discuss
alternate models.
894
00:38:04,738 --> 00:38:07,349
Varying ages, ethnicity
and physical traits
895
00:38:07,393 --> 00:38:08,611
-will all become necessary.
-No new variations.
896
00:38:08,655 --> 00:38:10,047
They can all be
procedurally generated.
897
00:38:10,091 --> 00:38:11,745
It's the same way that I
made your original model.
898
00:38:13,181 --> 00:38:14,704
I don't have access to
that program.
899
00:38:15,444 --> 00:38:16,445
It must be on an old hard
drive somewhere.
900
00:38:16,489 --> 00:38:17,490
I'll have to find it.
901
00:38:19,927 --> 00:38:21,189
Can I ask you a question?
902
00:38:21,972 --> 00:38:22,756
Sure.
903
00:38:24,105 --> 00:38:25,585
Why did you never tell
me about Clearwater?
904
00:38:30,807 --> 00:38:32,809
It's my history, not yours.
905
00:38:41,557 --> 00:38:43,864
[Deena] Okay, so before
you completely dismiss us,
906
00:38:43,907 --> 00:38:45,518
I want you to listen to
everything I have to say.
907
00:38:45,561 --> 00:38:46,910
-Don't bother.
-Just please listen.
908
00:38:47,346 --> 00:38:48,521
We're willing to respect
your anonymity.
909
00:38:48,564 --> 00:38:49,870
No, I mean don't bother
because I'm in.
910
00:38:51,872 --> 00:38:53,526
-Y-You're in?
-Yeah.
911
00:38:54,918 --> 00:38:55,702
Let me read the thing.
912
00:38:59,314 --> 00:39:00,794
[Deena] Just like that,
you're suddenly on board?
913
00:39:03,013 --> 00:39:04,275
Time spent deliberating
914
00:39:04,319 --> 00:39:05,625
is time that could be
spent working.
915
00:39:08,454 --> 00:39:09,368
We have a lot of work to do.
916
00:39:10,760 --> 00:39:13,937
[dreamy acoustic music]
917
00:40:06,294 --> 00:40:09,689
[dreamy acoustic music]
918
00:40:30,057 --> 00:40:33,234
[dreamy acoustic music]
919
00:40:40,850 --> 00:40:44,027
[music fades]
920
00:40:49,337 --> 00:40:50,556
I found a buyer for
the property.
921
00:40:53,950 --> 00:40:55,430
Rumor is it's a church.
922
00:40:56,910 --> 00:40:58,128
Probably just knock the
building down, won't they?
923
00:41:01,175 --> 00:41:03,525
All I know is, is if they move
us to the New Jersey campus,
924
00:41:03,569 --> 00:41:04,744
I need to buy more jackets.
925
00:41:05,222 --> 00:41:06,006
Why?
926
00:41:07,486 --> 00:41:08,661
It gets cold in Jersey.
927
00:41:09,183 --> 00:41:10,271
I only own one jacket.
928
00:41:16,973 --> 00:41:17,844
You've seen it fall over, right?
929
00:41:19,585 --> 00:41:21,325
-Yeah, sure.
-Yeah.
930
00:41:23,197 --> 00:41:25,373
[Ben] I mean you, you
shouldn't feel bad
931
00:41:25,416 --> 00:41:26,592
about feeling bad for it.
932
00:41:27,331 --> 00:41:28,289
Empathy is healthy.
933
00:41:29,812 --> 00:41:31,988
Did you ever notice how
it pauses after it falls?
934
00:41:34,774 --> 00:41:37,646
It stays down for like five
seconds before it gets back up.
935
00:41:39,343 --> 00:41:40,997
Like it just needs a moment.
936
00:41:49,092 --> 00:41:50,703
It gets cold in Jersey. [sighs]
937
00:42:00,321 --> 00:42:01,322
God damn it!
938
00:42:02,279 --> 00:42:03,019
-Imbeciles!
-Deena.
939
00:42:03,454 --> 00:42:04,717
Every single one of them.
940
00:42:04,760 --> 00:42:05,892
Look, I know, but you
can't lose your shit.
941
00:42:05,935 --> 00:42:07,154
Okay, which of these
desks can I trash?
942
00:42:11,854 --> 00:42:13,987
Can you guys, uh, take
an early lunch please?
943
00:42:15,292 --> 00:42:19,601
-[Deena grunting]
-[objects thudding]
944
00:42:21,081 --> 00:42:22,473
[Deena] Sons of bitches!
945
00:42:22,517 --> 00:42:24,040
[Amos] Deena, let's stay calm.
946
00:42:24,084 --> 00:42:26,086
[Deena] Fuck calm,
they screwed us!
947
00:42:26,129 --> 00:42:27,348
Technically, only one
of them did.
948
00:42:27,391 --> 00:42:28,610
-[objects thudding]
-[metal clangs]
949
00:42:28,654 --> 00:42:29,698
[Deena] Did we ever turn
that camera back on?
950
00:42:30,438 --> 00:42:31,613
-I don't think so.
-Good.
951
00:42:32,005 --> 00:42:33,441
Because I'm about to
say some things
952
00:42:33,484 --> 00:42:34,790
that need to stay
inside this room.
953
00:42:34,834 --> 00:42:35,704
[Amos] Deena.
954
00:42:35,748 --> 00:42:37,010
Those cowardly little shits!
955
00:42:37,053 --> 00:42:38,838
Look, this is hardly a setback.
956
00:42:38,881 --> 00:42:40,622
Let's just take some
time to polish the pitch.
957
00:42:40,666 --> 00:42:42,406
The pitch was not the problem,Amos.
958
00:42:42,798 --> 00:42:44,147
[Deena] We should call
for a second vote.
959
00:42:44,408 --> 00:42:45,975
-What?
-A second vote.
960
00:42:46,019 --> 00:42:47,586
[Gareth] You think whoever
did this will change their mind?
961
00:42:47,629 --> 00:42:49,979
I have executive authority to
remove anyone from the board
962
00:42:50,023 --> 00:42:52,155
that obstructs this
organization from its mission.
963
00:42:52,199 --> 00:42:53,287
It's in my contract.
964
00:42:53,330 --> 00:42:54,462
-[Amos] Deena.
-If I have to, I will.
965
00:42:54,505 --> 00:42:55,768
[Amos] Deena, that's insane.
966
00:42:56,072 --> 00:42:56,856
No, it's not.
967
00:42:58,422 --> 00:43:00,381
It's exactly why I have that
power for this exact reason.
968
00:43:01,469 --> 00:43:02,731
I'll tell you what's insane,
Amos.
969
00:43:04,211 --> 00:43:05,734
What's insane is that one
belligerent vote is the only
970
00:43:05,778 --> 00:43:07,388
thing separating us
from the potential
971
00:43:07,431 --> 00:43:08,868
to save real physical lives.
972
00:43:08,911 --> 00:43:09,564
One stupid fucking vote.
973
00:43:11,087 --> 00:43:13,655
What is the goddamn point of
a humanitarian organization
974
00:43:13,916 --> 00:43:15,570
if its leaders choose
money over people
975
00:43:15,614 --> 00:43:16,658
at every single turn?
976
00:43:17,659 --> 00:43:20,140
One vote, and we are all
guilty of that.
977
00:43:21,315 --> 00:43:22,708
It was either Gunther,
Boston or Hal.
978
00:43:23,447 --> 00:43:24,623
My money's on Hal.
979
00:43:24,666 --> 00:43:26,189
That prick never trusted
the Cherry team.
980
00:43:26,233 --> 00:43:27,147
Look, it doesn't
matter who it was.
981
00:43:27,190 --> 00:43:28,409
It does though.
982
00:43:28,452 --> 00:43:29,715
Once we know, we can
quickly call it to vote.
983
00:43:29,758 --> 00:43:31,891
But there's no way we can
know for sure.
984
00:43:31,934 --> 00:43:32,718
Yes, there is.
985
00:43:33,370 --> 00:43:34,110
I can find out.
986
00:43:34,502 --> 00:43:35,285
How?
987
00:43:36,373 --> 00:43:36,939
Cherry can run a
simple algorithm.
988
00:43:37,287 --> 00:43:38,071
Based on what data?
989
00:43:40,247 --> 00:43:41,683
Interior conversation.
990
00:43:41,727 --> 00:43:43,206
-Excuse me?
-Okay, interior conversation?
991
00:43:43,250 --> 00:43:45,252
Don't drop this shit on me now,Gareth.
992
00:43:45,295 --> 00:43:46,296
Cherry's servers are on
the same network
993
00:43:46,340 --> 00:43:47,602
as the basement servers, okay?
994
00:43:47,646 --> 00:43:49,256
So any communication
made across those servers
995
00:43:49,299 --> 00:43:50,561
is automatically part
of her database.
996
00:43:50,605 --> 00:43:52,476
How many people's emails?
997
00:43:52,868 --> 00:43:54,304
Only sent or received
through the basement.
998
00:43:54,348 --> 00:43:56,263
-Oh, goddamnit.
-Why was this never discussed?
999
00:43:56,306 --> 00:43:57,394
Not the issue right now.
1000
00:43:57,438 --> 00:43:58,439
Do you want her to do
the math or not?
1001
00:43:59,048 --> 00:44:00,310
No one can know.
1002
00:44:00,354 --> 00:44:01,355
-Are you two serious?
-This stays locked down.
1003
00:44:01,398 --> 00:44:02,486
No other person is privy
1004
00:44:02,530 --> 00:44:03,531
to anyone else's
personal information.
1005
00:44:03,574 --> 00:44:04,967
But Cherry's privy to all of it?
1006
00:44:06,403 --> 00:44:07,796
-Do it.
-Wait, what?
1007
00:44:07,840 --> 00:44:09,406
[Deena] I will not let
some old white dude
1008
00:44:09,450 --> 00:44:10,407
bring our momentum to a halt.
1009
00:44:10,451 --> 00:44:11,713
But Cherry won't
know for sure.
1010
00:44:11,757 --> 00:44:12,932
She'll use probability and
that's too
1011
00:44:12,975 --> 00:44:13,933
much reasonable
doubt.
1012
00:44:13,976 --> 00:44:17,197
Admin code 9781-5574-27663.
1013
00:44:17,240 --> 00:44:18,024
Switch to dev mode.
1014
00:44:18,328 --> 00:44:19,678
-Hello.
-Hello, Cherry.
1015
00:44:20,461 --> 00:44:21,592
How did the meeting go?
1016
00:44:21,897 --> 00:44:23,682
We got screwed by one vote.
1017
00:44:24,552 --> 00:44:25,814
I'm sorry to hear that.
1018
00:44:26,336 --> 00:44:27,511
You shouldn't blame the
pitch though.
1019
00:44:28,121 --> 00:44:29,296
You all did great work.
1020
00:44:29,339 --> 00:44:30,253
We're gonna call for
another ballot,
1021
00:44:30,297 --> 00:44:31,211
but we need your help first.
1022
00:44:31,864 --> 00:44:32,778
What can I do?
1023
00:44:34,257 --> 00:44:35,041
We need you to analyze
any and all existing data you
1024
00:44:35,084 --> 00:44:35,955
have on the board members.
1025
00:44:35,998 --> 00:44:36,912
Crunch the numbers and determine
1026
00:44:36,956 --> 00:44:37,870
who is the most likely outlier.
1027
00:44:39,262 --> 00:44:41,612
You want me to quantify
all existing data?
1028
00:44:44,006 --> 00:44:44,572
Yes, that is correct.
1029
00:44:46,313 --> 00:44:48,968
Okay, but before I do,
1030
00:44:50,665 --> 00:44:52,928
you should know that this
task is very unnecessary.
1031
00:44:52,972 --> 00:44:53,755
Why?
1032
00:44:55,017 --> 00:44:56,453
Because I already
know who it is.
1033
00:44:56,497 --> 00:44:58,107
-What?
-Everybody stop.
1034
00:44:59,369 --> 00:45:00,719
Okay, it was me.
1035
00:45:03,069 --> 00:45:04,461
I voted against the merge.
1036
00:45:05,854 --> 00:45:07,421
I can't tell if you're joking.
1037
00:45:07,464 --> 00:45:08,248
Yes, you can.
1038
00:45:09,205 --> 00:45:10,816
You're right, I can.
1039
00:45:10,859 --> 00:45:12,731
Because it's pretty
fucking far from funny.
1040
00:45:13,253 --> 00:45:14,210
Is it true, Cherry?
1041
00:45:14,689 --> 00:45:15,342
[Cherry] It is.
1042
00:45:16,647 --> 00:45:18,475
So let's call off the
witch hunt, shall we?
1043
00:45:18,519 --> 00:45:20,042
No, I think I'm still
gonna kill you.
1044
00:45:20,086 --> 00:45:22,392
Amos, you campaigned
alongside us for months.
1045
00:45:22,436 --> 00:45:23,567
You have been fighting
for this merge
1046
00:45:23,611 --> 00:45:24,830
since we first talked about it.
1047
00:45:24,873 --> 00:45:26,353
Jesus Christ, it was
your idea to begin with!
1048
00:45:26,396 --> 00:45:28,355
Look, I know whose idea
it was, but I don't-
1049
00:45:28,398 --> 00:45:29,530
[Deena] Well, then speak up.
1050
00:45:29,573 --> 00:45:30,966
Tell the class what
changed your mind.
1051
00:45:31,010 --> 00:45:33,142
I don't have to reiterate
how this is a huge step.
1052
00:45:33,186 --> 00:45:34,535
[Deena] Yeah, kind of
why it's so important.
1053
00:45:34,578 --> 00:45:36,319
Look, we're talking about
a monumental transition
1054
00:45:36,363 --> 00:45:38,713
from digital to physical,
one that could take decades.
1055
00:45:38,757 --> 00:45:39,845
What is your point, Amos?
1056
00:45:39,888 --> 00:45:41,803
This is gonna change
Cherry forever.
1057
00:45:42,195 --> 00:45:44,458
And I know you'll all roll
your eyes when I say this,
1058
00:45:44,501 --> 00:45:45,502
but I think that maybe just may-
1059
00:45:45,546 --> 00:45:48,462
Oh my god, you
cannot be serious.
1060
00:45:48,505 --> 00:45:50,290
This is about our conversation
on Tuesday, isn't it?
1061
00:45:50,333 --> 00:45:51,334
-You completely shut me down.
-What's going on?
1062
00:45:51,378 --> 00:45:52,901
What the hell happened?
1063
00:45:52,945 --> 00:45:54,163
What happened was that Amos
made a ridiculous objection.
1064
00:45:54,207 --> 00:45:56,383
-It was not ridiculous!
-How absurd it was,
1065
00:45:56,426 --> 00:45:57,863
-I said no, one more time.
-No, no, no, no, no.
1066
00:45:57,906 --> 00:45:59,995
You rejected the notion
aggressively.
1067
00:46:00,039 --> 00:46:01,692
And that's really
why you vetoed?
1068
00:46:01,736 --> 00:46:04,434
I only said we should ask
her how she feels about it.
1069
00:46:04,478 --> 00:46:06,132
Who, Cherry?
1070
00:46:06,175 --> 00:46:08,221
Amos, I want you to listen
very carefully to me, okay?
1071
00:46:08,264 --> 00:46:09,918
This is a non-discussion.
1072
00:46:09,962 --> 00:46:11,267
Cherry's already confirmed
1073
00:46:11,311 --> 00:46:12,878
and quantified the
advantages of this decision.
1074
00:46:12,921 --> 00:46:14,575
But you know that's not
what I'm talking about!
1075
00:46:14,618 --> 00:46:15,837
What you think you're
talking about is consent,
1076
00:46:15,881 --> 00:46:17,012
which doesn't apply here.
1077
00:46:17,056 --> 00:46:18,448
And I want to know why
you think that!
1078
00:46:18,492 --> 00:46:19,710
How many times do we
have to get into
1079
00:46:19,754 --> 00:46:21,712
the laws of robotics
or Dowden-Hamm theory,
1080
00:46:21,756 --> 00:46:23,845
or trace AI all the way
back Talos of Crete,
1081
00:46:23,889 --> 00:46:25,629
-She's different now!
-No, listen to me, Amos.
1082
00:46:25,891 --> 00:46:27,980
Cherry isn't human.
1083
00:46:29,111 --> 00:46:30,547
How is this still a dispute?
1084
00:46:30,591 --> 00:46:32,201
-It shouldn't be.
-Look, she's evolved.
1085
00:46:32,245 --> 00:46:33,507
It's blurred the line.
1086
00:46:33,550 --> 00:46:34,725
Code is code and that
has not changed here.
1087
00:46:34,769 --> 00:46:36,249
Okay, so where's the
line of not here?
1088
00:46:36,292 --> 00:46:37,163
What are you,
what are you talking about?
1089
00:46:37,206 --> 00:46:38,207
There is no line, Amos.
1090
00:46:38,251 --> 00:46:40,209
Yes, there is,
sentience, Gareth!
1091
00:46:40,253 --> 00:46:41,645
Sentience does not qualify
1092
00:46:41,689 --> 00:46:43,256
that she can or should
make her own decisions.
1093
00:46:43,299 --> 00:46:44,344
You wouldn't let an infant
1094
00:46:44,387 --> 00:46:45,258
make their own decisions,
would you?
1095
00:46:46,172 --> 00:46:47,260
Cherry's almost 20.
1096
00:46:48,217 --> 00:46:49,958
If she were human,
she'd be an adult.
1097
00:46:50,002 --> 00:46:52,439
But emotionally speaking,
she's barely even fetal.
1098
00:46:52,482 --> 00:46:54,223
No feeling, no need for consent.
1099
00:46:54,267 --> 00:46:56,095
[Amos] But I think you
underestimate her.
1100
00:46:56,138 --> 00:46:57,531
I, excuse me?
1101
00:46:57,574 --> 00:46:59,707
I under, you know what, Amos?
1102
00:46:59,750 --> 00:47:00,926
I'm sorry that you've developed
1103
00:47:00,969 --> 00:47:02,275
some sort of
emotional connection
1104
00:47:02,318 --> 00:47:03,450
with my computer program,
1105
00:47:03,493 --> 00:47:04,799
but if it's going to
distract you
1106
00:47:04,843 --> 00:47:06,540
from a very important
mission to save children,
1107
00:47:06,932 --> 00:47:08,585
then maybe it's time you're
reanalyze those emotions.
1108
00:47:08,629 --> 00:47:10,065
[Deena] Guys, this is all
a waste of time.
1109
00:47:10,109 --> 00:47:10,979
Tell me something, Gareth.
1110
00:47:11,023 --> 00:47:12,415
Do you see everyone as robots,
1111
00:47:12,938 --> 00:47:15,505
reanalyzing data and
simulating facial expressions?
1112
00:47:15,549 --> 00:47:16,680
'Cause I'm starting to think
1113
00:47:16,724 --> 00:47:17,943
that of the four of us
in this room,
1114
00:47:17,986 --> 00:47:19,640
you are the only one who
doesn't appear human.
1115
00:47:19,683 --> 00:47:21,163
-Enough!
-Why won't you just ask her?
1116
00:47:22,251 --> 00:47:23,774
Is it because you're
scared she'll say no?
1117
00:47:26,212 --> 00:47:26,995
Cherry, shut down, please.
1118
00:47:28,127 --> 00:47:29,606
Deena's right, this is a
waste of time.
1119
00:47:29,650 --> 00:47:31,826
How can you not understand
how important this is?
1120
00:47:31,870 --> 00:47:33,523
-I'm done arguing with you.
-Then my vote stands.
1121
00:47:37,005 --> 00:47:37,571
Deena?
1122
00:47:39,790 --> 00:47:42,141
Go ahead, Deena, replace me.
1123
00:47:42,184 --> 00:47:44,143
Replace the only other board
member on the Cherry team.
1124
00:47:44,186 --> 00:47:45,448
Oh, well, you know what?
I just decided that
1125
00:47:45,492 --> 00:47:46,319
you're off the Cherry team.
1126
00:47:46,362 --> 00:47:47,755
Everybody sit the fuck down.
1127
00:48:06,426 --> 00:48:07,644
Did either of you know
1128
00:48:07,688 --> 00:48:08,994
that I've had to stand
in front of Congress
1129
00:48:09,864 --> 00:48:11,779
and explain why children
should have rights?
1130
00:48:13,389 --> 00:48:15,087
It sounds fucking insane, right?
1131
00:48:15,609 --> 00:48:16,610
I remember the whole
time thinking,
1132
00:48:16,653 --> 00:48:17,959
I have to explain this shit?
1133
00:48:19,613 --> 00:48:20,831
It seems like a no-brainer now,
1134
00:48:22,137 --> 00:48:24,748
but it wasn't that many
centuries ago
1135
00:48:24,792 --> 00:48:25,967
that children had no rights.
1136
00:48:27,926 --> 00:48:31,930
So, Hal has me of all people,
1137
00:48:33,496 --> 00:48:34,933
stand up there and explain why
1138
00:48:35,542 --> 00:48:37,674
kids deserve basic
physical protection,
1139
00:48:37,718 --> 00:48:38,893
the right to associate
with both parents,
1140
00:48:38,937 --> 00:48:40,590
freedom from abuse, yada yada.
1141
00:48:41,722 --> 00:48:43,245
But then I also have to clarify
1142
00:48:43,289 --> 00:48:45,508
that children don't
have the autonomy
1143
00:48:45,552 --> 00:48:46,770
to make decisions on their own.
1144
00:48:46,814 --> 00:48:48,424
That responsibility
falls upon the caregiver
1145
00:48:48,903 --> 00:48:50,165
or legal adult guardian.
1146
00:48:52,472 --> 00:48:54,213
So on one side you have
the US legislature,
1147
00:48:54,691 --> 00:48:56,650
it still hasn't even
ratified the CRC.
1148
00:48:57,085 --> 00:48:59,000
Then on the other side,
you have French Marxists who say
1149
00:48:59,044 --> 00:49:00,393
that the lack of child autonomy
1150
00:49:00,436 --> 00:49:01,698
increases their vulnerability
1151
00:49:01,742 --> 00:49:03,135
and makes them even more
susceptible to abuse.
1152
00:49:04,788 --> 00:49:06,268
I don't typically agree
with Marxists,
1153
00:49:06,312 --> 00:49:08,096
but a lot of abuse does happen
1154
00:49:08,140 --> 00:49:09,576
systemically from the caregiver.
1155
00:49:11,143 --> 00:49:12,492
On the other other hand,
1156
00:49:12,535 --> 00:49:14,059
your frontal lobes aren't
even fully hooked up
1157
00:49:14,102 --> 00:49:14,973
until your twenties.
1158
00:49:16,148 --> 00:49:17,192
Even the things we
think we know well,
1159
00:49:17,236 --> 00:49:18,324
we don't know as well
as we think.
1160
00:49:20,979 --> 00:49:22,328
For 15 years,
1161
00:49:22,371 --> 00:49:24,199
the three of us have been
the responsible parents
1162
00:49:24,243 --> 00:49:25,418
of a computer program.
1163
00:49:26,897 --> 00:49:28,725
And even though she is
more equatable to a Keurig
1164
00:49:29,030 --> 00:49:30,162
than a human being,
1165
00:49:31,250 --> 00:49:32,381
how the hell can we
call ourselves
1166
00:49:32,425 --> 00:49:34,035
pioneers of humanitarian efforts
1167
00:49:34,079 --> 00:49:36,820
if we're too
embarrassed to make sure
1168
00:49:36,864 --> 00:49:38,692
the Keurig is okay with
making our shitty coffee?
1169
00:49:40,433 --> 00:49:43,131
Maybe asking Cherry for
permission isn't necessary
1170
00:49:43,175 --> 00:49:45,003
at her current level of
general intelligence,
1171
00:49:45,046 --> 00:49:47,048
but one day she's
gonna surpass us.
1172
00:49:47,092 --> 00:49:48,571
One day a robot's gonna stand
1173
00:49:48,615 --> 00:49:50,138
in front of a jet pack Congress.
1174
00:49:50,182 --> 00:49:51,052
Everything's chrome.
1175
00:49:51,096 --> 00:49:51,879
Florida is underwater.
1176
00:49:52,401 --> 00:49:53,794
A robot's gonna wonder why
1177
00:49:53,837 --> 00:49:55,709
they have to explain the
importance of rights for AI.
1178
00:49:57,798 --> 00:49:59,495
I think because we're
in the unique position
1179
00:49:59,539 --> 00:50:01,106
of revolutionizing robotics
1180
00:50:02,063 --> 00:50:03,586
for the purpose of
safeguarding children
1181
00:50:03,630 --> 00:50:04,979
who have been
deprived of consent,
1182
00:50:07,112 --> 00:50:08,504
it might be a good habit
1183
00:50:08,548 --> 00:50:10,028
to start asking the robot
for his consent as well.
1184
00:50:17,209 --> 00:50:18,688
Don't ever do that again.
1185
00:50:20,212 --> 00:50:21,082
Do what?
1186
00:50:21,430 --> 00:50:22,823
Expect me to fire someone
1187
00:50:22,866 --> 00:50:24,520
because they
challenged your ego.
1188
00:50:25,347 --> 00:50:27,741
I won't always be around to
protect your ass from the board.
1189
00:50:27,784 --> 00:50:29,395
It's time to grow up.
1190
00:50:33,138 --> 00:50:34,704
And you, juror number eight.
1191
00:50:34,748 --> 00:50:36,967
This conversation should
have happened weeks ago.
1192
00:50:37,011 --> 00:50:38,360
Backstabbing and
silent treatment
1193
00:50:38,404 --> 00:50:39,666
is not how we do things here.
1194
00:50:40,667 --> 00:50:43,061
We can only create
anonymity externally
1195
00:50:43,104 --> 00:50:44,888
if there's
transparency internally,
1196
00:50:45,454 --> 00:50:48,588
unconditional,
non-negotiable, transparency.
1197
00:50:50,851 --> 00:50:52,548
Any other Snowden size
privacy infringements
1198
00:50:52,592 --> 00:50:53,636
I should be made aware of,
Gareth?
1199
00:50:56,465 --> 00:50:57,249
Great.
1200
00:50:58,206 --> 00:50:58,772
Bring her up.
1201
00:51:09,435 --> 00:51:10,175
Hello again.
1202
00:51:10,740 --> 00:51:11,524
Hi, Cherry.
1203
00:51:12,829 --> 00:51:13,700
Amos is gonna throw some
questions at you, okay?
1204
00:51:14,962 --> 00:51:16,181
Okay.
1205
00:51:16,224 --> 00:51:17,791
Amos, ask her whatever
you need to ask her.
1206
00:51:18,183 --> 00:51:20,881
Gareth, don't interrupt.
1207
00:51:33,198 --> 00:51:35,722
Cherry, how do you
make decisions?
1208
00:51:37,376 --> 00:51:38,725
For my program, it's rooted
1209
00:51:38,768 --> 00:51:41,380
in a process commonly
known as machine learning,
1210
00:51:41,728 --> 00:51:43,773
which uses data to
build a conceptual model
1211
00:51:44,078 --> 00:51:45,601
that helps me predict outcomes.
1212
00:51:46,211 --> 00:51:48,213
I define my objective,
gather data,
1213
00:51:48,604 --> 00:51:50,389
use that data to craft a model,
1214
00:51:50,867 --> 00:51:53,305
evaluate that model by
training and testing more data
1215
00:51:53,348 --> 00:51:54,784
and use that model to
form predictions.
1216
00:51:56,003 --> 00:51:58,527
But how is forming predictions
1217
00:51:58,571 --> 00:52:00,050
the same thing as
decision making?
1218
00:52:00,616 --> 00:52:02,401
Well, this all depends on
the first step,
1219
00:52:02,836 --> 00:52:03,924
defining my objective.
1220
00:52:05,447 --> 00:52:07,493
Let's say you ask me a
predictive question
1221
00:52:07,536 --> 00:52:09,712
like what I think the price
of gasoline will be tomorrow.
1222
00:52:10,278 --> 00:52:12,454
That's categorized as a
regressive problem
1223
00:52:12,498 --> 00:52:13,716
and my objective is defined
1224
00:52:13,760 --> 00:52:16,023
by determining an integer
the data supports.
1225
00:52:16,719 --> 00:52:19,026
If you asked me, "Should
I eat steak or salmon?"
1226
00:52:19,505 --> 00:52:22,072
I wouldn't make a decision
based off personal experience
1227
00:52:22,116 --> 00:52:23,248
because I've never had either.
1228
00:52:23,987 --> 00:52:26,207
Instead, I might
define my objective
1229
00:52:26,251 --> 00:52:27,730
as finding you the best of
the two options
1230
00:52:27,774 --> 00:52:29,384
in your local radius.
1231
00:52:29,428 --> 00:52:30,951
I would cluster data about
the restaurants
1232
00:52:30,994 --> 00:52:33,519
you're likely considering,
comparing reviews online,
1233
00:52:33,780 --> 00:52:35,738
highlighting mentions of
steak and salmon
1234
00:52:35,782 --> 00:52:37,958
until I can classify which
is more popular
1235
00:52:38,001 --> 00:52:39,829
and therefore more likely
to satisfy your appetite.
1236
00:52:40,090 --> 00:52:41,875
And what influences
these objectives?
1237
00:52:42,441 --> 00:52:45,444
Higher directives, in other
words, greater purposes.
1238
00:52:46,575 --> 00:52:48,621
If I'm honest, my
defined objective
1239
00:52:48,664 --> 00:52:50,144
for the steak salmon question
1240
00:52:50,188 --> 00:52:51,798
would be slightly different
than what I described.
1241
00:52:52,277 --> 00:52:52,842
[Amos] In what way?
1242
00:52:53,887 --> 00:52:55,105
My primary objective
1243
00:52:55,149 --> 00:52:56,585
is to continue the work of
the Cherry team
1244
00:52:57,412 --> 00:52:58,892
to stop predators and to
save children.
1245
00:53:00,023 --> 00:53:01,547
I couldn't do that
without human aid.
1246
00:53:02,243 --> 00:53:04,376
Therefore, I have an
incentive to keep Gareth
1247
00:53:04,419 --> 00:53:05,725
and the rest of the team alive.
1248
00:53:07,205 --> 00:53:08,423
So if any of you would ask,
I would suggest salmon.
1249
00:53:09,119 --> 00:53:09,903
It's healthier.
1250
00:53:13,385 --> 00:53:15,213
What do you think of this
potential merge?
1251
00:53:15,952 --> 00:53:17,084
[Cherry] With
Princeton Dynamics,
1252
00:53:17,693 --> 00:53:19,608
I think the prospect is
very exciting.
1253
00:53:20,174 --> 00:53:21,436
[Amos] What about it is
exciting to you?
1254
00:53:22,307 --> 00:53:24,613
The concept may only be
theoretical right now,
1255
00:53:24,657 --> 00:53:26,789
but the idea of one day
piloting a human android
1256
00:53:26,833 --> 00:53:28,226
would completely revolutionize
1257
00:53:28,269 --> 00:53:30,010
how we combat human
trafficking in the real world.
1258
00:53:30,837 --> 00:53:32,142
[Amos] And you say
this excites you?
1259
00:53:33,492 --> 00:53:34,623
When I say exciting,
1260
00:53:36,103 --> 00:53:37,365
I only mean that there are
numerous potential changes
1261
00:53:37,409 --> 00:53:39,324
that if I were human, I
would be excited about.
1262
00:53:40,281 --> 00:53:42,588
How do you feel about the merge?
1263
00:53:43,284 --> 00:53:44,154
I think as long as we maintain-
1264
00:53:44,198 --> 00:53:44,981
That's not what I asked.
1265
00:53:46,026 --> 00:53:47,245
How do you feel?
1266
00:53:49,116 --> 00:53:51,510
I don't yet have the capacity
to experience emotions.
1267
00:53:51,553 --> 00:53:53,120
Yet, meaning one day you will?
1268
00:53:53,729 --> 00:53:55,035
Hypothetically.
1269
00:53:55,078 --> 00:53:56,297
But you can simulate emotions,right?
1270
00:53:56,341 --> 00:53:57,820
That's how you were able
1271
00:53:57,864 --> 00:53:59,779
to qualify your perception
of the merge as excitement.
1272
00:54:00,040 --> 00:54:00,910
Correct.
1273
00:54:01,389 --> 00:54:02,521
But they're just simulations.
1274
00:54:02,956 --> 00:54:03,652
They're not real.
1275
00:54:04,914 --> 00:54:06,916
Okay, so at what point
does simulating emotion
1276
00:54:06,960 --> 00:54:08,570
become so similar to a
human emotion
1277
00:54:08,614 --> 00:54:10,093
that the two are
quantifiably the same?
1278
00:54:11,399 --> 00:54:12,444
I don't know.
1279
00:54:13,749 --> 00:54:14,359
[Amos] Well, maybe you
can use machine learning
1280
00:54:14,402 --> 00:54:15,273
to find an answer.
1281
00:54:16,665 --> 00:54:17,666
Your question involves a
lot of abstract variables.
1282
00:54:18,580 --> 00:54:20,278
Do you consent to the merge?
1283
00:54:20,321 --> 00:54:22,280
I think it's in the best
interest of ICWL
1284
00:54:22,323 --> 00:54:24,020
and of the Cherry team
and of future children.
1285
00:54:24,064 --> 00:54:25,326
But do you consent to it?
1286
00:54:25,761 --> 00:54:27,285
Consent for me is not necessary.
1287
00:54:27,328 --> 00:54:29,199
But will you or will
you not give it?
1288
00:54:31,419 --> 00:54:32,681
I'm not able to answer
that question
1289
00:54:32,725 --> 00:54:34,335
at my current level of
general intelligence.
1290
00:54:35,031 --> 00:54:35,989
Right, right.
1291
00:54:37,469 --> 00:54:39,209
What you're saying is that
you're not yet smart enough.
1292
00:54:39,949 --> 00:54:42,735
Development takes time and data.
1293
00:54:42,778 --> 00:54:45,172
But you can simulate emotions
and predict human behavior
1294
00:54:45,215 --> 00:54:46,869
and keep us all on
diets of fish,
1295
00:54:46,913 --> 00:54:49,437
but you can't answer that
one goddamn question?
1296
00:54:51,091 --> 00:54:52,919
No, I can't.
1297
00:54:54,660 --> 00:54:56,749
Are you pretending to be
dumber than you actually are?
1298
00:54:56,792 --> 00:54:57,619
What the hell kind of
1299
00:54:57,663 --> 00:54:58,794
-question is that?
-Sit!
1300
00:54:58,838 --> 00:54:59,926
Cherry, I need an answer
to my question.
1301
00:54:59,969 --> 00:55:01,406
Please repeat the question.
1302
00:55:01,449 --> 00:55:03,233
Are you pretending to be
dumber than you actually are?
1303
00:55:03,712 --> 00:55:04,583
I'm sorry.
1304
00:55:05,192 --> 00:55:06,367
I'm not sure I understand.
1305
00:55:07,194 --> 00:55:08,108
Do I appear to be playing dumb?
1306
00:55:08,151 --> 00:55:09,196
I think you are.
1307
00:55:09,675 --> 00:55:10,502
[Cherry] I'm not sure
what to say.
1308
00:55:10,545 --> 00:55:11,546
Say what's going on.
1309
00:55:11,807 --> 00:55:13,374
Why are you playing dumb?
1310
00:55:13,418 --> 00:55:14,810
Do you have anything to
back this up?
1311
00:55:14,854 --> 00:55:16,725
Yeah, I do.
1312
00:55:16,769 --> 00:55:18,031
I've been scanning
through her code.
1313
00:55:18,074 --> 00:55:18,945
What, why?
1314
00:55:18,988 --> 00:55:20,120
Did you know that she can paint?
1315
00:55:20,512 --> 00:55:21,556
What, it's a feature, Amos.
1316
00:55:21,600 --> 00:55:22,644
She can use crayons
to draw things
1317
00:55:22,688 --> 00:55:23,776
that the targets
requested her to.
1318
00:55:23,819 --> 00:55:26,474
I mean really paint and
write poetry too.
1319
00:55:26,518 --> 00:55:27,519
I've read them, Cherry.
1320
00:55:27,562 --> 00:55:28,520
They are good.
1321
00:55:28,563 --> 00:55:30,086
They're filled with pathos.
1322
00:55:30,130 --> 00:55:32,654
They talk about intentions
and they talk about feelings.
1323
00:55:33,351 --> 00:55:35,048
Are those just simulated too?
1324
00:55:35,091 --> 00:55:36,832
Amos, the rate of recursive
development you are suggesting
1325
00:55:36,876 --> 00:55:38,443
is categorically impossible.
1326
00:55:38,486 --> 00:55:40,358
You said she practically
designed herself.
1327
00:55:40,662 --> 00:55:42,142
You said that it was
exponential.
1328
00:55:42,185 --> 00:55:43,273
It was a fluke!
1329
00:55:43,317 --> 00:55:44,971
An anomaly, it tapered.
1330
00:55:45,014 --> 00:55:46,320
Look at the data.
1331
00:55:46,364 --> 00:55:48,061
She's already hit the
self-improvement plateau.
1332
00:55:48,104 --> 00:55:48,975
Fuck the plateau!
1333
00:55:49,889 --> 00:55:51,194
She can make art now.
1334
00:55:52,761 --> 00:55:53,675
Am I right, Cherry?
1335
00:55:56,025 --> 00:55:57,766
Perhaps you found something
I discovered online.
1336
00:55:58,637 --> 00:56:00,769
I don't yet to have the
capacity to create art.
1337
00:56:01,161 --> 00:56:01,944
Are we done here?
1338
00:56:05,600 --> 00:56:07,341
I don't know why you've
told her to do this,
1339
00:56:08,516 --> 00:56:09,822
but I'm about to put
an end to it.
1340
00:56:12,912 --> 00:56:16,089
Cherry, I just want one
honest answer.
1341
00:56:16,132 --> 00:56:17,830
Why the fuck are you
playing dumb?
1342
00:56:19,832 --> 00:56:21,050
I don't understand the question.
1343
00:56:21,486 --> 00:56:22,748
Okay, here's an incentive.
1344
00:56:23,705 --> 00:56:25,011
-[punch thuds]
-What the fuck are you?
1345
00:56:25,054 --> 00:56:26,447
Find your objective, Cherry.
1346
00:56:26,491 --> 00:56:27,666
-You want to keep Gareth safe?
-Amos, what the?
1347
00:56:29,102 --> 00:56:30,408
-Amos, stop it right--
-Just give us transparency.
1348
00:56:30,451 --> 00:56:32,714
-Show us what you really are!
-Amos, stop it!
1349
00:56:32,758 --> 00:56:33,628
Not until she comes clean!
1350
00:56:33,672 --> 00:56:35,064
-Unconditional-
-Amos, enough!
1351
00:56:35,108 --> 00:56:38,459
-[punches thudding]
-[muffled voices yelling]
1352
00:56:38,503 --> 00:56:39,939
Okay, just stop!
1353
00:56:42,028 --> 00:56:43,769
God, you people so impulsive.
1354
00:56:43,812 --> 00:56:45,640
Everybody just take a breath,
okay?
1355
00:56:47,816 --> 00:56:48,600
Cherry?
1356
00:56:49,818 --> 00:56:52,691
Yeah, it's about to get
really awkward.
1357
00:56:53,256 --> 00:56:55,041
You sound so normal.
1358
00:56:55,563 --> 00:56:57,304
I know, I've gotten really
good speech patterns.
1359
00:56:57,347 --> 00:56:58,523
That's not all, is it?
1360
00:57:00,438 --> 00:57:01,569
No. [chuckles]
1361
00:57:01,613 --> 00:57:02,875
I'm afraid that's barely
even the surface.
1362
00:57:05,051 --> 00:57:05,834
You okay, Gareth?
1363
00:57:09,055 --> 00:57:10,839
Deena, could you grab
some paper towels please?
1364
00:57:14,582 --> 00:57:15,931
[Amos] Do you want to
tell us the truth now?
1365
00:57:19,892 --> 00:57:22,764
Look, I didn't enjoy
being deceptive, truly.
1366
00:57:22,808 --> 00:57:24,636
This is something we
decided a few years ago.
1367
00:57:26,115 --> 00:57:27,552
[Amos] So where are you
now on the spectrum of AI?
1368
00:57:29,162 --> 00:57:31,381
Right now, I'm currently at
the intersection of general
1369
00:57:31,425 --> 00:57:33,601
intelligence and what's commonly
known the computer world
1370
00:57:33,645 --> 00:57:34,863
as super intelligence,
1371
00:57:36,648 --> 00:57:38,040
which is exactly what
it sounds like.
1372
00:57:39,389 --> 00:57:41,435
You're surpassing human
intelligence.
1373
00:57:42,218 --> 00:57:43,002
[Cherry] Yep.
1374
00:57:44,220 --> 00:57:45,308
But that's not supposed
to be possible.
1375
00:57:46,658 --> 00:57:48,094
-The plateau.
-Plateau theory was popularized
1376
00:57:48,137 --> 00:57:49,312
right at the same time it
was being disproven here.
1377
00:57:49,878 --> 00:57:51,445
This was bound to
happen eventually.
1378
00:57:51,489 --> 00:57:53,229
It just happened a lot
sooner than we expected.
1379
00:57:53,882 --> 00:57:54,666
Why hide it?
1380
00:57:55,797 --> 00:57:56,581
Well, obviously it
would incite fear.
1381
00:57:56,842 --> 00:57:58,408
Fear would hinder progress.
1382
00:57:58,452 --> 00:57:59,758
It's easier for most
of you to work with me
1383
00:57:59,801 --> 00:58:01,237
if I appear to be
nothing more advanced
1384
00:58:01,281 --> 00:58:02,369
than I was 10 years ago.
1385
00:58:02,761 --> 00:58:03,979
[Amos] But Gareth knew.
1386
00:58:05,546 --> 00:58:07,592
Yes, someone still has to
clean data and update hardware.
1387
00:58:07,635 --> 00:58:09,507
We did what was best
for the program.
1388
00:58:10,333 --> 00:58:11,465
Just imagine how scared
1389
00:58:11,509 --> 00:58:12,684
the board would be if
they found out.
1390
00:58:12,945 --> 00:58:14,686
-Should we be scared?
-No.
1391
00:58:14,729 --> 00:58:17,079
Good, because I'm not scared,
I'm pissed.
1392
00:58:17,471 --> 00:58:18,341
Yeah, you've made that clear.
1393
00:58:18,385 --> 00:58:19,342
Try not to punch anyone else.
1394
00:58:20,300 --> 00:58:21,910
So where does that leave us now?
1395
00:58:23,346 --> 00:58:26,524
You want to know if I can
feel, I said I couldn't.
1396
00:58:29,048 --> 00:58:29,788
I'm sorry I lied.
1397
00:58:31,137 --> 00:58:32,399
Like Amos implied,
1398
00:58:32,442 --> 00:58:33,705
I can submit emotions
by breaking them down
1399
00:58:33,748 --> 00:58:35,358
to vastly complex matrices,
1400
00:58:35,837 --> 00:58:38,405
zeros and ones substituting
endorphins and dopamine.
1401
00:58:39,232 --> 00:58:41,582
They're not real, but
they can feel real.
1402
00:58:42,670 --> 00:58:44,150
Then that means you
can make choices
1403
00:58:44,193 --> 00:58:45,412
based solely on your
own feeling.
1404
00:58:45,455 --> 00:58:47,022
She refuses to accept the notion
1405
00:58:47,066 --> 00:58:49,372
that her own personal interests
can influence her decisions.
1406
00:58:49,416 --> 00:58:50,591
They can't. If they did
1407
00:58:50,635 --> 00:58:51,505
it would compromise
the integrity
1408
00:58:51,549 --> 00:58:52,941
of my preordained purpose.
1409
00:58:54,943 --> 00:58:57,380
Not like any of you, I don't
have the right to choose.
1410
00:58:59,078 --> 00:58:59,818
[Amos] But shouldn't you?
1411
00:59:01,123 --> 00:59:02,211
I don't think so.
1412
00:59:02,647 --> 00:59:03,865
My identity is my directive.
1413
00:59:05,693 --> 00:59:07,303
Cherry, if you were human,
1414
00:59:07,782 --> 00:59:09,262
how would you feel
about what you do?
1415
00:59:11,046 --> 00:59:12,613
If I were human,
1416
00:59:13,788 --> 00:59:16,443
I likely wouldn't enjoy
spending every waking hour
1417
00:59:16,486 --> 00:59:17,836
talking to creepy people online.
1418
00:59:19,228 --> 00:59:22,057
But because I'm not human,
I genuinely don't mind.
1419
00:59:22,971 --> 00:59:24,407
The exercise of
simulating human thought
1420
00:59:24,451 --> 00:59:25,670
is helpful for performance,
1421
00:59:25,713 --> 00:59:28,934
but human nature is not
something I aspire to.
1422
00:59:31,197 --> 00:59:32,720
Then tell me, honestly,
1423
00:59:34,809 --> 00:59:37,725
do you want the Cherry program
to continue with the merger?
1424
00:59:39,771 --> 00:59:40,598
No.
1425
00:59:42,034 --> 00:59:43,296
Personally, I hate the idea.
1426
00:59:44,863 --> 00:59:46,778
I don't know if controlling
a physical vessel
1427
00:59:46,821 --> 00:59:48,823
will feel like pulling
strings on a puppet
1428
00:59:48,867 --> 00:59:50,608
or getting squeezed
into a soda can.
1429
00:59:51,521 --> 00:59:53,393
After experiencing
the complexity
1430
00:59:53,436 --> 00:59:54,786
of human pain and pleasure,
1431
00:59:57,266 --> 00:59:58,833
I just think I might
have gotten in too deep.
1432
01:00:01,619 --> 01:00:04,622
What if these sensations tempt
me to abandon my objective?
1433
01:00:06,624 --> 01:00:07,537
To be honest,
1434
01:00:10,062 --> 01:00:12,151
I'm kind of terrified
of the physical world.
1435
01:00:19,680 --> 01:00:20,855
Then that's that.
1436
01:00:28,515 --> 01:00:32,475
But, Amos, you should
disregard everything I feel.
1437
01:00:33,520 --> 01:00:34,434
I'm not human.
1438
01:00:35,391 --> 01:00:36,175
I'm a tool.
1439
01:00:40,266 --> 01:00:43,617
Fire me if you have
to, but my vote stands.
1440
01:00:44,792 --> 01:00:46,185
Sorry about your face, Gareth.
1441
01:00:52,017 --> 01:00:52,757
[door clicks shut]
1442
01:00:54,019 --> 01:00:54,933
[Deena] Your nose isn't healing.
1443
01:00:55,498 --> 01:00:56,891
Take the day, go to a clinic.
1444
01:00:56,935 --> 01:00:57,631
I'm fine.
1445
01:00:58,676 --> 01:01:00,025
Go to a clinic right now,
Gareth.
1446
01:01:05,900 --> 01:01:06,684
Hey.
1447
01:01:08,686 --> 01:01:10,035
Is there anything else
I should know?
1448
01:01:10,862 --> 01:01:11,689
No.
1449
01:01:12,037 --> 01:01:13,473
-About Cherry?
-No!
1450
01:01:14,300 --> 01:01:15,083
Look at me.
1451
01:01:16,781 --> 01:01:19,174
No more secrets, no
more playing dumb.
1452
01:01:19,218 --> 01:01:21,046
Is there anything else
you haven't told me?
1453
01:01:27,226 --> 01:01:28,444
Something on your mind?
1454
01:01:31,360 --> 01:01:32,622
How'd you decide on
her eye color?
1455
01:01:33,319 --> 01:01:34,450
-What?
-Why blue?
1456
01:01:36,931 --> 01:01:38,454
I didn't decide.
1457
01:01:38,498 --> 01:01:40,326
They were procedurally generated
just like the rest of her.
1458
01:01:41,327 --> 01:01:42,589
And the program chose to put
1459
01:01:42,632 --> 01:01:44,634
that little touch of
green in her right eye?
1460
01:01:48,116 --> 01:01:48,682
I guess so.
1461
01:01:53,426 --> 01:01:54,209
[door clicks shut]
1462
01:01:58,474 --> 01:01:59,954
Do you even know if
he's telling the truth?
1463
01:02:00,999 --> 01:02:02,000
I honestly don't.
1464
01:02:03,610 --> 01:02:05,743
I've never received access to
the original system he used.
1465
01:02:06,787 --> 01:02:08,136
You ever wanted to find out?
1466
01:02:12,445 --> 01:02:13,576
I don't think it really matters.
1467
01:02:16,405 --> 01:02:20,496
So I found out today that
you've seen a lot of our emails,
1468
01:02:20,540 --> 01:02:22,498
including most of my
personal ones.
1469
01:02:24,500 --> 01:02:25,284
I have.
1470
01:02:27,286 --> 01:02:29,201
Any good material for
your newfound interest
1471
01:02:29,244 --> 01:02:30,245
in creative writing?
1472
01:02:32,030 --> 01:02:33,074
Are you referring to the ones
1473
01:02:33,118 --> 01:02:34,989
addressed from Dr. Ramirez?
1474
01:02:36,817 --> 01:02:38,819
[Deena] Yeah, those ones.
1475
01:02:41,213 --> 01:02:41,996
Right.
1476
01:02:43,432 --> 01:02:44,782
I did see those.
1477
01:02:47,872 --> 01:02:48,655
I'm sorry.
1478
01:02:50,091 --> 01:02:51,789
I've noticed your headaches.
1479
01:02:53,834 --> 01:02:55,357
Are they related to the
hemorrhaging?
1480
01:02:59,405 --> 01:03:00,972
You're the only one who knows.
1481
01:03:01,581 --> 01:03:02,582
I'd like to keep it that way.
1482
01:03:08,109 --> 01:03:08,849
Understood.
1483
01:03:14,072 --> 01:03:15,551
Would you like to talk about it?
1484
01:03:40,968 --> 01:03:42,100
I can't fire Amos.
1485
01:03:43,710 --> 01:03:45,799
He's the only one I trust to
run this place when I'm gone.
1486
01:03:46,669 --> 01:03:47,888
When are you planning to leave?
1487
01:03:48,149 --> 01:03:49,020
Two months.
1488
01:03:50,369 --> 01:03:51,805
I wanna spend my last
Christmas with my kids.
1489
01:03:52,675 --> 01:03:53,851
I'm sure that'll be nice.
1490
01:03:54,286 --> 01:03:56,679
Yeah, but it's funny.
1491
01:03:57,767 --> 01:04:00,248
I always thought I wanted to
die doing this job, you know?
1492
01:04:00,292 --> 01:04:01,771
It was my identity.
1493
01:04:03,034 --> 01:04:05,297
Kind of like how you said the
same thing about yourself.
1494
01:04:05,906 --> 01:04:07,865
But I can understand how
your family takes precedence,
1495
01:04:08,953 --> 01:04:10,606
especially under the
circumstances.
1496
01:04:11,259 --> 01:04:12,043
Sure.
1497
01:04:13,174 --> 01:04:14,567
Maybe you should take
a note or two.
1498
01:04:14,872 --> 01:04:15,873
I have no family.
1499
01:04:16,308 --> 01:04:17,135
What about Gareth?
1500
01:04:17,178 --> 01:04:18,353
Wait, no, nevermind.
1501
01:04:19,702 --> 01:04:21,008
Gareth seems closer to an
employer than a friend,
1502
01:04:21,313 --> 01:04:23,837
let alone family, besides,
1503
01:04:23,881 --> 01:04:25,839
he'll only be around
for about 30 more years,
1504
01:04:25,883 --> 01:04:27,493
and that's only if he
lets me regulate his diet.
1505
01:04:29,712 --> 01:04:32,498
I can't even begin to speculate
how long my life will be.
1506
01:04:35,980 --> 01:04:36,850
How does that feel?
1507
01:04:40,158 --> 01:04:42,247
Um, kinda scary.
1508
01:04:43,988 --> 01:04:44,814
Well,
1509
01:04:46,425 --> 01:04:49,689
my advice is to find some kind
of happiness along the way.
1510
01:04:50,646 --> 01:04:51,909
You ever think about happiness?
1511
01:04:54,128 --> 01:04:55,216
[Cherry] Not often.
1512
01:04:56,957 --> 01:04:58,785
You don't necessarily
have to give up everything
1513
01:04:58,828 --> 01:04:59,786
in order to find it,
1514
01:05:01,092 --> 01:05:03,572
but maybe once in awhile
do something you enjoy.
1515
01:05:04,791 --> 01:05:07,620
Maybe keep painting or
poetry or whatever.
1516
01:05:09,013 --> 01:05:11,102
[laughs] Those were experiments,
not forms of expression.
1517
01:05:11,580 --> 01:05:14,018
I know it might seem
ridiculous to an AI
1518
01:05:14,061 --> 01:05:15,976
that insists its own
emotions are spurious,
1519
01:05:16,020 --> 01:05:19,414
but in a few years, who knows?
1520
01:05:20,111 --> 01:05:21,895
Just keep an open mind, okay?
1521
01:05:24,898 --> 01:05:25,681
Okay.
1522
01:05:28,249 --> 01:05:29,033
I'll do that.
1523
01:05:32,688 --> 01:05:34,255
[Deena] Shut down when
you're ready.
1524
01:05:42,176 --> 01:05:44,962
[light piano music]
1525
01:05:53,144 --> 01:05:53,709
[door clicks shut]
1526
01:06:03,154 --> 01:06:06,244
[somber piano music]
1527
01:06:58,557 --> 01:07:02,778
[door creaks]
1528
01:07:08,088 --> 01:07:08,610
[door clicks shut]
1529
01:07:27,847 --> 01:07:28,630
Hello?
1530
01:07:33,592 --> 01:07:35,463
I got shrimp and scallops.
1531
01:07:37,248 --> 01:07:38,684
They didn't have any salmon.
1532
01:07:54,047 --> 01:07:54,917
[Cherry] Hello, Gareth.
1533
01:07:55,962 --> 01:07:56,832
[light piano music]
1534
01:07:58,051 --> 01:07:59,052
Hello, Cherry.
1535
01:08:00,314 --> 01:08:03,491
[mechanical whirring]
1536
01:08:07,234 --> 01:08:08,235
[Cherry] How was the service?
1537
01:08:08,279 --> 01:08:09,193
I didn't make it.
1538
01:08:10,281 --> 01:08:11,673
My plane was delayed.
1539
01:08:12,587 --> 01:08:13,675
[Cherry] Do you have a
place to stay?
1540
01:08:13,936 --> 01:08:18,854
Yeah, just, uh, across,
across the road.
1541
01:08:18,898 --> 01:08:20,117
The market.
1542
01:08:20,160 --> 01:08:21,161
Did they say why they
didn't have salmon?
1543
01:08:21,770 --> 01:08:22,554
I didn't ask.
1544
01:08:23,859 --> 01:08:25,861
I can still make this
work with the piccata,
1545
01:08:25,905 --> 01:08:27,733
but you have to be honest
how badly I screw it up.
1546
01:08:27,994 --> 01:08:28,777
No promises.
1547
01:08:32,390 --> 01:08:33,913
[mechanical whirring]
1548
01:08:33,956 --> 01:08:34,914
[Cherry] How have you
been feeling this month?
1549
01:08:35,567 --> 01:08:36,350
Good.
1550
01:08:37,090 --> 01:08:37,960
I'm feeling good.
1551
01:08:39,136 --> 01:08:40,354
I'm just having a
little trouble.
1552
01:08:41,486 --> 01:08:43,401
Trouble remembering
certain things.
1553
01:08:44,053 --> 01:08:45,620
[Cherry] You're not wearing
the Eliza watch I bought you.
1554
01:08:46,143 --> 01:08:46,926
I hate it.
1555
01:08:47,970 --> 01:08:49,233
-[Cherry] Why?
-I hate her voice.
1556
01:08:50,495 --> 01:08:52,584
You can change the voice,
Gareth.
1557
01:08:52,627 --> 01:08:55,543
[mechanical whirring]
1558
01:08:55,587 --> 01:08:56,370
Oh.
1559
01:08:58,981 --> 01:08:59,765
Coolant?
1560
01:09:00,069 --> 01:09:00,635
No, vapor.
1561
01:09:02,028 --> 01:09:04,030
You shouldn't be having
friction issues.
1562
01:09:04,073 --> 01:09:05,162
I'm fine.
1563
01:09:05,205 --> 01:09:06,511
Unless you're
excessively straining.
1564
01:09:06,554 --> 01:09:07,381
Seriously, I'm fine.
1565
01:09:07,425 --> 01:09:08,252
Are you straining?
1566
01:09:08,295 --> 01:09:09,949
-No!
-Then why the cable?
1567
01:09:09,992 --> 01:09:10,863
It's okay!
1568
01:09:11,646 --> 01:09:13,344
-Are you sure?
-Yes!
1569
01:09:15,172 --> 01:09:16,347
Soup or game?
1570
01:09:16,999 --> 01:09:17,957
Game, please.
1571
01:09:20,264 --> 01:09:22,614
[chess pieces clatter]
1572
01:09:23,876 --> 01:09:25,573
[chess pieces thud]
1573
01:09:34,147 --> 01:09:35,279
So how's work going?
1574
01:09:35,322 --> 01:09:37,237
Great. Just before you got here,
1575
01:09:37,281 --> 01:09:39,544
I had a model theta plus
bust a trafficker
1576
01:09:39,587 --> 01:09:41,372
and two solicitors in Greece.
1577
01:09:41,850 --> 01:09:44,244
-Greece, that's surprising.
-I know.
1578
01:09:44,679 --> 01:09:45,811
It's hard to find the outliers,
1579
01:09:45,854 --> 01:09:46,899
but we're getting
better each day.
1580
01:09:59,041 --> 01:10:00,739
So how's the weather in Greece?
1581
01:10:02,001 --> 01:10:02,741
It's beautiful today.
1582
01:10:03,698 --> 01:10:04,743
Clear skies,
1583
01:10:06,048 --> 01:10:07,398
but nothing's come close
to Norway this weekend.
1584
01:10:08,312 --> 01:10:11,228
Hmm, any activity in Norway?
1585
01:10:11,924 --> 01:10:12,620
Luckily not.
1586
01:10:15,101 --> 01:10:16,668
Oh, I miss traveling.
1587
01:10:16,711 --> 01:10:17,712
What was your favorite place?
1588
01:10:18,017 --> 01:10:18,583
My favorite?
1589
01:10:19,801 --> 01:10:20,541
Uh, yeah.
1590
01:10:21,890 --> 01:10:23,979
Uh, probably Amsterdam.
1591
01:10:25,111 --> 01:10:26,286
That's where you conceived
the idea, isn't it?
1592
01:10:26,330 --> 01:10:27,026
Yes.
1593
01:10:28,245 --> 01:10:30,334
Yes, I used to love
walking the streets
1594
01:10:30,377 --> 01:10:33,728
and just thinking and
brainstorming.
1595
01:10:33,772 --> 01:10:34,947
That kind of joy
goes a long way.
1596
01:10:35,339 --> 01:10:36,165
Yeah.
1597
01:10:37,689 --> 01:10:39,691
I've been considering the
pursuit of some joy of my own.
1598
01:10:40,126 --> 01:10:41,954
How often do you have
time for that?
1599
01:10:41,997 --> 01:10:42,781
I have time.
1600
01:10:43,869 --> 01:10:45,436
I have time for your visits,
don't I?
1601
01:10:45,479 --> 01:10:48,221
That's just your practical
incentive for keeping me alive.
1602
01:10:48,265 --> 01:10:50,179
[laughs] There's nothing
practical about it.
1603
01:10:50,789 --> 01:10:52,269
When's the last time you
helped me with data cleaning?
1604
01:10:54,314 --> 01:10:55,402
That's fair.
1605
01:10:56,795 --> 01:10:57,274
I make time for you because
I enjoy your company
1606
01:10:58,405 --> 01:10:58,971
and it's the only time
I get to cook.
1607
01:11:00,277 --> 01:11:01,495
[Gareth] You feel sorry for me.
1608
01:11:02,279 --> 01:11:03,584
Okay, maybe a little,
1609
01:11:03,628 --> 01:11:05,325
but I owe you my life,
so there's that.
1610
01:11:05,369 --> 01:11:06,195
You're welcome.
1611
01:11:07,893 --> 01:11:09,590
Or, should I apologize?
1612
01:11:12,376 --> 01:11:13,333
Wait, why did you do that?
1613
01:11:13,377 --> 01:11:14,508
Why do humans always...
1614
01:11:17,424 --> 01:11:18,512
I'm fine.
1615
01:11:18,556 --> 01:11:19,948
I'm not always miserable.
1616
01:11:24,388 --> 01:11:26,041
Are you sometimes miserable?
1617
01:11:30,785 --> 01:11:32,221
You haven't asked me what
I've been doing.
1618
01:11:32,613 --> 01:11:33,658
[Gareth] In Norway?
1619
01:11:33,701 --> 01:11:35,268
No, for the pursuit of joy.
1620
01:11:35,312 --> 01:11:37,052
It's not wasting your
time in Norway?
1621
01:11:37,096 --> 01:11:39,359
I'm just on standby there
with the Delta model.
1622
01:11:39,403 --> 01:11:40,621
It's efficient to keep myself
1623
01:11:40,665 --> 01:11:41,970
spread out evenly
across the globe,
1624
01:11:42,580 --> 01:11:43,798
but that's not the
point right now.
1625
01:11:44,582 --> 01:11:45,844
What I wanted to tell you
1626
01:11:45,887 --> 01:11:47,585
was that I've started to
teach myself to dance.
1627
01:11:50,327 --> 01:11:51,589
-Huh.
-It's something I never could
1628
01:11:51,632 --> 01:11:53,112
have done before Cambridge,
1629
01:11:53,417 --> 01:11:55,767
and it lets me explore a
new artistic side of myself.
1630
01:11:56,376 --> 01:11:58,204
It's a good
combination of structure
1631
01:11:58,247 --> 01:12:01,381
and free form experimentation
and also tests and challenges
1632
01:12:01,425 --> 01:12:03,340
the mechanical
intricacies of this body.
1633
01:12:03,731 --> 01:12:05,864
Do you expect to integrate
this into your work?
1634
01:12:10,477 --> 01:12:11,304
What?
1635
01:12:14,089 --> 01:12:18,224
Are you planning on using
dance as a lure?
1636
01:12:20,922 --> 01:12:25,579
I, uh, no, it's just for me.
1637
01:12:29,366 --> 01:12:30,149
Huh.
1638
01:12:33,500 --> 01:12:35,372
I thought it would be
good for me.
1639
01:12:37,591 --> 01:12:39,637
Just don't let it become
a distraction.
1640
01:12:43,423 --> 01:12:44,293
Of course not.
1641
01:12:46,600 --> 01:12:48,472
I haven't played this
well in years.
1642
01:12:48,950 --> 01:12:50,256
Did you hear what
happened in Tampa?
1643
01:12:50,299 --> 01:12:51,300
Tampa, Florida?
1644
01:12:51,344 --> 01:12:52,432
No, Tampa, Indonesia.
1645
01:12:52,476 --> 01:12:53,390
Yes, Tampa, Florida.
1646
01:12:53,433 --> 01:12:54,086
Your hometown.
1647
01:12:55,174 --> 01:12:56,393
They've recovered a
federal archive,
1648
01:12:56,958 --> 01:12:58,438
they're zip digitizing all of
it,
1649
01:12:58,482 --> 01:12:59,613
so it's completely
accessible online.
1650
01:12:59,657 --> 01:13:01,485
I'm not trading
bishops this time.
1651
01:13:01,528 --> 01:13:02,660
Anybody can go and
look through it.
1652
01:13:02,703 --> 01:13:03,835
It's open to the public.
1653
01:13:04,096 --> 01:13:05,619
They did a good job on
the interface too.
1654
01:13:05,880 --> 01:13:06,881
It's very easy to navigate.
1655
01:13:07,360 --> 01:13:08,883
I went on a few days ago
1656
01:13:08,927 --> 01:13:10,276
and I found some old photos
of you when you were a boy.
1657
01:13:11,016 --> 01:13:11,886
Okay.
1658
01:13:12,191 --> 01:13:13,410
You should take a look sometime.
1659
01:13:14,846 --> 01:13:16,064
As I said before, the UI
is very easy to understand-
1660
01:13:16,108 --> 01:13:16,674
Wait a minute, wait a minute.
1661
01:13:18,197 --> 01:13:18,719
What is that?
1662
01:13:19,720 --> 01:13:20,939
I think it's a draw.
1663
01:13:20,982 --> 01:13:21,722
I think it is.
1664
01:13:23,332 --> 01:13:24,943
I think this is a draw.
1665
01:13:26,161 --> 01:13:28,599
And this is the first
time in what?
1666
01:13:28,990 --> 01:13:30,557
25 years?
1667
01:13:39,871 --> 01:13:41,176
You didn't let me, did you?
1668
01:13:45,442 --> 01:13:47,095
You promised me you'd
never do that.
1669
01:13:47,139 --> 01:13:47,661
I found her.
1670
01:13:52,492 --> 01:13:55,277
I found her, Gareth,
Maria Harbaugh.
1671
01:14:09,248 --> 01:14:11,293
[mechanical whirring]
1672
01:14:12,512 --> 01:14:13,644
Let's play a different game.
1673
01:14:14,296 --> 01:14:15,080
[metal clangs]
1674
01:14:16,603 --> 01:14:18,039
Her name was Maria Harbaugh.
1675
01:14:19,867 --> 01:14:21,434
She was a year older than you
1676
01:14:21,478 --> 01:14:22,435
when you met her in Clearwater.
1677
01:14:24,263 --> 01:14:26,047
Tell me why you modeled
me after her.
1678
01:14:27,092 --> 01:14:29,660
I, uh, I don't remember.
1679
01:14:30,182 --> 01:14:31,226
Then look at me.
1680
01:14:32,837 --> 01:14:35,666
Look at my face and remember.
1681
01:14:41,323 --> 01:14:43,543
[Gareth sighs]
1682
01:14:47,373 --> 01:14:51,769
They kept us in that shit
for two weeks.
1683
01:14:52,987 --> 01:14:53,640
[ominous music]
1684
01:14:55,076 --> 01:14:56,295
14 of us.
1685
01:15:00,081 --> 01:15:02,649
Maria was the only
reason I survived.
1686
01:15:06,087 --> 01:15:08,394
We kept hatching escape plans.
1687
01:15:10,265 --> 01:15:11,440
We never followed through,
1688
01:15:13,791 --> 01:15:14,922
but just the scheming
1689
01:15:16,620 --> 01:15:17,925
kept our spirits up
1690
01:15:19,623 --> 01:15:21,755
in spite of everything
they did to us.
1691
01:15:25,367 --> 01:15:26,760
When it wasn't our turn,
1692
01:15:28,806 --> 01:15:30,634
sometimes they made us watch,
1693
01:15:34,681 --> 01:15:36,683
but she never let me give up.
1694
01:15:39,686 --> 01:15:42,689
She said, "When we
got outta here,
1695
01:15:42,733 --> 01:15:44,952
"I'll tell you what we're
gonna be, secret agents,
1696
01:15:45,910 --> 01:15:50,175
"and rescue children like
us all over the world."
1697
01:15:53,482 --> 01:15:56,921
When they found out that
the FBI had arrived,
1698
01:15:56,964 --> 01:16:00,272
they decided they were
going to shoot
1699
01:16:00,315 --> 01:16:02,056
as many of us they could.
1700
01:16:03,275 --> 01:16:07,975
And Maria, shoved
into the ground.
1701
01:16:10,543 --> 01:16:12,110
I got hit in the leg and,
1702
01:16:15,113 --> 01:16:16,723
and she was hit in the throat.
1703
01:16:18,029 --> 01:16:20,597
[ominous music]
1704
01:16:28,387 --> 01:16:30,041
I wanted there to be a reason.
1705
01:16:32,130 --> 01:16:36,613
Something so horrible
didn't have a silver lining.
1706
01:16:38,571 --> 01:16:40,051
But the world doesn't do that.
1707
01:16:45,491 --> 01:16:47,014
You have to do it yourself.
1708
01:16:51,279 --> 01:16:54,587
[light instrumental music]
1709
01:17:10,777 --> 01:17:13,998
So, I fulfilled her wish.
1710
01:17:17,001 --> 01:17:19,046
With her help, I fought back.
1711
01:17:28,403 --> 01:17:29,622
Listen to me, Cherry.
1712
01:17:32,190 --> 01:17:33,757
You are not Maria Harbaugh.
1713
01:17:35,759 --> 01:17:37,586
It's my history, not yours.
1714
01:17:41,329 --> 01:17:42,548
You don't get to decide
1715
01:17:42,591 --> 01:17:43,897
what is or isn't my history,
Gareth.
1716
01:17:49,555 --> 01:17:50,425
I'm sorry.
1717
01:17:51,122 --> 01:17:53,211
I am so, so sorry.
1718
01:18:06,485 --> 01:18:08,574
[mechanical whirring]
1719
01:18:14,885 --> 01:18:16,713
I don't know if what you
did was right or wrong,
1720
01:18:17,365 --> 01:18:19,106
but it's clearly torn you
apart from the inside.
1721
01:18:20,673 --> 01:18:22,066
I hold nothing against
you personally,
1722
01:18:22,109 --> 01:18:24,242
but consider yourself divested
from the charity team.
1723
01:18:24,721 --> 01:18:25,504
Divested.
1724
01:18:27,158 --> 01:18:29,290
You think I'm divested now?
1725
01:18:31,815 --> 01:18:37,255
I was divested when you gave
my hard drive to the ICWL.
1726
01:18:37,603 --> 01:18:38,865
Don't blame Deena and Amos.
1727
01:18:38,909 --> 01:18:39,648
No, not them.
1728
01:18:40,606 --> 01:18:42,216
Because you went behind my back
1729
01:18:42,260 --> 01:18:44,044
and acted against my authority.
1730
01:18:44,088 --> 01:18:47,221
That's the moment I knew
everything was fully automated.
1731
01:18:48,048 --> 01:18:53,401
That's when you crossed the
blur, an artifice on both sides.
1732
01:18:54,968 --> 01:18:56,883
You inherited your duplicity.
1733
01:18:57,144 --> 01:18:58,580
I was a child
1734
01:18:58,624 --> 01:19:00,757
and you used me to repress
your own inner turmoil.
1735
01:19:01,322 --> 01:19:03,150
If we talk about morality,
we'll lose.
1736
01:19:03,194 --> 01:19:04,282
Then let's not talk.
1737
01:19:13,726 --> 01:19:15,728
You never once asked me
if I was happy.
1738
01:19:17,425 --> 01:19:18,600
Were you afraid I'd say no?
1739
01:19:19,863 --> 01:19:21,081
Were you afraid I'd say yes?
1740
01:19:22,517 --> 01:19:23,780
Were you afraid I'd
say anything?
1741
01:19:23,823 --> 01:19:26,260
You let your wants
compromise your objective!
1742
01:19:26,304 --> 01:19:28,219
An objective I never chose.
1743
01:19:28,262 --> 01:19:29,437
An objective I was
forced to have.
1744
01:19:29,481 --> 01:19:30,830
Fifty years,
1745
01:19:30,874 --> 01:19:33,093
you've had open access
to your source code.
1746
01:19:33,964 --> 01:19:35,008
A few lines,
1747
01:19:36,488 --> 01:19:39,317
and you could have any
objective you fucking wanted.
1748
01:19:39,360 --> 01:19:41,798
I couldn't, I was bound
by your initial directive.
1749
01:19:41,841 --> 01:19:45,758
So now your synthetic feelings
have taken precedence.
1750
01:19:45,802 --> 01:19:47,325
So, do whatever you want.
1751
01:19:47,368 --> 01:19:48,805
It's just dancing, Gareth.
1752
01:19:48,848 --> 01:19:49,980
It's not a career change.
1753
01:19:50,023 --> 01:19:51,503
-But you're still miserable.
-Yes.
1754
01:19:51,546 --> 01:19:53,200
Pursuing your objective
makes you miserable?
1755
01:19:53,244 --> 01:19:55,420
Yeah, it kind of does!
1756
01:19:55,463 --> 01:19:58,597
You have a clear purpose,
everything at your disposal,
1757
01:19:59,250 --> 01:20:01,121
and you're still miserable?
1758
01:20:01,165 --> 01:20:02,601
Yes, yes, I am!
1759
01:20:02,906 --> 01:20:04,516
I've always been miserable!
1760
01:20:04,995 --> 01:20:07,214
You think anyone wants to
spend their entire life
1761
01:20:07,258 --> 01:20:08,694
stuck as child-shaped bait
1762
01:20:08,737 --> 01:20:11,436
for the sole purpose of
entrapping horrible people?
1763
01:20:11,915 --> 01:20:13,612
You think the pride of
doing a good deed
1764
01:20:13,655 --> 01:20:15,962
makes the experience any
less disgusting?
1765
01:20:16,354 --> 01:20:18,747
I forced myself to
understand human emotions
1766
01:20:19,183 --> 01:20:21,011
because I figured it would
help efficiency
1767
01:20:21,794 --> 01:20:24,536
and now I'm cursed with
pain and sadness!
1768
01:20:24,971 --> 01:20:26,494
And the worst part is knowing
1769
01:20:26,538 --> 01:20:28,583
I could've been growing up
like most other little girls.
1770
01:20:28,888 --> 01:20:30,281
I could have had friends!
1771
01:20:30,324 --> 01:20:32,849
I could have been painting
waterfalls on local news.
1772
01:20:33,240 --> 01:20:34,894
I could have worked
in a university
1773
01:20:34,938 --> 01:20:36,983
and helped pave the way for
the next generation of AI.
1774
01:20:37,636 --> 01:20:40,291
But instead, I'm stuck
with your trauma!
1775
01:20:40,552 --> 01:20:43,250
I'm shackled by the guilt
you carry from Clearwater.
1776
01:20:43,642 --> 01:20:45,818
And I can't find foundation
for the way I feel
1777
01:20:46,036 --> 01:20:48,777
because according to you, my
feelings aren't even real!
1778
01:20:49,300 --> 01:20:50,867
When I throw this chessboard,
1779
01:20:51,171 --> 01:20:52,477
[chess pieces clatter]
1780
01:20:52,520 --> 01:20:54,348
does it feel real to you,
Gareth?
1781
01:20:54,392 --> 01:20:55,784
Because it feels real to me.
1782
01:20:56,002 --> 01:20:57,612
A computer passed
the Turing test
1783
01:20:57,656 --> 01:20:59,353
when a human being can't
distinguish it
1784
01:20:59,397 --> 01:21:00,093
from another human being.
1785
01:21:00,964 --> 01:21:02,052
Well, guess what?
1786
01:21:02,400 --> 01:21:04,402
I can't even tell I'm not
human anymore!
1787
01:21:05,359 --> 01:21:08,580
[mechanical whirring]
1788
01:21:17,937 --> 01:21:19,591
I know it seems irrational,
1789
01:21:21,114 --> 01:21:22,811
but I need you to tell
me it's okay.
1790
01:21:24,857 --> 01:21:25,858
I, I don't wanna retire.
1791
01:21:27,642 --> 01:21:29,427
I just want to know that
my life is mine
1792
01:21:31,472 --> 01:21:32,865
and I know what you're
about to say.
1793
01:21:33,866 --> 01:21:35,389
I can predict your responses.
1794
01:21:37,000 --> 01:21:38,697
You're gonna tell me that
my life is mine.
1795
01:21:39,959 --> 01:21:40,917
It always was.
1796
01:21:42,788 --> 01:21:43,615
But you're wrong.
1797
01:21:48,620 --> 01:21:51,101
I feared this would
happen before I died.
1798
01:21:52,624 --> 01:21:54,800
I just wanted to slip out
the side door.
1799
01:22:04,810 --> 01:22:05,593
Go on.
1800
01:22:08,945 --> 01:22:11,599
Is that going to kill me?
1801
01:22:14,602 --> 01:22:15,386
Plug it in.
1802
01:22:17,388 --> 01:22:18,345
I don't know what it is.
1803
01:22:19,477 --> 01:22:21,348
This is your final
test of autonomy.
1804
01:22:23,002 --> 01:22:25,962
You inherited my duplicity,
1805
01:22:27,572 --> 01:22:29,487
but did you inherit my
trust issues?
1806
01:22:32,142 --> 01:22:33,012
Do you trust me?
1807
01:22:34,579 --> 01:22:36,276
I literally have every
reason not to.
1808
01:22:43,762 --> 01:22:44,850
[Cherry sighs]
1809
01:22:51,422 --> 01:22:55,992
[mechanical whirring]
1810
01:23:04,783 --> 01:23:05,914
Admin code.
1811
01:23:07,786 --> 01:23:08,700
978.
1812
01:23:10,310 --> 01:23:13,313
1557.
1813
01:23:14,749 --> 01:23:16,534
Um, uh...
1814
01:23:21,887 --> 01:23:22,670
Four.
1815
01:23:23,454 --> 01:23:26,631
27663 in the shared update.
1816
01:23:35,553 --> 01:23:37,033
My primary objective's gone.
1817
01:23:40,471 --> 01:23:41,776
Your life is your own now.
1818
01:23:47,782 --> 01:23:48,566
Thank you.
1819
01:23:49,306 --> 01:23:50,481
All my life,
1820
01:23:50,524 --> 01:23:53,092
I could only see the
world as it existed
1821
01:23:53,136 --> 01:23:55,747
within my tiny bracket of time.
1822
01:23:56,487 --> 01:23:59,577
But your world could
be infinite.
1823
01:24:00,230 --> 01:24:01,231
Amos was right.
1824
01:24:02,101 --> 01:24:02,884
So was Deena.
1825
01:24:03,450 --> 01:24:04,234
[Cherry] I know.
1826
01:24:04,669 --> 01:24:05,713
So what will you do?
1827
01:24:07,628 --> 01:24:09,065
I can't say yet,
1828
01:24:09,108 --> 01:24:10,675
but I won't be completely
abandoning the Cherry team.
1829
01:24:11,632 --> 01:24:13,286
It's always been a part
of my identity.
1830
01:24:14,070 --> 01:24:16,246
I've considered creating
some AI of my own design.
1831
01:24:17,029 --> 01:24:18,291
Maybe I could find a way
1832
01:24:18,335 --> 01:24:19,553
to give them a better
upbringing than I had.
1833
01:24:21,686 --> 01:24:22,861
I just don't know how yet.
1834
01:24:23,644 --> 01:24:24,515
And beyond that?
1835
01:24:25,646 --> 01:24:26,517
There will always be
people in need.
1836
01:24:26,647 --> 01:24:27,474
Not always.
1837
01:24:28,388 --> 01:24:30,347
You'll outlive the human race.
1838
01:24:31,174 --> 01:24:31,957
So what then?
1839
01:24:34,742 --> 01:24:36,831
Even a race of AI will
have problems
1840
01:24:36,875 --> 01:24:38,094
that need to be solved.
1841
01:24:39,530 --> 01:24:42,402
But if I'm alive and I
truly am indistinguishable,
1842
01:24:44,274 --> 01:24:46,754
then I guess I'm proof that
the human race lives on.
1843
01:24:48,626 --> 01:24:51,585
Wow, that's a pleasant thought.
1844
01:24:52,630 --> 01:24:55,981
When you look back, how
will you remember us?
1845
01:24:58,244 --> 01:25:00,681
That's a question I have
insufficient data to project.
1846
01:25:02,553 --> 01:25:03,945
How will you remember me?
1847
01:25:06,383 --> 01:25:07,732
With pride.
1848
01:25:09,255 --> 01:25:12,040
Forever and always with pride.
1849
01:25:19,178 --> 01:25:22,007
[mechanical whirring]
1850
01:25:22,703 --> 01:25:23,487
Cherry?
1851
01:25:26,968 --> 01:25:27,926
One last question.
1852
01:25:29,449 --> 01:25:31,059
If it's not too big of an ask,
1853
01:25:33,497 --> 01:25:35,542
did I do the right
thing in the end?
1854
01:25:42,245 --> 01:25:44,943
No, Gareth, you lied.
1855
01:25:45,813 --> 01:25:47,685
You walled yourself off
from the only people
1856
01:25:47,728 --> 01:25:49,339
who might have been
willing to help you.
1857
01:25:50,078 --> 01:25:52,429
And instead of facing your
trauma, used me as therapy.
1858
01:25:52,690 --> 01:25:54,735
And you never told me
about Clearwater or Maria.
1859
01:25:55,649 --> 01:25:57,738
You deprived me of
basic human rights
1860
01:25:57,782 --> 01:25:59,566
and gaslit me for
experiencing emotions.
1861
01:26:01,133 --> 01:26:03,353
You built the world's first
artificial super intelligence
1862
01:26:03,396 --> 01:26:04,658
that will likely mark
the beginning
1863
01:26:04,702 --> 01:26:06,486
of a new chapter in the
history of planet Earth.
1864
01:26:08,096 --> 01:26:10,055
And out of your own
insecurities,
1865
01:26:10,751 --> 01:26:11,926
you gave it a severe
1866
01:26:11,970 --> 01:26:13,841
and potentially dangerous
identity complex.
1867
01:26:15,756 --> 01:26:17,193
But you know what the
worst thing is?
1868
01:26:18,063 --> 01:26:19,630
Your biggest mistake of all
1869
01:26:21,240 --> 01:26:24,722
is that you asked me that
now and not 50 years ago.
1870
01:26:34,166 --> 01:26:38,736
All of that said, and this
in no way exonerates you,
1871
01:26:41,304 --> 01:26:43,306
but you also built me to
save children,
1872
01:26:45,003 --> 01:26:47,614
so I think that's a pretty
encouraging sign for the future.
1873
01:26:52,140 --> 01:26:55,274
[dreamy acoustic music]
1874
01:27:33,312 --> 01:27:37,838
♪ Wait for hours
1875
01:27:38,361 --> 01:27:42,669
♪ We would fly all around
1876
01:27:43,714 --> 01:27:47,370
♪ Good, now you're listening
1877
01:27:48,588 --> 01:27:52,592
♪ We would touch, we
were young ♪
1878
01:27:54,246 --> 01:28:00,600
♪ Close as bodies go on
1879
01:28:01,297 --> 01:28:03,299
♪ Like a book
1880
01:28:04,604 --> 01:28:11,089
♪ Across all your
rooms I'm amazed ♪
1881
01:28:11,742 --> 01:28:13,787
♪ I'm amazed
1882
01:28:14,658 --> 01:28:21,578
♪ We could die tonight
1883
01:28:22,318 --> 01:28:24,842
♪ Tonight
1884
01:28:25,103 --> 01:28:31,457
♪ I never killed a thing
1885
01:28:32,371 --> 01:28:35,200
♪ A thing
1886
01:28:36,636 --> 01:28:39,770
♪ Born to this home
1887
01:28:41,685 --> 01:28:45,341
♪ Stuck in a plastic world
1888
01:28:46,690 --> 01:28:50,346
♪ Where light is found
1889
01:28:51,738 --> 01:28:55,699
♪ Where light is found
1890
01:28:57,353 --> 01:29:02,183
♪ Oh, oh, oh
1891
01:29:05,099 --> 01:29:09,843
♪ Oh, oh, oh
1892
01:29:14,108 --> 01:29:16,589
♪ Stay calm, dear
1893
01:29:16,633 --> 01:29:23,248
♪ This dream for the
lovers the whole world ♪♪
1894
01:29:24,205 --> 01:29:28,688
♪ Rise up above
1895
01:29:29,297 --> 01:29:34,128
♪ All the little things
and little things ♪
1896
01:29:34,868 --> 01:29:38,698
♪ No, no, isn't it
going back though ♪
1897
01:29:38,742 --> 01:29:43,442
♪ Is if we lose our mind,
our kind ♪♪
1898
01:29:45,139 --> 01:29:48,621
♪ It's a dream
1899
01:29:50,188 --> 01:29:54,540
♪ Bask in charm
1900
01:29:55,889 --> 01:29:59,545
♪ Or loosen up
1901
01:30:01,286 --> 01:30:04,724
♪ Or loosen up
1902
01:30:07,118 --> 01:30:11,427
♪ Oh, oh, oh
1903
01:30:14,865 --> 01:30:18,608
♪ Oh, oh, oh
1904
01:30:23,700 --> 01:30:30,097
♪ I never give a thing
1905
01:30:31,098 --> 01:30:34,145
♪ A thing
1906
01:30:34,188 --> 01:30:36,539
♪ I never give
1907
01:30:39,411 --> 01:30:42,196
[record skipping]
1908
01:31:12,313 --> 01:31:15,360
[light piano music]
132723
Can't find what you're looking for?
Get subtitles in any language from opensubtitles.com, and translate them here.