All language subtitles for A.S01E04.1080p.DSNP.WEB-DL.DDP5.1.H.264-ECLiPSE

Hi.

Hi.

There you are.

It’s good to have you home again.

Are you okay?

Yeah. It’s been quite hectic.

Congratulations.

On what?

It’s in the news.

Your drone saved those hostages.

Haven’t you seen it?
It’s everywhere.

It’s amazing.

On...?

We go to Mali,

where two hostages have been rescued
with Norwegian aid.

A hyper-modem drone came to the rescue
in freeing two hostages...

I wish you’d occasionally ask me...

before making decisions.

Can’t you be glad I asked
and you gained responsibility?

Seriously?

Yes. You should be proud
you had the responsibility.

The kidnappers hid among civilians,

but no innocent lives were lost.

The drone, developed by Norway’s AGR,

located the hostages
and helped French forces rescue them.

We don’t yet know
how many perpetrators...

Didn’t we agree
not to release details?

It’s not coming from us.

- Alain has leaked...
- Alain?

To play it safe
if civilian deaths come out.

Then he can blame our technology.

Civilians died?

Are you saying
civilians were killed?

- This is reported as a success.
- Yes, and it must stay that way.

Madeleine, call Rikke
and make sure she pushes Bjørn on this.

Good job.

Hi, this is Madeleine Jahr’s cell phone...

Hi, this is
Madeleine Jahr’s cell phone. Please...

CALL ME!

Bjørn.

I should start exercising again.

But hey, things are really buzzing.

We’re getting so many questions
about AI that... Look at this.

I can call them later.

We can pick and choose
what programs we want to talk to.

And we get a lot of free publicity.

You’ll be here the rest of the week?

In Norway?

Why?

They want to talk to you.

You’re the boss of it all, and...

- No. I don’t think so. That’s...
- Yes. Yes. Yes.

I didn’t build the drone.
I don’t know anything, so...

Those who know that stuff should talk.

A developer, in front of the camera?

No. This is what we’ll do.

I’ll call you when we’ve decided
on a program, and then...

I’ve talked to the developers.
They’ll give you a rundown.

And remember to call that hostage,
the Norwegian they freed.

Josef Cissé.
Sorry, I must take this.

Do you know where Madeleine is?
She’s not answering. Or Ole?

Technical.

Why didn’t you come to the meeting?

We promised your teacher
to go to those meetings.

- There’s no point.
- Yes, there is.

The teacher doesn’t get it.

- Can’t you drop it?
- No!

- Please?
- No, I can’t!

- You’ll be thrown out of school.
- Yeah. I don’t mind.

- Please, Birk.
- No! Just drop it.

Okay?

- Are you saying it’s the French?
- Don’t blow this out of proportion.

Well, look at that.

Welcome home.

- There’s something I have to tell you.
- Spit it out.

I don’t know how to say this,

but it didn’t go as well
as the media says.

At all. Alain suddenly
went to use the drone.

It can’t have been ready,
because it just went crazy.

Bjørn, I’ve seen the video,
and talked to Alain.

You’ve seen the attack?

We’re in full control of the video,
and it’s not going anywhere.

We’ve tested the drone
thousands of times.

I’m at a loss.

We’re trying to work out
what happened.

Sure, but Rikke wants me to go on TV.

I mean, people think this went well.
What should we say?

We’ll figure it out.

Okay?

I have to go to a meeting.
Call any time.

You might remember the WikiLeaks scandal

and the video of
the American human-guided drone

killing innocent people in Iraq.

Right.

The soldier misunderstands
and thinks a camera is a gun,

and he decides to attack.

This was in Kabul last year.

Same problem.

Unlike these soldiers,

an autonomous drone
will never be over-eager,

impulsive, sadistic.

It will never become
hysterical, tired, hungry, angry.

An autonomous drone follows the mission plan
and fulfills its task

without distractions or emotion,

and without human errors, like here.

But...

I mean, can you say anything
about... how AI works?

I mean, like...

Or KI.

- What do you mean?
- I mean, I have to...

I have to explain the basics.

Just the ABCs,
but it has to sound like I...

I just have to...

Yes, but remember what you told me
when I started here.

You’re the one who told me
that historically,

there’s always been moral outrage
when new weapons are developed.

Right?

With the rifle, people...

I remember what I said.
That’s enough.

You know you’ll never get
your security clearance back?

And we need you.

We developed this system together.
It’s our system...

It’s not our system.
We couldn’t even copy HC’s algorithms.

This is the result.

Just try to turn it around.
Okay? For one second.

Think that this could be the beginning

of something that can actually be good.

You think so?

Can you tell that idiot
that I’m not coming back?

He’s waiting for me.

Okay, so Bjørn Urdal is an idiot now?

It’s fucking idiotic that he’s the CTO.

Oh, hi.

Hi.

So Endre had to... had to leave.

Okay.

I thought I’d prepare a little.

I guess I can Google it.

What will he do?

How was school today?

It was okay.

Okay?

Jørgen asked me to a launch party
today, and I just blurted out,

“No, I’m not going to
any launch parties with you. I quit.”

So I just resigned.

He was flabbergasted. And it feels great.

- That’s great, Mom.
- Quit? Do you have a plan?

Yes. I called Marius.

He was super happy.
I’m seeing him tomorrow.

Marius from AGR?

He called while you were in Mali.
Didn’t I tell you?

No, you didn’t tell me.

Anyway. I called him back,
and I’m meeting them tomorrow.

You can’t just quit your job!

I mean, you have to...

This is Bjørn.

Yes?

Okay.

Tomorrow?

Yes.

Right...

I’m appearing on
Dagsnytt 18 tomorrow.

Okay. Good.

Yeah... It’s great.

- I have to talk to Ole.
- Ole is busy right now.

No, I must talk to him.
I was told he’s here.

Yes, but it’s very important
no one disturbs him.

What is it?

I can’t go on Dagsnytt 18.

Bjørn, okay. Just calm down.

No! I’ll make a fool of myself.
I can’t do it.

It’s Birk. Daddy not here?

- Look at him.
- Shut up.

Fred!

We’ve saved lives with our technology,
so this is a critical interview.

What does Ole say?

If we really want more money for AI,
this is the way to go.

- We can’t hide...
- What does Ole say?

Ole says the same, okay?

- Tell him to call me.
- Yeah, yeah, yeah. I’ll tell him.

CONTACT TEACHER:
BIRK IS IN THE ER AFTER A FIGHT.

God damn it.

Damn.

Hi, this is Mona. Leave a message,
and I’ll call you back. Bye.

Birk’s been beaten up.

I’ll get him,
but call as soon as you hear this.

It makes thousands of calculations
in milliseconds,

which will ensure a natural and
uniquely adapted mobility.

- And it’s all AI?
- Yes.

It memorizes and automatizes
all the movements.

The way we automatize movements
learning to walk.

Just a lot faster, of course.

So after a short run-in,

it will function just like a regular foot.

This is just great.
You know what we need?

We need to associate AGR
with physical therapy, rehabilitation,

things other than arms and war.

I mean, we’re in no way ashamed
of our arms production.

We do have some of the least
dangerous arms in the world. Right, Amy?

- What?
- To civilians.

I mean, their precision
minimizes civilian losses.

They’re not Kalashnikovs.

We have numbers on that.

Right. I’m not quite...

Hey. Let me have a look at you.

It hurts.

I assume this was that Fred again.

If the school won’t act,
we’ll go to the police.

I started it.

Okay.

Okay.

Why did you start it?

Hey.

Birk.

Hey.

You can just tell me.
I won’t be mad.

Hey.

- What have you done?
- It’s not my fault.

Okay.

So whose fault is it?

Is it mine?

Hey.

- How can it be my fault?
- Some friends of his family...

Their business was meant to get money.

- And they thought you...
- I see.

That’s when they started.

It’s happened since then?

It didn’t improve
when you became a substitute teacher.

I don’t know what to say, Birk.

You have to tell me things like that.

I should probably have asked you.

Before I began.

I didn’t have a whole lot of options.

No, I know.

- I can’t wait to switch schools.
- Yeah. I get that.

I won’t have time to drive you home.
I have to be at NRK in 20 minutes.

Maybe they can put make-up on me
before Mom sees.

I’m not sure it’ll help.

Come on, Tarzan.

Give me a moment.

Where the hell have you been?

That’s my impression of a skeleton.

Maybe we should think about ourselves.
I know about this.

It’s far better to say what happened
before someone else does.

- We have to go in!
- Yes, but you can’t do that.

We have to go in.

What is it?

There’s a good basketball team
in Rånåsfoss.

- Okay?
- Pia says the school’s quite good.

Pia?

Someone I met there.

Okay.

AI technology is positive in many ways,

but in the arms industry,
we need much clearer guidelines

than we currently have.

Bjørn Urdal, you are
the newly appointed CTO of AGR.

Where do you think
the world will be in ten years

in terms of AI technology?

In Norway, we say KI,

for kunstig intelligens.

We don’t want the developers
to laugh at us.

So... Well...

I don’t believe in a dystopia, like...

- Like...
- Her name is Gregersen.

I’m by no means
as skeptical as she is.

On the contrary, I’m very positive.

I think the possibilities
of KI are limitless.

I’m not claiming to be an expert,

but a rule of thumb I like to follow

is that you can read about something
in a book

or a science magazine or whatever,

that will be possible in 10 or 15 years,

you can be sure
that it’s actually possible already.

All you need is
the means and ability to implement.

We at AGR have the ability
and Norway has the means.

Together, we can develop
computer systems

that can help people with tasks

we never imagined we could solve...

But Mr. Urdal, you are primarily
an arms company.

We see ourselves as a
technology company, first and foremost.

We produce modern instruments

for rehabilitation,
autonomous navigation...

I’ll have to stop you,

because we’re not here to discuss
your spring catalog, so to speak.

We’re discussing artificial intelligence,

because a Norwegian drone
with Norwegian artificial intelligence

was used for an armed mission
in Mali, of all places.

That’s right. One of our
reconnaissance drones, called Ammo,

found the hostages in one night,

with no human intervention.

It is a huge breakthrough
for this type...

Yes. This time...
This time, it was a reconnaissance drone,

but who can guarantee that the French

won’t attach a weapon
to the drone next time?

I mean, do we want a computer program
to make decisions about life and death?

Is that what we want?

Mr. Urdal? Can a computer
make moral decisions on behalf of humans?

Mr. Urdal?

If you ask me,
this is a very dangerous path to follow...

Okay, but we have to
go back to Mr. Urdal.

What prevents you
from developing technology

that makes moral decisions on its own
on our behalf?

The legislation prevents it.

We would never sell such technology
to anyone before it is legal.

But you’re not opposed
to its development?

I understand that
autonomous weapons in war

can be a scary thought,

but don’t forget that war itself
is a frightening concept.

People trying to kill each other
is a frightening concept,

and we humans
get tired, we get hungry, we get angry,

we become hysterical and prejudiced.
We make decisions in anger.

Since we’re here to discuss
this incident in Mali,

I’ll use an example from there.

As of today, French soldiers
have killed more civilians in Mali

than the terrorists.

That’s not what they wanted,
but it’s still true. And why?

Because humans make mistakes.

It’s so-called human errors.

And this is what we eliminate
by being open to autonomous weapons.

An algorithm will never act in anger.

And if the legislation had let us use

the technology in our drone
to its full capacity,

we might have been able to carry out
this mission without civilian losses.

Were there civilian losses in Mali?

Damage. Without civilian damage.

The Norwegian hostage wouldn’t be
in hospital now. Right?

But we’re not there yet,
because it’s too scary.

My point is that

military evolution, from the spear
to the gun to the rocket,

has always been met with moral outrage.

Even bows and arrows, crossbows,

were condemned by the church in 1139.

Yes, but...

Raise your finger as much as you want,

but the truth is that the worst
killing machine of all time is humans.

I don’t have the numbers
in front of me,

but around 50,000 people
are killed by small firearms

in armed conflicts every year.

50,000. That’s twice the capacity
of the Ullevål Stadium.

And you can add bigger
conventional weapons on top of that.

That is frightening.

So I’m much more afraid of human beings

than a computer program,
as Ms. Gregersen calls it.

Just so it’s clear, I’m not a supporter
of conventional weapons. I mean...

Good.

Right. We’ll have to stop there.
You can agree on that, at least.

We must move to our next topic.
Thanks for joining us on Dagsnytt 18.

Our next topic is also related
to the events of the last few days.

Why are darker-skinned aid workers

sent to conflict areas deemed
too dangerous for white aid workers?

And this is what we eliminate
by being open to autonomous weapons.

An algorithm will never act in anger.

And if the legislation had let us use
our drone to its full capacity...

You know, Bjørn?

I just have to say
I thought that was amazing.

Yes. You couldn’t have done better.

Thanks. I’m not sure where it all came from.

But it went okay.

- It was great.
- Yeah? I felt it...

When I got going,
it started to roll, and...

- It went really quickly.
- It’s over before you know it.

Yes, it is.

But I guess I’d better get
the brawler back home.

- Yes.
- Bye.

Thanks.

I’ll teach you how to fight.

- You don’t know how.
- No, I don’t.

I can’t believe AGR wants to
invest in the prosthesis.

It’s just amazing. Just amazing.

- Look. Here’s another one.
- Tell me.

It’s not as positive, though.

“Total dystopia on Dagsnytt 18.

“Are we really discussing
autonomous drones?”

Yes!

Didn’t you see it?

We just discussed it.

What the hell’s wrong with you?
Are you a moron?

But what do you think?
About Rånåsfoss?

Rånåsfoss... might not be
such a bad idea.

Isn’t that the council slogan?

“Rånåsfoss – not such a bad idea!”

Yeah. I mean...

AGR has sold
a surveillance drone to the French.

Is there more to uncover?

We haven’t talked to
the Norwegian aid worker.

He’s in hospital.
What do you expect him to say?

I don’t know.

You should adjust your priorities
a bit now.

Okay?

- Hey.
- Hi.

I heard you and the missus hit it off.

Did we? Has she looked at the offer?

- Yes. She was super happy.
- Great.

- I felt like I was just babbling.
- No. Want a coffee?

Thanks a lot.

- Good job on TV yesterday.
- Oh? Thanks.

Something about the way you said it

made all the pieces
fall into place for me.

Not just AI,
but weapons development in general

and why we do what we do,
and like...

It’s a necessary evil.

And it’s just like you said.

It’s about minimizing
the loss of life, so...

Exactly correct.

I’m babbling.
I just wanted to say that.

You talked to Josef, right?

Josef, who’s that?

The hostage.
You were supposed to call him.

Oh, damn. I forgot.

That’s really bad.
I gave you the number.

Yeah, you did.

He reached out through the embassy
and asked to talk to you.

He asked specifically for me?

Yes.

This is Josef.

Yes, hello.
This is Bjørn Urdal from AGR calling.

Firstly, I want to apologize
for not calling earlier, but...

I’ve seen Dagsnytt 18.

Yes?

Why are you lying?

Hello? Are you there?

Uh, yes. Yes. I’m here.

Don’t you have anything to say?

- I honestly don’t know what to say.
- No?

I know exactly
what I’m going to say.

But not to you.

I hear you,
and I’d love to accommodate you,

but I’m not comfortable with this.

Randi, half of these kids will apply
for jobs with us after school anyway.

Isn’t it better that they start trained?

Go straight into solid jobs...

But this is about arms! They’re only 16.

Guess how old I was
when I started at AGR?

It had a different name then, but...

Bjørn. I’m in a meeting with the principal.

We’ll have to pick this up later.
But don’t forget.

Academia isn’t for everyone.

I talked to Josef. The guy
who was kidnapped, the hostage...

Shh. Let’s go over here. Come.

- Did he say who he’d talk to?
- No. But it’s probably a newspaper.

Or, damned if I know,
the UN or something.

What about the other hostage?
The Frenchwoman?

What if she talks?

It’s fine.

Okay?

Well, I don’t know.
Alain might have talked to her, but don’t...

Don’t worry about it, please.

Look around instead.
We’ve funded the new part and this building.

It was expensive,

but we’ve created it together.

I’ll make some calls and sort it out.

That won’t help.
This is about to blow up.

- So what do you want?
- You just have to fix it!

- I’ll do my best, Bjørn.
- Good.

Otherwise, I’ll have to tell someone
before Josef does it for us.

I believe the sale contract
only has your name on it.

Your name and your GLT.

You’ve done this yourself.

And you were alone in Mali
when it happened.

You never learn.

AGR offers a former criminal
a new chance,

and in return, you sell
illegal weapons behind our back.

You see, I’m a little sick
of all your empty threats.

You won’t admit anything.
You won’t rock the boat.

And I’m going to fix this.

Ann.

How are you?

I’m fine.

- You sure?
- You?

- I’m fine. Are you?
- I’m good.

- Be careful.
- It’s okay. Thank you.

- Take care.
- Thank you.

- I thought you were in France.
- No. I’ve been in hospital too.

- You’ve been here?
- A military hospital.

Really?

Have you seen the news?

They’re lying about everything.

It’s terrible. Poor kids.

- Have you talked to anyone?
- No.

- French reporters or anything?
- No. Have you?

No, not yet.

What will you say?

Just the truth.

That a drone flew in
and killed everyone,

young people, children.

Everyone.

Josef, you know it didn’t kill everyone.

It waited until
the little kids left the pitch.

And it saved our lives.

- Really?
- Yes.

Yeah, I guess so.

But...

How do you know
that it waited until the kids had left?

They told me at the hospital.

They told you that?

Yeah, well, I don’t remember...
I overheard it.

Is it true,

what Ismael said?

You work for the military?

Josef,

does it really matter?

Does it really matter?

Listen to me.

- Ann...
- Listen to me.

Is that why they kidnapped us?

That was why...

They wanted you.

That’s why they did that to me?

What’s important now is that
you don’t tell anyone.

Believe me.

Or what?

What will they do?

Kill me? Is that it?

We’re celebrities. Ann...

People have to know about this.

Josef...

Don’t tell anyone anything.

You’re sick.

You rest up.

I’ll come back later.

Okay.

- Bjørn here.
- Hi.

This is Kaja Rysst calling
from the Intelligence Service.

I’d like to discuss
a few things with you.

About the situation in Mali.

We’re trying to get an overview
of what happened.

NORWEGIAN AID WORKER DEAD