Original subtitles

Hi.

Hi.

There you are.

It’s good to have you home again.

Are you okay?

Yeah. It’s been quite hectic.

Congratulations.

On what?

It’s in the news.

Your drone saved those hostages.

Haven’t you seen it? It’s everywhere.

It’s amazing.

On...?

We go to Mali,

where two hostages have been rescued with Norwegian aid.

A hyper-modem drone came to the rescue in freeing two hostages...

I wish you’d occasionally ask me...

before making decisions.

Can’t you be glad I asked and you gained responsibility?

Seriously?

Yes. You should be proud you had the responsibility.

The kidnappers hid among civilians,

but no innocent lives were lost.

The drone, developed by Norway’s AGR,

located the hostages and helped French forces rescue them.

We don’t yet know how many perpetrators...

Didn’t we agree not to release details?

It’s not coming from us.

- Alain has leaked... - Alain?

To play it safe if civilian deaths come out.

Then he can blame our technology.

Civilians died?

Are you saying civilians were killed?

- This is reported as a success. - Yes, and it must stay that way.

Madeleine, call Rikke and make sure she pushes Bjørn on this.

Good job.

Hi, this is Madeleine Jahr’s cell phone...

Hi, this is Madeleine Jahr’s cell phone. Please...

CALL ME!

Bjørn.

I should start exercising again.

But hey, things are really buzzing.

We’re getting so many questions about AI that... Look at this.

I can call them later.

We can pick and choose what programs we want to talk to.

And we get a lot of free publicity.

You’ll be here the rest of the week?

In Norway?

Why?

They want to talk to you.

You’re the boss of it all, and...

- No. I don’t think so. That’s... - Yes. Yes. Yes.

I didn’t build the drone. I don’t know anything, so...

Those who know that stuff should talk.

A developer, in front of the camera?

No. This is what we’ll do.

I’ll call you when we’ve decided on a program, and then...

I’ve talked to the developers. They’ll give you a rundown.

And remember to call that hostage, the Norwegian they freed.

Josef Cissé. Sorry, I must take this.

Do you know where Madeleine is? She’s not answering. Or Ole?

Technical.

Why didn’t you come to the meeting?

We promised your teacher to go to those meetings.

- There’s no point. - Yes, there is.

The teacher doesn’t get it.

- Can’t you drop it? - No!

- Please? - No, I can’t!

- You’ll be thrown out of school. - Yeah. I don’t mind.

- Please, Birk. - No! Just drop it.

Okay?

- Are you saying it’s the French? - Don’t blow this out of proportion.

Well, look at that.

Welcome home.

- There’s something I have to tell you. - Spit it out.

I don’t know how to say this,

but it didn’t go as well as the media says.

At all. Alain suddenly went to use the drone.

It can’t have been ready, because it just went crazy.

Bjørn, I’ve seen the video, and talked to Alain.

You’ve seen the attack?

We’re in full control of the video, and it’s not going anywhere.

We’ve tested the drone thousands of times.

I’m at a loss.

We’re trying to work out what happened.

Sure, but Rikke wants me to go on TV.

I mean, people think this went well. What should we say?

We’ll figure it out.

Okay?

I have to go to a meeting. Call any time.

You might remember the WikiLeaks scandal

and the video of the American human-guided drone

killing innocent people in Iraq.

Right.

The soldier misunderstands and thinks a camera is a gun,

and he decides to attack.

This was in Kabul last year.

Same problem.

Unlike these soldiers,

an autonomous drone will never be over-eager,

impulsive, sadistic.

It will never become hysterical, tired, hungry, angry.

An autonomous drone follows the mission plan and fulfills its task

without distractions or emotion,

and without human errors, like here.

But...

I mean, can you say anything about... how AI works?

I mean, like...

Or KI.

- What do you mean? - I mean, I have to...

I have to explain the basics.

Just the ABCs, but it has to sound like I...

I just have to...

Yes, but remember what you told me when I started here.

You’re the one who told me that historically,

there’s always been moral outrage when new weapons are developed.

Right?

With the rifle, people...

I remember what I said. That’s enough.

You know you’ll never get your security clearance back?

And we need you.

We developed this system together. It’s our system...

It’s not our system. We couldn’t even copy HC’s algorithms.

This is the result.

Just try to turn it around. Okay? For one second.

Think that this could be the beginning

of something that can actually be good.

You think so?

Can you tell that idiot that I’m not coming back?

He’s waiting for me.

Okay, so Bjørn Urdal is an idiot now?

It’s fucking idiotic that he’s the CTO.

Oh, hi.

Hi.

So Endre had to... had to leave.

Okay.

I thought I’d prepare a little.

I guess I can Google it.

What will he do?

How was school today?

It was okay.

Okay?

Jørgen asked me to a launch party today, and I just blurted out,

“No, I’m not going to any launch parties with you. I quit.”

So I just resigned.

He was flabbergasted. And it feels great.

- That’s great, Mom. - Quit? Do you have a plan?

Yes. I called Marius.

He was super happy. I’m seeing him tomorrow.

Marius from AGR?

He called while you were in Mali. Didn’t I tell you?

No, you didn’t tell me.

Anyway. I called him back, and I’m meeting them tomorrow.

You can’t just quit your job!

I mean, you have to...

This is Bjørn.

Yes?

Okay.

Tomorrow?

Yes.

Right...

I’m appearing on Dagsnytt 18 tomorrow.

Okay. Good.

Yeah... It’s great.

- I have to talk to Ole. - Ole is busy right now.

No, I must talk to him. I was told he’s here.

Yes, but it’s very important no one disturbs him.

What is it?

I can’t go on Dagsnytt 18.

Bjørn, okay. Just calm down.

No! I’ll make a fool of myself. I can’t do it.

It’s Birk. Daddy not here?

- Look at him. - Shut up.

Fred!

We’ve saved lives with our technology, so this is a critical interview.

What does Ole say?

If we really want more money for AI, this is the way to go.

- We can’t hide... - What does Ole say?

Ole says the same, okay?

- Tell him to call me. - Yeah, yeah, yeah. I’ll tell him.

CONTACT TEACHER: BIRK IS IN THE ER AFTER A FIGHT.

God damn it.

Damn.

Hi, this is Mona. Leave a message, and I’ll call you back. Bye.

Birk’s been beaten up.

I’ll get him, but call as soon as you hear this.

It makes thousands of calculations in milliseconds,

which will ensure a natural and uniquely adapted mobility.

- And it’s all AI? - Yes.

It memorizes and automatizes all the movements.

The way we automatize movements learning to walk.

Just a lot faster, of course.

So after a short run-in,

it will function just like a regular foot.

This is just great. You know what we need?

We need to associate AGR with physical therapy, rehabilitation,

things other than arms and war.

I mean, we’re in no way ashamed of our arms production.

We do have some of the least dangerous arms in the world. Right, Amy?

- What? - To civilians.

I mean, their precision minimizes civilian losses.

They’re not Kalashnikovs.

We have numbers on that.

Right. I’m not quite...

Hey. Let me have a look at you.

It hurts.

I assume this was that Fred again.

If the school won’t act, we’ll go to the police.

I started it.

Okay.

Okay.

Why did you start it?

Hey.

Birk.

Hey.

You can just tell me. I won’t be mad.

Hey.

- What have you done? - It’s not my fault.

Okay.

So whose fault is it?

Is it mine?

Hey.

- How can it be my fault? - Some friends of his family...

Their business was meant to get money.

- And they thought you... - I see.

That’s when they started.

It’s happened since then?

It didn’t improve when you became a substitute teacher.

I don’t know what to say, Birk.

You have to tell me things like that.

I should probably have asked you.

Before I began.

I didn’t have a whole lot of options.

No, I know.

- I can’t wait to switch schools. - Yeah. I get that.

I won’t have time to drive you home. I have to be at NRK in 20 minutes.

Maybe they can put make-up on me before Mom sees.

I’m not sure it’ll help.

Come on, Tarzan.

Give me a moment.

Where the hell have you been?

That’s my impression of a skeleton.

Maybe we should think about ourselves. I know about this.

It’s far better to say what happened before someone else does.

- We have to go in! - Yes, but you can’t do that.

We have to go in.

What is it?

There’s a good basketball team in Rånåsfoss.

- Okay? - Pia says the school’s quite good.

Pia?

Someone I met there.

Okay.

AI technology is positive in many ways,

but in the arms industry, we need much clearer guidelines

than we currently have.

Bjørn Urdal, you are the newly appointed CTO of AGR.

Where do you think the world will be in ten years

in terms of AI technology?

In Norway, we say KI,

for kunstig intelligens.

We don’t want the developers to laugh at us.

So... Well...

I don’t believe in a dystopia, like...

- Like... - Her name is Gregersen.

I’m by no means as skeptical as she is.

On the contrary, I’m very positive.

I think the possibilities of KI are limitless.

I’m not claiming to be an expert,

but a rule of thumb I like to follow

is that you can read about something in a book

or a science magazine or whatever,

that will be possible in 10 or 15 years,

you can be sure that it’s actually possible already.

All you need is the means and ability to implement.

We at AGR have the ability and Norway has the means.

Together, we can develop computer systems

that can help people with tasks

we never imagined we could solve...

But Mr. Urdal, you are primarily an arms company.

We see ourselves as a technology company, first and foremost.

We produce modern instruments

for rehabilitation, autonomous navigation...

I’ll have to stop you,

because we’re not here to discuss your spring catalog, so to speak.

We’re discussing artificial intelligence,

because a Norwegian drone with Norwegian artificial intelligence

was used for an armed mission in Mali, of all places.

That’s right. One of our reconnaissance drones, called Ammo,

found the hostages in one night,

with no human intervention.

It is a huge breakthrough for this type...

Yes. This time... This time, it was a reconnaissance drone,

but who can guarantee that the French

won’t attach a weapon to the drone next time?

I mean, do we want a computer program to make decisions about life and death?

Is that what we want?

Mr. Urdal? Can a computer make moral decisions on behalf of humans?

Mr. Urdal?

If you ask me, this is a very dangerous path to follow...

Okay, but we have to go back to Mr. Urdal.

What prevents you from developing technology

that makes moral decisions on its own on our behalf?

The legislation prevents it.

We would never sell such technology to anyone before it is legal.

But you’re not opposed to its development?

I understand that autonomous weapons in war

can be a scary thought,

but don’t forget that war itself is a frightening concept.

People trying to kill each other is a frightening concept,

and we humans get tired, we get hungry, we get angry,

we become hysterical and prejudiced. We make decisions in anger.

Since we’re here to discuss this incident in Mali,

I’ll use an example from there.

As of today, French soldiers have killed more civilians in Mali

than the terrorists.

That’s not what they wanted, but it’s still true. And why?

Because humans make mistakes.

It’s so-called human errors.

And this is what we eliminate by being open to autonomous weapons.

An algorithm will never act in anger.

And if the legislation had let us use

the technology in our drone to its full capacity,

we might have been able to carry out this mission without civilian losses.

Were there civilian losses in Mali?

Damage. Without civilian damage.

The Norwegian hostage wouldn’t be in hospital now. Right?

But we’re not there yet, because it’s too scary.

My point is that

military evolution, from the spear to the gun to the rocket,

has always been met with moral outrage.

Even bows and arrows, crossbows,

were condemned by the church in 1139.

Yes, but...

Raise your finger as much as you want,

but the truth is that the worst killing machine of all time is humans.

I don’t have the numbers in front of me,

but around 50,000 people are killed by small firearms

in armed conflicts every year.

50,000. That’s twice the capacity of the Ullevål Stadium.

And you can add bigger conventional weapons on top of that.

That is frightening.

So I’m much more afraid of human beings

than a computer program, as Ms. Gregersen calls it.

Just so it’s clear, I’m not a supporter of conventional weapons. I mean...

Good.

Right. We’ll have to stop there. You can agree on that, at least.

We must move to our next topic. Thanks for joining us on Dagsnytt 18.

Our next topic is also related to the events of the last few days.

Why are darker-skinned aid workers

sent to conflict areas deemed too dangerous for white aid workers?

And this is what we eliminate by being open to autonomous weapons.

An algorithm will never act in anger.

And if the legislation had let us use our drone to its full capacity...

You know, Bjørn?

I just have to say I thought that was amazing.

Yes. You couldn’t have done better.

Thanks. I’m not sure where it all came from.

But it went okay.

- It was great. - Yeah? I felt it...

When I got going, it started to roll, and...

- It went really quickly. - It’s over before you know it.

Yes, it is.

But I guess I’d better get the brawler back home.

- Yes. - Bye.

Thanks.

I’ll teach you how to fight.

- You don’t know how. - No, I don’t.

I can’t believe AGR wants to invest in the prosthesis.

It’s just amazing. Just amazing.

- Look. Here’s another one. - Tell me.

It’s not as positive, though.

“Total dystopia on Dagsnytt 18.

“Are we really discussing autonomous drones?”

Yes!

Didn’t you see it?

We just discussed it.

What the hell’s wrong with you? Are you a moron?

But what do you think? About Rånåsfoss?

Rånåsfoss... might not be such a bad idea.

Isn’t that the council slogan?

“Rånåsfoss – not such a bad idea!”

Yeah. I mean...

AGR has sold a surveillance drone to the French.

Is there more to uncover?

We haven’t talked to the Norwegian aid worker.

He’s in hospital. What do you expect him to say?

I don’t know.

You should adjust your priorities a bit now.

Okay?

- Hey. - Hi.

I heard you and the missus hit it off.

Did we? Has she looked at the offer?

- Yes. She was super happy. - Great.

- I felt like I was just babbling. - No. Want a coffee?

Thanks a lot.

- Good job on TV yesterday. - Oh? Thanks.

Something about the way you said it

made all the pieces fall into place for me.

Not just AI, but weapons development in general

and why we do what we do, and like...

It’s a necessary evil.

And it’s just like you said.

It’s about minimizing the loss of life, so...

Exactly correct.

I’m babbling. I just wanted to say that.

You talked to Josef, right?

Josef, who’s that?

The hostage. You were supposed to call him.

Oh, damn. I forgot.

That’s really bad. I gave you the number.

Yeah, you did.

He reached out through the embassy and asked to talk to you.

He asked specifically for me?

Yes.

This is Josef.

Yes, hello. This is Bjørn Urdal from AGR calling.

Firstly, I want to apologize for not calling earlier, but...

I’ve seen Dagsnytt 18.

Yes?

Why are you lying?

Hello? Are you there?

Uh, yes. Yes. I’m here.

Don’t you have anything to say?

- I honestly don’t know what to say. - No?

I know exactly what I’m going to say.

But not to you.

I hear you, and I’d love to accommodate you,

but I’m not comfortable with this.

Randi, half of these kids will apply for jobs with us after school anyway.

Isn’t it better that they start trained?

Go straight into solid jobs...

But this is about arms! They’re only 16.

Guess how old I was when I started at AGR?

It had a different name then, but...

Bjørn. I’m in a meeting with the principal.

We’ll have to pick this up later. But don’t forget.

Academia isn’t for everyone.

I talked to Josef. The guy who was kidnapped, the hostage...

Shh. Let’s go over here. Come.

- Did he say who he’d talk to? - No. But it’s probably a newspaper.

Or, damned if I know, the UN or something.

What about the other hostage? The Frenchwoman?

What if she talks?

It’s fine.

Okay?

Well, I don’t know. Alain might have talked to her, but don’t...

Don’t worry about it, please.

Look around instead. We’ve funded the new part and this building.

It was expensive,

but we’ve created it together.

I’ll make some calls and sort it out.

That won’t help. This is about to blow up.

- So what do you want? - You just have to fix it!

- I’ll do my best, Bjørn. - Good.

Otherwise, I’ll have to tell someone before Josef does it for us.

I believe the sale contract only has your name on it.

Your name and your GLT.

You’ve done this yourself.

And you were alone in Mali when it happened.

You never learn.

AGR offers a former criminal a new chance,

and in return, you sell illegal weapons behind our back.

You see, I’m a little sick of all your empty threats.

You won’t admit anything. You won’t rock the boat.

And I’m going to fix this.

Ann.

How are you?

I’m fine.

- You sure? - You?

- I’m fine. Are you? - I’m good.

- Be careful. - It’s okay. Thank you.

- Take care. - Thank you.

- I thought you were in France. - No. I’ve been in hospital too.

- You’ve been here? - A military hospital.

Really?

Have you seen the news?

They’re lying about everything.

It’s terrible. Poor kids.

- Have you talked to anyone? - No.

- French reporters or anything? - No. Have you?

No, not yet.

What will you say?

Just the truth.

That a drone flew in and killed everyone,

young people, children.

Everyone.

Josef, you know it didn’t kill everyone.

It waited until the little kids left the pitch.

And it saved our lives.

- Really? - Yes.

Yeah, I guess so.

But...

How do you know that it waited until the kids had left?

They told me at the hospital.

They told you that?

Yeah, well, I don’t remember... I overheard it.

Is it true,

what Ismael said?

You work for the military?

Josef,

does it really matter?

Does it really matter?

Listen to me.

- Ann... - Listen to me.

Is that why they kidnapped us?

That was why...

They wanted you.

That’s why they did that to me?

What’s important now is that you don’t tell anyone.

Believe me.

Or what?

What will they do?

Kill me? Is that it?

We’re celebrities. Ann...

People have to know about this.

Josef...

Don’t tell anyone anything.

You’re sick.

You rest up.

I’ll come back later.

Okay.

- Bjørn here. - Hi.

This is Kaja Rysst calling from the Intelligence Service.

I’d like to discuss a few things with you.

About the situation in Mali.

We’re trying to get an overview of what happened.

NORWEGIAN AID WORKER DEAD