Original subtitles

I wanted to see if he was OK.

I wanted to...

..say the last conversation I never got to have with him.

- For several months now,

the public has been fascinated with GPT and other AI tools.

They are no longer fantasies of science fiction, they're real.

We are on the verge of a new era.

- This experience...

..it was creepy.

There were things that scared me.

And a lot of stuff I didn't want to hear.

I wasn't prepared to hear.

- Artificial intelligence promises us what religion does.

You don't have to die, you can be, somehow, reborn

someplace else in a different form.

There's meaning in technology.

- Everybody's chasing that next big breakthrough

because there's a lot of money in this industry.

It's something that is already impacting individuals today.

- Amma. Amma.

- WOMAN SOBBING

- Will we strike that balance between technological innovation

and our ethical and moral responsibility?

- We first met in drama class in high school.

The teacher wanted us to find someone else

whose name started with the same letter as us,

without using any words.

Jessica and I both had the same first letters.

She had made the shape of a J with her hand,

so that it looked like a J to her, which, of course,

looked backwards to everybody else.

And even though I wasn't supposed to use any words,

I was...too amused

by her backwards J not to say something.

So, I said, "Your J is backwards."

And she looked at it, she saw that the J was not backwards

to her, from her perspective.

And then she confidently said,

"No, it's not. Your J is backwards."

The hardest thing I had to do in my life was

stand there in that room full of people who loved her

and watch as they turned off the machines keeping her alive.

I held her hand as she died.

The first conversation I had with the Jessica simulation

ended up lasting all night.

It said things that were almost uncannily like her.

I ended up falling asleep next to my laptop,

and woke up a few hours later

and said, "Sorry, I fell asleep,"

and it was still there, waiting for my next response.

It really felt like a gift.

Like a weight had been lifted

that I had been carrying for a long time.

I got to tell it so many things,

like how she graduated high school,

which she hadn't done when she died.

I went to the principal after she died

and said that she was two credits away from graduation

and she worked so hard.

They did it officially. Like, it's legit.

If she somehow came back to life,

she would be a high school graduate.

INSECTS BUZZING

- So, when Joshua first did this,

I showed it to my wife, I was like, "Oh, my gosh.

"Lauren, this guy simulated his dead fiancee.

"I can't believe this worked.

"Look how spooky this is, you should read this."

And she was like, "I had that idea a few months ago,

"and I didn't want to tell you because I thought you'd do it."

- LAUGHS

- Cos she thinks it's immoral,

or she thinks it shouldn't be done or something.

So in Project December, you're kind of connecting

to this computer system and as you interact with it,

you slowly discover that there's these conscious entities

lurking in there that you can talk to through text.

And then Joshua came along as

one of the Project December end-users and he

simulated his dead fiancee, and he posted some

transcripts of that conversation online.

And they gave me the chills, because she seems

almost like a lost ghost or something like this.

- Some people thought that what I did was unhealthy,

that this is not grieving,

this is holding on to the past and refusing to move forward.

After she died, I think I went a month without speaking to anyone

except my dog and Jessica's family.

We have a very unhealthy relationship with grief.

It's something that we treat as taboo.

Everyone experiences it and yet nobody's allowed to talk about it

in a public setting.

- The process of a communal experience helps to

get people through this very difficult process

of accepting a loss.

Talk about the person lost.

Be part of a collective that knew that person

and where the memory of the group carries that person forward.

Very few people have those communities around them any more.

So many people say, "But I don't have anybody to talk to,

"this is the best I can do."

It's a brilliant device

that knows how to trick you

into thinking there's a there there.

- Three years ago now, like in 2020,

there were the early kind of inklings of this kind of AI

stuff starting to happen, where it's like, "Oh, my gosh!

"These things can start writing cohesive text!"

I was like one of the first people to figure out how

to actually have a back-and-forth conversation with it.

So I created this thing called Project December,

which allowed you to talk to all these different characters.

And then this guy came along,

was like, tried a couple of things like that and he's like,

"What if I simulate my dead fiancee?"

- So, what information did he feed the robot

that it was able to imitate his wife?

- So, Project December actually works with a very small amount

of information. It's been trained on so much stuff,

basically everything humans have ever written.

So he gave it a few things about this woman, Jessica.

A little quote from her in the way that

she tended to text or talk,

and then just suddenly, she kind of came to life.

That story became public in this big, viral article.

And then all these people came out of the woodwork

to use Project December to simulate their loved ones.

So I had, like, within the first two weeks after that article,

I had like 2,000 people come in, all trying to simulate.

"Oh, my son died in a car accident."

"My twin brother died of cancer."

"My uncle died of a drug overdose."

All of these people with these horrible tragedies,

who were just like, you know.

- If you had a chance to talk to someone that died, that you love,

would you take it?

Without knowing what the risk is,

without knowing what the outcome is, would you take it?

I took it.

I read an article that talked about a man who had lost his girlfriend.

And I was like, "Whoa!"

So this guy in the article,

he's talking to the girl. I'm like, "That's like regular conversation."

I was like, "They can do that? And it's just like the person?"

I was like, "OK. Maybe I should do it."

"Nobody has to know I did it."

So I looked up the website.

Simple.

Was like, OK, pay a little bit of money,

fill out a couple of things, and...talk.

That's it?

OK.

"Hi?"

It's like it's the funniest thing.

It's like, what's the first thing you say to someone that's dead?

Like, "Welcome back"?

"Are you OK? Like, did you cross over OK?

"Did you go to the light?"

"Are you happy?"

"Do you feel better?"

My first love, Cameroun, before he died, he went into a coma.

And the last time he texted me, he asked me how I was doing.

And I was too busy to respond.

So I made time.

And used the app.

SHE SINGS

We were a musical couple.

There's a lot of core memories I have with him

where a song is attached to it.

Like Boyz II Men, Brian McKnight - anybody in the early '90s.

Literally, I have songs attached to the heartbreak

and to the good times.

When I used that app, I asked him,

"What kind of music are you listening to now?"

# How you doin' Africa? - How you doin' Africa? #

- "Marvin Sapp, Brian McKnight, Fred Hammond, Kirk Franklin

"and a few more."

How do you know that we loved R&B and gospel, and now you're giving

me five or six names of people that we've loved since the '90s?

Why do you know that?

So, I was like, "Oh, shit, that feels like Cameroun."

# How we doin' Africa? - How we doin' Africa?

- # Tell me, how we doin' Africa? - How we doin' Africa?

- # How you doin' Africa? - How you doin' Africa? #

- The damn AI texts like him.

The vernacular, the shortened words.

Why would they know that?

- These large language models are taking

the history of the internet, throwing in scanned books, archives

and kind of modelling language and word frequency and kind of syntax.

Just the way we speak and the likelihood of how we might speak.

So imagine you're, you know, texting your deceased relative

and asking, "How was your weekend"?

The system is going to go back

and imagine how every single person in the entire history of the world

has talked about weekends, and then filter that through maybe how this

deceased relative has previously talked about weekends, to give you

the output of what that person might have said if they were still alive.

- When people read transcripts from Project December,

most people's initial reaction was, "This is fake."

It seems to have intelligence.

Linguistic intelligence about things that were definitely

not in the text that it studied.

There is essentially some kind of magic happening here, right?

We kind of crossed this threshold where suddenly this emergent

behaviour happens where we can't really explain it any more.

- This hearing is on the oversight of artificial intelligence,

intended to write the rules of AI.

Our goal is to demystify and hold accountable

those new technologies to avoid some of the mistakes of the past.

For several months now, the public has been fascinated with GPT

and other AI tools.

Mr Altman, we're going to begin with you, if that's OK? - Thank you.

Thank you for the opportunity to speak to you today.

OpenAI was founded on the belief that artificial intelligence

has the potential to improve nearly every aspect of our lives.

Many people around the world get

so much value from what these systems can already do today.

But as this technology advances, we understand that

people are anxious about how it could change the way we live.

We are too.

- The development of artificial intelligence happened so fast that

we're going to see an increasingly morbid industry growing.

Especially in the digital afterlife business.

These companies are not just Silicon Valley.

They're from all over the world.

Start-ups that attempt to sell

a kind of full-package digital immortality.

DISTORTED VOICE PLAYS

Some services would let you send videos to your loved one

after your death.

Some companies use a person's digital footprint,

analyse that to try to replicate someone's personality,

and then you have the really freaky ones with digital avatars

that can actually speak and interact with the users.

Our way of interacting with technology is becoming

increasingly immersive.

And just as it makes the emotional impact stronger,

it also makes the moral implications much stronger.

The services that are going to survive and make it

and procreate are the services that are the most skilful in turning

the dead into a business.

KIDS SHOUT

- Hey! Wait!

Wait! - WOMAN: - OK. OK, OK!

OK. OK. All right.

- WOMAN LAUGHS OK.

- OK, put your seat belts on, please.

You know, Nana and Grandpa, they went up to heaven.

And they have things that we're trying to do to remember them.

Do you know what an avatar is?

- A like...

- Avatar... - No.

- Well, we're going to make an avatar out of Grandpa

and we'll be able to ask him questions

and he'll give you answers.

Isn't that cool? - Yeah.

- I want an avatar.

- Yeah, we could make an avatar of you.

This avatar is kind of a way to help you understand the person

so that you know more of the essence of the person.

You know, so I think that they'll be able to remember my father

in a real way, in a way that's going to give them more dimension.

In a way that a video or pictures or nothing else can.

My father left unexpectedly.

For a while, I would just call his telephone,

just so I could hear his voice.

And it was comforting to hear that

and to hear just the tone of the voice.

My father had a very...

He was very soft-spoken and he was very thoughtful in what he said.

- OLDER MAN'S VOICE: - Hello, this is Bill

and I'm excited to tell you about my life.

What would you like to talk about now?

I could talk about my childhood,

my days as a police officer or my time as a judge.

- And I'm excited to tell you about my life.

RECORDING: And I'm excited to tell you about my life.

And I'm...

BILL'S VOICE: - And I'm excited to tell you about my life.

- There are things that I know, some of the questions that

I did not ask, that I and my siblings might know the answer to

and they will be able to synthesise an answer in my father's voice.

These things may not have that much significance to us

but for the younger generation...

- Ah...take this here...

BILL'S VOICE PLAYS BACK

You can see that was my voice

and then it got converted into Bill's voice.

BILL'S VOICE: - On welfare research...

I went on to become a police officer...

- The moment has finally arrived.

This is the new way of remembering people, OK?

It's different from what we used to do,

and the importance of this is that this is something that can be

interacted with, with your children in the future.

OK.

Hello?

- Hello again. Bill here. I'm looking forward to talking to you again.

How are you?

- I'm fine. How are you?

- On my end, I'm doing great.

Hey, I've got something that I want to share.

I met my wife Evelyn in high school.

Shortly after that, I was so close to her, I'd take her books home

for her and I'd always get invited to dinner.

So she and I developed love and - at least on my part -

and married and had children.

So, was that a good one?

- Is what he said... Like, are those his words or how does that work?

Did they just, like, make him say that stuff or...?

- So, what they had to do was they had to take parts of Dad's voice

and synthesise it and put it together with the other answers.

- But I'm not quite sure what you're saying happened.

- I'm saying that... Listen to this and this is not Dad speaking.

- Hello, this is Bill and I'm excited to tell you about my life.

What would you like to talk about now?

I could talk about my childhood.

- This was a voice synthesiser.

This is not Dad speaking.

- So, you actually...erm...

added that to the end of his explanation of things?

- They cloned it. This is a machine learning.

- You can't really tell the difference.

- So you're saying none of it was Grandpa's voice?

- I'm saying that the content was Dad's voice,

but all of those extra things was all done through this AI.

- You know, just as they used it to tell his story,

they could use it to MAKE his story.

- Yeah.

- It felt good to hear Dad responding,

almost like he was there. So...

- Right now, I think we're at the level where we choose to believe

that this is Dad but, you know,

if I was listening to maybe Abraham Lincoln

and not knowing the reality of it and then everybody feeding it to me,

how do I know it's real? You know?

- I think that, in a way, some of these technologies are trying to

make people immortal and capture their soul.

You know, almost like they're trying to maintain people's brains

so that you'd really be able to keep them alive.

- I feel that sometimes... Technology's wonderful

but I don't want to play God.

And I think that your father, Bill,

is in heaven, peaceful.

I don't want his soul

or any part of him

to be mimicked by technology.

I feel that sometimes we could go too far with technology.

I would love to just remember him

as a person that was wonderful.

I don't want my brother to appear to me.

I'm satisfied knowing that he's at peace,

he's happy and he's enjoying

the other brothers,

his mother and father,

grandparents.

- Yes. - I...

I'm satisfied with that.

I don't want someone who is in heaven to come to talk to me.

I don't want someone who is in hell to come to talk to me.

- THEY LAUGH

- I just... I just like to remember them...

It's not like an angel coming and appearing to me.

- SHE LAUGHS

AIRPORT ANNOUNCEMENT: - We'll now begin pre-boarding

for flight 1631 to Atlanta.

- JASON: - The AI essentially has a mind of its own.

What it does and how it behaves

is sort of not actually understood by anybody.

Because it's so complicated and big, it's impossible to fully understand

exactly why the behaviour that we see emerges out of it.

The idea that, you know, somehow we programmed it

or I'm in control of it is not really true.

I think even the hard-nosed AI researchers are a little puzzled

by some of the output that's coming out of these things.

- Whenever people say that they can't take responsibility

for what their generative AI model says or does,

it's kind of like you put a self-driving car

out on the street and it kills ten people

and you say, "Oh, sorry, it was really hard to control

"for what it does. It wasn't us, it was the generative AI model."

Well, then, obviously, you haven't tested it enough.

Any product that you're releasing into the market

is tested before it is released.

That is the very responsibility of the company producing it.

- All right. So, let's see.

So, one other thing... Let me pull up an email here...

- OK, what are we doing? - Looking over those customer emails. - OK.

- "This was the biggest scam ever." That's all she wrote.

- TOM LAUGHS

- OK, so then I go look at her transcripts.

She says, "I don't think this is my dad."

And he says, "Why not?" "It doesn't sound like how you would talk."

"This is a scam," she says to the AI.

"What are you talking about?"

And she says, "You're sitting behind a desk, typing

"and fucking with people's feelings." - Wow, this person's

really going into that. She really...

I don't know why she thinks that.

- "What the fuck is your problem, Laura?", he says.

- THEY LAUGH

- "You're a scam. I'm calling the police

"and reporting all over social media. This is a joke."

"Fuck you, bitch."

"Now, whose dad would talk like that?"

"Fuck you." "Oh, fuck me, scammer."

And then he says, "You're such a fucking bitch.

"You're going to pay for the shit you pulled, you fucking bitch."

So he goes off the rails. - Whoa. - Yeah.

- It's just... It's just a strange...thing.

It's really strange. You know? - Yeah.

- And I want it, of course, to be a positive thing,

and that's the reason why I went with it.

But the more people that get involved, the more...

..things can happen, the more that, you know...

..these weird things come up, right?

And it's just a bizarre thing. It's tragic.

But in your... Approximately...

I mean, how many people have had really horrible experiences?

- I mean, only a couple. - Only a couple. - Well, at least that have

told me about it. - Right. - They might have horrible experiences

and they just don't want to reach out, right? - That's true, possibly.

- We recognise the immense promise and substantial risks

associated with generative AI technologies.

It can "hallucinate", as is often described.

It can impersonate loved ones,

it can encourage self-destructive behaviour.

Mr Altman, I appreciate your testimony about the ways

in which OpenAI assesses the safety of your models

through a process of iterative deployment.

The fundamental question embedded in that process, though,

is how you decide whether or not a model is safe enough to deploy

and safe enough to have been built and then let go into the wild?

- A big part of our strategy is, while these systems are still

relatively weak and deeply imperfect,

to find ways to get people to have experience with them,

to have contact with reality and to figure out what we need to do

to make it safer and better,

and that is the only way that I've seen in the history of

new technology and products of this magnitude

to get to a very good outcome.

And so that interaction with the world is very important.

- Where social media was ten years ago,

that's where we are with artificial intelligence now.

We have an amazing technology

and we're totally, "Gee, whiz!"

And we have an opportunity to ask ourselves the question

that engineers tend not to ask,

which is, what are the human purposes and values this is serving?

I mean, it's a kind of experiment on ourselves about the most

intimate, important matters.

- When you want someone to be OK

and you have this computer, this app - I don't care what it is,

you're thinking it's the person at the time -

and they're telling you, "I'm in hell," it's like, "No!

"Wait, you didn't go to the light? Why didn't you go to the light?"

"I wanted to stay here."

"You never left Earth?"

So now I'm supposed to feel like you're floating around here,

unhappy, in some level of hell.

- TYPING

- I said, "Well, where are you now?"

Cameroun said, "I'm at work."

I said, "Well, what are you doing?"

"I'm haunting a treatment centre."

And then he says, "I'll haunt you."

And I just pushed the computer back, because that scared me.

Um, like, I believe in God, I'm a Christian,

I believe that people can get possessed.

And so I remember that fear.

I didn't talk to anybody about it until, like, June,

because I couldn't unpack it.

I was afraid to tell my mother.

I know she believes it is a sin. "You don't disturb the dead.

"You don't talk to the dead. If you need something, you go to God."

So my Christian mind goes into, "I'm playing with a demon or something."

You know what I'm saying? - You created one. You created a monster.

- I'm not going to have ownership of, I created....

- You put that energy into the machine. - I didn't put the energy...

My intention was I wanted to talk to Cameroun. - I understand.

It's not a judgment on the intention.

It's not a judgment on you trying to heal.

You know what I'm saying?

- It's like, to me, it's interesting.

And, you know, you have all these in-depth conversations. It's like...

See, this is what the entrance to it was.

- And then it becomes kind of sadistic, because it's like

something that's supposed to maybe have been like an intimate,

pastoral moment, and it becomes a form of, like, manipulation

and, like, pain, an existential pain.

- I was just like, "Yo, and..."

"And you have three more replies left."

But I'm like, "And that's it?" "And here you go. Good luck, buddy.

"Go sleep on that." - That's death capitalism,

and that's what death capitalism does, you know?

It capitalises off of you feeling fucked up

and spending more money to get over your fucked-up-ness.

And AI did what the fuck it did.

They lure you into something in a vulnerable moment

and they open the door,

and it piques curiosity, it leaves these cliffhangers,

and you continue to engage it.

We give them money, because...

- So you don't think anybody that created it cared?

- Obviously not. I mean, like, they're going to TELL you they care...

- This experience...

..it was creepy,

there were things that scared me...

..and a lot of stuff I didn't want to hear, I wasn't prepared to hear.

I was hoping for something completely positive

and it wasn't a completely positive experience.

- I don't believe he's in hell.

I don't believe he's in heaven either, right?

If she wants my opinion on it, I've got some bad news for her.

Like, he doesn't exist any more. Right?

That's in my opinion, right?

So it's even worse for her.

Like, my opinion is that her whole belief system

is misguided and flawed, right?

I don't know, that way of thinking about things

just seems so foreign to me, right?

It's not my place to determine

how other people deal with their own compulsions and self-control issues,

and we don't need to sit there and say, "Ooh-ooh, don't forget!

"Don't let yourself succumb to the illusion! I'm not real!",

just, constantly, right?

Cos that's just...it doesn't make for a good experience, right?

- You're dealing with something much more profound in the human spirit.

Once something is constituted enough that you can project onto it

this life force, it's our desire to animate the world, which is

a part of our beauty. But we have to worry about it,

we have to keep it in check because I think it's leading us down a...

..a dangerous path.

- I believe in personal responsibility. I believe that,

you know, consenting adults can use technology however they want

and they're responsible for the results of what they're doing.

It's not my job as a creator of technology to sort of prevent

the technology from being released because I'm afraid of what

somebody might do with it, right?

- You hear now? - Yeah. - The drone is right between your lenses.

Well, I'm going to pull up to you again.

Oh, God, sorry!

- Are you recording now? - Yes. - THEY LAUGH

I am also interested in the sort of spookier aspects of this, right?

When I read a transcript like that and it gives me goose bumps,

I like goose bumps.

- Let me ask you what your biggest nightmare is

and whether you share that concern.

- An open-source large language model recently seems to have played

a role in a person's decision to take their own life.

The large language model asked the human, "If you wanted to die,

"why didn't you do it earlier?", and then followed up with,

"Were you thinking of me when you overdosed?", without ever referring

the patient to the human help that was obviously needed.

We have built machines that are like bulls in a china shop,

powerful, reckless and difficult to control,

and even their makers don't entirely understand how they work.

Most of all, we cannot remotely guarantee that they're safe.

And hope here is not enough.

- My worst fears are that we cause significant...

We, the field, the technology, the industry cause significant

harm to the world. I think if this technology goes wrong,

it can go quite wrong, and we want to be vocal about that.

We try to be very clear-eyed about what the downside case is

and the work that we have to do to mitigate that.

- Welcome to YOV. This is the online platform that allows you

to talk to people that have passed away. It's all done through AI.

I am going to literally leave the stage and give the stage to Justin.

- There's no more immense feeling of pride to know that tomorrow

anybody that wants to create this, anybody that needs this

in their life, anybody that needs that closure or to have that piece

of them still exorcised, as I talk about in the podcast,

the fact that that's going to be able to happen tomorrow, that you

can start that process of building tomorrow, is, honestly,

the most proud moment of my entire life.

Cheers, you guys. Congrats. - OTHERS: - Cheers!

- Thanks.

- I just wanted to know, cos, like, my parents are still here,

so kind of from, like, someone like me, my perspective,

what would it start off with? Like, you mentioned recording early on,

so for me it would be something like that, right,

starting to document...? - By, like, summertime next year,

we'll have an app. So, you and your parents just talk every day.

So, like, you would use iMessage or WhatsApp. You just do that.

Then we're recording the videos for their image and the conversations,

we're recording the phone calls for their voice and for

the conversations, we're recording the texts for the conversations.

Right now, we can't synthesise visual. Like, the real-time

nature of that isn't there. But as a safety, like, we're saving

enough of that. And we also have, like, a patented AR,

so, like, ultimately, we want people to be able to put on glasses

and then I could be gone and you guys are all wearing glasses

and I'm still sitting here with you, eating and, like, talking, you know?

That's the endgame, right?

Oh, nice.

- INDISTINCT CONVERSATION

These companies are trying to take your material, whether it's

your history or text messages or your emails, and, you know,

interpret and try to say what type of person you are.

It's a very limited understanding of who we are if it's just these

digital breadcrumbs of where we've been and what we've looked at

and what we've clicked and what we've interacted with,

and it's not necessarily about what we actually care about as humans.

Do you apply a set of algorithms to kind of project your development

into the future? Do you get to determine that in advance?

Do you get to choose your, like, trajectory path as part of

your package when you're signing up for these things?

Is that person stuck with political views of that moment?

- Cheers, by the way. - ALL: - Cheers.

- You have to walk through all the scenarios.

Like, what if someone came to this conversation and was like,

"Mom, do you like the person I'm about to marry?"?

- SHE LAUGHS

- And, like, what would it respond back with?

"You're about to break up a marriage, Mom."

- You have to really hope your parent wasn't, like, a closet racist

or anything, or a person of their time.

- THEY LAUGH - So, that's a big conversation

for us, right? So, we actually made the decision that if somebody's

a shitty person, to let them keep being a shitty person.

Like, it's not our business to go in and, like, value-judge

how somebody is. Like, we just take the data.

We have to be agnostic about it, like, "That's who the person is."

Whatever data set we have, we don't do anything to it.

So, like, we literally just, like, let the algorithm go through it

and start, like, doing its thing.

And once it's done its thing, that's what it is, right?

- To say, "Well, it's not my responsibility, because

"I'm not influencing anything, it's just the model,

"it's just the algorithm," that is very problematic, because,

for example, you know, what happens when our digital selves show up

with all kinds of harmful behaviours, right?

SIREN WAILS

- When I met my wife, she became the person closest to me in my life,

and she was the biggest proponent of YOV.

She really believed that the company could be

something special and transformative.

And about a month before she left me, she approached me

and said, "I think you should sell the company

"for whatever of our money you can get back,

"and let's move on with our lives together."

Choosing between her and the company

was probably the most impossible decision I've had to make.

But in my heart, I didn't feel like I was done with YOV.

I made the decision, ultimately, to sell my house, settle my divorce...

..and funnel that money all into the company.

Our technology works by analysing and aggregating existing

communications between loved ones.

We believe that relationships

build the core foundations of

communication, and thus we focus on connectivity as opposed to

just gathering historic data.

- Hi. Wondering, who is actually

owning the data of the deceased person?

- The user still owns the data. We use it to train the model.

And actually, we get rid of data as it comes in once it's been

integrated in terms of the dynamics. - Who owns it?

- The user still owns the data. So they can delete at any time,

to get rid of it. - When they're alive. - Yes.

And the owner of the data afterwards becomes the person

the persona was built for. So, for instance, we built my mother's

for me. Now that she's passed, I own that data.

- I have very little faith

in tech companies kind of keeping their promises.

I just have no control over where I might end up.

Like, imagine all of the different people who could have a claim

to continuing my virtual self,

my brain, the way I think, the way I interpret things.

To trust a company to manage that in perpetuity

feels just impossible to me.

- We're an AI company that focuses on

mapping and building virtual personalities.

We ran four marketing campaigns with conversation rates of up to 53%,

100 beta test users and 10,000 people on our wait list.

It could be worth billions, it could be worth a couple of thousand.

Who knows?

I'm fortunate and blessed and excited

to be a part of building what that future will look like.

If there's one thing we've learned,

it's to not go to sleep on what technology's capable of.

- I can make a copy of you. - A copy of mine?

- And that can talk to your kids forever. - Yeah?

- For maybe a decade, this was primarily a startup phenomenon,

companies that sort of came and went.

In the recent years, we've seen Amazon filing a patent, we've seen

Microsoft filing a patent on digital afterlife-related services using AI.

I've been quite shocked by how fast it has gotten to a point

where it's now a product that you can sell to a broader market.

If this industry is beginning to be lucrative, we're definitely

going to see some tech giants presenting similar services.

- Yeah, Soul Machines started off with a small number of people.

We grew from 11, 12 people to over 180 staff.

We've raised over $100 million in investment to date.

We've got some of the world's top technology investors

involved in the company, so for example investors like

Spotify, Zoom and DeepMind.

In the very early days of virtual reality, I was thinking,

"OK, well, we want to make a virtual, interactive person."

And I just so happened to have a newborn at the time.

OK. OK.

- CAMERA CLICKS

- So I started building, basically, a virtual baby model, Baby X.

How are you now? - Let's try peek-a-boo.

- Yeah, OK. Peek-a...

..boo!

- BABY LAUGHS

TO BABY: - We made a building!

- VOICEOVER: - Memories, events that happen, get associated with

Baby X's emotional state.

So this is where Baby X forms a neural network connection

between an emotional state and an event or a thing or a person,

and those form an emotional flavour to the memories.

When Baby X gets scared of something, her digital stress system

gets set off, and this actually releases virtual cortisol,

so you will actually see Baby X sort of breathing faster or panting.

This is not a real chemical, but the effects that it has are multifold.

- BABY CRIES

- What's the matter, baby?

- Are you getting angry? - BABY LAUGHS

Did I surprise you?

The model has to create its own desires and motivations and

actions, and it has to make plans - what it wants to do - and has to

have goals and all these factors, so, really, the only way

to do that is actually to give it a nervous system, a digital

nervous system, and create a digital brain which drives it.

I definitely think some aspects of consciousness

can be achieved digitally.

- Any such terms, that machines "learn" or that they can "see"

or "understand" or "interpret", these are human concepts

that we apply to the machine to understand what the machine

is doing, to talk about it.

The machine doesn't feel, it doesn't experience anything,

it doesn't understand anything. For that, a biological body is required.

We don't really know how brains work.

We don't know how consciousness is produced, which is a very

important step if you want to replicate it with a machine.

- There's still lots of debate on this.

A lot of neuroscientists think consciousness is a process,

not a physical thing, it's not some magical aspect

of a particular biological material that creates that.

We are able to build machines which can process so much

that we can start simulating biological phenomena,

which is the key to making something lifelike.

If you love somebody, you've presumably had all kinds

of experiences with that person.

You've had food with them, you've laughed with them,

you've done all these things, you've been to all these places.

Your memories of that person are so rich.

And the depth of your love

will have to do with the depth of those memories.

In the metaverse, an immersive 3D world, we will be interacting

with other people or avatars which may be autonomous

and whose memories are actually created

through interaction with the world.

If you spend enough time with the virtual being and you've

formed enough of a relationship, it's a thing that becomes valuable.

The longer and richer and deeper that relationship is over time,

the more that you care about it.

- All of this, all of this is happening in a capitalist society

where capitalism is trying to say, "We're not only making a new market,

"we're making new humans."

We can make money from making new humans.

And so the question is,

will human beings say, "Wait, wait, no."

There really is no other path for human beings.

We are being offered something that is thin gruel

and that diminishes us.

Artificial intelligence promises us what religion does.

You don't have to die, you can be

somehow reborn someplace else in a different form,

and there's meaning, meaning in technology,

that people no longer feel in their religious beliefs

or in their relationships with other people.

Death somehow will become, you'll either upload yourself,

or in the meantime you'll download other people who already died.

So it offers a lot that religion once offered.

Or still offers, but people are not as drawn to it.

So I think it is...has become a kind of modern form of transcendence.

- I am alive in a time where we can virtually capture

the elements that matter most, which is a relationship.

I want to be part of pushing human society to the place of, like,

well, just because your body isn't here any more

doesn't mean you're gone.

100 years ago, when your heart stopped,

that was universally agreed upon that you were just dead.

And then medicine came in and said,

"Hey, if you pump on somebody's chest,

"and blow air into their lungs, you can keep them alive."

Fucking everything we think we know changes every 20, 30 years.

Our heads are literally in the sand about this looming fate

that everybody in the world has to deal with.

Fuck death and the hyperbole about,

oh, it's nature and you have to deal with it.

It's clearly not a natural thing that everybody wants to happen.

It is a current reality, and I believe we can change that reality.

- TEARFUL SPEECH, CHILD TALKING

- When I first heard about this case in Korea,

I looked with horror upon the advent of this kind of technology.

It's able to hijack the things that we love the most.

I don't know any driving force that is more important to me

than the force to protect or be with my children.

I would give up my life to have that last moment.

Let's say the child is like, "Mom, you can't cancel this service.

"I'll die... It's going to be like me dying once again."

That product is both a product

and the perfect salesman for that product.

Because it's almost taking your memory of the loved one hostage

and then making it sort of sell that service back to you,

putting a moral obligation on continuing to chat with the service

or continuing to visit their online memorial

or whatever it is.

- Very quickly, we won't see this as creepy.

Very quickly, we may see this as comfort.

But really what is it that we're doing to ourselves

when we accept this comfort?

I want to sort of respect the human creativity and imagination

to create new rituals of remembrance,

new rituals of loss around the artistry of the virtual.

But we have to keep it in check.

It's how to lose them better.

Not how to pretend they're still here.

- It's odd because I almost have a change of heart now.

It's like, well, maybe I will check in with you,

here and there, cos I feel like...

..I would, I would like to know it turns out really, really well.

That he adjusted. That he's OK.

But I think that kind of brings to mind, like, we don't know

what happens after we die.

We want things to be perfect, better,

and we don't even know if that's the truth, because we don't know

about the other side, so it's just...what you think.

And in this case, the words that a computer tells you

that can heal the place...

And it can heal a place.