this post was submitted on 05 Feb 2024
143 points (99.3% liked)

Technology

34832 readers
18 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 15 comments
sorted by: hot top controversial new old
[–] [email protected] 50 points 9 months ago (1 children)

A finance worker at a multinational firm was tricked into paying out $25 million to fraudsters using deepfake technology to pose as the company’s chief financial officer in a video conference call, according to Hong Kong police.

The elaborate scam saw the worker duped into attending a video call with what he thought were several other members of staff, but all of whom were in fact deepfake recreations, Hong Kong police said at a briefing on Friday.

“(In the) multi-person video conference, it turns out that everyone [he saw] was fake,” senior superintendent Baron Chan Shun-ching told the city’s public broadcaster RTHK.

Chan said the worker had grown suspicious after he received a message that was purportedly from the company’s UK-based chief financial officer. Initially, the worker suspected it was a phishing email, as it talked of the need for a secret transaction to be carried out.

However, the worker put aside his early doubts after the video call because other people in attendance had looked and sounded just like colleagues he recognized, Chan said.

[–] [email protected] 27 points 9 months ago (1 children)

Damn, that's a pretty intricate scam,though. The deep fake part is bullshit, but I mean knowing who all to have on call and what to say.

[–] [email protected] 23 points 9 months ago

Must have been an insider or ex employee.

[–] [email protected] 47 points 9 months ago* (last edited 9 months ago) (2 children)

At some point someone’s going to train an LLM on material from successful scams to autonomously generate new scams, then wire the money to server farms to run more copies of itself.

[–] [email protected] 24 points 9 months ago (1 children)

Can't wait for self-replicating scam bots

[–] [email protected] 3 points 9 months ago

Maybe they'll finally try to sell me an extended warranty on a car I actually own.

[–] [email protected] 13 points 9 months ago

Thats an ingenious idea…

[–] [email protected] 14 points 9 months ago* (last edited 9 months ago)

Oh thats a good social engineer, nice

[–] [email protected] 12 points 9 months ago

This story sounds suss, but I want it to be true because

[–] [email protected] 10 points 9 months ago* (last edited 9 months ago) (1 children)

The scam involving the fake CFO was only discovered when the employee later checked with the corporation’s head office.

A surprise teleconference resulting in the transfer of $25 million dollars? You can bet your ass I'm going to verify that transaction by calling the CFO on his direct line before any money is sent.

[–] [email protected] 3 points 9 months ago

You aren't your run of the mill AP clerk I'm afraid

[–] [email protected] 10 points 9 months ago

Ohhhh, that's why I have to take those monthly security training quizzes, lol. I haven't seen one on AI deepfakes though, I'm sure they're coming.

[–] [email protected] 8 points 9 months ago

I'm surprised there was no further validation or approval for that kind of money beyond "find the right person and socially engineer them."

[–] [email protected] 6 points 9 months ago

Perhaps it should be a company policy that any demand to pay by phone/text/video conf must be authenticated by the office worker hanging up and calling the appropriate company officer on a non-published phone number. The workers immediate supervisor should also be involved in anything out of the ordinary. With a well known policy that calling the company officer will never result in any trouble for the office worker.

[–] [email protected] 5 points 9 months ago

The worker mysteriously quit his job after a few days to go live on a tropical island. He was last heard as saying “Yeah the boss totally told me to transfer the money to this account, that AI is so lifelike”.