ľֱ

Doctor Targeted by Deepfake Ad Scam

— Social media ad advised diabetes patients against taking metformin

Last Updated January 13, 2025
MedpageToday

Credit:

A well-known endocrinologist in New Zealand was recently the victim of a deepfake scam, according to reporting from the .

The likeness of Sir Jim Mann, DM, PhD, MA, of the University of Otago, was used in a deepfake news video that circulated on social media after being posted to a Facebook page for a company that sells hemp gummies. In the video, the fake Mann urged people with type 2 diabetes to stop taking the gold-standard medication metformin and instead use alternative natural products.

Though the post has reportedly been removed, Mann told the Herald that it has since occasionally resurfaced and that he only learned of its existence when someone texted him about it.

"I was just bombarded after that with texts, emails from two groups of people ... One [group was] saying, 'Congratulations on this wonderful new product ... that you've discovered and great that you've exposed all these medics and other people as being frauds ... where can I get the product?' And other people who said, 'For goodness sake, be aware, you've been scammed,'" he told the outlet.

"There were some really very reasonable, intelligent people who had completely taken it, including people that I know well ... Goodness knows how many people have been taken in," he added. "AI is so clever that they could manipulate my mouth to be looking as if I was saying those words."

In an interview with ľֱ, Mann said people who knew him "could detect that it wasn't quite my voice."

"They took a lecture that I gave [and] distorted the lecture so it looked as my mouth was actually saying what they put into my mouth, and the voice was almost mine, all part of AI," he said.

However, the technology used to create deepfakes is "getting better all the time," he said, making the rise of deepfake scams "a major healthcare issue." Healthcare workers as well as the general public need to be aware that these scams are occurring, he said.

Mann also urged caution to those who come across videos from experts that appear too good to be true.

"If you hear somebody saying something that sounds too good to be true, it probably is too good to be true. ... They were pretty outrageous claims," he told the Herald.

Indeed, the deepfake scam using Mann's likeness is not an isolated event.

In November, Los Angeles-based podiatrist and social media personality Dana Brems, DPM, said in an Instagram post that a company used AI to make a fake recording of her voice.

The post showed Brems reacting, mouth covered in dismay, to what she said was an advertisement that "used an AI clone of my voice to pretend I recommended their product."

Social media posts from Brems about the ad -- which appeared to be for an ear-cleaning device -- racked up views, with many commenters pointing to the potential harms of fake health-related recommendations tied to medical professionals.

"Once people catch on that they can use AI to impersonate doctors [and] other authority figures, it's going to be a huge problem," Brems told ľֱ at the time.

Mann agreed with this sentiment in statements made to the Herald.

"It makes me feel terrible because I'm patron of Diabetes New Zealand, so a lot of people are aware of my name, even if they don't know me," he said.

He advised people to source reliable information directly from recognized healthcare professionals.

  • author['full_name']

    Jennifer Henderson joined ľֱ as an enterprise and investigative writer in Jan. 2021. She has covered the healthcare industry in NYC, life sciences and the business of law, among other areas.