愛污传媒

Skip to main content

Man or machine? Toronto company finds a way to determine how real audio clips are

Yan Fossat of Klick Labs poses for a photo in Toronto on Tuesday, May 14, 2024. Fossat and his team at Klick Labs in Toronto have found a way to determine whether audio clips are voiced by humans or artificial intelligence. THE CANADIAN PRESS/Nathan Denette Yan Fossat of Klick Labs poses for a photo in Toronto on Tuesday, May 14, 2024. Fossat and his team at Klick Labs in Toronto have found a way to determine whether audio clips are voiced by humans or artificial intelligence. THE CANADIAN PRESS/Nathan Denette
Share

Eyes may be the windows to the soul, but at Klick Labs, it's all about the voice.

The Toronto-based research arm of life sciences technology firm Klick Health has found a way to analyze voices in a manner that鈥檚 so granular, it can tell whether it's a person or an artificial intelligence-powered machine.

The capability comes as the number of deepfakes 鈥 AI-produced video, audio clips or photos that appear real 鈥 has exploded with the recent release of several AI chatbots. Everyone from pop star Taylor Swift to U.S. President Joe Biden and the Pope have fallen victim to the phenomenon.

And it鈥檚 not expected to abate any time soon. The European Union鈥檚 law enforcement agency Europol recently predicted as much as 90 per cent of online content may be synthetically generated by 2026 and the Canadian Security Intelligence Service has called the situation "a real threat to a Canadian future."

But Yan Fossat, Klick Labs鈥 senior vice-president of digital health research and development, is hopeful his company can help make the world of AI a bit safer.

"Every technology that's not regulated is dangerous and this is moving a bit faster than a lot of things," he said, while standing in Klick's downtown Toronto lab.

It was in that space 鈥 cluttered with wires, pieces of household electronics and whirring 3D printers 鈥 that Fossat and a team of three started thinking about how their favourite science fiction films could help them tackle deepfakes.

鈥淚n 'Terminator,' they use dogs to smell if the people look like humans and in 鈥楤lade Runner,鈥 there's the Voight-Kampff machine and I've always wanted to make a Voight-Kampff machine,鈥 said Fossat, referencing a fictional test used in the film to measure physiological responses, such as eye motion and reaction time, to determine whether a character was a human or replicant.

For their own project, the Klick team assembled 49 humans with diverse backgrounds and accents, whose audio they fed to a deepfake generator to make synthetic clips.

The clips were analyzed based on their vocal biomarkers 鈥 features embedded in voices that tell us something about the speaker鈥檚 health or physiology.

For example, if someone has just dashed up a flight of stairs, they breathe faster, which can be heard in their voice. Voice can also indicate when someone is just waking or feeling tired.

Klick Labs has identified 12,000 of these biomarkers, but to tell man from machine, Jaycee Kaufman, Klick's lead scientist, said it so far relies on five 鈥 the length and variation of speech, the rates of micropauses and macropauses and the overall proportion of time spent speaking versus pausing.

Micropauses are less than a half second and macropauses are more than that time, she said. They often occur naturally when someone is speaking and simply takes a breath or is grasping for words.

鈥淲e don鈥檛 really pay attention to it, but it鈥檚 happening,鈥 added Fossat.

鈥淲e have a brain and it needs to think and we have lungs and we need to breathe. Machines don't have that, so they don't do it.鈥

So far, Klick Labs鈥 method of identifying deepfakes has an 80 per cent success rate, but it might not last long.

It鈥檚 only getting harder to tell whether a clip is a deepfake or not because AI is constantly evolving and 鈥渂ecoming better and better at sounding like voices from humans,鈥 Fossat said.

鈥淔or example, OpenAI, the company who makes (generative AI chatbot) ChatGPT just came out a couple of weeks ago with a new vocal deepfake voice that is so good it breathes,鈥 he said.

鈥淚t fakes those micro breaths, which is quite amazing.鈥

He insists the development hasn鈥檛 rendered Klick Labs鈥 research useless because there are thousands of other biomarkers, like heart rate, it can test for deepfake detection.

Sixteen other studies on vocal biomarkers and diseases that Klick Labs is conducting could also aid its research.

One of those studies has used vocal biomarkers to diagnose diabetes with 89 per cent accuracy for women and 86 per cent for men.

That research will soon be continued with a study Klick is set to run with Humber River Hospital in Toronto and Fossat said it could eventually form the basis of phone-based tools anyone can use to find out how at risk they are of having the disease.

Every advance in Klick's research means more chances to learn about biomarkers and apply it back to the detection of diseases and deepfakes, which are proving hard to keep up with.

"It moves so fast every time you do something, by the time you're finished 鈥 everything has changed and we have to do it again," Fossat said.

This report by The Canadian Press was first published May 26, 2024. 

CTVNews.ca Top Stories

The president and CEO of New Brunswick-based Covered Bridge Potato Chips is taking an 'extended leave of absence' after being charged with domestic violence this past weekend.

A memorial is growing outside a Walmart in Halifax after a 19-year-old employee was found dead inside an oven in the store Saturday night.

A search has started at Prairie Green Landfill for the remains of two victims of a serial killer.

He is a familiar face to residents of a neighbourhood just west of Roncesvalles Avenue.

Canada's discount airline is suspending operations to and from Saskatoon.

A new report suggests that Canadians' exposure to a radioactive gas is increasing, putting millions of people at a higher risk of developing lung cancer.

Local Spotlight

He is a familiar face to residents of a neighbourhood just west of Roncesvalles Avenue.

A meteor lit up our region's sky last night 鈥 with a large fireball shooting across the horizon over Lake Erie at around 7:00 p.m.

Residents of Ottawa's Rideauview neighbourhood say an aggressive wild turkey has become a problem.

A man who lost his life while trying to rescue people from floodwaters, and a 13-year-old boy who saved his family from a dog attack, are among the Nova Scotians who received a medal for bravery Tuesday.

A newly minted Winnipegger is hoping a world record attempt will help bring awareness for the need for more pump track facilities in the city.

A Springfield, Ont. man is being hailed a 'hero' after running into his burning home to save his two infant children.

Hortense Anglin was the oldest graduate to make her way across the platform at York University's Fall Convocation ceremony this week. At the age of 87, she graduated with an Honours degree in Religious Studies.

Looking for a scare with good intentions this Halloween season? The ghosts and ghouls of Eganville, Ont. invite families to tour the Haunted Walk at Lekbor Manor.

The image of a sleepy Saskatchewan small town with 'not a lot going on' is a well-known anecdote. However, one Saskatchewan company is hoping to change that 鈥 and allow communities both on and off the beaten path to share their stories and advertise what they have to offer.