It’s a feat made all the more extraordinary because the famous folk singer is dead.
National broadcaster SBS plans to use artificial intelligence (AI) to bring Kim’s voice back to life on a new program, “Competition of the Century: AI vs Human,” to air later this week.
It’s not the first time AI has been used to revive a famous singer in South Korea.
In December, music channel Mnet aired “One More Time,” a show that used AI and holograms of late artists to pay tribute to their work.
Recent AI performances have excited fans of their music and the technology, but others have raised concerns about the ethics and legalities of resurrecting the voices of the dead. The creation of new works — or revived voices — by AI also raises copyright issues. Who is considered the owner? The creator of the AI program or the AI system itself?
Legendary Korean singer
Kim was aged just 31 when he died in 1996 at the peak of his career after a string of hits including “A Letter From a Private,” “Song of My Life” and “In the Wilderness.”
Decades later, fans still gather in a street named in his honor near his childhood home in the city of Daegu, though this year’s tributes were mostly held online due to the coronavirus pandemic.
Murals of the artist gaze over the street, where tourists sit on benches shaped like guitars and listen to musicians playing his greatest hits.
So, when national broadcaster SBS announced that it was using AI to recreate the Kim’s voice on a new program set to air this month, it sent fans into a frenzy.
“The recovered voice sounds very much alike him, as if Kim recorded it alive,” said Kim Jou-yeon, a Kim fan for 30 years.
It even impressed a young fan Park Hye-hyun, who was just two years old when Kim died. “One of my wishes was to hear more songs in Kim’s voice … I had tears,” she said.
Show inspired by a Go match
Surprisingly, Lee won one of their three matches.
Go requires two players to place black and white stones on a 19-by-19 grid. Each competitor tries to claim the most territory by surrounding their opponent’s pieces so they’re removed from the board.
“Lee-AlphaGo was a big shock followed by short but huge interest in AI, which is still being developed somewhere, but we’re unfamiliar with it yet,” SBS producer Nam said in a phone interview.
Nam sensed the Korean public was ready for an update and began pulling together the six-part AI competition series, including the AI performance from the late Kim Kwang-seok.
Recreating Kim
The audio AI company behind Kim’s reincarnated voice is Supertone, a South Korean startup founded in 2020 that provides AI audio solutions for content creators, according to co-founder and Chief Operating Officer Choi Hee-doo.
“For example, BTS is really busy these days, and it’d be unfortunate if they can’t participate in content due to lack of time. So, if BTS uses our technology when making games or audiobooks or dubbing an animation, for instance, they wouldn’t necessarily have to record in person,” Choi said.
Supertone’s Singing Voice Synthesis (SVS) technology learns voices by listening to multiple songs with corresponding notes and lyrics, Choi explained.
The system learned 100 songs by 20 singers before it was given 10 Kim Kwang-seok songs to learn. It now knows his voice well enough to mimic the singer’s unique style and pronunciation, Choi said.
In the SBS show, the AI Kim won’t be competing against a human singer — he’ll be singing a duet with one. “We revived Kim Kwang-seok to show the capability of it,” said Nam, the show’s producer.
Instead, Ock Joo-hyun, the former leader singer of girl band Fin.K.L, will be taking on the AI machine. Just as the AI system learned Kim’s voice, it will be trained to mimic her, too.
While some may consider a competition between an AI singer and a human as harmless fun, others warn the technology poses threats that need to be addressed by stricter guidelines and regulations.
Potential dangers of AI
Tech-savvy South Korea is considered to be at the forefront of AI technology, but there are calls for more regulation.
Worldwide, nations and organizations are calling for legal reform, ethical guidelines and social agreements to prevent the misuse of AI.
Supertone’s Chief Technology Officer Heo Hoon said he supports laws to regulate the industry. He said to mitigate the current risks the company doesn’t deal directly with the public, preferring to work with businesses that share its ethics.
“We are clearly aware of the possibility of our technology being misused when in hands of the public,” Heo said. “I think reviving the voice of the deceased would bring backlash, which hopefully would begin a social debate and conclusively lead to legislation.”
The company has built a level of protection into its recordings by marking the audio as being produced by its AI, though casual listeners are unlikely to know.
“We have watermarking technology, which is an information planted in audio, that can’t be heard, but tracks where it was made and how it’s being distributed,” Heo said.
Questions of ownership
The use of AI to create works traditionally produced by human creativity raises the issue of ownership. If AI creates the works, does the program hold the copyright, or does it belong to the programmer?
Lawyer Ko Hwan-kyoung, an expert in AI and data protection, said the issue needs to be addressed as AI becomes more advanced.
“What’s interesting about AI is that it’s evolving to a level where it can write and compose by studying datas,” Ko said.
Last year, singer Hayeon released “Eyes on You,” a single composed by an AI program. Human producers later refined the song, according to her record label, Enterarts.
“Are we going to acknowledge AI as legal entity with legal personality like humans, and grant copyright?” Ko, the lawyer, asked. “We need necessary regulation that guarantees human safety, not an excessive one that hinders development of AI technology.”
In the case of Kim Kwang-seok, producer Nam said SBS gained the consent of Kim’s family to reproduce his voice before proceeding with the show.
SBS paid a one-off fee to his family for featuring his voice in the show, as they did with other cast members, Nam said. Parts of the show will be published on YouTube after it airs, but neither SBS nor Supertone plan to release Kim’s song as a single.
“We’ve agreed not to officially release the songs introduced in the show,” Supertone’s Choi said.
So for now, Kim fans will have to be content with playing the old songs recorded by the real singer at a microphone more than 20 years ago.
Son Somi in Seoul also contributed to this story.
