AI puts virtual beings to wider applications

Moreover, with the development and integration of AI, virtual reality, high-precision rendering and other technologies, digital humans are becoming more similar to humans, from image, facial expression, posture, action, to speech, semantics, voice, which advance their resonance with people, said Luan from SenseTime.

"Digital humans produced by artists were common in movies and games. The production process was usually labor-intensive and required high artistic skill, thus pretty costly. But now, assisted by AI, as the production process and operation of digital humans becomes increasingly automated, and the production cost falls, digital humans will likely enter more sectors such as finance, retail, governance and automobile," Luan said.

Based on the intelligence level and the automation level involved in their production, digital humans can be divided into five levels, according to a white book jointly released by SenseTime and the Augmented Reality Core Technology Industry Alliance.

And digital humans that work at Bank of Ningbo are at level 4, which means they can have relatively natural interaction with humans. Their production process can be greatly shortened thanks to AI, Luan said, adding that level 5 digital human is still a concept and considered as intelligent as humans. Its production process will be fully automatic.

The market for virtual celebrities hit 6.22 billion yuan ($933.34 million) in China last year, up nearly 80 percent year-on-year. It is expected to expand to 20 billion yuan over the next two years, according to a report by market consultancy iiMedia.

Xiaoice, another Chinese AI pioneer, is also scrambling to tap into the opportunities of digital humans. The company developed Cui Xiaopan, the first digital employee of Chinese real estate developer Vanke. "She" is in charge of reminding employees to pay the company's bills on time and collect bills due. The resolution rate of the cases Cui handled was as high as 91.44 percent, and the new employee was ultimately chosen for Vanke's best new employee award in 2021.

Yu Liang, chairman of Vanke, said Cui joined the company in February 2021. Thanks to the support of powerful AI algorithms, "she" quickly learned how to find problems in processes and data and detect abnormal documents far more efficiently than human employees.

Li Di, CEO of Xiaoice, said, "With joint efforts with our partners, an era has arrived in which AI beings are becoming reliable, stable and indefatigable."

AI beings developed by Xiaoice now work as two video hosts or anchors for China's National Business Daily. They have been broadcasting news for more than seven months.

Xiaoice said the virtual hosts' overall naturalness has been improved to a level that they are almost indistinguishable from humans.

Also, the news programs are developed entirely by AI technologies in an unmanned operation encompassing the entire process of video acquisition, editing and broadcasting.

Xiaoice said the company has also managed to reduce production costs to enable the large-scale application of virtual hosts. After collecting and processing video data about a human anchor, Xiaoice's AI models can train a relatively high-quality digital twin or clone in about a week.

Pan Helin, executive dean of the Digital Economy Research Institute at the Zhongnan University of Economics and Law, said the biggest obstacle to the large-scale application of virtual humans is technology, because it is still difficult for virtual humans to effectively complete tasks in complicated scenes.