The First Robot Platform Solution To Support Multimodal Interaction! KU Xunfei Robot Super Brain Platform 2.0 Released

Jun 29, 2024 Leave a message

On June 27th, iFLYTEK also unveiled the Robot Brain Platform 2.0 project at today's iFLYTEK Spark V4.0 press conference, which will feature multi-modal perceptual interaction through audio-visual fusion and a robot brain based on large models.


By integrating software and hardware to build new interactions for robots, the iFlytek Starfire model will be further empowered in the field of robotics.

 

It is reported that the iFlytek Robot Brain Platform has solved the problem of robots listening, speaking, understanding, and thinking in noisy environments.

 

With this system, robots can not only achieve basic functions such as speech recognition and natural language processing, but also have various perceptual abilities such as portrait recognition and lip shape recognition.


This system can even accurately capture the voice of users in crowded and noisy service scenarios, and use the iFlytek Spark model to deeply analyze the natural language semantics of customers and accurately understand their intentions.

 

At the same time, iFlytek's anthropomorphic voice technology makes robot response language more humanized, enabling more friendly and natural communication with users.

 

At present, iFLYTEK's multimodal interaction system has been widely used in various devices, such as digital all-in-one machines, commercial and home service robots, etc., especially in the fields of smart homes, smart retail, education, etc., showing a strong empowering role.


With the development of big model technology, iFlytek's robot super brain platform is constructing a new way of humanoid robot interaction from two dimensions: terminal multimodal interaction and big model understanding decision-making, promoting the progress of the entire robot industry.


It is understood that iFlytek Spark has become a major model partner for leading enterprises in multiple key industries, including National Energy Group, China Petroleum, China Mobile, China People's Insurance Corporation, Pacific Insurance, Bank of Communications, Chery Automobile, China FAW, Volkswagen, Haier Group, and Midea Group.