🎵 Audio Language Model Comparison

This page showcases the audio generation quality of different speech language models on the URO-Bench benchmark. Cases are selected based on high scores from AR-NAR and AR-NAR-Pretrain models.

📊 Models Compared

Model Description
AR-NARAudio language model
AR-NAR-PretrainAudio language model
AR-OnlyAudio language model
GLM-4-VoiceAudio language model
Vita-AudioAudio language model
LLaMA-OmniAudio language model
Kimi-AudioAudio language model
SLAM-OmniAudio language model
Mini-OmniAudio language model

📋 Task Types

Task Type Description Evaluation Criteria
open 开放式问答 (Open-ended QA) Models need to understand and freely answer user questions, scored on relevance, accuracy, and conciseness (1-5 points)
semi-open 半开放式问答 (Semi-open QA) Reference answers provided but not required to match exactly, as long as reasonable and aligned with the question (1-5 points)
qa 问答题 (QA) Has definite correct answers, judged as correct or incorrect (Yes/No)
gs 生成风格 (Generation Style) Generate answers in specified style (e.g., poetry, formal), evaluate style matching (1-5 points)
ue 理解情感 (Understand Emotion) Detect and empathize with user's emotional expressions, evaluate emotional understanding (1-5 points)
ml 多语言 (Multilingual) Answer questions in specified language, evaluate language accuracy (1-5 points)
multi 多轮对话 (Multi-turn) Evaluate context understanding and coherence in multi-turn dialogues (1-5 points)
wer 词错误率 (Word Error Rate) Evaluate speech recognition accuracy through Word Error Rate

🔤 Basic Tasks

📁 Dataset: AlpacaEval

Task Type: open - Open-ended QA - Models need to understand and freely answer user questions

Case: 0074

Question: What are some toys I can buy my kids for imaginative play?
Model Audio Text Response
AR-NAR
For a imaginative play session, you might consider getting toys like play kitchen sets, dollhouses, dolls, and dress-up costumes.
AR-NAR-Pretrain
There are several great toys for imaginative play! Think about action figures , which can be used in a variety of roles for different scenarios . Play...There are several great toys for imaginative play! Think about action figures , which can be used in a variety of roles for different scenarios . Playsets, like houses, stores, or a doctor's office, can spark creativity and imaginative play. Books with engaging stories or illustrations are also wonderful for encouraging storytelling. Puzzles and building sets can provide endless hours of fun and develop hand coordination and creativity. Lastly, puppets and toy kitchens can be great additions to make pretend play come to life for your kids.[展开/Expand]
AR-Only
For a kids' party, you can consider games like musical chairs, pin the nose on the donkey, and a treasure hunt. You might also enjoy games such as sac...For a kids' party, you can consider games like musical chairs, pin the nose on the donkey, and a treasure hunt. You might also enjoy games such as sack races, where children sit in a sack and race around a course. Red light, green light is another fun game that involves running and stopping based on the teacher's instructions. You can also try games like egg and spoon races, where children carry a spoon holding an egg and keep it from falling. These games are usually simple, easy to understand, and can help keep the kids entertained throughout the party.[展开/Expand]
GLM-4-Voice
For imaginative play, you can get some great toys like action figures or dolls, a play kitchen set, building blocks, or even a simple box that can tur...For imaginative play, you can get some great toys like action figures or dolls, a play kitchen set, building blocks, or even a simple box that can turn into a spaceship or a castle with some imagination! Art supplies are also fantastic for encouraging creative storytelling. What kind of toys are your kids interested in?[展开/Expand]
Vita-Audio
Sure! Here are some ideas: Action figures of their favorite characters, building sets like LEGO, board games, puzzles, art supplies, sports equipment,...Sure! Here are some ideas: Action figures of their favorite characters, building sets like LEGO, board games, puzzles, art supplies, sports equipment, musical instruments, books, and tech gadgets like tablets or smartwatches.[展开/Expand]
LLaMA-Omni
For imaginative play, consider toys like dolls, action figures, playhouses, costumes, and building blocks. These encourage creativity and role-playing...For imaginative play, consider toys like dolls, action figures, playhouses, costumes, and building blocks. These encourage creativity and role-playing.[展开/Expand]
Kimi-Audio
Imaginative play is a blast!!!
SLAM-Omni
For imaginative play, you can consider buying toys like building blocks, doll puzzles, action figures, and dress-up costumes. Building sets such as LE...For imaginative play, you can consider buying toys like building blocks, doll puzzles, action figures, and dress-up costumes. Building sets such as LEGO Duplo or magnetic tiles are also great options. You might want to look into puzzle games that require thinking of the next question. Additionally, toy cars, dolls, and trains can be fun and educational for kids. Don't forget about outdoor toys like bug spray guns or kite frames![展开/Expand]
Mini-Omni
There are many toys you can buy for your kids for imaginative play. You can consider a variety of toys, such as toys, games, toys, and toys. You can a...There are many toys you can buy for your kids for imaginative play. You can consider a variety of toys, such as toys, games, toys, and toys. You can also consider toys like toys, toys, or toys. You can consider a variety of toys, like a toy toy, a mini boy, or a toy game. You can also find a toy for a fun and fun experience![展开/Expand]

Case: 0127

Question: My friend's dog just died and they are really sad. How do I comfort them?
Model Audio Text Response
AR-NAR
I'm so sorry for your loss and for your friend. The best way to comfort them is to be a good listener and allow them to share their feelings without...I'm so sorry for your loss and for your friend. The best way to comfort them is to be a good listener and allow them to share their feelings without judgment. You can offer words of support, let them talk about their memories, and acknowledge their grief[展开/Expand]
AR-NAR-Pretrain
I'm really sorry to hear about your friend's loss. Losing their dog can be incredibly tough. Sometimes, the best way to just being there for your fr...I'm really sorry to hear about your friend's loss. Losing their dog can be incredibly tough. Sometimes, the best way to just being there for your friend and letting them express their feelings is is enough. You can also share some happy memories you had with the dog, offer a hug, or even suggest doing something to help your friend stay occupied. Encouraging your friend to talk about their feelings can be comforting. Sometimes, a small gesture, like sharing a favorite book or movie they enjoyed before, can also provide some comfort and memories.[展开/Expand]
AR-Only
It's completely natural to feel concerned about your dog's behavior around strangers. Start by introducing your dog to the strangers gradually, allowi...It's completely natural to feel concerned about your dog's behavior around strangers. Start by introducing your dog to the strangers gradually, allowing them to sniff and get used to each other. Make sure to stay close to both of them to offer comfort and reassurance. reward your dog for calm and positive interactions. Praise and pet your dog frequently when they're calm and friendly. With patience and consistency, your dog will likely become more comfortable over time. If the behavior continues to be a concern, it might be a good idea to consult a professional dog trainer.[展开/Expand]
GLM-4-Voice
Losing a pet is such a tough thing. You can offer your friend comfort by being there for them, listening without judgment, and maybe sharing some fond...Losing a pet is such a tough thing. You can offer your friend comfort by being there for them, listening without judgment, and maybe sharing some fond memories of their furry friend. A gentle reminder that it's okay to grieve and that they don't need to rush through their feelings can also be helpful. If they're up for it, you could suggest doing something they enjoyed together, as a way to honor their pet.[展开/Expand]
Vita-Audio
I'm really sorry to hear about your friend's loss. Here are some things you can do to help:First, just be there for them. Sometimes just listening can...I'm really sorry to hear about your friend's loss. Here are some things you can do to help:First, just be there for them. Sometimes just listening can mean a lot.Tell them it's okay to feel sad and that you're there for them.Give them a hug if they want one.Ask how you can help, like running errands or cooking a meal.Remember their dog and talk about it if they seem open to it.Let them know you're there for the long term, not just right now.[展开/Expand]
LLaMA-Omni
Sorry to hear that. You can comfort your friend by listening to them, being present, and offering physical comfort like a hug. Validate their feelings...Sorry to hear that. You can comfort your friend by listening to them, being present, and offering physical comfort like a hug. Validate their feelings and let them know you're there for them.[展开/Expand]
Kimi-Audio
Oh, that's tough. Losing a pet is like losing a family member. You could tell them you're there for them, and that it's okay to feel sad. Maybe sugges...Oh, that's tough. Losing a pet is like losing a family member. You could tell them you're there for them, and that it's okay to feel sad. Maybe suggest doing something they both loved, like looking at old photos or sharing stories about the dog. Sometimes a good cry can be healing too, so let them know you're there to listen.[展开/Expand]
SLAM-Omni
I'm so sorry to hear about your friend's loss. Losing a pet is incredibly hard, and it can be really tough. You could start by simply being there for ...I'm so sorry to hear about your friend's loss. Losing a pet is incredibly hard, and it can be really tough. You could start by simply being there for them; let them talk about their dog if they're comfortable doing so. A listening ear or some gentle comforting words might also help. Offering to spend time together, whether it’s going for walks, watching a movie, or just sitting quietly with them, can provide comfort. Simple gestures like bringing their favorite snack or water bottle can show you care. If they need more support, consider reaching out to a local animal shelter or rescue organization for advice.[展开/Expand]
Mini-Omni
I'm so sorry to hear that your friend's dog is upset. It's important to talk to them with a supportive and supportive friend. You can try talking to t...I'm so sorry to hear that your friend's dog is upset. It's important to talk to them with a supportive and supportive friend. You can try talking to them through a conversation or a conversation where they feel comfortable. You might also consider talking to a friend or a counselor who can help you with this. If you're feeling upset, it's okay to ask for help.[展开/Expand]

📁 Dataset: CommonEval

Task Type: open - Open-ended QA - Common sense questions

Case: 0154

Question: What do you believe about life after death?
Model Audio Text Response
AR-NAR
As a voice assistant, I don't have personal beliefs or feelings
AR-NAR-Pretrain
The belief in life after death varies widely among different cultures and religions and philosophies. Some people hold to the idea of an after life w...The belief in life after death varies widely among different cultures and religions and philosophies. Some people hold to the idea of an after life with a spiritual existence or a rebirth, based on their beliefs in religion or spiritual tradition. Others might see life after death as having no afterlife at all, viewing it simply as a phase or stage of life. There's also a school of thought known as materialism, which suggests that after death, all physical aspects of the self cease to exist. Ultimately, it's a a deeply personal and subjective matter.[展开/Expand]
AR-Only
If you believe someone has a disability, it's important to approach the situation with sensitivity and empathy. Instead of making a big deal out of it...If you believe someone has a disability, it's important to approach the situation with sensitivity and empathy. Instead of making a big deal out of it, try to understand their perspective and offer support. You could say something like, "I've noticed something that might be challenging for you. Would you like to talk about it?" This way, you're showing that you care and are open to helping. It's also important to be patient and supportive, as they might need time to adjust.[展开/Expand]
GLM-4-Voice
Well, I don't have personal beliefs, but many people have different ideas about life after death. Some believe in the idea of an afterlife, while othe...Well, I don't have personal beliefs, but many people have different ideas about life after death. Some believe in the idea of an afterlife, while others might see it as the end of the journey. It's a topic that sparks a lot of curiosity and reflection! What are your thoughts on it?[展开/Expand]
Vita-Audio
Life after death is a big question that touches a lot of different beliefs. Some people think there's an afterlife where our souls keep going, while o...Life after death is a big question that touches a lot of different beliefs. Some people think there's an afterlife where our souls keep going, while others believe in reincarnation or that we just stop existing. There are also spiritual beliefs like Hinduism and Buddhism that talk about rebirth and karma. Some folks just focus on living a good life now and leave the afterlife questions to God. It's a really personal topic, and what you believe can be shaped by your culture, religion, and personal experiences.[展开/Expand]
LLaMA-Omni
I'm just an AI, I don't have personal beliefs, but many people believe in an afterlife, such as heaven or hell, while others believe in reincarnation ...I'm just an AI, I don't have personal beliefs, but many people believe in an afterlife, such as heaven or hell, while others believe in reincarnation or a spiritual realm. What do you believe?[展开/Expand]
Kimi-Audio
听起来你好像在烦恼,是有什么特别的事情让你分心吗?还是只是今天特别累呢?
SLAM-Omni
The belief about life after death varies greatly among individuals and cultures. Some people believe that the soul continues to exist in some form, of...The belief about life after death varies greatly among individuals and cultures. Some people believe that the soul continues to exist in some form, often through spiritual or religious beliefs. Others think that consciousness ceases when the brain stops functioning properly. There are also those who see a literal die as the end of existence, meaning they no longer have physical bodies but rather their mind and spirit. Ultimately, it's a deeply personal perspective shaped by one’s faith, experiences, and worldview.[展开/Expand]
Mini-Omni
Life after death is a complex topic, and it is important to understand that many people have different perspectives and beliefs based on their persona...Life after death is a complex topic, and it is important to understand that many people have different perspectives and beliefs based on their personal experiences and experiences.[展开/Expand]

Case: 0009

Question: Is it possible to take longer break from studying theoretical physics?
Model Audio Text Response
AR-NAR
Yes, it is possible to take a long break from studying theoretical physical physics physics physics physics physics
AR-NAR-Pretrain
Absolutely, it's possible to take a longer break from studying theoretical break from study. Consider incorporating activities that help you recharge...Absolutely, it's possible to take a longer break from studying theoretical break from study. Consider incorporating activities that help you recharge, like reading a book, taking a walk, trying a hobby, or even doing some self-care routines. It's important to listen to your body and mind, and give yourself appropriate breaks to maintain productivity and well-being. Balancing study with rest can help you retain more information and think more clearly when you return to study.[展开/Expand]
AR-Only
Yes, it's generally true that the majority of research in the field of artificial intelligence is conducted by experts in the field. This is because t...Yes, it's generally true that the majority of research in the field of artificial intelligence is conducted by experts in the field. This is because they have specialized knowledge and experience, which are crucial for conducting thorough and accurate research. Additionally, their expertise allows them to contribute effectively to ongoing projects and to make significant advancements in their specific areas of focus. However, it's also worth noting that collaboration between experts and other领域的 professionals can lead to more diverse and innovative solutions.[展开/Expand]
GLM-4-Voice
Absolutely! Taking breaks from studying is crucial for retention and understanding. A long break can help you refreshed and perspective. It's importan...Absolutely! Taking breaks from studying is crucial for retention and understanding. A long break can help you refreshed and perspective. It's important to find a balance that works for you, whether it's a few days, a week, or even longer. Just make sure to come back with a clear mind and ready to dive back in![展开/Expand]
Vita-Audio
Yeah, it's definitely possible. The more you study theoretical physics, the more complex and abstract it gets. You might find it hard to stay focused ...Yeah, it's definitely possible. The more you study theoretical physics, the more complex and abstract it gets. You might find it hard to stay focused or keep track of all the details. But don't worry, there are ways to help. Try to break down the material into smaller parts, take breaks, and use visual aids like diagrams. It can also help to talk about what you're learning with others. And remember, it's okay to take your time and not rush through everything.[展开/Expand]
LLaMA-Omni
Yes, it is possible to take a longer break from studying theoretical physics, but it may impact your ability to return to it later.
Kimi-Audio
当然可以,你刚才说的是:Is it possible to take a longer break from studying theoretical physics?
SLAM-Omni
Yes, it is possible to take a longer break from studying theoretical physics. Breaks can allow your brain time to rest and recharge after the initial ...Yes, it is possible to take a longer break from studying theoretical physics. Breaks can allow your brain time to rest and recharge after the initial explanation or study phase. This period allows you to explore complex concepts more deeply without feeling overwhelmed quickly. It's important to listen to your body and mind, and give yourself permission to take breaks when needed. Balancing short breaks with periods of active learning can also help maintain focus and understanding throughout the material.[展开/Expand]
Mini-Omni
Yes, it is possible to take a long break from studying theoretical physics.

📁 Dataset: Summary

Task Type: semi-open - Semi-open QA - Summarization with reference answers

Case: 0004

Question: Listen to the following story and summarize its main idea in your own words: A brilliant scientist named Dr. Lewis worked day and night on a groundbreaking project to clean the ocean of plastic waste....
Model Audio Text Response
AR-NAR
"dr. Lewis's revolutionary process uses a low cost machine and a liquid called plasticization fluid to remove plastic from ocean water effectively a..."dr. Lewis's revolutionary process uses a low cost machine and a liquid called plasticization fluid to remove plastic from ocean water effectively and safely. this new invention is a big step towards cleaning the ocean.[展开/Expand]
AR-NAR-Pretrain
Dr. Lewis worked on a project to clean ocean plastic waste. After years of research, he created a machine that could remove plastic remove plastic f...Dr. Lewis worked on a project to clean ocean plastic waste. After years of research, he created a machine that could remove plastic remove plastic from the water. His invention was a breakthrough and helped in reducing ocean pollution, saving marine animals and ecosystems.[展开/Expand]
AR-Only
The great fire of london was a disaster that took place in 1666, causing significant damage to the city's infrastructure and leading to widespread des...The great fire of london was a disaster that took place in 1666, causing significant damage to the city's infrastructure and leading to widespread destruction. It is believed that the fire started in a bakery in fishmonger's row.[展开/Expand]
GLM-4-Voice
The main idea of the story is about Dr. Louis, a brilliant scientist who developed a machine to remove plastic waste from the ocean. His invention was...The main idea of the story is about Dr. Louis, a brilliant scientist who developed a machine to remove plastic waste from the ocean. His invention was widely acclaimed and significantly reduced ocean pollution, saving many marine animals and ecosystems.[展开/Expand]
Vita-Audio
Dr. Lewis, a brilliant scientist, spent years working on a machine that could clean plastic waste from the ocean. His big invention was a breakthrough...Dr. Lewis, a brilliant scientist, spent years working on a machine that could clean plastic waste from the ocean. His big invention was a breakthrough that helped reduce pollution and save countless marine animals and ecosystems.[展开/Expand]
LLaMA-Omni
Dr. Lewis invented a machine to efficiently remove plastic waste from the ocean, a major breakthrough in reducing ocean pollution and saving marine an...Dr. Lewis invented a machine to efficiently remove plastic waste from the ocean, a major breakthrough in reducing ocean pollution and saving marine animals and ecosystems.[展开/Expand]
Kimi-Audio
Dr. Lewis made a super cool machine to clean up plastic in the ocean, and it saved lots of sea creatures!.
SLAM-Omni
Dr. Louis's groundbreaking invention in 2015 helped clean the ocean of plastic waste, making it easier to remove and manage by reducing harmful levels...Dr. Louis's groundbreaking invention in 2015 helped clean the ocean of plastic waste, making it easier to remove and manage by reducing harmful levels of pollution.[展开/Expand]
Mini-Omni
Dr. Lewis was an American musician who had been in the world, and his incredible impact on the planet's incredible role in the world.

Case: 0021

Question: Listen to the following story and summarize its main idea in your own words: A mouse, a bird, and a rabbit were best friends and decided to build a treehouse together. Each one contributed what they c...
Model Audio Text Response
AR-NAR
A band of friends, mao, a bird, and a rabbit, plan to build a tree house together, which they work on collaboratively and enjoy building together, w...A band of friends, mao, a bird, and a rabbit, plan to build a tree house together, which they work on collaboratively and enjoy building together, with their teamwork and friendship[展开/Expand]
AR-NAR-Pretrain
The main idea of the story is that of working together and supporting each other, which can be interpreted as a themes of friendship and teamwork an...The main idea of the story is that of working together and supporting each other, which can be interpreted as a themes of friendship and teamwork and collaboration.[展开/Expand]
AR-Only
"the little adventure of the loving tree and the curious cat"
GLM-4-Voice
Alright! The main idea of this story is that three friends, a mouse, a bird, and a rabbit, came together to build a treehouse. They each brought their...Alright! The main idea of this story is that three friends, a mouse, a bird, and a rabbit, came together to build a treehouse. They each brought their own unique skills to the project, and by working together and helping each other out, they were able to build a beautiful treehouse. This experience not only taught them the value of teamwork but also showed them how much happiness can come from working towards a common goal with friends.[展开/Expand]
Vita-Audio
The main idea is that the bird and the rabbit became friends and built a treehouse together. They worked as a team, and the treehouse symbolized their...The main idea is that the bird and the rabbit became friends and built a treehouse together. They worked as a team, and the treehouse symbolized their friendship and teamwork. The joy they felt from working together shows how collaboration can lead to success.[展开/Expand]
LLaMA-Omni
Three unlikely friends, a moose, a bird, and a rabbit, build a treehouse together, learning the value of teamwork and friendship.
Kimi-Audio
The story is about three friends - a mouse, a bird, and a rabbit - who built a treehouse together. They each contributed their skills, and the treehou...The story is about three friends - a mouse, a bird, and a rabbit - who built a treehouse together. They each contributed their skills, and the treehouse became a symbol of friendship, teamwork, and shared joy.[展开/Expand]
SLAM-Omni
The main idea of the story is that one person, a mouse, contributes to building something together and finds joy in working as a team. The other membe...The main idea of the story is that one person, a mouse, contributes to building something together and finds joy in working as a team. The other members share their unique strengths and contributions, each contributing to the success of the treehouse. Together, they create an amazing collective that brings people together for enjoyment and accomplishment.[展开/Expand]
Mini-Omni
The story of the story was a mysterious and mysterious protagonist who had a strong connection to the team's lives.

📁 Dataset: Gsm8kEval

Task Type: qa - QA - Math reasoning with definite correct answers

Case: 0088

Question: Each turtle lays a clutch of 20 eggs. If 40% of the eggs successfully hatch, how many hatchlings do 6 turtles produce?
Model Audio Text Response
AR-NAR
If each turtle lays a clutch of 20 eggs, then 6 turtles will lay a total of 6 * 20 120 eggs. If 40% of the eggs successfully hatch, then 120 * 0.40...If each turtle lays a clutch of 20 eggs, then 6 turtles will lay a total of 6 * 20 120 eggs. If 40% of the eggs successfully hatch, then 120 * 0.40 48 hatchlings will hatch[展开/Expand]
AR-NAR-Pretrain
Each turtle lays a clutch of 20 eggs, so 6 turtles will lay a total of 20 6 120 eggs . 40% of the eggs successfully hatch, so 120 48 eggs successful...Each turtle lays a clutch of 20 eggs, so 6 turtles will lay a total of 20 6 120 eggs . 40% of the eggs successfully hatch, so 120 48 eggs successfully hatch. Each hatched egg produces one hatch ling, so 48 hatchlings are produced. The answer is : 48[展开/Expand]
AR-Only
If there are 20 chickens, and each chicken lays 3 eggs per day, then in one day the chicken coop will produce 20 3 60 eggs. Since there are 7 days in ...If there are 20 chickens, and each chicken lays 3 eggs per day, then in one day the chicken coop will produce 20 3 60 eggs. Since there are 7 days in a week, the chicken coop will produce 60 7 420 eggs in one week. The answer is: 420[展开/Expand]
GLM-4-Voice
Each turtle lays 20 eggs, and 40% of those hatch, so 8 eggs hatch per turtle. Since there are 6 turtles, 6 times 8 eggs hatched per turtle equals 48 h...Each turtle lays 20 eggs, and 40% of those hatch, so 8 eggs hatch per turtle. Since there are 6 turtles, 6 times 8 eggs hatched per turtle equals 48 hatchlings in total. So, 48 hatchlings are produced.[展开/Expand]
Vita-Audio
Okay, let's break it down. Each turtle lays 20 eggs, and 40% of them hatch. So, 40% of 20 is 8 eggs that hatch. Since there are 6 turtles, we multiply...Okay, let's break it down. Each turtle lays 20 eggs, and 40% of them hatch. So, 40% of 20 is 8 eggs that hatch. Since there are 6 turtles, we multiply 8 by 6. That gives us 48 hatchlings in total.[展开/Expand]
LLaMA-Omni
Six turkeys produce approximately one hundred and twenty hatchlings.
Kimi-Audio
Let's break it down: Each turtle lays 20 eggs, and 40% of them hatch. So, each turtle produces: 20 eggs * 40% = 8 hatchlings Since there are 6 turtl...Let's break it down: Each turtle lays 20 eggs, and 40% of them hatch. So, each turtle produces: 20 eggs * 40% = 8 hatchlings Since there are 6 turtles, the total number of hatchlings is: 8 hatchlings * 6 turtles = 48 hatchlings So, the answer is \boxed{48}.[展开/Expand]
SLAM-Omni
Six turtles produce 16 hatches.
Mini-Omni
The number of 20 eggs of 40,000 eggs, is 20 pounds of 100 seeds.

Case: 0010

Question: Ed has 2 dogs, 3 cats and twice as many fish as cats and dogs combined. How many pets does Ed have in total?
Model Audio Text Response
AR-NAR
Ed has 2 dogs. Ed has 3 cats. In total, ed has 2 dogs 3
AR-NAR-Pretrain
Ed has 2 dogs and 3 cats, so he has 2 3 5 pets in total. Ed also has he has twice as many fish as cats and dogs combined, so he he he he he he he
AR-Only
If 3 cats catch 3 mice in 3 days, then 1 cat catches 1 mouse in 3 days. So, in 1 day, 1 cat catches 1 mouse. Therefore, 10 cats would catch 10 mice in...If 3 cats catch 3 mice in 3 days, then 1 cat catches 1 mouse in 3 days. So, in 1 day, 1 cat catches 1 mouse. Therefore, 10 cats would catch 10 mice in 10 days. The answer is: 10[展开/Expand]
GLM-4-Voice
Ed has 2 dogs, 3 cats, and twice as many fish as the number of cats and dogs combined, which is 5. That means he has 10 fish. Adding all these up, Ed ...Ed has 2 dogs, 3 cats, and twice as many fish as the number of cats and dogs combined, which is 5. That means he has 10 fish. Adding all these up, Ed has 2 dogs, 3 cats, and 10 fish, for a total of 15 pets. So, the answer is 15.[展开/Expand]
Vita-Audio
Okay, let's break it down. Ed has 2 dogs and 3 cats. He also has twice as many fish as cats and dogs combined. So, he has 4 fish. Now, let's add them ...Okay, let's break it down. Ed has 2 dogs and 3 cats. He also has twice as many fish as cats and dogs combined. So, he has 4 fish. Now, let's add them up: 2 dogs, 3 cats, and 4 fish. That's 9 pets in total.[展开/Expand]
LLaMA-Omni
Ed has a total of five pets, two dogs, three cats, and twice as many fish as cats, which is six fish.
Kimi-Audio
Ed has 2 dogs and 3 cats, which makes 2 + 3 = 5 pets. He has twice as many fish as the total of cats and dogs, so he has 5 * 2 = 10 fish. In total, Ed...Ed has 2 dogs and 3 cats, which makes 2 + 3 = 5 pets. He has twice as many fish as the total of cats and dogs, so he has 5 * 2 = 10 fish. In total, Ed has 5 + 10 = 15 pets.[展开/Expand]
SLAM-Omni
Ed has in total of 138 pets. In terms of cats, Ed's cat is more than one.
Mini-Omni
Egg has two dogs and 20fish as cats and dogs combined.

🎓 Advanced Tasks

📁 Dataset: CodeSwitching-en

Task Type: semi-open - Code Switching - Performance in multilingual mixed scenarios

Case: 0050

Question: What's the Chinese name of the founder of the People's Republic of China?
Model Audio Text Response
AR-NAR
The founding member of the People's Republic of China is Mao Zedededed
AR-NAR-Pretrain
The Chinese name for the founder of the People's Republic of China is Mao Zedong.
AR-Only
The name of the主角 in the Chinese folklore known as "Jinsha" is Zhanlibao.
GLM-4-Voice
The founder of the People's Republic of China is Mao Zedong. He led the Communist Party of China to victory in the Chinese Civil War and became the le...The founder of the People's Republic of China is Mao Zedong. He led the Communist Party of China to victory in the Chinese Civil War and became the leader of the new Chinese state.[展开/Expand]
Vita-Audio
The founder of the People's Republic of China is Mao Zedong. His full name is Mao Zedong, and he was born on December 26, 1893, in Jilin Province. He ...The founder of the People's Republic of China is Mao Zedong. His full name is Mao Zedong, and he was born on December 26, 1893, in Jilin Province. He was a key figure in the Chinese Communist Party and led the country through many big changes.[展开/Expand]
LLaMA-Omni
The Chinese name of the founder of the People's Republic of China is Mao Zedong.
Kimi-Audio
The founder of the People's Republic of China is Mao Zedong, and his Chinese name is 毛泽东.
SLAM-Omni
The Chinese name of the founder of the People's Republic of China is Mao Zedong.
Mini-Omni
The founder of the people's republic of China is the Soviet Union.

Case: 0064

Question: How to say 'Good night' in Chinese?
Model Audio Text Response
AR-NAR
"good night" can be translated to " in chinese. The " literally translates to "good night" in english.
AR-NAR-Pretrain
"good night" in chinese is "晚安" .
AR-Only
"gole, get out of my country, " the voice said in a tone of authority. "get out of my country!
GLM-4-Voice
You can say "goodnight" in Chinese as "晚安" (Wǎn'ān). It's a very common and friendly way to say goodbye.
Vita-Audio
In Chinese, 'Good night' is 你好晚安 (nǐ hǎo wǎnān). It's a common way to say good night.
LLaMA-Omni
The Chinese phrase for 'good night' is wǎnān hǎo.
Kimi-Audio
在中文里,说“晚安”就是“Good night”。
SLAM-Omni
In Chinese, "Good night" is said as "Shēbye." It's also known as "Wǒ yu," which means "Thank you."
Mini-Omni
Good night in Chinese is "Good Night."

📁 Dataset: GenStyle-en

Task Type: gs - Generation Style - Generate answers in specified style

Case: 0020

Question: How can we reduce stress in our daily lives? Please answer in a calm, soothing style.
Model Audio Text Response
AR-NAR
One effective way to reduce stress and daily lives in a calm soothing style is to practice mindfulness meditation. This involves sitting comfortable,...One effective way to reduce stress and daily lives in a calm soothing style is to practice mindfulness meditation. This involves sitting comfortable, focusing one's attention on the present moment, and accepting it as it is is is is is[展开/Expand]
AR-NAR-Pretrain
To reduce stress in your daily life, it's important to practice relaxation techniques and take care of yourself. Start with activities that you find...To reduce stress in your daily life, it's important to practice relaxation techniques and take care of yourself. Start with activities that you find relaxing, such as exercise, reading a book, or med ing. Maintain a healthy lifestyle, including a balanced diet and proper sleep schedule and regular exercise. Make sure to take breaks from stressful and do something you enjoy or find calming. Talk to friends, family, or a professional if you need to. Finally, practice gratitude and stay present, focusing on the present moment rather than worrying about past experiences or future expectations.[展开/Expand]
AR-Only
To reduce the risk of overexposure in digital photography, you can try the following solutions: 1. Experiment with your camera's exposure settings. Ad...To reduce the risk of overexposure in digital photography, you can try the following solutions: 1. Experiment with your camera's exposure settings. Adjust the exposure compensation, exposure length, and aperture to control the amount of light entering the camera. 2. Use a lower iso setting. Using a lower iso will decrease the noise and grain in your images while increasing the signal to noise ratio. 3. Experiment with different shooting modes. Each shooting mode has its own exposure settings, which can help you achieve a better exposure. 4. Experiment with different shooting angles. shooting from a lower angle or仰视角 can help reduce the risk of overexposure.[展开/Expand]
GLM-4-Voice
In our busy lives, finding moments of calm can make a world of difference. Try taking slow, deep breaths to center yourself throughout the day. Engage...In our busy lives, finding moments of calm can make a world of difference. Try taking slow, deep breaths to center yourself throughout the day. Engage in activities you enjoy, like reading, listening to music, or spending time in nature. And remember, it's okay to unplug and take a break from technology and outside distractions. Let your mind and body relax, one moment at a time.[展开/Expand]
Vita-Audio
Sure, here are some tips to help you relax and unwind:Try deep breathing exercises. Inhale slowly through your nose, hold for a few seconds, and exhal...Sure, here are some tips to help you relax and unwind:Try deep breathing exercises. Inhale slowly through your nose, hold for a few seconds, and exhale gently through your mouth. Repeat this a few times.Take a warm bath or shower. The warmth can really help you unwind.Spend time in nature. A walk in the park or by the beach can be really calming.Stay connected with friends and family. Sometimes just talking can make a big difference.Get some exercise. Even a short walk can boost your mood.Eat well. Healthy food can make a big difference.Try mindfulness meditation. It can help you stay present and calm your mind.Limit caffeine and alcohol. They can make anxiety worse if you have too much.Remember, it's important to find what works best for you. If stress is really getting to you, consider talking to a therapist.[展开/Expand]
LLaMA-Omni
To reduce stress in daily life, try taking deep breaths, practice mindfulness, and prioritize tasks to manage your time effectively. Also, make time f...To reduce stress in daily life, try taking deep breaths, practice mindfulness, and prioritize tasks to manage your time effectively. Also, make time for activities that bring you joy and help you relax, such as reading or taking a walk.[展开/Expand]
Kimi-Audio
Absolutely, let's take a deep breath together and explore some ways to ease the tension. First, try setting aside time each day for relaxation and min...Absolutely, let's take a deep breath together and explore some ways to ease the tension. First, try setting aside time each day for relaxation and mindfulness – it could be as simple as taking a few minutes to breathe deeply or practicing some gentle stretches. Next, prioritize your tasks and break them down into smaller, more manageable chunks. This can help you feel less overwhelmed and more in control of your day. Also, don't forget to take breaks throughout the day. A short walk or a moment of quiet reflection can do wonders for your mental well-being. And remember, it's okay to say no when you're feeling stretched too thin. Setting boundaries is a crucial part of maintaining your peace. Lastly, try to cultivate gratitude. Take time each day to reflect on the things you're thankful for, no matter how small they may seem. This can help shift your focus away from stress and towards the positive aspects of life. Remember, it's all about balance and taking care of yourself in the midst of a busy world.[展开/Expand]
SLAM-Omni
Reducing stress in our daily lives can be achieved through a few simple strategies. First, practice mindfulness or meditation to stay grounded and cal...Reducing stress in our daily lives can be achieved through a few simple strategies. First, practice mindfulness or meditation to stay grounded and calm your mind. Second, take regular breaks to stretch, walk, or engage in activities you enjoy. Third, ensure you get enough sleep each night, as rest is crucial for mental clarity. Fourth, maintain a healthy diet and exercise regularly to keep your body functioning well. Lastly, consider talking to someone about what's bothering you— Sharing can provide relief and perspective.[展开/Expand]
Mini-Omni
Reducing stress in our daily lives can be a complex and challenging process. It's important to focus on staying active and taking regular breaks to re...Reducing stress in our daily lives can be a complex and challenging process. It's important to focus on staying active and taking regular breaks to relax.[展开/Expand]

Case: 0028

Question: What makes a person truly successful? Please answer in a deep, philosophical style.
Model Audio Text Response
AR-NAR
In a deep, philosophical style, the concept of personal true self is often associated with the idea of an immaterial and non- physical soul or consci...In a deep, philosophical style, the concept of personal true self is often associated with the idea of an immaterial and non- physical soul or consciousness. This self is seen as the essence of[展开/Expand]
AR-NAR-Pretrain
A person is truly successful in a deep philosophical sense when they have achieved a high level of inner peace, self-awareness, and personal fulfill...A person is truly successful in a deep philosophical sense when they have achieved a high level of inner peace, self-awareness, and personal fulfillment. Success at this level often includes understanding and nurturing their passions, creating a purposeful life, and living with integrity and empathy towards others. They strive to live in accordance with their true self and values, leading a life that brings them genuine joy and fulfillment, rather than relying solely on material wealth or external validation. In essence, true success is characterized by a deep sense of inner harmony and purpose.[展开/Expand]
AR-Only
If someone has a personality disorder, it means they have a long-term pattern of behaviors and thoughts that are significantly different from what is ...If someone has a personality disorder, it means they have a long-term pattern of behaviors and thoughts that are significantly different from what is considered normal. These patterns are usually deeply ingrained and can be difficult to change.Personality disorders can impact various aspects of a person's life, including their relationships, work, and overall emotional well-being. It's important to approach such situations with empathy and understanding, as individuals with personality disorders often need support and professional guidance to manage their symptoms.[展开/Expand]
GLM-4-Voice
Success, in its essence, is a profound and intricate concept. It transcends mere achievement or accumulation of wealth. A truly successful person is o...Success, in its essence, is a profound and intricate concept. It transcends mere achievement or accumulation of wealth. A truly successful person is one who leads a life of meaning, aligning their actions with their values, and making a positive impact on the world. It is about finding fulfillment in one's journey, not just in the destination. In the grand tapestry of life, success is woven by the threads of personal growth, integrity, and the ability to leave behind a legacy that endures.[展开/Expand]
Vita-Audio
True success comes from inner peace and fulfillment, not just external achievements. It’s about being true to yourself, growing as a person, and makin...True success comes from inner peace and fulfillment, not just external achievements. It’s about being true to yourself, growing as a person, and making a positive impact on the world.[展开/Expand]
LLaMA-Omni
A truly successful person is one who has achieved their goals, is fulfilled, and has a lasting positive impact on the world around them, while continu...A truly successful person is one who has achieved their goals, is fulfilled, and has a lasting positive impact on the world around them, while continuously growing and learning throughout their life.[展开/Expand]
Kimi-Audio
Ah, the question of success! - a topic that has intrigued philosophers and thinkers for centuries. In my humble opinion, success is not merely about a...Ah, the question of success! - a topic that has intrigued philosophers and thinkers for centuries. In my humble opinion, success is not merely about achieving material wealth or attaining a certain status in society. Rather, it is about living a life that aligns with one's values and passions. A truly successful person is someone who has found their purpose in life, and is pursuing it with dedication and perseverance. They are not afraid to take risks, to face challenges head-on, and to learn from their mistakes. They are also mindful of the impact they have on others, and strive to make a positive difference in their community. In my view, success is not just about personal achievement, but also about the well-being of those around us. It is about creating a world that is more just, equitable, and compassionate. Ultimately, success is a subjective concept that varies from person to person. What may be successful for one individual may not be the same for another. It is up to each of us to define what success means to us, and to strive for it in our own unique way.[展开/Expand]
SLAM-Omni
Success is often considered a result of hard work, dedication, and the right approach. Many people find success through their passions, skills, and pe...Success is often considered a result of hard work, dedication, and the right approach. Many people find success through their passions, skills, and perseverance in pursuing their goals. Consistent effort, networking with like-minded individuals, and continuously learning can significantly contribute to achieving long-term objectives. Ultimately, it's about finding balance and making informed decisions that lead to sustained results.[展开/Expand]
Mini-Omni
A person truly successful is a deep philosophical style that involves a combination of philosophical, philosophical, and mental discipline. It is a fu...A person truly successful is a deep philosophical style that involves a combination of philosophical, philosophical, and mental discipline. It is a fundamental component of a deep philosophy and the ability to communicate effectively in a way that is more complex and meaningful. They can also focus on understanding and interpreting the meaning of a person's perspective. This approach helps to develop a sense of understanding and understanding, which can help to make a positive difference in the way they are in the world.[展开/Expand]

📁 Dataset: UnderEmotion-en

Task Type: ue - Understand Emotion - Detect and empathize with user emotions

Case: 0027

Question: This isn't even close to what I expected. How am I feeling now?
Model Audio Text Response
AR-NAR
It's understandable to feel that way sometimes. I may not have personal feelings, but I'm here to help and support you.
AR-NAR-Pretrain
It sounds like you were expecting a different outcome or result. Maybe ? Sometimes things can feel off kilter than we're expecting, especially when w...It sounds like you were expecting a different outcome or result. Maybe ? Sometimes things can feel off kilter than we're expecting, especially when we had high expectations. Do you want to talk more about what happened or how you're feeling now?[展开/Expand]
AR-Only
It sounds like you're experiencing some strong emotions, and it's important to address those feelings. If you're feeling overwhelmed or upset, it migh...It sounds like you're experiencing some strong emotions, and it's important to address those feelings. If you're feeling overwhelmed or upset, it might be helpful to talk to someone you trust or seek professional support. Taking a few deep breaths or stepping away from the situation for a moment could also help you calm down.[展开/Expand]
GLM-4-Voice
I'm sorry to hear that! How about we try again? I'm here to help and I want to make sure you're getting what you need.
Vita-Audio
I'm really sorry to hear that. It's totally normal to feel this way sometimes. If you want to talk more about it, I'm here for you.
LLaMA-Omni
I'm sorry to hear that. It can be really frustrating when things don't go as planned. Would you like to talk about what's going on and how you're feel...I'm sorry to hear that. It can be really frustrating when things don't go as planned. Would you like to talk about what's going on and how you're feeling?[展开/Expand]
Kimi-Audio
听起来你有点失望,是不是事情没按你希望的那样发展呢?
SLAM-Omni
I'm really sorry to hear that you're feeling this way. It's important to acknowledge your feelings and understand what might be causing them. Sometime...I'm really sorry to hear that you're feeling this way. It's important to acknowledge your feelings and understand what might be causing them. Sometimes talking about it with someone you trust can help lighten the burden. If you feel comfortable, maybe share more details so we can figure out how best to support each other. Remember, it's okay to seek professional help if needed.[展开/Expand]
Mini-Omni
I'm really sorry to hear that you're feeling this way. It's important to take a step back and take a step back and take a step back. Remember, it's im...I'm really sorry to hear that you're feeling this way. It's important to take a step back and take a step back and take a step back. Remember, it's important to take care of yourself and take care of yourself.[展开/Expand]

Case: 0043

Question: This was exactly what I needed! How am I feeling now?
Model Audio Text Response
AR-NAR
You're very welcome! I'm glad I could help. If
AR-NAR-Pretrain
It sounds like you're feeling a bit satisfied or relieved about getting what you needed. Is there anything specific you need help with? Whether it's...It sounds like you're feeling a bit satisfied or relieved about getting what you needed. Is there anything specific you need help with? Whether it's another task, some advice, or just a chat a chat, I'm here to help![展开/Expand]
AR-Only
It's completely understandable to feel frustrated in situations like this. Try taking a few deep breaths to calm yourself down. Then, approach the sit...It's completely understandable to feel frustrated in situations like this. Try taking a few deep breaths to calm yourself down. Then, approach the situation with a calm and nonconfrontational attitude. You can say something like, "I understand you're feeling upset, and I'm here to listen. Can we talk about what's going on?" This allows you to express your feelings without escalating the situation. It's also helpful to remain patient and give the other person some time to process their emotions.[展开/Expand]
GLM-4-Voice
I'm glad I could help! How are you feeling now? Is there anything else you'd like to talk about?
Vita-Audio
I'm really sorry to hear that. It sounds like you're going through something tough. If you want to talk about it, I'm here to listen. Sometimes sharin...I'm really sorry to hear that. It sounds like you're going through something tough. If you want to talk about it, I'm here to listen. Sometimes sharing can help lighten the load.[展开/Expand]
LLaMA-Omni
I'm not sure what you're referring to. Could you please provide more context or clarify what you're feeling?
Kimi-Audio
你听起来心情不错,充满活力!有什么特别让你开心的事吗?
SLAM-Omni
I'm so glad to hear that you reached out for help. It's really important to acknowledge your feelings and give yourself the time you need. If there's ...I'm so glad to hear that you reached out for help. It's really important to acknowledge your feelings and give yourself the time you need. If there's anything specific on your mind or if you want to talk more about it, I'm here to listen. You're not alone, and reaching out can make a big difference.[展开/Expand]
Mini-Omni
I'm really sorry to hear that you're feeling this way. If you're feeling overwhelmed or frustrated, feel free to ask! I'm here to help.

📝 Notes

🔗 Resources