TECHNOLOGY

GigaChat the AI assistant detects emotions and finds content in longaudio files

The updated GigaChat Audio model is available through the GigaChat AI assistant and
as free open-source code for software developers across the globe
July 14, 2026, Moscow

Users of the GigaChat AI assistant can enjoy the updated GigaChat Audio AI, a large
language model capable of processing audio files and voice messages without converting
speech to text first. The LLM has been trained to understand intonation and had its sound
data processing potential enhanced to deliver higher performance.

Anton Frolov, senior vice president, head of GenAI Development, Sberbank:
“Voice is the most natural way to interact with technology, but also the most demanding
one, as any detection error or a misread emotion destroys your trust in the assistant
immediately. That is why we believe that audio is where the AI assistant market has room
for growth. By giving open access to these models, we are handing developers and
researchers a powerful tool. The range of applications for voice technology is very wide,
ranging from simultaneous voice translation to services for people with speech disorders,
while multilingualism and the ability to easily learn other languages unlock international
opportunities for these models.”

The AI assistant with more empathy
The updated GigaChat can detect users’ positive or negative emotions based on
intonation, voice characteristics, and pronunciation nuances to be more on-point in
responses. For example, it will talk more gently to an irritated user or mirror the mood of
someone sharing good news.

The model can process recordings up to three hours in length and navigate within them.
You can ask it about the exact time when some specific issue was discussed, request a
summary of a segment you need, or get a summary of the entire recording with
timestamps. The AI is also capable of distinguishing between different speakers in a
recording. These features will be useful for reviewing meetings and calls, navigating
through recordings, and taking minutes.

The AI assistant can now remember facts that users find important directly in a voice
dialogue and rely on them in future sessions. Upon subsequent requests, GigaChat will
take into account your previous wishes. For example, it will plan a travel route based on
your interests. The user has full control over this function, which means recorded facts
can be viewed, edited, or the memory can be disabled at any time in the profile settings.
In-house tests show that GigaChat Audio is as good at understanding and responding to
voice queries as the best global solutions. This was confirmed by the Arena-Hard-Audio
benchmark, when other neural networks blindly compared the responses of different
models to the same voice questions. GigaChat Audio secured a win rate of 70%, almost
on par with Gemini 3 Flash preview (77.5%) and higher than Gemini 2.5 Pro (62%). In
terms of emotion recognition accuracy, Sber’s model is at 80%, outperforming Qwen3-
Omni-30B (70%) or Kimi-Audio (62%).

Availability for developers
In addition to the voice model’s integration into the AI assistant, the team has opensourced GigaChat3.1-Audio-10B, a lightweight version which recognizes Russian, English, and other languages. It can be used to create transcription solutions,
pronunciation trainers, voice-over quality assessment tools, context-aware voice
interpreters, and summarization solutions for long audio recordings.

Sber has also open-sourced GigaAM Multilingual, a family of automatic speech
recognition models. The first open-source model in Russia that supports multiple
languages, it currently delivers the best speech recognition quality in Russian. According
to benchmarks, GigaAM makes fewer errors than its closest rivals by a factor of 1.5–2.
The model supports Russian, English, Kyrgyz, Kazakh, and Uzbek languages and is
available in two versions: a compact one that runs on standard processors, and a flagship
one with higher-quality recognition. GigaAM can be used at call centers and in voice
assistants, meeting transcription, interviews, and podcasts, voice input in applications,
and auto-generated subtitles.

Available on GitVerse and Hugging Face, both the models have been pre-trained on
many languages, which allows them to be quickly fine-tuned for additional ones, including
the languages of CIS countries. This would require only a few dozen hours of marked-up
audio recordings. Scientific papers about the new models have been accepted at
Interspeech 2026, a premier international conference on speech science and technology.

Press office
media@sberbank.ru
PJSC Sberbank is Russia’s largest bank and a leading global financial institution. Holding almost
one-third of aggregate Russian banking sector assets, Sberbank is the key lender to the national
economy and one of the biggest deposit takers in Russia. The Government of the Russian
Federation represented by the Ministry of Finance of the Russian Federation is the principal
shareholder of PJSC Sberbank owning 50% plus one voting share of the bank’s authorized
capital, with the remaining 50% minus one voting share held by domestic and international
investors. It holds general banking license No. 1481 dd. August 11, 2015, from the Bank of
Russia. Official websites of the bank: www.sberbank.com (Sberbank Group website),
www.sberbank.ru.

Follow us on TwitterGoogle News, and Instagram and like us on Facebook for the latest updates and exciting stories.

Show More

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button