Confucius4-TTS: a Multilingual and Cross-Lingual Zero-Shot TTS Engine

One voice. Any language.

Confucius4-TTS is an advanced LLM-based text-to-speech (TTS) system designed for multilingual and cross-lingual speech synthesis. Built on a speech encoder + large language model (LLM) architecture, Confucius4-TTS enables high-quality speech generation while preserving speaker identity across languages.

✨ Key Features

14 Languages Supported: Chinese, English, Japanese, Korean, German, French, Spanish, Indonesian, Italian, Thai, Portuguese, Russian, Malay and Vietnamese (more coming soon)
Unconstrained Voice Cloning: No reference transcript required
Cross-Lingual Voice Transfer: Unaccented speech synthesis across 14 languages
Zero-Shot Voice Transfer: Clone voices without additional training
Seamless Emotion Transfer: Clone the feeling, not just the voice
Robust Generalization: Stable performance in real-world multilingual scenarios

With strong cross-lingual generalization, Confucius4-TTS allows users to seamlessly switch languages while keeping the same voice, delivering fluent, natural, and expressive speech.

Intra-lingual

Language	Target Text	Result
German	Nachdem der Damm 1963 erbaut worden war, kamen die jahreszeitlichen Überflutungen, die Sedimente im Fluss verteilen, zum Stillstand.
English	In 1990, it was added to the list of world heritage sites in danger, due to the threat of desert sands.
Spanish	Se informó que los saqueos generalizados se extendieron toda la noche, dado que no hubo presencia policial en las calles de Bishkek.
French	On essaie encore de déterminer quelle a été l'ampleur de l'accident et comment la Terre sera affectée.
Indonesian	Dua tahun setelah berakhirnya perang, bekas sekutu kini menjadi musuh dan Perang Dingin dimulai.
Italian	Secondo la polizia, il corpo sembrava essere lì da un giorno circa.
Japanese	でも、やっぱりこういうコンテンツ制作は続けることが一番大切ですよね。
Korean	해질녘 바다를 바라보던 노인은 60년 전 같은 해변에서 만났던 첫사랑을 떠올렸다.
Portuguese	Creio que foi o sorriso, o sorriso foi quem abriu a porta. Era um sorriso com muita luz lá dentro, apetecia entrar nele, tirar a roupa, ficar nu dentro daquele sorriso.
Russian	Когда она открыла сундук, найденный в подвале дома своей бабушки, Мария обнаружила старый дневник, раскрывающий семейные тайны, хранившиеся на протяжении поколений.
Thai	รัฐบาลประกาศการลงทุนหลายพันล้านบาทเพื่อสร้างโรงเรียนและโรงพยาบาลในภูมิภาคที่ด้อยโอกาสของประเทศ
Vietnamese	Sách nói là phương tiện tuyệt vời để khám phá những câu chuyện hay trong cuộc sống.
Chinese	我也是，不过下班后去健身房锻炼了一下，感觉好多了。
Malay	Sebuah kursus biasanya akan meliputi semua isu yang dibincang di sini dengan lebih terperinci, biasanya dengan pengalaman amali.

Cross-lingual

Source Language	Target Language	Target Text
English	Chinese	至今为止，元气火箭总共发行了两张专辑。
	Japanese	アラバマ州の最大都市はバーミングハムである。
	Korean	바람은 파도 소리처럼 쏴아쏴아 하고 머리 맡에서 뒤설렌다.
	Russian	Неожиданно катастрофа приобрела глобальные масштабы.
Chinese	English	Hey look, a flying pig!
	Japanese	アラバマ州の最大都市はバーミングハムである。
	Korean	바람은 파도 소리처럼 쏴아쏴아 하고 머리 맡에서 뒤설렌다.
	Russian	Неожиданно катастрофа приобрела глобальные масштабы.
Korean	English	Hey look, a flying pig!
	French	De manière informelle, la capacité d'un modèle de classification correspond à sa complexité.
	Russian	Неожиданно катастрофа приобрела глобальные масштабы.
	Chinese	至今为止，元气火箭总共发行了两张专辑。
Japanese	English	Hey look, a flying pig!
	French	De manière informelle, la capacité d'un modèle de classification correspond à sa complexité.
	Russian	Неожиданно катастрофа приобрела глобальные масштабы.
	Chinese	至今为止，元气火箭总共发行了两张专辑。

Emotion Transfer

Prompt	Target Language	Target Text	Results
	Chinese	这个呀，就是我们精心制作准备的纪念品，大家可以看到这个色泽和这个材质啊，哎呀多么的光彩照人!
	Korean	이것이 바로 저희가 정성껏 준비한 기념품입니다. 보시다시피 색감과 재질이 정말 눈부시게 빛나네요.
	Vietnamese	Đây chính là món lưu niệm chúng tôi tỉ mỉ chế tác và chuẩn bị. Các bạn có thể thấy sắc màu cùng chất liệu này, thật sự rực rỡ óng ánh quá.
	Thai	นี่คือของที่ระลึกที่เราตั้งใจประดิษฐ์และเตรียมมาให้ทุกคนได้ชื่นชมกันนะครับ อย่างที่เห็นสีสันและวัสดุนี้มันช่างสวยงามวิบวับจริงๆ
	English	Translate for me, what is a surprise!
	Japanese	これを訳してくれ、なんと驚いたことだ！
	German	Übersetze das für mich, was für eine Überraschung!
	French	Traduis ça pour moi, quelle surprise !
	Vietnamese	Cung đình nghiêm ngặt, cấm đồn đại phiến, quý phi Tề!
	Thai	วังนี้มีระเบียบเข้มงวด ห้ามข่าวลวงสู่ใด เลดี้ฉี
	Indonesian	Istana sangat tegas, dilarang menyebarkan kabar palsu, Nona Qi
	Malay	Istana ini amat ketat, tiada khabar palsu dibenarkan, Puan Qi
	Russian	Все эти годы были потрачены зря.
	Spanish	Al final, todos estos años han sido en vano.
	Italian	Tutti questi anni sono stati sprecati alla fine.
	Portuguese	Todos esses anos acabaram sendo desperdiçados.