SpeechBalloon converts meeting content from speech to text in real-time through external microphone devices and the app. Participants can easily understand and record important information from the meeting.
The app distinguishes speakers and accurately tracks the content of each speaker's remarks, identifying various speakers.
Visualize the location of voices easily through pie chart icons, allowing participants to grasp meeting content visually.
SpeechBalloon offers various participation methods. Individuals can join through the app, or everyone can install the app and participate in the same room. Additionally, participants can directly set their locations to represent each participant's position.
Meeting content is saved as text, including participant information, time, and content. This enables the review of meeting content later and extraction of important information.
Speech Balloon | Soboro | ShareTyping | XL8 EventCAT | |
---|---|---|---|---|
Company | SpeechWise (founded in Oct. 2023, Republic of Korea) | Soriboneun Tongro Co., Ltd. (Republic of Korea) | AUD social cooperative (founded in Nov 2013, Republic of Korea) | L8 (founded in 2017, USA) |
Function | Converts speech to text in real time and displays it to the user with location information. | Converts speech to text using artificial intelligence technology, and provides real-time automatic text translation services without a human interpreter. | Provides real-time automatic text translation services without a human interpreter. | Provides AI real-time translation solutions that can translate text into the language of the other country in real time. |
Characteristics | No auxiliary personnel required. | Speech recognition. | Seat layout display (speaker location identification). | Conversation content recording. |
Multilingual translation | Available in all languages. | English-English (△). | Not available. | English-Korean (ㅇ). |
Applications | Video conferencing, small meetings, client meetings, etc. | Schools, workplaces, hospitals, banks, public facilities, etc. | Video conferencing, conferences, discussions, etc. | Video conferencing, conference classes, etc. |
7 papers and 3 patents to prove technology
SpeechBalloon is an intensive technology of SpeechWise.
Kim, D., Yoon, S., Seo, J., Jeong, S., Lee, B. (2023). SpeechBalloon: A New Approach of Providing User Interface for Real-Time Generation of Meeting Notes. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. HCII 2023. Lecture Notes in Computer Science, vol 14020. Springer, Cham.
Dohee Kang, Daeha Kim, Donghyun Kang, Taein Kim, Bowon Lee, Deokhwan Kim, Byung Cheol Song, Beyond superficial emotion recognition: Modality-adaptive emotion recognition system, Expert Systems with Applications, Volume 235, 2024, 121097, ISSN 0957-4174,
Jiyoung Seo, Suyeon Yoon, Taeyong Kim, Bowon Lee. (2023). Multi-resolution Audio Feature Analysis for Speech Emotion Recognition. 전자공학회Thesis지, 60(3), 69-79, 10.5573/ieie.2023.60.3.69
Seo J, Lee B. Multi-Task Conformer with Multi-Feature Combination for Speech Emotion Recognition. Symmetry. 2022; 14(7):1428.
S. Seo, D. Kwak and B. Lee, "Integration of Pre-Trained Networks with Continuous Token Interface for End-to-End Spoken Language Understanding," ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore, Singapore, 2022, pp. 7152-7156, doi: 10.1109/ICASSP43922.2022.9747047.
Kim, T., Kim, T., Lee, B. (2021). Causality: A Portable Protocol for Rapid Development of Applications for Social Interactions. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1421. Springer, Cham.
*Taeyong Kim and Bowon Lee. 2020. Multi-Attention Multimodal Sentiment Analysis. In Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR '20). Association for Computing Machinery, New York, NY, USA, 436–441.
How to express emotional recognition results with auditory signals in virtual reality
Reliability evaluation and demand company evaluation
TRL Phase 8 scheduled for December 2023
TRL Phase 9 scheduled for the first half of 2024