DEEP NEURAL NETWORKS

The Speech to Text engine has been built from the ground up by the Voicegain R&D team utilizing Deep Neural Networks as the core enabling technology. Our core team has been working with speech recognition technology for more than a decade. We automated over 500M calls for Fortune 500 enterprise customers. For the Voicegain Speech to Text Engine, we did not merely repackage existing academic or open source projects. Rather, we used latest DNN research to build a custom speech recognition pipeline, which gives us full control over all its aspects.

Out-of-the-box accuracy for real time transcription using standard models (medical notes or lecture/talk type of audio) varies between 90%-95%. For offline transcription, accuracy goes up to 92%-97%.

​

Out-of-the-box accuracy for recognition using grammars is about the same as other commercial ASR engines. This accuracy can be significantly increased with custom models.

​

You can easily test accuracy on your domain by signing up for the Free Trial. You will be able to upload your audio and check the transcript accuracy.

CUSTOM MODELS

The Voicegain Speech to Text Engine uses 3 types of models –
1) Language Model 2) Acoustic Model and 3) Pronunciation Model. In order to improve recognition accuracy of domain specific words, unique speaker accents or pronunciations, we provide APIs that help modify all three types of models.

Language and Pronunciation model customization requires simple upload of domain specific corpus and vocabulary files.

However the biggest impact comes from customizing the Acoustic Model that is represented in the DNN. This requires accurately transcribed audio files. They do not have to be time-aligned, so the effort to prepare them is relatively low.

With Custom Acoustic and Language Models some of our customers have achieved accuracy above 98% for real-time transcription.

Customizing the models for IVR has allowed us to reach recognition of 2+% above the results from major commercial IVR ASRs on specific domains.

Clients own the intellectual property of their custom models. To incorporate a custom model as part of its platform, Voicegain may enter into a separate licensing agreement with the client.

RESTFUL WEB API

VoiceGain Web API supports both: 

• Large vocabulary transcription — real-time, semi-real-time, and offline

• Speech recognition using context-free grammars (e.g. GRXML) 

Speech audio input can be submitted to Voicegain either: (a) in-line with the web request, (b) provide a URL that Voicegain can retrieve from, (c) stream via web-socket e.g. from a browser or (d) streamed from provided Java utility.

Recognition results are made available via: (a) HTTP response (b) polling (c) webhook callback, (d) web-sockets, (e) Message queues.

Additional APIs are available for language model construction, acoustic model training, broadcast web-socket, data upload, IVR tuning tool, etc..

WEB PORTAL

Voicegain Cloud Web Portal is provided to facilitate the following tasks: 

• Transcription of audio files, incl. transcript review

• Managing  broadcast web-sockets for real-time transcription

• Management of Voicegain Edge Kubernetes clusters  

• Configuration of the Speech to Text Engine  

• Language Model and Pronunciation model customization 

• Tuning & Regression testing tools 

• User and Role management 

• API documentation and support 

• Billing 

• Training of Custom Acoustic DNN models 

• Metrics Dashboard powered by Grafana 

• Application Logs