[pulseaudio-discuss] module-echo-cancel vad

[Arun Raghavan]

Hey Stuart,

On Wed, 15 Apr 2020, at 7:34 AM, Stuart Naylor wrote:
>  
> Been trying to work out what voice_detection does I know its VAD but in 
> terms of pulseaudio struggling to work out any effect or process?
>  Is it me? 😊
> 
>  If you look at  
> https://github.com/freedesktop/pulseaudio-webrtc-audio-processing/tree/master/webrtc/common_audio/vad
>  Then also much is the same.
> 
>  Webrtc has vad and it would be great if that could either change 
> stream params to phone or cork/duck or something.
>  I have been playing with AEC on a PI that isn’t great to be honest as 
> often the result is an attenuated ‘vocody’ stream but actually if the 
> vad could trigger cork/duck then it would be great to use.
> 
>  So on the off chance it isn’t me, would there be any interest in 
> linking webrtc vad to pulseaudio functionality, unfortunately speex vad 
> seems only part of the codec rather than speexdsp but vad to cork/duck 
> functionality parameters would be great IMHO.
> 
>  Just thought I would float that as presuming it would be a minimal 
> addition with little effect on existing.

We don't really do anything with the VAD -- we just enable the module in the hope that the AEC algorithm itself will use the information.

You might not be able to use the duck/cork modules directly, but you could potentially implement something like it in module-echo-cancel (the code for those modules is actually factored out into a stream-interaction.c file, so there might be some easy-to-use bits there).

Cheers,
Arun