audio speech recognition and recording at the same time with tee

kyle111 purehavoc77 at gmail.com
Mon Nov 4 08:33:23 UTC 2019


Hello all,

I am using gstreamer plugin for kaldi
<https://github.com/alumae/gst-kaldi-nnet2-online>   (speech recognition
tool). This is the  pipeline
<https://github.com/alumae/gst-kaldi-nnet2-online/blob/master/demo/gui-demo.py>  
for kaldi plugi to do speech-to-text ( microphone input -> text transcript):

    self.pulsesrc.link(self.audioconvert)
    self.audioconvert.link(self.audioresample) 
    self.audioresample.link(self.asr)
    self.asr.link(self.fakesink) 


Now, I'd like to record the audio from microphone into .ogg file at the same
time. I made the following changes to the pipeline codes:

    # get audio from mic device
    self.pulsesrc.link(self.audioconvert1)
    self.audioconvert1.link(self.tee)

    # save to ogg
    self.audio_queue.link(self.vorbisenc)
    self.vorbisenc.link(self.oggmux)
    self.oggmux.link(self.filesink)

    # send to asr
    self.asr_queue.link(self.audioconvert)
    self.audioconvert.link(self.audioresample)
    self.audioresample.link(self.asr)
    self.asr.link(self.fakesink)
   
    # tied up tee and queues
    self.tee.link(self.audio_queue)
    self.tee.link(self.asr_queue)

However, the pipeline doesn't work, There is no gst errors but audio is not
saved and text doesn't come out.
I suspect something is blocking the pipeline and I couldn't figure it out.
Would like to hear suggestions !



--
Sent from: http://gstreamer-devel.966125.n4.nabble.com/


More information about the gstreamer-devel mailing list