I just did some tests with other frameworks. When using streamutil from pjproject-1.10 (pjsip.org) the problem is not reproducible. So it seems the PJMedia uses some other way to access ALSA driver than GStreamer. I'l have to check this in detail.