Srtclientsink latency after reconnect

I’m using mediamtx srt server for testing

If I launch this pipeline, and listen on the other side, the latency is correct:

gst-launch-1.0 pulsesrc ! \
    audioconvert ! \
    audioresample ! \
    opusenc bitrate=64000 ! \
    mpegtsmux ! \
    queue max-size-buffers=1 leaky=downstream ! \ 
    valve name=valve drop=false !
    srtclientsink uri={SRT_URI} name=srt

but If I restart mediamtx server, when srtclientsink automatically reconnect the latency is really awful (more than 1 second)

How can I discard old buffers on reconnect?