Hang in splitmuxsink with audio/video over RTP

Application Development
1

Hello hackers!

I have a pipeline that is pretty much:

                     |-----> rtph264depay -> h264timestamper -> h264parse -> queue -> splitmuxsink [video]
udpsrc -> rtpbin ->  |
                     |-----> rtpmp4adepay -> aacparse -> splitmuxsink [audio_0]

And we observe the splitmuxsink seems to hang after a while, not deterministic. The surest way we detect is that the video queue before the splitmuxsink starts to grow and grow with buffers, and if it is unlimited we will OOM.

Our splitmuxsunk is configured as:

    let splitmuxsink = gst::ElementFactory::make_with_name("splitmuxsink", None)?;
    splitmuxsink.set_property(
        "muxer-factory",
        match format {
            "ts" => "mpegtsmux",
            &_ => "matroskamux",
        },
    );
    splitmuxsink.set_property("location", location.unwrap_or("item-%08d"));
    splitmuxsink.set_property("start-index", start_index);
    splitmuxsink.set_property("max-size-time", item_duration_ns);
    splitmuxsink.set_property("async-finalize", true);
    splitmuxsink.set_property_from_str(
        "muxer-properties",
        match format {
            "ts" => "properties, offset-to-zero=false",
            &_ => "properties, offset-to-zero=true",
        },
    );

And we use NTP clock in sender and receiver.

I have some debug logs from a run, with DEBUG category for splitmuxsink and aggregator, below. Does anyone have any pointers on how to continue to debug this issue?

All the best

0:00:36.764767358 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a001f180, pts 0:00:36.429926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 331, offset none, offset_end none, flags 0x4000
0:00:36.764812345 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a001f2a0, pts 0:00:36.451260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 360, offset none, offset_end none, flags 0x4000
0:00:36.764833262 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0014730, pts 0:00:36.472593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 346, offset none, offset_end none, flags 0x4000
0:00:36.764914227 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.764932948 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4001720, pts 0:00:36.433807395, dts 0:00:36.433807395, dur 0:00:00.016666666, size 888, offset 1111091, offset_end none, flags 0x4200
0:00:36.764970564 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c401e220, pts 1000:00:36.435565889, dts 1000:00:36.435565889, dur 0:00:00.016666666, size 289, offset 1111938, offset_end none, flags 0x2200
0:00:36.764990890 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4038370, pts 1000:00:36.452232556, dts 1000:00:36.452232556, dur 0:00:00.016666666, size 152, offset 1112227, offset_end none, flags 0x2200
0:00:36.765038339 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c401e220, pts 0:00:36.450474061, dts 0:00:36.450474061, dur 0:00:00.016666666, size 289, offset 1111938, offset_end none, flags 0x2200
0:00:36.765100409 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4038370, pts 1000:00:36.452232556, dts 1000:00:36.452232556, dur 0:00:00.016666666, size 152, offset 1112227, offset_end none, flags 0x2200
0:00:36.765120493 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4028e20, pts 1000:00:36.468899223, dts 1000:00:36.468899223, dur 0:00:00.016666666, size 271, offset 1112379, offset_end none, flags 0x2200
0:00:36.765160727 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a001f2a0, pts 0:00:36.451260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 360, offset none, offset_end none, flags 0x4000
0:00:36.765229057 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0014730, pts 0:00:36.472593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 346, offset none, offset_end none, flags 0x4000
0:00:36.765248461 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0014850, pts 0:00:36.493926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.765287803 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4038370, pts 0:00:36.467140728, dts 0:00:36.467140728, dur 0:00:00.016666666, size 152, offset 1112227, offset_end none, flags 0x2200
0:00:36.765324951 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4028e20, pts 1000:00:36.468899223, dts 1000:00:36.468899223, dur 0:00:00.016666666, size 271, offset 1112379, offset_end none, flags 0x2200
0:00:36.765346127 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4028fd0, pts 1000:00:36.485565889, dts 1000:00:36.485565889, dur 0:00:00.016666666, size 389, offset 1112650, offset_end none, flags 0x2200
0:00:36.765364904 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0014730, pts 0:00:36.472593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 346, offset none, offset_end none, flags 0x4000
0:00:36.765406596 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0014850, pts 0:00:36.493926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.765434589 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4028e20, pts 0:00:36.483807395, dts 0:00:36.483807395, dur 0:00:00.016666666, size 271, offset 1112379, offset_end none, flags 0x2200
0:00:36.765438388 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0014970, pts 0:00:36.515260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 369, offset none, offset_end none, flags 0x4000
0:00:36.765474319 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4028fd0, pts 1000:00:36.485565889, dts 1000:00:36.485565889, dur 0:00:00.016666666, size 389, offset 1112650, offset_end none, flags 0x2200
0:00:36.765493503 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.765506798 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0014850, pts 0:00:36.493926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.765566703 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0014970, pts 0:00:36.515260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 369, offset none, offset_end none, flags 0x4000
0:00:36.765587413 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4028fd0, pts 0:00:36.500474061, dts 0:00:36.500474061, dur 0:00:00.016666666, size 389, offset 1112650, offset_end none, flags 0x2200
0:00:36.773119858 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.550474061 total GOP bytes 1698, total next GOP bytes 1698
0:00:36.773135278 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.786101696 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.557926838 total GOP bytes 2512, total next GOP bytes 2512
0:00:36.789776640 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.567140728 total GOP bytes 2512, total next GOP bytes 2512
0:00:36.789792535 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.806777511 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.583807395 total GOP bytes 3305, total next GOP bytes 3305
0:00:36.806794722 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.806866232 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.579260171 total GOP bytes 3734, total next GOP bytes 3734
0:00:36.823448088 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.600474061 total GOP bytes 0, total next GOP bytes 0
0:00:36.823470218 35643 0x7fd718001440 INFO            splitmuxsink gstsplitmuxsink.c:3317:handle_mq_input:<queue_video:sink> Have keyframe with running time +0:00:36.600474061
0:00:36.828406417 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.600658172 total GOP bytes 0, total next GOP bytes 0
0:00:36.828431402 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:2866:check_completed_gop:<splitmuxsink0> Collected GOP is complete. Processing (ctx 0x7fd77c1612c0)
0:00:36.828540806 35643 0x7fd718000f00 DEBUG           splitmuxsink gstsplitmuxsink.c:1450:complete_or_wait_on_out:<splitmuxsink0> Got new output cmd for time +0:00:36.600474061
0:00:36.828559085 35643 0x7fd718000f00 DEBUG           splitmuxsink gstsplitmuxsink.c:1458:complete_or_wait_on_out:<splitmuxsink0> Max out running time now +0:00:36.600474061
0:00:36.828579731 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4021270, pts 1000:00:36.502232556, dts 1000:00:36.502232556, dur 0:00:00.016666666, size 868, offset 1113039, offset_end none, flags 0x4200
0:00:36.828598954 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4028940, pts 1000:00:36.518899223, dts 1000:00:36.518899223, dur 0:00:00.016666666, size 461, offset 1113866, offset_end none, flags 0x2200
0:00:36.828637959 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a001c660, pts 0:00:36.536593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.828675343 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0014970, pts 0:00:36.515260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 369, offset none, offset_end none, flags 0x4000
0:00:36.828737687 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a001c660, pts 0:00:36.536593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.828758043 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a001cdf0, pts 0:00:36.557926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 345, offset none, offset_end none, flags 0x4000
0:00:36.828803119 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4021270, pts 0:00:36.517140728, dts 0:00:36.517140728, dur 0:00:00.016666666, size 868, offset 1113039, offset_end none, flags 0x4200
0:00:36.828859117 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4028940, pts 1000:00:36.518899223, dts 1000:00:36.518899223, dur 0:00:00.016666666, size 461, offset 1113866, offset_end none, flags 0x2200
0:00:36.828881426 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c401bc00, pts 1000:00:36.535565889, dts 1000:00:36.535565889, dur 0:00:00.016666666, size 481, offset 1114327, offset_end none, flags 0x2200
0:00:36.828934403 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4028940, pts 0:00:36.533807395, dts 0:00:36.533807395, dur 0:00:00.016666666, size 461, offset 1113866, offset_end none, flags 0x2200
0:00:36.828988965 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c401bc00, pts 1000:00:36.535565889, dts 1000:00:36.535565889, dur 0:00:00.016666666, size 481, offset 1114327, offset_end none, flags 0x2200
0:00:36.829014959 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c40301a0, pts 1000:00:36.552232556, dts 1000:00:36.552232556, dur 0:00:00.016666666, size 448, offset 1114808, offset_end none, flags 0x2200
0:00:36.829096111 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a001c660, pts 0:00:36.536593505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 333, offset none, offset_end none, flags 0x4000
0:00:36.829139614 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a001cdf0, pts 0:00:36.557926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 345, offset none, offset_end none, flags 0x4000
0:00:36.829170588 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0014db0, pts 0:00:36.579260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 331, offset none, offset_end none, flags 0x4000
0:00:36.829234750 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c401bc00, pts 0:00:36.550474061, dts 0:00:36.550474061, dur 0:00:00.016666666, size 481, offset 1114327, offset_end none, flags 0x2200
0:00:36.829293248 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c40301a0, pts 1000:00:36.552232556, dts 1000:00:36.552232556, dur 0:00:00.016666666, size 448, offset 1114808, offset_end none, flags 0x2200
0:00:36.829322246 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a001cdf0, pts 0:00:36.557926838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 345, offset none, offset_end none, flags 0x4000
0:00:36.829325912 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4030350, pts 1000:00:36.568899223, dts 1000:00:36.568899223, dur 0:00:00.016666666, size 429, offset 1115256, offset_end none, flags 0x2200
0:00:36.829365500 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0014db0, pts 0:00:36.579260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 331, offset none, offset_end none, flags 0x4000
0:00:36.829389053 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c40301a0, pts 0:00:36.567140728, dts 0:00:36.567140728, dur 0:00:00.016666666, size 448, offset 1114808, offset_end none, flags 0x2200
0:00:36.829423148 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4030350, pts 1000:00:36.568899223, dts 1000:00:36.568899223, dur 0:00:00.016666666, size 429, offset 1115256, offset_end none, flags 0x2200
0:00:36.829444169 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0014db0, pts 0:00:36.579260171, dts 99:99:99.999999999, dur 0:00:00.021333333, size 331, offset none, offset_end none, flags 0x4000
0:00:36.839753153 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.617140728 total GOP bytes 900, total next GOP bytes 900
0:00:36.839771755 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.849540455 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.621991505 total GOP bytes 1728, total next GOP bytes 1728
0:00:36.856290538 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.633807395 total GOP bytes 1728, total next GOP bytes 1728
0:00:36.856307116 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.871118107 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.643324838 total GOP bytes 2528, total next GOP bytes 2528
0:00:36.873081349 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.650474061 total GOP bytes 2528, total next GOP bytes 2528
0:00:36.873091584 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.889930817 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.667140728 total GOP bytes 3199, total next GOP bytes 3199
0:00:36.889951189 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.892393693 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.664658172 total GOP bytes 3563, total next GOP bytes 3563
0:00:36.906706324 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.683807395 total GOP bytes 0, total next GOP bytes 0
0:00:36.906725126 35643 0x7fd718001440 INFO            splitmuxsink gstsplitmuxsink.c:3317:handle_mq_input:<queue_video:sink> Have keyframe with running time +0:00:36.683807395
0:00:36.913704846 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.685991505 total GOP bytes 0, total next GOP bytes 0
0:00:36.913736099 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:2866:check_completed_gop:<splitmuxsink0> Collected GOP is complete. Processing (ctx 0x7fd77c1612c0)
0:00:36.913765868 35643 0x7fd718000f00 DEBUG           splitmuxsink gstsplitmuxsink.c:1450:complete_or_wait_on_out:<splitmuxsink0> Got new output cmd for time +0:00:36.683807395
0:00:36.913778399 35643 0x7fd718000f00 DEBUG           splitmuxsink gstsplitmuxsink.c:1458:complete_or_wait_on_out:<splitmuxsink0> Max out running time now +0:00:36.683807395
0:00:36.913794565 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4031ee0, pts 1000:00:36.585565889, dts 1000:00:36.585565889, dur 0:00:00.016666666, size 900, offset 1115685, offset_end none, flags 0x4200
0:00:36.913831910 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0015540, pts 0:00:36.600658172, dts 99:99:99.999999999, dur 0:00:00.021333333, size 353, offset none, offset_end none, flags 0x4080
0:00:36.913856881 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0015cd0, pts 0:00:36.621991505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 334, offset none, offset_end none, flags 0x4000
0:00:36.913927564 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4030350, pts 0:00:36.583807395, dts 0:00:36.583807395, dur 0:00:00.016666666, size 429, offset 1115256, offset_end none, flags 0x2200
0:00:36.913947374 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4031ee0, pts 1000:00:36.585565889, dts 1000:00:36.585565889, dur 0:00:00.016666666, size 900, offset 1115685, offset_end none, flags 0x4200
0:00:36.913962355 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4021ae0, pts 1000:00:36.602232556, dts 1000:00:36.602232556, dur 0:00:00.016666666, size 475, offset 1116544, offset_end none, flags 0x2200
0:00:36.914034211 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.914055744 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4031ee0, pts 0:00:36.600474061, dts 0:00:36.600474061, dur 0:00:00.016666666, size 900, offset 1115685, offset_end none, flags 0x4200
0:00:36.914068019 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4021ae0, pts 1000:00:36.602232556, dts 1000:00:36.602232556, dur 0:00:00.016666666, size 475, offset 1116544, offset_end none, flags 0x2200
0:00:36.914079566 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c40399d0, pts 1000:00:36.618899223, dts 1000:00:36.618899223, dur 0:00:00.016666666, size 466, offset 1117019, offset_end none, flags 0x2200
0:00:36.914099371 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.914114676 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0015540, pts 0:00:36.600658172, dts 99:99:99.999999999, dur 0:00:00.021333333, size 353, offset none, offset_end none, flags 0x4080
0:00:36.914170257 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0015cd0, pts 0:00:36.621991505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 334, offset none, offset_end none, flags 0x4000
0:00:36.914191968 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0016460, pts 0:00:36.643324838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 328, offset none, offset_end none, flags 0x4000
0:00:36.914258872 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c4021ae0, pts 0:00:36.617140728, dts 0:00:36.617140728, dur 0:00:00.016666666, size 475, offset 1116544, offset_end none, flags 0x2200
0:00:36.914276372 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c40399d0, pts 1000:00:36.618899223, dts 1000:00:36.618899223, dur 0:00:00.016666666, size 466, offset 1117019, offset_end none, flags 0x2200
0:00:36.914288459 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c40292a0, pts 1000:00:36.635565889, dts 1000:00:36.635565889, dur 0:00:00.016666666, size 343, offset 1117485, offset_end none, flags 0x2200
0:00:36.914315261 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.914328971 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0015cd0, pts 0:00:36.621991505, dts 99:99:99.999999999, dur 0:00:00.021333333, size 334, offset none, offset_end none, flags 0x4000
0:00:36.914371946 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0016460, pts 0:00:36.643324838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 328, offset none, offset_end none, flags 0x4000
0:00:36.914393323 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6a0016bf0, pts 0:00:36.664658172, dts 99:99:99.999999999, dur 0:00:00.021333333, size 343, offset none, offset_end none, flags 0x4000
0:00:36.914464963 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c40399d0, pts 0:00:36.633807395, dts 0:00:36.633807395, dur 0:00:00.016666666, size 466, offset 1117019, offset_end none, flags 0x2200
0:00:36.914480454 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c40292a0, pts 1000:00:36.635565889, dts 1000:00:36.635565889, dur 0:00:00.016666666, size 343, offset 1117485, offset_end none, flags 0x2200
0:00:36.914490204 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3347:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Waiting for buffer to be consumed (chain) before enqueueing buffer: 0x7fd6c4039c60, pts 1000:00:36.652232556, dts 1000:00:36.652232556, dur 0:00:00.016666666, size 364, offset 1117828, offset_end none, flags 0x2200
0:00:36.914504665 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.914518915 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0016460, pts 0:00:36.643324838, dts 99:99:99.999999999, dur 0:00:00.021333333, size 328, offset none, offset_end none, flags 0x4000
0:00:36.914619126 35643 0x7fd7180010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:audio_0> Enqueuing buffer: 0x7fd6a0016bf0, pts 0:00:36.664658172, dts 99:99:99.999999999, dur 0:00:00.021333333, size 343, offset none, offset_end none, flags 0x4000
0:00:36.914641847 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:video_0> Consumed: buffer: 0x7fd6c40292a0, pts 0:00:36.650474061, dts 0:00:36.650474061, dur 0:00:00.016666666, size 343, offset 1117485, offset_end none, flags 0x2200
0:00:36.914655126 35643 0x7fd718000f00 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_15:video_0> Enqueuing buffer: 0x7fd6c4039c60, pts 1000:00:36.652232556, dts 1000:00:36.652232556, dur 0:00:00.016666666, size 364, offset 1117828, offset_end none, flags 0x2200
0:00:36.914671254 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_15> all pads have data
0:00:36.914681509 35643 0x7fd718002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_15:audio_0> Consumed: buffer: 0x7fd6a0016bf0, pts 0:00:36.664658172, dts 99:99:99.999999999, dur 0:00:00.021333333, size 343, offset none, offset_end none, flags 0x4000
0:00:36.923012103 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.700474061 total GOP bytes 911, total next GOP bytes 911
0:00:36.923025567 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:36.935126506 35643 0x7fd718001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:36.707324838 total GOP bytes 1814, total next GOP bytes 1814
0:00:36.939843527 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:36.717140728 total GOP bytes 1814, total next GOP bytes 1814
0:00:36.939858980 35643 0x7fd718001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
2025-05-09T07:19:41.601818Z  INFO persist::pipeline::common: current-level-buffers current_buffers=14 queue="video-queue"
2

A more complete view of the pipeline attached.

playing
playing13469×1091 1.42 MB

3

There are no GST_DEBUG logs from splitmuxsink or aggregator from the point of hang.

4

Some more verbose logging:

0:00:11.515066669 43431 0x7ff594002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_3:audio_0> Consumed: buffer: 0x7ff5140521c0, pts 0:00:11.237736261, dts 99:99:99.999999999, dur 0:00:00.021333333, size 332, offset none, offset_end none, flags 0x4000
0:00:11.515218051 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1758:handle_mq_output:<queue_video:src> Event custom-downstream event: 0x7ff5440083f0, time 99:99:99.999999999, seq-num 920, splitmuxsink-unblock, timestamp=(gint64)11260049484;
0:00:11.515227708 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1746:handle_mq_output:<queue_video:src> Fired probe type 0x1010
0:00:11.515234153 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1949:handle_mq_output:<splitmuxsink0> Pad <queue_video:src> buffer with run TS +0:00:11.260049484 size 849
0:00:11.515239597 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1326:complete_or_wait_on_out:<queue_video:src> Max out running time currently +0:00:11.260049484, with threshold applied it is +0:00:11.260049484
0:00:11.515245196 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1337:complete_or_wait_on_out:<queue_video:src> Checking running time +0:00:11.260049484 against max +0:00:11.260049484
0:00:11.515250278 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1326:complete_or_wait_on_out:<queue_video:src> Max out running time currently +0:00:11.260049484, with threshold applied it is +0:00:11.260049484
0:00:11.515255096 43431 0x7ff594000f00 LOG             splitmuxsink gstsplitmuxsink.c:1337:complete_or_wait_on_out:<queue_video:src> Checking running time +0:00:11.260049484 against max +0:00:11.260049484
0:00:11.515240741 43431 0x7ff5940010c0 DEBUG             aggregator gstaggregator.c:3329:gst_aggregator_pad_chain_internal:<muxer_3:audio_0> Enqueuing buffer: 0x7ff514052950, pts 0:00:11.259069595, dts 99:99:99.999999999, dur 0:00:00.021333333, size 353, offset none, offset_end none, flags 0x4000
0:00:11.515279793 43431 0x7ff5940010c0 LOG             splitmuxsink gstsplitmuxsink.c:1746:handle_mq_output:<queue_audio_0:src> Fired probe type 0x1040
0:00:11.515286757 43431 0x7ff594002cc0 DEBUG             aggregator gstaggregator.c:861:gst_aggregator_wait_and_check:<muxer_3> all pads have data
0:00:11.515289263 43431 0x7ff5940010c0 LOG             splitmuxsink gstsplitmuxsink.c:1758:handle_mq_output:<queue_audio_0:src> Event custom-downstream event: 0x7ff54c009220, time 99:99:99.999999999, seq-num 921, splitmuxsink-unblock, timestamp=(gint64)11260049484;
0:00:11.515299758 43431 0x7ff594002cc0 DEBUG             aggregator gstaggregator.c:3750:gst_aggregator_pad_pop_buffer:<muxer_3:video_0> Consumed: buffer: 0x7ff54001c320, pts 0:00:11.243382817, dts 0:00:11.243382817, dur 0:00:00.016666666, size 396, offset 342630, offset_end none, flags 0x2200
0:00:11.515307665 43431 0x7ff5940010c0 LOG             splitmuxsink gstsplitmuxsink.c:1326:complete_or_wait_on_out:<queue_audio_0:src> Max out running time currently +0:00:11.260049484, with threshold applied it is +0:00:11.260049484
0:00:11.515324778 43431 0x7ff5940010c0 LOG             splitmuxsink gstsplitmuxsink.c:1337:complete_or_wait_on_out:<queue_audio_0:src> Checking running time +0:00:11.260049484 against max +0:00:11.260049484
0:00:11.519770448 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:2918:handle_mq_input:<queue_video:sink> Fired probe type 0x1010
0:00:11.519791215 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3085:handle_mq_input:<queue_video:sink> Buffer TS is 1000:00:11.284561222 (PTS 1000:00:11.284561222, DTS 1000:00:11.284561222)
0:00:11.519802941 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3102:handle_mq_input:<queue_video:sink> Buffer running TS is +0:00:11.293382817
0:00:11.519809129 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3135:handle_mq_input:<queue_video:sink> in running time now +0:00:11.293382817
0:00:11.519816595 43431 0x7ff594001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:11.293382817 total GOP bytes 1706, total next GOP bytes 1706
0:00:11.519824468 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3304:handle_mq_input:<splitmuxsink0> Max in running time now +0:00:11.293382817, DTS +0:00:11.293382817
0:00:11.519829054 43431 0x7ff594001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:11.519839814 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3417:handle_mq_input:<queue_video:sink> Returning to queue buffer buffer: 0x7ff540004010, pts 1000:00:11.284561222, dts 1000:00:11.284561222, dur 0:00:00.016666666, size 467, offset 344338, offset_end none, flags 0x2200 run ts +0:00:11.293382817
0:00:11.519853604 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3349:handle_mq_input:<queue_audio_0:sink> Done sleeping for GOP start input state now 1
0:00:11.519864664 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3417:handle_mq_input:<queue_audio_0:sink> Returning to queue buffer buffer: 0x7ff514002360, pts 0:00:11.280402928, dts 99:99:99.999999999, dur 0:00:00.021333333, size 340, offset none, offset_end none, flags 0x4000 run ts +0:00:11.280402928
0:00:11.532053131 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:2918:handle_mq_input:<queue_audio_0:sink> Fired probe type 0x1010
0:00:11.532084774 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3085:handle_mq_input:<queue_audio_0:sink> Buffer TS is 0:00:11.301736261 (PTS 0:00:11.301736261, DTS 99:99:99.999999999)
0:00:11.532097909 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3102:handle_mq_input:<queue_audio_0:sink> Buffer running TS is +0:00:11.301736261
0:00:11.532108322 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3135:handle_mq_input:<queue_audio_0:sink> in running time now +0:00:11.301736261
0:00:11.532119267 43431 0x7ff594001280 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_audio_0:sink> Buf TS +0:00:11.301736261 total GOP bytes 2513, total next GOP bytes 2513
0:00:11.532128314 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3347:handle_mq_input:<queue_audio_0:sink> Sleeping for GOP start
0:00:11.536759350 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:2918:handle_mq_input:<queue_video:sink> Fired probe type 0x1010
0:00:11.536780264 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3085:handle_mq_input:<queue_video:sink> Buffer TS is 1000:00:11.301227889 (PTS 1000:00:11.301227889, DTS 1000:00:11.301227889)
0:00:11.536786463 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3102:handle_mq_input:<queue_video:sink> Buffer running TS is +0:00:11.310049484
0:00:11.536791162 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3135:handle_mq_input:<queue_video:sink> in running time now +0:00:11.310049484
0:00:11.536797369 43431 0x7ff594001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3269:handle_mq_input:<queue_video:sink> Buf TS +0:00:11.310049484 total GOP bytes 2513, total next GOP bytes 2513
0:00:11.536814703 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3304:handle_mq_input:<splitmuxsink0> Max in running time now +0:00:11.310049484, DTS +0:00:11.310049484
0:00:11.536818228 43431 0x7ff594001440 DEBUG           splitmuxsink gstsplitmuxsink.c:3310:handle_mq_input:<queue_video:sink> Waiting for end of GOP
0:00:11.536828587 43431 0x7ff594001440 LOG             splitmuxsink gstsplitmuxsink.c:3417:handle_mq_input:<queue_video:sink> Returning to queue buffer buffer: 0x7ff540018ef0, pts 1000:00:11.301227889, dts 1000:00:11.301227889, dur 0:00:00.016666666, size 429, offset 344805, offset_end none, flags 0x2200 run ts +0:00:11.310049484
0:00:11.536874724 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3349:handle_mq_input:<queue_audio_0:sink> Done sleeping for GOP start input state now 1
0:00:11.536890068 43431 0x7ff594001280 LOG             splitmuxsink gstsplitmuxsink.c:3417:handle_mq_input:<queue_audio_0:sink> Returning to queue buffer buffer: 0x7ff5140144e0, pts 0:00:11.301736261, dts 99:99:99.999999999, dur 0:00:00.021333333, size 332, offset none, offset_end none, flags 0x4000 run ts +0:00:11.301736261
2025-05-09T07:36:02.195494Z  INFO persist::pipeline::common: current-level-buffers current_buffers=37 queue="video-queue"
5

Turned out to be a deadlock in a probe before the splitmuxsink :slight_smile: