When using decoders from the nvcodec plugin together with NVIDIA DeepStream it would be very good if it would be possible to keep memory on the GPU between the decoder and nvstreammux. Ideal would be if the decoder had support for memory:NVMM. That is not the case though, so the second best option would be if it was possible to convert from e.g. memory:CUDAMemory to memory:NVMM. Neither cudaupload not cudadownload seems to support that case. Converting like this:
… “video/x-raw(memory:CUDAMemory)” ! cudadownload ! “video/x-raw(memory:NVMM)” …
is accepted by cudadownload without any errors, but sending the buffers to nvstreammux results in the error “error: input buffer [stream_id=0] is not NVMM format; FATAL error”.
Is there a way to get this conversion to work?