Hi,
I’m expanding on my previous post here and I’m trying to replace the compositors with vacompositors with little luck in an effort to offload some work from the cpu to the igpu.
This is my example pipeline:
gst-launch-1.0 filesrc location=/home/<username>/test_video.mp4 ! queue ! decodebin ! videoconvert ! videoscale ! videorate ! alphacomp.sink_0 filesrc location=/home/<username>/mask.png ! pngdec ! imagefreeze ! video/x-raw,format=RGBA,framerate=30/1 ! alphacomp.sink_1 vacompositor name=alphacomp ! alpha method=green ! videobox top=0 bottom=0 left=550 right=20 ! vapostproc ! comp.sink_1 filesrc location=/home/<username>/background.png ! pngdec ! imagefreeze ! video/x-raw,format=RGBA,framerate=30/1 ! comp.sink_0 v4l2src device=/dev/video0 ! queue ! jpegdec ! videoconvert ! videoscale ! video/x-raw,framerate=30/1 ! videorate ! comp.sink_2 vacompositor name=comp sink_0::zorder=1 sink_1::xpos=750 sink_1::ypos=150 sink_1::width=1125 sink_1::height=900 sink_1::zorder=2 sink_2::zorder=3 sink_2::xpos=50 sink_2::ypos=400 sink_2::width=640 sink_2::height=360 ! queue ! videoconvert ! videoscale ! videorate ! video/x-raw,width=1920,height=1080,framerate=30/1,format=I420 ! autovideosink
What I’m getting currently is the background with the v4l2 camera on the left side, and a big, black box on the right side, i.e. no alpha masking of the test_vide.mp4.
Any ideas of what I’m missing here? Sprinkling caps in the pipeline with “video/x-raw(memory:VAMemory)…” causes screen to output a green image. Help will be much appreciated!