Originally, the only way to support a raw format was to add software conversion support. We don’t have any column tiling formats yet, but this is certainly feasible. The benefit is that you can validate the codec using automated tests like fluster.
Since 1.24, we have mechanism to allow opaque pixel formats to be passed through. The missing bit is to map the V4L2 definitions to their opaque DRM format + modifier form. This is not completely implemented yet, a draft is available here:
With that, mapping any opaque formats will become trivial (aka one liner for vendors that have not upstreamed their drivers and uses custom pixel formats).
Note that for the first approach, we can clearly land these as GstVideoFormat without any RPi media drivers upstream.
p.s. I haven’t check if these are format available in the ISP, so perhaps there is some progress, since the ISP is being upstreamed.