[meta-freescale] how to combine wayland surface and gst-fsl-plug video?

[Baodong Chen]

On Tue, Apr 8, 2014 at 7:22 PM, Carlos Rafael Giani
<dv at pseudoterminal.org>wrote:

>  Hmm perhaps the v4lsink is painting it in fullscreen mode with zero
> transparency. Typically you need to embed the sink in your UI.
>
The sinks should then adjust the video viewport to the region in the UI.
>
Yes, it is in full screen mode,no transparency. You said is what i want so
far. Is there any detail info i can refer to?
I think i should use mfw_ipucsc to convert a video frame to ARGB8888(maybe
also need scaled) and copy the frame to wayland surface's share memory.


Another idea would be to check if it is possible to use IPU overlays with
> the isink. I never tried it though.
>
> A proper solution would be to use the GPU to render video frames with
> OpenGL ES, but the 0.10 FSL plugins do not have such a sink.
> I am developing Wayland support for the sink of my GStreamer 1.0 iMX
> plugins.
>
This sounds great!

>
>
> Carlos
>
>
> On 2014-04-08 11:34, Baodong Chen wrote:
>
>
>
>
> On Tue, Apr 8, 2014 at 5:18 PM, Carlos Rafael Giani <dv at pseudoterminal.org
> > wrote:
>
>>  My guess: the IPU sink (mfw_isink) is being used, which will not work
>> nicely with Wayland, because the IPU sink draws pixels directly on the
>> framebuffer. This kind of works with X11 if compositing is disabled. But in
>> Wayland, compositing is always present.
>>
>> Perhaps it works with the mfw_v4lsink . IIRC this one produces an overlay
>> that does not touch the framebuffer directly.
>>
> I both tried mfw_v4lsink and mfw_isink, the result is no difference, I can
> not see my wayland surface.
>
>>
>>
>
>> On 2014-04-08 11:06, Baodong Chen wrote:
>>
>> need help!
>>
>>
>> On Fri, Apr 4, 2014 at 7:02 PM, Baodong Chen <chenbdchenbd at gmail.com>wrote:
>>
>>> Hello:
>>> I am using fsl 3.0.17-1.0.0_beta bsp for my testing board.
>>> and build a fsl-image-weston image for using wayland.
>>> then i create a test program which create a wayland surface using
>>> wayland shm
>>> interface.
>>> the surface is my ui interface having a few buttons. when i click
>>> the play button to use gstreamer gst-fsl-plugin to play a video, i can
>>> NOT see my ui
>>> interface, i think the wayland surface is behind the video view, when i
>>> touch the
>>> screen, my test app can receive motion events. may be the hw layer order
>>> is
>>> wrong or color key setting?
>>> what i want:
>>> my walyand surface is on the top and i can see ui interface when playing
>>> video.
>>>
>>>  someone plz guide me how to achieve this,thanks!
>>>
>>
>>
>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.yoctoproject.org/pipermail/meta-freescale/attachments/20140409/7ae1f49d/attachment.html>