VideoProcessorStream does not support Past / Future Surfaces

[SuRGeoNix]

VideoProcessorStream get's a pointer to past / future surfaces (used mainly for deinterlace) but Vortice exposes only a single surface. Is it possible to safely set an array (native pointers) somehow?

Update: I also get an Access violation when I set 1 Past or Future Surface (during VideoProcessorBlt), which probably means that the marshalling of the array is not proper?

[amerkoleci]

Can you provide an example to native API with an example?

[SuRGeoNix]

Never used it, so I'm not sure if I will give you valid information. I was actually trying to see how it works as d3d11 vp generally lacks of documentation. Here is what I tried in C#

vc.VideoProcessorBlt(vp, vpov, 0, 1, [new()
{
    Enable = true,
    InputSurface = frame.VPIV,
    PpPastSurfaces = frame.Prev.VPIV,
    PastFrames = 1
}]);

Also just for ref ms doc

and here some cpp code (how they define it)

std::vector<ID3D11VideoProcessorInputView*> surfaces;

I'm not sure how you can create an array in C# that it will be valid for native.

But you already do this with VideoProcessorBlt and VideoProcessorStream[] array so I guess same way?

public unsafe void VideoProcessorBlt(ID3D11VideoProcessor videoProcessor, ID3D11VideoProcessorOutputView view, uint outputFrame, uint streamCount, VideoProcessorStream[] streams)
{
    nint zero = IntPtr.Zero;
    nint zero2 = IntPtr.Zero;
    Span<VideoProcessorStream.__Native> span = default(Span<VideoProcessorStream.__Native>);
    int num = streams.Length;
    Span<VideoProcessorStream.__Native> span2 = (((uint)(num * Unsafe.SizeOf<VideoProcessorStream.__Native>()) >= 1024u) ? ((Span<VideoProcessorStream.__Native>)new VideoProcessorStream.__Native[num]) : stackalloc VideoProcessorStream.__Native[num]);
    span = span2;
    zero = videoProcessor?.NativePointer ?? IntPtr.Zero;
    zero2 = view?.NativePointer ?? IntPtr.Zero;
    int i = 0;
    for (int num2 = streams.Length; i < num2; i++)
    {
        streams[i].__MarshalTo(ref span[i]);
    }

    Result result;
    fixed (VideoProcessorStream.__Native* ptr = span)
    {
        void* ptr2 = ptr;
        result = ((delegate* unmanaged[Stdcall]<nint, void*, void*, uint, uint, void*, int>)base[53])(base.NativePointer, (void*)zero, (void*)zero2, outputFrame, streamCount, ptr2);
    }

    GC.KeepAlive(videoProcessor);
    GC.KeepAlive(view);
    int j = 0;
    for (int num3 = streams.Length; j < num3; j++)
    {
        streams[j].__MarshalFree(ref span[j]);
    }

    result.CheckError();
}

[SuRGeoNix]

@amerkoleci Please let me know if I can help you out with more info!

[SuRGeoNix]

I gave it a try messing with Mappings.xml but I don't think that is possible to have a dynamic array as struct field. Probably needs to be implemented manually (so it will work well also with the length of the arrays using the proper fields PastFrames / FutureFrames for length). SharpGen has "relation" for that but probably works only for functions, eg:-

<map field="D3D11_VIDEO_PROCESSOR_STREAM::PastFrames" name="PastFrames" type="..." relation="length(ppPastSurfaces)" />