Batch InsertMany with SelfProvided vectors are double in dimension

[Sens612]

Hi,

By the way great work on the chsarp client.

the GetIndexObject method returns a Flat index config

When i try to insert several objects with vector dimension 1536 and then I fetch these objects to look at vector dimension they are 3072. Also this 3072 vector seems to have a lot of random floats and even some NaN instances.

I have tried doing this with individual inserts, and that works correctly and after fetching the objects their vectors have dimension of 1536.

[Sens612]

I think I discovered the problem, my vectors were double[], but when I changed it to float[] it seems to work. This problem also exists when doing search and the input Vector is double[] it makes it into 3072 dimension.

[mpartipilo]

Hi @Sens612!

Thank you for reporting this. Vectors are indeed always stored as a bytestream of floats which is why using floats fixes your problem, so the behavior you're seeing is making me suspect that I'm missing a conversion step to float before this bytestream conversion happens.

You should be able to use any numeric type as vector values. I will re-open this issue and investigate it.

p.s. Thanks for your compliments 😊

[mpartipilo]

My suspicion was correct! You found a real bug that only happened with InsertMany and using non-float vector values.

The fix is done and will be included in the upcoming C# Client v1.0.1 release.

[mpartipilo]

The new version has been released. Happy coding!