Skip to content

support scale_offset and cast_value codecs #3772

@d-v-b

Description

@d-v-b

the numcodecs.fixescaleoffset codec is flawed for Zarr v3 and should not be used, because it has not been adapted properly to the Zarr v3 data model. To fix this we developed two new codecs in this PR zarr-developers/zarr-extensions#43

we should implement these codecs here or externally and direct users away from numcodecs.fixedscaleoffset

one concern about cast_value is that it contains some logic that might be hard to express in performant numpy code. We may have to choose between a memory-and-compute inefficient pure numpy solution vs a performant compiled solution.

if you or someone you know used the scale-offset transformation with zarr data, either via a codec or via a metadata convention a la CF + xarray, please have a look at the linked PR, the specs, and keep an eye on the developments related to this feature in zarr python.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions