Dask/ zarr Array support

[ivirshup]

I would love to be able to pass a dask or zarr array to this library and have it decide the best way to iterate through (given a spec) rather than needing to provide chunks iteratively myself.

[aliddell]

Can you be more specific?

[ivirshup]

Sure, I would like to pass a zarr or dask array to the Stream object, and have it figure out how to request and iterate through the data. The API should look at the desired chunk/ shard spec, the incoming chunk/ shard shape and figure out a reasonably efficient access pattern to go through.

I think the api would look roughly like:

array: da.Array | zarr.Array = ...

settings = aqz.StreamSettings(
    ...
)

settings.dimensions = [
    aqz.Dimension(
        ...
    ),
    ....
]

stream = aqz.ZarrStream(settings)
stream.write(array)