Data Access

Data sets can be local or remote (e.g. cloud storage), and a wide variety of file formats are supported. The large, multidimensional, datasets required for modern scientific analysis are supported natively. Adding completely new data formats requires only a few lines of code.

Data can be anywhere

Local data

Data on your machine can be loaded directly into memory or lazy-loaded from disk (for very large files)

Remote data

Remote datasets can either be streamed on-demand or downloaded and loaded into memory

Data can be BIG

🧬 A large (~60 GB) multi-resolution image can be interactively panned and zoomed while remaining entirely on disk.

Most common data formats are already supported

Many common scientific data file formats are supported alongside domain-specific datasets, leveraging open-source libraries that provide access to a wide variety of underlying file formats.

🪐 Astro Favorites

🧬 Bio Favorites

New data loaders are easy

If a Python library exists to read your data file format, it is often just a few lines of code to define a custom data loader.

Page updated

Report abuse