♟️
zarr
  • Zarr Cloud Data Conversion
  • AI Ready Checklist
  • AI
  • Preprocessing
    • Indexing Public Bucket
    • Raw Data
    • Time Convention
    • Bottom Detection L0
    • Xarray
    • Zarr
    • Uncalibrated Data
    • Boto3 Notes
    • Dask
    • Geospatial Indexing
    • Regrid & Interpolate
  • Cloud
    • Lambda
      • Delete Folder PDS Bucket
      • Indexing Lambda
      • Raw To Zarr Lambda
    • CloudWatch Filter Pattern
    • Processing Power
    • SNS SQS
    • Dead Letter Queue SNS DLQ
    • Billing Estimate
  • Analysis
    • Calculating Sv Mean
    • Dimension Reduction
    • Plotting
    • Colab Notebooks
    • Experimental
    • Segment Anything
  • Web
    • Colors
  • Ideas
  • Reading
  • Mapping
  • Notes
  • Datasets
  • Echopype
    • Echopype
Powered by GitBook
On this page
  • Intro
  • Resources
  • Tutorials

Was this helpful?

Zarr Cloud Data Conversion

NextAI Ready Checklist

Last updated 11 months ago

Was this helpful?

Intro

The following chronicles the creation of a Zarr store using water-column sonar data. The goal is to allow users to access the data in a cloud-native format.

Resources

  • https://cires.gitbook.io/ncei-wcsd-archive/

  • https://zarr.readthedocs.io/en/stable/tutorial.html

  • https://drive.google.com/file/d/1qgb5JL_MIaTjv35-49F3EcQvjYts5AG_/view

  • https://higlass.github.io/higlass-zarr-datafetchers/

Papers

  • https://www.mdpi.com/2077-1312/7/4/110/htm

  • https://archimer.ifremer.fr/doc/00503/61441/65160.pdf

  • https://www.frontiersin.org/articles/10.3389/fmars.2019.00211/full

Tutorials

1. Converting Raw EK60 Data to Zarr - Level 00

2. Converting CSV Data to Zarr - Level 01

Echopype notes:

Nice paper on echopype moving forward: https://arxiv.org/pdf/2111.00187.pdf

LogoGoogle Colaboratory
LogoGoogle Colaboratory
ecosystem