#1060 closed defect (fixed)

Common interface for extracting specific structures from decode files

Reported by: mdumitru Owned by: mdumitru
Priority: major Milestone: 9.3
Component: conversion Version: development
Keywords: Cc: vmerticariu, pbaumann
Complexity: Medium

Description (last modified by dmisev)

Rasdaman should allow for a common syntax in the decode function that allows to select certain subset structures from the file (e.g. variables in NetCDF, bands in GDAL, fields in GRIB etc).
Some basic example:

select decode(mycol, "NetCDF", "variables=[myVar1, myVar2]") from mycol

Relatively common parameters:

  1. dataset subset: variable names, message ids, band ids: can be considered a single category. I'm not sure if GRIB's message ids belongs here actually, as we import them as a dimension rather than bands in rasdaman.
  2. spatial subset: lat/lon, x/y/t, etc. subsets, especially relevant for insitu
  3. x/y transpose: indicate if x/y should be transposed or is it not relevant (comes up in netCDF and GRIB and has a performance penalty at both decode and encode)

Any others?

Change History (5)

comment:1 Changed 19 months ago by dmisev

  • Component changed from undecided to conversion
  • Milestone set to 9.1.x

inv_netcdf supports specifying variable names for example, see #81

comment:2 Changed 12 months ago by dmisev

  • Cc vmerticariu pbaumann added; gmerticariu removed

Indeed we should try to consolidate a common interface for decode:

  1. dataset subset: variable names, message ids, band ids: can be considered a single category. I'm not sure if GRIB's message ids belongs here actually, as we import them as a dimension rather than bands in rasdaman.
  2. spatial subset: lat/lon, x/y/t, etc. subsets, especially relevant for insitu
  3. x/y transpose: indicate if x/y should be transposed or is it not relevant (comes up in netCDF and GRIB and has a performance penalty at both decode and encode)

Any other parameters?

Last edited 12 months ago by dmisev (previous) (diff)

comment:3 Changed 12 months ago by dmisev

  • Description modified (diff)
  • Milestone changed from 9.1.x to 9.3

comment:4 Changed 11 months ago by dmisev

Fixed, details at wiki:CommonFormatsInterface

comment:5 Changed 11 months ago by dmisev

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.