Opened 3 years ago

Last modified 4 months ago

#758 assigned enhancement

Evaluate the use of fixed number of decimal places in numeric representations

Reported by: pcampalani Owned by: vmerticariu
Priority: major Milestone: Future
Component: petascope Version: development
Keywords: significant figures decimal digits Cc: dmisev, pbaumann, vmerticariu
Complexity: Medium


While the current policy on numerical representations (both coordinates and data values) is to reach the highest precision possible, it is common practice to deliver data with a fixed number of either decimal places or significant figures.

As far as I understand, a fixed representation is useful when interpreting the data uncertainty, and it can help a software implementation choosing the best data type to use (float, double, etc) to store values associated to a given data component.

Regarding data values, this feature should be embedded in the encoding phase of rasdaman directly (via a parameter which shall be taken from petascopedb::ps_quantity.significant_figures).

Regarding coordinates (both absolute and relative), a deeper inspection should be done. Maybe using fixed 15 decimal places like GDAL does.

Change History (4)

comment:1 Changed 3 years ago by pbaumann

sounds like an interesting idea to deliberate in the future. Tricky numeric effects are luring, so serious investigations will be required for sure.

comment:2 Changed 21 months ago by dmisev

  • Cc vmerticariu added; abeccati removed
  • Milestone changed from 9.1 to 9.2

comment:3 Changed 16 months ago by dmisev

  • Owner changed from pcampalani to vmerticariu
  • Status changed from new to assigned

comment:4 Changed 4 months ago by dmisev

  • Milestone changed from 9.2 to Future
Note: See TracTickets for help on using tickets.