Evaluate the use of fixed number of decimal places in numeric representations
|Reported by:||pcampalani||Owned by:||vmerticariu|
|Keywords:||significant figures decimal digits||Cc:||dmisev, pbaumann, vmerticariu|
While the current policy on numerical representations (both coordinates and data values) is to reach the highest precision possible, it is common practice to deliver data with a fixed number of either decimal places or significant figures.
As far as I understand, a fixed representation is useful when interpreting the data uncertainty, and it can help a software implementation choosing the best data type to use (float, double, etc) to store values associated to a given data component.
Regarding data values, this feature should be embedded in the encoding phase of rasdaman directly (via a parameter which shall be taken from petascopedb::ps_quantity.significant_figures).
Regarding coordinates (both absolute and relative), a deeper inspection should be done. Maybe using fixed 15 decimal places like GDAL does.
Change History (4)
comment:2 Changed 22 months ago by dmisev
- Cc vmerticariu added; abeccati removed
- Milestone changed from 9.1 to 9.2
comment:3 Changed 17 months ago by dmisev
- Owner changed from pcampalani to vmerticariu
- Status changed from new to assigned