you are viewing a single comment's thread
view the rest of the comments
[โ€“] -3 points 2 years ago* (5 children)

It's not that precision can't be arbitrarily recorded higher in fraction, it's that precision can't be recorded precisely. Decimal is essentially fractional that's written differently and ignoring every fraction that isn't a power of 10.

How can a measurement 3/4 that's precise to 1/4 unit be recorded in decimal using significant figures? The most-correct answer would be 1. "0.8" or "0.75" suggest a precision of 1/10th and 1/100th, respectively, and sig figs are all about eliminating spurious precision.

If you have 2 measurement devices, and one is 5 times more precise than the other, decimal doesn't show it because it can only increase precision by powers of 10.

In the case of 1/64th above, if you just divide it out it shows a false precision of 1/100,000.

  • source
  • parent
  • hideshow 5 child comments
  • [โ€“] 6 points 2 years ago (4 children)

    0.75 +- .25 is that what you mean? If so here you go, that's how any statician would do.

  • source
  • parent
  • hideshow 4 child comments
  • [โ€“] 0 points 2 years ago (3 children)

    That's not a number - that's a sentence that takes up 3 times as many characters as 3/8.

    3/8 is more efficient.

  • source
  • parent
  • hideshow 3 child comments