464
IEEE 754 (cdn.fosstodon.org)
submitted 2 years ago by to c/science_memes@mander.xyz
37 comments fedilink hide all child comments
 

cross-posted from: https://lemmy.ml/post/24332731

Stolen Cross-posted from here: https://fosstodon.org/@foo/113731569632505985

Omni-Man looking at the IEEE 754 Single Precision Floating-Point Standard and saying "look what they need to mimic a fraction" with the rest of the meme whited out
you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 2 years ago

Accumulation of floating point precision errors is so common, we have an entire page about why unit tests need to account for it.

  • permalink
  • fedilink
  • source
  • parent