Skip to content
Artwork for Code for Thought
Code for Thought · March 30 · 40 min

[EN] ByteSized: fun with floating points - U Ruede, A Herten and E di Napoli

English Edition: how are real numbers e.g. 0.1 represented on computers? What can go wrong with using their representation in calculations? And does it matter? These and other questions are the subject of this ByteSized episode with my guests Prof. Ulrich Ruede (University of Erlangen-Nuernberg), Andreas Herten and Edoardo di Napoli (both Research Centre Juelich). Links: https://www.h-schmidt.net/FloatConverter/IEEE754.html an online tool to convert numbers into their bit/hex equivalent - also showing the rounding errors https://dl.acm.org/doi/10.1145/103162.103163 Goldberg Paper: What every computer scientist should know about floating points https://arxiv.org/abs/2012.02492 revisiting Goldberg, Vincent Lafage https://en.wikipedia.org/wiki/IEEE_754 the Wiki entry on the IEEE 754 standard for floating points (the standard itself is not accessible for free) https://en.wikipedia.org/wiki/Unit_in_the_last_place definition von "ulp" https://developer.nvidia.com/blog/floating-point-8-an-introduction-to-efficient-lower-precision-ai-training/ NVidia’s take on lower precision numbers https://indico.esa.int/event/445/contributions/8473/attachments/5559/9378/gernigon_cedric_EDHPC2023.pdf list of lower precision formats https://en.wikipedia.org/wiki/Chinese_remainder_theorem Chinese remainder theorem I would like to thank the STEP-UP project in the UK for supporting this series of ByteSized episodes. Get in touch Thank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören! Contact Details/ Coordonnées / Kontakt: Email mailto:peter@code4thought.org UK RSE Slack (ukrse.slack.com): @code4thought or @piddie Bluesky: https://bsky.app/profile/code4thought.bsky.social LinkedIn: https://www.linkedin.com/in/pweschmidt/ (personal Profile) LinkedIn: https://www.linkedin.com/company/codeforthought/ (Code for Thought Profile) This podcast is licensed under the Creative Commons Licence: https://creativecommons.org/licenses/by-sa/4.0/

0:00-40:30

transcript

No transcript — this publisher did not publish one.

show notes

English Edition: how are real numbers e.g. 0.1 represented on computers? What can go wrong with using their representation in calculations? And does it matter? These and other questions are the subject of this ByteSized episode with my guests Prof. Ulrich Ruede (University of Erlangen-Nuernberg), Andreas Herten and Edoardo di Napoli (both Research Centre Juelich). 

Links:

I would like to thank the STEP-UP project in the UK for supporting this series of ByteSized episodes. 

Get in touch

Thank you for listening! Merci de votre écoute! Vielen Dank für´s Zuhören!

Contact Details/ Coordonnées / Kontakt:

This podcast is licensed under the Creative Commons Licence:  https://creativecommons.org/licenses/by-sa/4.0/

links14