24
submitted 3 weeks ago* (last edited 3 weeks ago) by [email protected] to c/[email protected]

What I think in addition to what Atkinso writes: If you just strip arbitrary bytes that happen to be equal in value to the numeric value of ASCII control characters or whitespace, how can you be sure that you don't destroy valid non-whitespace unicode symbols?

You can't! This will work only of you have actually ASCII input.

you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 1 points 3 weeks ago

it's incorrect bc it destroys multibyte characters

It doesn't. As the poster two levels up said, all bytes that don't represent an ASCII character have the high bit set, even the follow-up bytes in multibyte sequences. So the condition b >= 32 will match and preserve them.

[-] [email protected] 4 points 3 weeks ago

yeah fair enough. that wasn't really my point and I wasn't paying attention

this post was submitted on 01 Jun 2025
24 points (90.0% liked)

Programming

21048 readers
698 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]



founded 2 years ago
MODERATORS