this post was submitted on 16 Aug 2023
37 points (97.4% liked)

Python

6233 readers
1 users here now

Welcome to the Python community on the programming.dev Lemmy instance!

πŸ“… Events

October 2023

November 2023

PastJuly 2023

August 2023

September 2023

🐍 Python project:
πŸ’“ Python Community:
✨ Python Ecosystem:
🌌 Fediverse
Communities
Projects
Feeds

founded 1 year ago
MODERATORS
top 5 comments
sorted by: hot top controversial new old
[–] [email protected] 9 points 1 year ago

Contributing immortal objects into Python introduces true immutability guarantees for the first time ever. It helps objects bypass both reference counts and garbage collection checks. This means that we can now share immortal objects across threads without requiring the GIL to provide thread safety.

This is actually really cool. In general, if you can make things immutable or avoid state, then that will help you structure things concurrently. With immortal objects you now can guarantee that immutability without costly locks. It will be interesting to see what the final round of benchmarks are when this is fully implemented.

[–] [email protected] 1 points 1 year ago (1 children)

Can't this result in ugly memory leaks?

[–] [email protected] 4 points 1 year ago

@Sternout @jnovinger
Maybe, but (apart from the "Accidental Immortalisation" case mentioned in PEP 683) these things are created deliberately by C extensions.
A sane extension shouldn't be building loads of them on the fly in the first place.

[–] [email protected] 1 points 1 year ago (1 children)

I have not read the PEP itself or the PEPs that they claim to simplify, but this feel like a very bad idea that only really benefits Meta and a few other mega servers. It is enabling a micro-optimization that is only usable in a niche use case (forking long running processes with shared memory). Unfortunately, it is making all other python applications, on average, 2% slower. This is a minor regression but it hurts everyone and benefits almost no one.

[–] [email protected] 2 points 1 year ago

Shouldn't this be useful for pandas and other data analytics libraries? That would be useful beyond meta and similar. A lot of mid to large sized orgs use those.