Skip to content

GH-113710: Fix updating of dict version tag and add watched dict stats #115221

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Feb 12, 2024

Conversation

markshannon
Copy link
Member

@markshannon markshannon commented Feb 9, 2024

Fixes a regression introduced by #114592 where mutating a global variable would cause repeated de-optimizations.

@@ -133,6 +133,9 @@ typedef struct _rare_event_stats {
uint64_t builtin_dict;
/* Modifying a function, e.g. func.__defaults__ = ..., etc. */
uint64_t func_modification;
/* Modifying a dict that is being watched */
uint64_t watched_dict_modification;
uint64_t watched_globals_modification;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do these new stats relate to the existing builtin_dict one?

Copy link
Member Author

@markshannon markshannon Feb 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They only apply to any watched dict, and watched module globals respectively.
Whereas the builtin dict count tracks any modification to the builtins, which are always watched

In theory watched_globals_modification + builtin_dict == watched_dict_modification
Although, as soon as we start watching any other dicts that will no longer be true.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That makes sense, thanks.

@markshannon
Copy link
Member Author

The stats look good ~800 dict watchers fired instead of 8 million.

Copy link
Member

@gvanrossum gvanrossum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So I take it PyDict_EVENT_CLONED is no longer special?

@markshannon
Copy link
Member Author

So I take it PyDict_EVENT_CLONED is no longer special?

It never was, it was (and still is) misnamed.

@markshannon markshannon merged commit 8144661 into python:main Feb 12, 2024
fsc-eriker pushed a commit to fsc-eriker/cpython that referenced this pull request Feb 14, 2024
@markshannon markshannon deleted the watched-dict-stats branch August 6, 2024 10:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants