This requires a lot more trust than I usually have for the other players. I especially don't trust that the average GM is going to be consistent and agreeable.
The rules feel like they came out of resolving "you hit me" "no you didn't" playground games.
There are rules light games like Fate Accelerated, or lighter ones I don't know, that can be fun without it being entirely the DM says stuff.