I think that's a common experience for many mixed race people, especially among those that don't really feel a connection with the minority part of their identity.
One thing I think Oli London doesn't get enough flack for is that he completely poisoned the concept of racial identity. People now mostly think of it as something comparable to gender identity, as if race and sex/gender are basically the same, but I see it as more of a sense of belonging/connection.
I'm half white British and half Asian (mostly Chinese with some Thai and Malay). For me, I feel a connection to my British and Chinese diaspora heritage as my parents are still alive and present in my life, but mixed race people who were raised by single parents often identify differently. I also think my Thai (one great grandparent) and Malay (one great great grandparent) relatives are too distant for me to claim to be one of them. But there is of course no clear dividing line for what percentage of a certain race someone has to be in order to feel a connection with that part of their heritage.
The same goes for trans-racial families, another thing Oli London ruined. It originally referred to a family of parents with a different race to their adopted children. A white or Asian child adopted into a black or Hispanic family and treated as one of their own by their community is obviously going to feel a sense of connection even if it doesn't make then black or Hispanic.