Here are some thoughts based on past reflections I’ve had (so they might not be phrased the best) in no particular order:
First, you mentioned sometimes not understanding what is being said. I minored in philosophy during college, and the first and most important thing I was taught during Intro was the principle of charity during discussion, composed of two parts. The first, assume the other person has something worth saying, isn’t super relevant here. But the second part is that questions of meaning come before questions of truth. If you can repeat back what the other person tells you in your own words and have them agree, then you can start forming a rebuttal.
Speaking of forming things, I believe that the thoughts you express are not your thoughts, but a linguistic representation of your thoughts. When I envision a thought forming, it’s more like a glowing ball of thought and words can be put together to form a kind of shell around the thought. The better the wording, the closer the shell gets to matching the shape of the thought itself. Improving your English toolset will allow you to better shape your words to match your thoughts more quickly and easily. The primary way to do this is to expand your vocabulary/lexicon/internal thesaurus and ability to connect words together, and the primary method to accomplish that is to expose yourself to new words in new orders, and you do that by reading new stuff.
All that is just the prep work. In an actual conversation you don’t have the luxury of reading a bunch right now. My advice there is that, if the other people are cool, be upfront that you are still formulating your thoughts into words and ask for help in finding the right ones if your struggling. Doing so will leave less space in the minds of others to assume anything else, likely leading to not just more patience from them but possibly help for you as well.
I think the process of forming thoughts into words is one of the most fascinating things there is. The times when I have observed myself pulling an original thought out of the ether of my mind or better yet being able to help someone else in pulling their thoughts out of their head and into the world are some of the most beautiful moments I have experienced. I wish you well in working on your ability to find those moments!