We now get milk in glass bottles (extra plus, it tastes FAR better than supermarket milk). We are also trying to phase out plastic use where we can. IKEA is actually remarkably useful for that. They have a lot of glass or wooden kitchen stuff.
I'm also careful to avoid "perfect is the enemy of good" situations. I'm not plastic free, just changing what can be changed without huge disruptions.