That only makes sense if you also have buttermilk, otherwise you're missing the rest of what makes milk... milk.

You can go from milk to butter in a pinch (put it in a container and shake for 10 min or so), you can't go the other way.