I get the idea but there are several issues.

1. Intermediate products. For example I've used many automatic measuring microscopes, so if a block was 25mm +/- 1mm it would find the edge of both sides and calculate the distance between them and determine if part was good. These systems are very expensive (cheap ones could buy a car, expensive ones could buy a house). It's useful but I don't think anyone would make it without a benefit to them personally. Technically I could do the same with a drop gauge or even a ruler but wouldn't be as accurate or as fast. In a lot of cases you don't need that, for example making utensils like forks or spoons. But for example making gears in a transmission have as tight if not tighter tolerances.

2. Quanitity. Now let's make a house, yeah people might like the act of building. And we all agree houses are valuable, not monetarily but in shelter from weather and safety from animals and other humans. How many screws are in your house? If your answer is 3 digits you are wrong. Who is going to make all those screws? Now we are going to ignore machine screws which need a precise thread and just use wood screws. Do you think anyone's life dream is to make 10,000s of screws? If you find someone to make them, how are they going to feed their family over the months/years it will take them?

3. Quality. Going back to screws they need accurate threading and accurate heads. Without accurate heads a screwdriver won't work(think of removing a stripped screw) and without accurate threads it won't screw down or mate with the drilled hole. Who is going to verify that? If you "buy" 1000 screws and only 50 are usable what do you do? With no incentive to make good screws does the screw maker care? Who is going to verify the food you get is safe to eat?

4. Non-profit products. Let's say you love math. How are you going to survive? In history their were patrons who paid some of these people hoping there would be a reason in several years or decades. Some worked out, some didn't. But someone needed to say "yeah study how to solve that problem and I'll support you while you do". But they have limited resources too. In most cases these were basically investments hoping the end product would result in a net benefit. You can't survive with just math. You can't go into the woods and scream a theorum at a deer to get meat to feed your family. Now that math feeds into intermediate products which feed into final products which are valuable and that value gets distributed to all the earlier producers.

Yeah people like to make final products. Most people won't enjoy just sitting their useless. Some people like fixing/restoring stuff. But they use so so many stuff other people have done. Distribution is totally fucked up, granted. But for some people to do their dreams there are so many other people they rely on.