Hypothetically, you could really get rid of all of it. Kickoffs could be 4th and 25 to allow for something like onside kicks. Combine that with a rule that incompletions on 4th down are turnovers at the spot where the ball hits the ground to replace punts and normal kickoffs. Finally, do offseason testing to see what size and configuration of "uprights" (some sort of single Quidditch hoop?) results in quarterbacks roughly matching kickers' percentages on PATs and FGs.
It would strike us all as being goony AF, but when you get down to it, the kicking specialists are kind of relics anyway, and at this point they mostly serve to add randomness and drama by leveraging "black box" skillsets that none of their teammates possess. It's like, "you as an offense only managed to reach the 'X' yardline so you have only earned a 'Y%' chance at 'Z' yards of field position or 3 points." Kicking and punting are already like a weird minigame, and they could be replaced by one focused on throwing without fundamentally altering the nature of the sport.