Laurels (Kalmia genus) are evergreens with cool flowers. However, they're highly poisonous if eaten so not good around curious kids or animals.

https://www.wildflower.org/plants/result.php?id_plant=KAAN

Witch Hazel can take a few years to bloom and the leaves can look raggedy with all the insect action. But I did see a witch hat gall this summer which was really neat!

Spicebush could be an option. Black chokeberry too, it has awesome fall color.