I haven't ever felt unsafe in the CBD, but also can't remember being there outside of daylight hours for many years. So I guess that is reflected in the survey results being much higher for that time.
Interesting that people are finding their suburban areas better and the CBD worse. I expect there are a lot less people in the CBD day to day (including me), but it seems this trend started in 2018 which is before the massive COVID WFH surge.