We started a war with Iraq (which had nothing to do with Osama Bin Laden, a Saudi Arabian), and after ousting their leader, we turned our attention to hunting down Osama hiding in Afghanistan with the Taliban.
It was the other way around. Afghanistan first. After routing the talibans Bush turned to Iraq