I never had to have a passport to visit Canada growing up. Used to cross the Rio Grande with tour groups in Big bend National Park, no border patrol anywhere.