Kagi also links to an alphabetical list as first result. However, they also have a "quick answer" button using an LLM.
Quick Answer
The country in Africa that starts with the letter K is Kenya. [1] Kenya is located in East Africa and shares borders with Tanzania, Uganda, South Sudan, Ethiopia, and Somalia. [2]
Alphabetical List of All African Countries - ThoughtCo Countries beginning with K - Worldometer