It's because it isn't fed facts really. Words are converted into numbers and it understands the relationship between them.
It has absolutely no understanding of facts, just how words are used with other words.
It's not like it's looking up things in a database. It's taking the provided words and applying a mathematical formula to create new words.