My head canon is that creatures such as ghosts, demons, djinns, ... enter our mortal realm willingly from time to time and sometimes form a connection with a person, who they then teach how to summon them in times of need. This knowledge is then passed down.

So effectively otherworldly creatures are tourists who gave a local their number and now they get bothered by their greatgreatgreatgreatgrandkids.