Okay, so it was actually unmanned, and it was a hydrogen balloon, but it does seem to be a pretty widely repeated story from a contemporary newspaper. This was shortly after the first hot air balloon flight and might have had less fanfare, so it seems a bit more reasonable that peasants 21 km away wouldn't have heard anything about it until the large levitating blob was coming at them.