Yep you need a domain name pointing to your instance when you run the installation of Lemmy and it will create a let's encrypt https cert for your site automatically.