So after completely reinstalling nginx and resetting all its configs to default and basically copy pasting the nginx conf you provided. It finally worked.
Now to test slowly.
Update:
After using certbot to install the ssl certificate. It then returned a 404 error.