I tried setting up a static site with S3 and Cloudfront and managing the domain with Cloudflare. Even when S3, Cloudfront and Cloudflare were set up correctly, requests to the newly setup website returned a very nondescript error:
After some googling, the solution turned out to be to set the Cloudflare SSL/TLS encryption mode to Full
instead of the default Flexible
.