AWS S3 Ember CLI Static Hosting Routing Issue Throwing 404

I am trying to deploy my Ember app to AWS. I have taken the following steps found here. The app loads but immediately throws a 404 once the URL/route changes since those files do not exist on the S3 bucket. Any ideas?