Build and Release Ember App to Azure Service Fabric

currently our process works, but it takes too much time due that the fronend Ember app needs to be build into every single environment we have ( 5 environments ). because we never know which environment will be available when we release it. we intend to add even more environments because every developer should have his own working development environment. (because of the backend)

how we do it, is that we create a frontend build and a backend build which creates artifacts. now the frontent build takes around 2 minutes for every environment. ember build --env=test and ember build --env=acceptance and ember build --env=development ... and more

when the artifacts are created we then create the release picking the correct ones depending on which environment we release (this done via release pipeline).

my question is can we make a frontend ember build somehow not depending on the environment? i would like to note that we are using azure service fabric.

thanks!