Does size of the script really matter when chossing frameworks?

I know that size of the javascript file is crucial for the website success as it affects the performance.

But is the size really that important that it becomes a factor when choosing a javascript framework. Whenever I read an article on the comparion of javascript framewroks always size of the script is mentioned in big bold letters.

They say Backbone is just 6.5k, Angular at 40k, Ember at 90k but it does it really matter?

In today's world where people have high broadband connection, mobiles are equipped with high speed 4G and 3G, I think an additional 50k size more doesn't affect. I believe its the features that a framework provides should be given importance.

If a particular framework suits my needs, then even if is 50k or even a 100k more, I believe it should be picked up.

I want to know whether what I think is right?