You just know this will be used to stick it to us and charge more for downloading videos.
If you are downloading multiple videos a day, all day long, each and every day, day in and day out, then maybe. If you download one, or maybe two videos a day from Netflix, it is not likely to affect you at all.
We must be careful not to get caught up in the rhetorical extremes of the debate. There are several issues here involving net neutrality but they boil down to two; (1) hogging bandwidth and (2) censoring content/privacy.
If my next door neighbor is using 10 times more bandwidth than me downloading videos and playing high resolution interactive on-line games all day, I should not have to pay as much as him just to keep my speeds acceptable. To me, that just seems fair.
Where the controversy (and extremists viewpoints) comes in is with companies like Comcast saying they will monitor the content of our data to determine what type of data is being up and downloaded, and then charging, or worse yet, blocking depending on that content. That's where I draw the line. If they could monitor and block only illegal content such as child porn, terroristic plots, pirated software (programs, songs, and videos) organized criminal activity; etc.) without trampling on our individual First Amendment Right to Free Speech, AND without seeing what else we were doing, AND without gathering and saving information about what else we were doing, then I would be all for it. But ISPs don't have the technology to ONLY pick out illegal activities without seeing what else we are doing. And I simply don't trust Comcast and some of these other companies to not use gathered information for profit - that is, I am certain they would sell that information about our Internet surfing habits to marketers. And I am certain some of those "marketers" would be scammers and identity thieves posing as marketers.
There needs to be compromises and that comes from debate. It is important to understand both sides of the argument.