You make a number of very valid points. When a program is distributed without its source code, users don't have as much control as they would otherwise. Internet censorship is on the rise and presents a serious and credible threat to society.
open source != free software, but RMS was definitely talking about both