So let me get this straight...
if a user completly agrees with your view points, and give you a positive rep point then that's great and you're really happy about it...
but if a user completly disagrees with your viewpoints and gives you a negative rep point then they are abusing the system?
you really can't have it both ways?
IMO either rep points should be given exclusively based on how helpful members are (i.e whether they helped you solve a problem in the help sections),
(thus people get negative points for being unhelpful).
or they are awarded based on how much people like the content of the posts, in which case you'd expect to get a negative rep if someone didn't like the content...
If you really want to see the rep system moderated to remove negative rep points for when people didn't like the threads you made, then it'd only be fair to remove the rep points for when people did like the points you made...
thus your reputation would be based on how technically helpfull you were rather than how insightful (or un-insightful) your opinions were.