If you are setting them up on one cable then one should be set to master and the other should be set to slave. It should tell you on the top of the hard drive where the jumper should go to set the hard drive to slave or master.
If you are putting them on 2 different cables, then it really shouldn't matter.