For a direct answer to your question, no, binary is NOT a programming language. As Pete.i said, binary is a number system and the only thing that a computer actually works with.
Languages are what humans understand. The purpose of a programming language is to translate what humans understand into binary so a computer can process it.
Today's Dilbert comic strip seems appropriate here: