Yes, they really are different. Saying a program is written in C++ not Java is roughly equivalent to saying that I speak English, but not Japanese. The source code that is written is different, though a lot of languages fall into one or another pattern group. So some can look like they are close enough, but they really aren't.
/*What does not kill us, makes us drink far too much caffeine*/