Yeah, you need to buy a router. Do you want wireless capabilities or not? It's convenient if you have a laptop as well, and it'll still work with a wired connection. All you have to do with the router is plug the internet into a port on it, then connect both of the computers to the router.
Look at something like this: