I posted this for someone who asked a similar question:
I created my website using Wordpress. Although it is primarily a blog software, it can still be used to make great static websites. Lots of plugins and themes available. There are sites that handle all of the setup and hosting for you, but if you want to setup wordpress yourself, it's not too difficult with their 5 minute guide and some googling about. Joomla and Drupal are also popular options, but i'm less experienced with them.
Weebly is another one that is pretty easy to use and more designed for static websites, rather than blogs/message boards. They handle all of the hosting and setup for you. They offer a free plan and the paid plans are pretty reasonable.
If you're looking for a free domain name, check out Dot TK - Free Domains for All. Although, I'd recommend getting a real .com,.net,.org right off the bat. You don't want to be changing your name after your site takes off!
I'm not sure what skill level you're starting out with. I'm not an expert by far, but I took a class on PHP and was able to create a basic portal page with login using PHP and an SQL database, so it can be done with a bit of study.
If you are comfortable working with CSS and HTML, starting with a base such as wordpress might be an option for you. Wordpress is built on PHP and a lot of the customization/design is done with CSS.
For a fast and easy way to get a test server running to play with, I'd recommend XAMMP. It's windows based and will get you started with PHP, apache, and SQL in minutes.
Can't comment on aspx as I have no experience with it.