When you installMagento probably your URLs would be like:

• http://www.domain.com/index.php/about-us

There is an option to remove that index.php from the URL.
Go to your admin panel -> System -> General -> Web -> Search Engines Optimization.
Change Use Web Server Rewrites to Yes.

Now your URL will be cool enough