When you installMagento probably your URLs would be like:
There is an option to remove that index.php from the URL.
Go to your admin panel -> System -> General -> Web -> Search Engines Optimization.
Change Use Web Server Rewrites to Yes.
Now your URL will be cool enough
(Visited 40 times, 1 visits today)