I see that you are using Digg3. Are you aware of the fact that some themes have a Home tab coded into the template which cannot be removed? See here please > http://wpbtips.wordpress.com/2009/05/06/the-home-tab/
To eliminate your problem create a custom menu and include only what you want to include in it.
taff have provided help for those who want to structure their blog like a website. > http://en.support.wordpress.com/using-wordpress-to-create-a-website/
What’s critical is:
(1) a clear comprehension of the differences between pages and posts > http://en.support.wordpress.com/post-vs-page/
(2) a clear comprehension of the fact that there is only one dynamic page in a blog for posts and we cannot post to more than that one page. But we can create the appearance that we have posted to more than one page.
We organize our posts by assigning Categories to them. When we publish a post it automatically appears on the running page for posts and also on the Categories pages and Archives pages. Note: There must be one published post in each Category in order for there to be anything to display.
A custom menu allows you to display Categories with drop-downs to sub-categories in tabs along the horizontal navigation where normally only Pages tabs are displayed. If you wish you can also include Pages with drop-downs to sub-pages and/or custom links in your custom menu as well. You are in charge of what appears in a custom menu. You choose the order in which to display any and/or all the foregoing in your custom menu. You choose which to display and which to hide. http://en.support.wordpress.com/menus
Also note that if you do not want all the posts to show on the front page, then you can create a static front page ie. landing page for your site, and also create a “blog” page for your posts to display on, but that’s optional.