Have you checked into the options we have fro displaying Archives? Every time we publish a post it's automatically added to the Archives and also to the Categories/Tags we assign.
The Categories become accessible to your readers when you place the Categories widget in your sidebar > Appearance > Widgets
There are options fro displaying Archives as well. One is using a Archives widget. The other is to use the shortcode placed on a static page http://en.support.wordpress.com/widgets/archives-widget/
Displaying a link to every post on your blog on any page other aside from the Categories and Archives pages becomes problematic when it comes to search spider robots indexing and search engine optimization. Some search spiders will stop indexing when they reach around 100 links on any page.