Linux.com has a review of a LiveCD made for writers.
GhostWriter is a live CD that provides a small number of tools for writers of short stories, novels, and screenplays. But GhostWriter can be used by someone authoring works of non-fiction as well. It’s easy to use and has a small footprint. In fact, there’s nothing to install — you run GhostWriter off a CD.