You could use a macro:

Option Explicit
Sub testme()

Dim myCell As Range
Dim myRng As Range

With ActiveSheet
Set myRng = .Range("a1", .Cells(.Rows.Count, "A").End(xlUp))
End With

For Each myCell In myRng.Cells
myCell.Value = "'" & myCell.Value
Next myCell

End Sub

I inserted the apostrophe in cells in column A.

If you're new to macros, you may want to read David McRitchie's intro at:
http://www.mvps.org/dmcritchie/excel/getstarted.htm

Shari wrote:

For exporting, I am trying to insert an apostrophe in each cell in one of my
columns that contains numbers. There are over 800 records, how do I do this
without having to go to each cell and do it manually?

--

Dave Peterson