is there anyway to add a small letter to the top right of value? like
the 2 appears in x^2).

With Excel 2003, select a cell and type
x2
but before hitting the Enter key select just the 2 in the formula bar and use
Format Cells Font Superscript


and is there anyway to do it to a lot of cell at the same time?

Not that I've found.