You are talking about a pivot table?
In my experience when I refresh a pivot table it doesn't change what
fields are displayed. Are you perhaps remaking the pivot table rather
than refreshing it?

Please advise which version of Excel and, if you have a macro that does
the refresh, the code of the macro.

Bill Manville
MVP - Microsoft Excel, Oxford, England