Where #REF! is returned, you might change your formula to
=IF(ISNUMBER(your formula here),your formula here,"")

This will prevent REF! from returning, and the sum will evaluate
properly.