I've found the problem - recently I converted all ranges of cells to tables which made formulas more meaningful and easier to work with, but at the same time it caused the exact problem I described. I've just converted tables back to ranges and everything works just fine now.

Can I do anything to fix this delay while still using tables?