Turms out that I can use Offset in some cases.

In my case each structure consists of the following, up tp 4 per row.

E.g.:

A1:B1 gets merged.
A2:B2 Not merged
A3:B3 Not merged
A4:B4 Not merged
A5:B5 Not merged

Due to the merge, I have to use Cells to refer to any of the cells A1:A5.
But, I can refeer to the cells B2:B5 using an Offset from the corresponding
A2:A5.