I think if you change the formula to:

=INDIRECT("B"&(COUNTA(B3:B6)+2))

it should work.

The problem is the COUNTA(B3:B6) is yielding 3, so the formula is
looking at cell B3, instead of B6.

HTH, rg