I would do this:

Format your column B cells as "0000" in order to see leading zeros.

in B3, type in the following formula:

=IF(A3<"",B2+1,"")

Copy this formula down Column B as far as you need to.