A little snag: I used the =SUBTOTAL(3,A2) which can identify the column is
visible or not (1 or 0) - however, the =SUMIF(category,cat,count) only works
for whole numbers/values in the category list, my data has floating point
numbers so the SUMIF didn't work.

Workaround:
What I did was create a column (say D2) =SUBTOTAL(3,A2) and another (say
e2) =IF(D2=1, A2, -10)...
The -10 forces the hidden values out of range of my distribution (0.0-1.0)
and can be filtered out in the =FREQUENCY () part.
Using =IF(D2=1, A2, "") - setting it to an empty cell didn't work as the
=FREQUENCY() fell over with #error.

It works but it takes several minutes to run (if you change any filter) as
the spreadsheet is about 65000 rows.

Thanks for the help!