With the following change filter will be always available if user is in lazy_load_categories_groups group:
lazy_load_categories_groups
@Moin, could you please check if filter is available again?