Programatically restricting FilterBuilder operators

In one particular scenario I have a situation where I want to further restrict the operators in the FilterBuilder for a particular field under certain conditions. Is there a way I can do this programatically with the FilterBuilder?

I know the operators can be customized at the DataSource level via validOperators, DataSource.setTypeOperators and I am using both of those in various places as well, but this case is a little different in that depending on programming logic I want to conditionally hide/remove certain operators for a specific field.

Thanks.