This is only relevant if you are setting wholesale pricing within your retail cart as a separate price group.
Alternatively look at using a separate cart for wholesale, restricted by authorisation level or member group to only wholesale members. You can customise tax rules and other settings specifically for your wholesale members.