Cumulative Hotfix 2 for Outlook Add-in for EV 10.0.3 compatibility with EV 10.0.3 without hotfix

To get it to work properly for some end user PCs, we'll need to use the EV 10.0.3 Outlook Add-in with the Cumulative Hotfix 2.  Does that mean I would have to apply  the Cumulative Hotfix 2 for Enterprise Vault 10.0.3  on our  EV server as well?  Or can I get away with leaving the server as is since it seems to be running smoothly thay way.

Thanks,

Rick