Remove users who do not belong to groups using CSOM

Hi,

Is there a way to remove a user who has been explicitly granted permission to a site or subsite (e.g. Direct Read or Contribute), instead of being assigned to a group using CSOM?

Web.SiteUsers.RemoveById will remove the user from site collection, which I don't want.

Thanks,

Debasish

SharePoint Architect