Plugin with Early Bound Types Error

Every time I try to debug my plugin I get this error:

Business Process Error
Could not load file or assembly 'Microsoft.Xrm.Client, Version=6.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.