只恐多情

This implies a reluctance of having too many deep feelings, which may cause more pain. 'Only fearing of being too affectionate', suggests that intense emotions like excessive attachment or profound love would only bring oneself unavoidable harms.