Prince Harry had “unproductive” conversations with William and Charles