The Risks of Letting AI Direct Conversations