Brexit has damaged Britain's standing in the world, and its chief advocates no longer wish to talk about it, a senior minister will claim today.