A bishop at the centre of speculation over his relationship with a married vicar has been sent on “gardening leave”.

The Right Rev Carl Cooper, Bishop of St David’s in the Anglican Church in Wales, has been ordered out of the pulpit by the Archbishop of Wales, Dr Barry Morgan, while Church leaders investigate his relationship with the Rev Mandy Williams-Potter, his press officer.

The marriages of the Bishop and of Mrs Williams-Potter have broken down, but both clerics insist that no one else is involved in either break-up.

Dr Morgan began the investigation after 23 clergy in the diocese asked him to establish whether the bishop had given “just cause for scandal”. Bishop Cooper, 47, has been married to his wife Joy for 25 years and they have three children.

The Church in Wales said in a statement that after consultation with the archbishop “about the particular difficulties in the diocese” the bishop had agreed to take leave of absence. It is not known how long he will be away from his duties. A preliminary inquiry is under way and if a full investigation begins he could face a Church court.

According to Mrs Williams-Potter, the rumours are unfounded and the pair are just good friends.

In their letter to the archbishop the 23 clergy said that not to investigate the matter “would be to acquiesce in a situation which is causing distress across the diocese”. They emphasised that an investigation may not find anything untoward, but wanted “clarification” of the circumstances surrounding the bishop’s separation.