Grimoard excommunicated Bernabò Visconti. He returned to France, and retired to his castle of Auriol, where he was found on 10 June 1362.

The reason for his retirement to Auriol is not far to seek. The plague was raging in southern France again in 1361 and 1362. Cardinal Pierre des Près died on 16 May 1361; Cardinal Petrus de Foresta, died on 7 June 1361; Cardinal Guillaume Farinier, died on 17 June 1361; Cardinal Guillaume Court, O.Cist., died on 12 June 1361; Cardinal Petrus Bertrandi, died on 13 July 1361; Cardinal Jean de Caraman,