The Rwandan-born refugee was a diocesan volunteer who was ordered to leave France