Ex-priest was fined for embezzlement and was in open conflict with his bishop the last 10 years