The Chief Justice of India H L Dattu on Monday defended holding the annual chief justices' conference on Good Friday.