Justification of administrative acts

If an administrative body denies you a permit or other document, is it required to provide a justification for its decision?