Is the fine for non-appearance legal if the summons was not received?

I've heard that even if a person didn't actually receive a summons, they are still considered notified if the letter was returned with the mark "addressee absent". Is this truly the case, and is there any way to appeal the fine if I genuinely wasn't home and didn't receive the summons personally?