Can I keep a weapon at home?

I found an article about a man who was storing naval guns in warehouses in his neighborhood. I was wondering if I was allowed to keep a gun at home, for example for self-defense? What are the consequences if I keep a gun without a permit?