If he does have a permit for the gun it should be taken away. People like this should not be allowed to own guns. Not that it would stop him from getting one illegally I guess. But it would be another charge if he did it in the future.
What is really bad is that he has done this previously and apparently nothing happened to him.