Poppi I was the only one who was treated that way too, so to everyone else he was the nicest person ever. I think it's because it's a safe way to let off steam, but it's not good for us and we have to look after ourselves. As JuJu says state the cause and effect but don't attack as that will make him defensive. Do however give specific circumstances and examples, and be very clear about how upsetting it is for you. Ask him how he would feel if it happened to him.
Oh, and you are most definitely not being silly by admitting to having problems and looking for ways to resolve them. Everyone goes through bad times and it's better to address the problems and try to fix them.