Loneliness is impacting the physical and mental health of Australians and men are feeling the impact, according to the CEO of a leading mental health charity.