The premier made the remarks in her introductory speech at the maiden cabinet meeting of her newly formed government