House of Fraser owner disillusioned with department stores