Hello & welcome,
The subaru will be a massive step down in refinement and luxury, although the leather will go some way to cushioning the blow, with that mileage I wouldn't be worried especially with fsh,
I'd check when the glow plugs where done and the dpf filter if applicable as the early diesels had some issues with these, but should have been rectified by now,
What made you look at changing ? The foz is a very capable and robust , won't get stuck anywhere and even on summer tyres gets me out of muddy fields & snowy conditions with no problems. Just have to ask yourself if it's what you want compared to the lexus,