AFAIK, the Kaby Lake will give you minor performance improvements, but the major difference from my perspective is that Haswell is limited to 32GB RAM, while Kaby Lake can address 64GB.
Then there are the price differences for boards and DDR3 vs DDR4 RAM (Kaby Lake supports DDR3L, but I haven't seen a mobo that takes Kaby Lake Xeons and DDR3)