There's been a lot of fine writing about dads and sons bonding at the match but, 50 years on from my father's death, it's clear the game drove us further apart