‘The Affair’ to end at Season 5