Much-loved period drama leaving Netflix has fans saying the same thing