Recasts happen all the time. With scheduling conflicts, tensions between cast and/or crew, and a certain actor's overall fit (or lack thereof) in a role, it makes sense why TV shows will recast a character from one season to the next.
These shows all recast characters pretty early on in their appearances, sometimes so quickly you might not have noticed. Or maybe you did, and you've always been wondering why.