Making a redirect take effect?

What more needs to be done to make a redirect take effect, beyond deploying the updated group redirect list? (I am using the Enterprise version, so we have a group.) I ask because the "source" page is still loaded if I use the original URL, even in an incognito/private window, which shouldn't have anything cached. Do I need to delete the original page?