Yup, pretty much. If the page was already cached, you'll need to also delete the cache for that page. Open the page while not logged into admin (I use a new private window for this) and check the source - if it's cached, you'll see a note from the plugin at the very bottom of the source code.
↧