Hi Marius,
Once again thanks a lot for your help,
I deleted the cache from the URL you sent me, however it didn't work.
But I went to plugin details as you suggested me, and I did this :
How do I delete the Super Cache rules from the .htaccess file?
Load your desktop ftp client and connect to your site. You may need to enable "Show hidden files" in the preferences of the ftp client. Navigate to the root of your site where you'll find the .htaccess file. Download that file and edit it in a text editor. Delete the lines between "# BEGIN WPSuperCache" and "# END WPSuperCache" and save the file. Now upload it, overwriting the .htaccess file on your server.
It seems to work now, can see the last updates without login in the dashboard.
Have a good day