Eventually I got round to removing it using the id tag. My CSS wasn't altering because of WP Super Cache and I had to remove all the cache files properly. Lesson learnt about caching plugins.
Still not sure how the google+ link got in the header but it's been removed anyway.
I guess I'll mark this as resolved?