"You're where you should be all the time
And when you're not, you're with
some underworld spy
Or the wife of a close friend"
is (probably) not about you and at most partially about Waren Beatty? The identity of the real subject(s) is a secret known to a select few including Dick Ebersol (who won a charity auction), Howard Stern (who says it is a composite of three people), and (so she claims) Taylor Swift.