If you think about it, that’s the paradox. Like a chicken and the egg scenario.
What came first, the time travelers that made him bad or the bad that attracted the time travelers? Either scenarios are equally as likely.
For the sale of this meme, lets say the time travelers made him bad. In the future, he’s bad regardless, whether if it was time travelers or not, which would send the travelers back.