Kanye West Steps Out in a 'Make America Great Again' Cap Despite Backlash Over Pro-Trump Tweets

Kanye West doesn’t care if his political leanings offend you.

While the world could not stop talking about the “Power” rapper’s opinions, it was business as usual for the star.

The musician, 40, strolled out his in office Calabasas, California, on Wednesday wearing a red “Make America Great Again” hat and his phone in hand after a full day of controversial tweets (over 80!), some of which declared his love for President Donald Trump.

West called Trump “my brother” in a series of tweets early Wednesday, writing, “You don’t have to agree with trump [sic] but the mob can’t make me not love him. We are both dragon energy. He is my brother. I love everyone. I don’t agree with everything anyone does. That’s what makes us individuals. And we have the right to independent thought.”

He continued, “If your friend jumps off the bridge you don’t have to do the same. Ye being Ye is a fight for you to be you. For people in my life the idea of Trump is pretty much a 50 50 split but I don’t tell a Hillary supporter not to support Hillary I love Hillary too.”

West later tweeted a closeup photo of his MAGA hat signed by Trump with over 30 fire emojis, writing “my MAGA hat is signed.”

A short while later, West said that he had spoken to his wife Kim Kardashian West about his previous tweets.

“My wife just called me and she wanted me to make this clear to everyone,” he wrote. “I don’t agree with everything Trump does. I don’t agree 100% with anyone but myself.”

Trump later responded to West, tweeting “Thank you Kanye, very cool!”

A source told PEOPLE on Wednesday the rapper wasn’t concerned with people’s opinions on his political views.

“He’s actually not as upset as you’d think about what’s being said,” a source close to West said. “He just thinks that no one gets his genius.”

“He hated the word erratic, but he likes to say that genius is erratic,” the insider continues, referencing the term a different source close to West used to describe him. “You can’t be a genius if you’re not erratic in some way. So it’s not wrong, but he thinks it’s more than being erratic.”

West’s friend, John Legend, seemed to take issue with the rapper’s tweets supporting Trump. He shared a series of cryptic Twitter posts in which he spoke of oppression continuing in the country.

“I love that great, brilliant artists have the power to imagine a better future. But artists can’t be blind to the truth,” he tweeted.

RELATED: Kim Kardashian Defends Husband Kanye West’s Twitter Sprees: ‘He’s a Free Thinker’

“The defining trait of Trump’s campaign and political profile was his embrace of white supremacy. He made it clear every time he spoke,” he added. “Some serious cognitive dissonance to ignore that for the other x% you might find appealing. I guess I agree with >1% of anyone’s thoughts though.”

Chance the Rapper also shared that he had spoken to West “two days ago” and adding that “he’s in a great space.”

On the subject of West’s support for Trump, the Grammy-winning rapper tweeted, “Black people don’t have to be democrats,” and “Next President gon be independent.”

This week, multiple sources told PEOPLE that West, 40, had cut off contact with several people in his inner circle, including his managers, lawyers and closest friends. The rapper confirmed he stopped working with a manager on Wednesday morning, tweeting, “I no longer have a manager. I can’t be managed.”

• Want to keep up on the latest from PEOPLE? Sign up for our daily newsletter to get our best stories of the day delivered straight to your inbox.

The Keeping Up with the Kardashians star also addressed her husband’s tweets on Trump, writing, “When he spoke out about Trump… Most people (including myself) have very different feelings & opinions about this.”

“But this is HIS opinion,” she continued. “I believe in people being able to have their own opinions, even if really different from mine.”

“He never said he agrees with his politics,” she added.