The comedian told "Hot 97's Ebro In The Morning that "multiple people on the cast" told him "you're so talented, you're so able, they don't use you and it's unfair and it's making us feel bad.'"
The comedian, who played President Obama, Jay-Z and Will Smith, among other celebs, said he was tired of -- as the host of the radio show said -- only being there to do impressions of black celebrities.
He didn't get to do his most famous impression of Obama for "the last year and a half," he said, saying the show "gave up" on the character, even though Obama was still in office.
Pharoah also says he was nearly fired in 2013 when he spoke out about how the show didn't have any black female comedians. "I almost freakin' lost my job," he says. The show then hired LaKendra Tookes, Leslie Jones, and Sasheer Zamata. He says it was Jones who encouraged him to do the Kevin Hart vs Katt Williams 'Weekend Update' skit.
He said he refused to do some of the skits he was asked to do, including wearing a dress: "They put people into boxes. Whatever they want you to do, they expect you to do," he added. "I'm a little fiery too... I'm not a yes n****." He said, though that he's "got no beef" with "SNL" head honcho Lorne Michaels and that the two are "good."
He told the radio hosts, "You go where you're appreciated." His new comedy series, "White Famous," was just picked up by Showtime.
Watch the interview below. Multiple F-bombs, so grab your headphones if you're watching it at work.