Energy minister Kwasi Kwarteng said the Conservative Party has suspended members over "Islamophobic material".
Speaking on BBC Radio 4's Today programme, he said: "We are trying to get to grips with this problem."
Mr Kwarteng said members had been "dismissed from the party in a summary way" when Islamophobic material was revealed on Thursday night.
He said: "When it was revealed, we took very decisive action, they were suspended. We will look into the case and if there is a cause to expel them I'm sure they will be expelled."
Asked whether he thinks an independent inquiry is needed, Mr Kwarteng said: "I think the party has enough structure and discipline and focus to try and deal with this problem in the first instance. Obviously this is something that is ongoing.
"I don't know exactly when we will be able to announce what structures we have in order to expel or maintain the suspension of these members, but there is no doubt that we took very summary action when we found out last night what had been going on."
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here