While the committee investigating the IRS targeting of conservative groups hasn't found any criminal violations, House Oversight Committee Chairman Darrell Issa says what it has found is even more troubling.

"Right now, what we see is something worse," Issa told Fox News on Wednesday. "We see the intent and the recognition of people that the IRS should not be a political body. And if it is, it could be the end of our democracy."

Editor's Note : Video Exposes Dangers of Obamacare Law

Appearing on "Hannity," Issa, R-Calif., said the targeting was ideological and "it clearly affected only conservative groups."

The Internal Revenue Service is being investigated for subjecting conservative groups seeking tax-exempt status to additional scrutiny. Though some liberal groups faced the same scrutiny, they were far fewer in number and were either told they were approved or denied. The conservative groups were held in limbo, which affected their ability to participate in the 2012 presidential election.

Issa on Tuesday called for IRS official Lois Lerner to turn over emails sent to her personal account. Lerner has pleaded her Fifth Amendment right not to testify before Issa's committee on grounds she could incriminate herself

"I believe that the trust of the American people was broken," Issa told Fox News.