Ocwen Financial Corp. will reduce struggling borrowers' loan balances by $2 billion in an agreement with federal regulators and 49 states over foreclosure abuses.

The Consumer Financial Protection Bureau and state attorneys general announced the deal Thursday with the Atlanta-based company, one of the largest U.S. mortgage servicers. The regulators said Ocwen pushed borrowers into foreclosure through illegal actions, such as failing to promptly and accurately credit mortgage payments.

Under the agreement, Ocwen also will refund a combined $125 million to about 185,000 borrowers who have been foreclosed upon. It also agreed to change the way it manages mortgages. The company must stop "robo-signing" of documents, the practice of automatically signing off on foreclosures without a proper review.

The agreement must be approved by a federal court in Washington.