The Congress on Monday accused the Modi government of withholding funds that should "rightfully" go to Karnataka, saying the people of the state are being made to pay the price just because they exercised their democratic right to elect a Congress government.