Modi can waive loans of the country's rich but can't do the same for farmers, he said.