The move was opposed by Labour and union Unite who mobilsed rural workers to demonstrate outside Parliament in a bid to persuade them to back their campaign to maintain the Agricultural Wages Board (AWB).
Unite national officer Cath Speight said: "According to the Government’s own estimates, returning back to the statutory sick and annual leave payments alone, could potentially take over £9 million a year out of workers' pockets.
"This will be very unwelcome news to many of our members, who are already struggling to survive in the face of rising costs and higher food prices. Many have already been told by employers that should the AWB be abolished, their wages will be forced down - this is unacceptable and we can not allow this to happen."
"During this present climate, where people are worried about food production, food security and food supplies, it is astonishing that this government has chosen to attack the very workers who we rely on to maintain supplies and production."
Back the Apple, the Labour Party's campaign for fair pay for farm workers, launched at Tolpuddle Martyrs Festival in July.
Shadow environment secretary Mary Creagh then said:
"David Cameron's Tories want to kill the AWB," she declared. "They are turning back the clock on 60 years of decent pay and conditions, back to the pre-industrial revolution era. That will mean a race to the bottom on rural wages."