The task force has looked at schools running growing schemes and found out what is preventing other schools starting schemes.
The members include writer Peter Seabrook, Blue Peter gardener Chris Collins; former England rugby union captain Lawrence Dallaglio, Garden Organic, the RHS, the Women's Institute and Morrisons supermarket.
Bremner said any recommendations had to balance funding restrictions with the desire to make "every school a food-growing school" as outlined in a Defra December 2010 report.
Bremner said private business was an important part of plans, with Morrisons and Sainsbury's working on schemes, while the RHS and Waitrose were looking to rollout the RHS campaign for schools gardening to all UK schools.
"The task force will look at the evidence and the solutions to ensure that no barriers exist to prevent any child from having the experience of growing food."