Cobrey Farms unsuccessfully sought permission in 2013 for the development at its Redhill Farm, where it already has polytunnels.
The appeal decision said views from the so-called "Poets' Path", associated with the local Dymock Poets group, as well as from a realigned right of way "would be considerably and adversely affected by the proposal".
Cobrey Farms had presented a fallback position of growing the asparagus under cloches, which would not require planning permission, to which the planning inspector said: "The much lower cloches, although obvious features, are far less visually intrusive due to their significantly lesser size."
He ruled: "Any benefits from the scheme are clearly outweighed by the negative aspects of the proposal." Cobrey Farms declined to comment on the decision.