The difference (percentage wise) will remain. When I used to setup an RTV event, I'd spank £50 in fuel when using a 3.5 V8 Ninety. In a Tdi the same setup would cost about £20-25.
But it depends what you are doing really. If the V8 drops to say 8mpg off road, but you only cover 2-3 miles, does...