It might weigh less (especially when compared to a glazed hardtop) but the surface isn't so smooth so the aerodynamics will be worse.
At the end of the day there won't be much in it and more will depend on your use of the accelerator than anything else.