You will need to add some css to remove or reduce the margins above and/or below fields. Have a look at the following page where it is explained how to target different elements of the form through css: CSS Targeting Examples - Gravity Forms Documentation
Hope that helps!