There is a correct height, the following is from the Fender Support page online:
Setting pickups too high can cause a number of unusual occurrences. Depress strings at last fret. Using a 6" (150 mm) ruler, measure the distance from the bottom of the first and fourth strings to top of the pole piece. A good rule of thumb is that the distance should be greatest at the fourth-string neck pickup position and closest at the first-string bridge pickup position. Follow the measurement guidelines from the chart below as starting points. The distance will vary according to the amount of magnetic pull from the pickup.
Note: Larger string gauges need wider vibrational allowances. If you have a five-string bass or are using heavier-gauge strings, your measurements must be increased accordingly.
Shop Pickups
Bass SideTreble Side
Vintage style8/64" (3.2 mm)6/64" (2.4 mm)
Noiseless™ Series8/64" (3.2 mm)6/64" (2.4 mm)
Standard "J" or "P"7/64" (2.8 mm)5/64" (2 mm)
Special Design Humbuckers7/64" (2.8 mm)5/64" (2 mm)