Always maintain the highest vacuum, until the part gels and cures. If you want, infuse at a lower vacuum, then raise it higher, but why bother in the first place? Just vacuum, and infuse. Leave pump on.
as Marcel mentioned, yes, there will be a pressure gradient, because one side is vacuum pressure, the other is ATM pressure. However, once you clamp your resin line, it evens out more. You will have a difference in thickness from vacuum to vent side, but unless you are doing precise parts, then it doesn’t matter too much. You shouldn’t be doing VARTM in the first place if you need to be that precise.
Clamp early, and let your resin flow into a delay line, and things should even out. Of infuse aroiund the outside, and vent in the middle, or vice versa.
But don’t stop the vacuum, because if you get an air leak around your tape, you will lose the part. Vacuum staying on, gives you a chance to have the air leak go around the part, not in it!