It's not the only deciding factor, or you'd have Sweet 16s with nothing but or even mostly 1/2 seeds.
Clearly 1/2 seeds are generally the best regular season teams and also have the easiest path on paper, but it doesn't guarantee anything and that's the double edged sword of the NCAAT.