Does language pretraining help T2I generation?

Three controlled experiments. gFD on GPIC Test-50K, lower is better.