The question to ask per feature
Does the first paint need this? If no, defer it. If the user needs it in half of sessions, deferring only moves the cost to a worse place.
Where lazy breaks correctness
A lazy image that is needed for a layout calculation arrives late and changes the measurement. Reserve the box so the measurement does not depend on arrival.