You're right, I see. Other dynamic elements like cloth or dynamics do render correctly when only rendering a single frame later in the sequence.
Interestingly enough, adding a null object with a collider tag does make the tracer evaluate from the beginning. Solving my issue!
Thanks for pointing me in that direction.