Did you remove Scale track and set scale to 1 for x,y,z ?
From screen it looks you still have some track for camera scale parameter.
I was select all scale parameters for camera in attribute manager/right click/Animation/Delete Track and set all to 1 and don´t see any offsets/jumps in camera movement (instead of f-curve settings)