It's normal for it to not accelerate as hard as second, due to the gearing advantage of second gear. But for the same reason, acceleration in third should be stronger than acceleration in fourth.
Are you shifting at redline for both gear changes?
(Note that the difference in audible volume before and after upshifting creates the perception of slower acceleration in the higher gear, adding to the actual acceleration differences.)