Axe handle crooked

[Severi]

I was watching Wranglerstar's video on replacing the handle on my Gransfors Burk small forest axe. Everything went perfectly up until it came to mounting the new handle. I followed the instructions on the video (I think) banging the bottom of the handle to drive the axe head onto the handle and it worked but upon looking at it again I realized that it mounted on a slight angle. Where do I go from here? Do I keep banging? Any help would be appreciated, this is the first time I've tried this.