If you are swaying in front of the ball in the downswing, try feeling like you are pushing your left hip way from the target. This will also increase rotation, which leads to more power.
https://blossom.primal.net/4241a9bf7a9011f36a3246afd1dab54ada1dd60a578b3855a1cd1e37eed7acdd.mov