Tried the higher setting with no improvement.
However, I just flashed my ESCs with BLHeli firmware instead of SimonK and I believe I see a small improvement.
I also had a crash due to testing late in the evening :S. Some broken parts/propellers, but luckily I had all the spare parts at home.
Next I'm gonna play with the ESC timings. Hope this solves the issue.