It’s not your headphones. You are not crazy. In actual reality the difference between gear is very minor, and this difference will not be noticed by the listener most of the time. However, you will often see reviewers and some audiophiles make this difference seem much greater, they significantly blow it out of proportion (because that’s how they perceive it… but perception and psychology is a whole other topic).
I say that you stay with your current gear unless you need more power to drive the headphones themselves.
I recommend that before you get any further down this journey, read the articles I mentioned in this post.
I think it is most important to listen to any headphone before you buy it… especially when it’s a big purchase like the one you are looking to make.