I don't know if I was lucky but I just write how I beat the challenge level. You can throw your hat on the yellow guys and "send them to a better place" when you press the throwing key again when you are over an hole which makes you switch position with them and makes them fall out of the map. I did this with most of these yellow guys in the challenge level. The last part before the door is tricky you need to get rid of the first guy which should be easy then throw your hat at the one on the first block and switch positions with him when he is on his high location, then you just quickly jump on the other block and then further to the door. That's how I did it. Good luck everyone! :)