I got it, you have to reset the big block by actually going to the right of it. It isn't enough to move the other block out of the way when the big block is going back to the right.
Could this be a bug? I'm in the lower left room. I can make the big block go left, but then I can not make it go down. I already solved this once, but now on this replay I can't make it work.
https://imgur.com/a/dt9A57N
 "Aurie"){kind=icon}
 "Temple of the Four Serpents"){kind=icon}
 "Wonderputt"){kind=icon}
 "Tactical Assassin 2"){kind=icon}