If there is no other use for controls then dragging them to mouse, you can just turn them into buttons (with keyboard shortcuts). Game would feel much more responsive then.
As it stands now you spend most of the time dragging controls to mouse... which isn't really a fun part.
 "Mouse Maze"){kind=icon}