Had no real problem till the last level. When I checked the walkthrough I discovered I had the right idea, but the timing is a PITA.
If you're having a hard time doing it the way the walkthrough shows, let just one of the big blues on the right go down and tip the pole to the left, leave it a ball.
Back in the top left, click the right hand little red and the right hand big blue as close to simultaneously as possible, this should get the first red off the screen and most of the time the single big ball at the base is enough to rock the pole back to the left.
Then, back at top left, inch the remaining red one box width down the slope by clicking it twice quickly. Do the same with the big blue underneath it.
Now you have everything set up the same as the way you were already able to remove the first red, just click red then blue as quickly as possible and it should work.