Well, I'm not real sure about it. I'm just beginning to experiment with this, but so far, I've noticed more sharpness with the IS off. What I have observed is just with a 200mm, and it's a f/2.8, so I can often get more than 1/200th shutter speed. When hand-held, I'm going to turn it on under that and turn it off over that. As Clicker pointed out, the longer the focal length the more pronounced the shake. If I was shooting a 400mm, I wouldn't turn it off unless I had 1/500 or higher, and with a 600mm, I don't image I'd ever turn it off.
You're excellent at these kinds of experiments under controlled conditions, Loupey, and I for one would be very interested in your results.