Yeah, sometimes it's just easier to shoot rocks & trees. Sometimes they listen better than people too!
I've heard a lot of stories about photographers being told that they can't photograph something when there really isn't any law stopping them from doing it. How much you want to challenge that in any particular situation is up to you though. This site should provide some info on what you can and can't do.