Disclosure….I am no movie expert, and have not seen the movie in over a year. I was just repeating what I have heard. That said, when I tell you the scene, I’ll bet that you remember it, and I guess that is proof enough.
Anyway, near the beginning of the film, when the timid villagers are looking for samurai, they see one walking down the road. The samurai, in a closeup sort of "glares" at them. He is not hired, never speaks and is not seen in the movie again, but that is "the" scene. According to the commentary that came with the Netflix rental, that scene was filmed again and again to get it perfect.