They say you can tell by the hat, but

When you compare them like this, the colors are actually different. The phrase 'wandering through this village and that village' sounds cool, like a lone wolf traveler from a samurai drama... Though in reality, it's just because they're poor and looking for work. And Jiro really gets it. Smart boy! Go Jiro!