In most restaurants, as soon as you sit at your table you will get a glass of water without asking for it. Also, in many washoku (Japanese-style food) or sushi restaurants, after your meal you will be offered hot tea, again without asking for it, and both are free of charge.
