Looking into the past. Yes, indeed, it takes millions of years for the light to travel from these galaxies to us. In fact we are looking at this distant objects knowing that their appearance might be very different today.