Looking into the past with a telescope

With the JWT, I have read that scientist will be able to see back
closer to the big bang than with any modern telescope; targeting IR.

I understand that when we look at a DSO (or any object), that we are
looking at the DSO the way it looked at some time(t) in the past. In
this respect, we are looking at a snap shot of the past.

But what exactly are the astronomers expecting to see? New galaxies
not seen before due to their extreme red shift?

.