Centralizers, Normalizers and the Center

If H is a subgroup of G is it true that

Z(G) is a subgroup of C_H(G) which is a subgroup of N_H(G)?

I believe that it is.

If H is just a subset of G the above is not necessarily true, right?

Are there any easy examples of the above 2 cases?

.