Using matrix product state based methods, both the ground state properties and quench dynamics are systematically investigated. With an increase of the transverse (electric) field, the system displays a quantum phase transition from a disordered phase to a translational symmetry breaking phase. In the ordered phase, an approximate Gaussian law of the Z2 LGT emerges in the ground state. Moreover, to shed light on the experiments, we also study the quench dynamics, where there is a dynamical signature of the spontaneous translational symmetry breaking. The spreading of the single particle of matter degree is diffusive under the weak transverse field, while it is ballistic with small velocity for the strong field. Furthermore, due to the existence of an approximate Gaussian law under the strong transverse field, the matter degree can also exhibit a confinement which leads to a strong suppression of the nearest-neighbor hopping. Our results pave the way for simulating the LGT on superconducting circuits, including the quantum phase transition and quench dynamics.