inside amorphous oxide layers are believed to contribute to both low-frequency 1/f charge noise and high-frequency dielectric loss, causing fast qubit dephasing and relaxation. Here, we propose to mitigate those noise channels by engineering the relevant TLS noise spectral densities. Specifically, our protocols smooth the high-frequency noise spectrum and suppress the low-frequency noise amplitude via relaxing and dephasing the TLSs, respectively. As a result, we predict a drastic stabilization in qubit lifetime and an increase in qubit pure dephasing time. Our detailed analysis of feasible experimental implementations shows that the improvement is not compromised by spurious coupling from the applied noise to the qubit.