energy range. We analyze the effect of the additional quantum states on the maximum achievable speed for quantum gates in the qubit state space. By calculating the minimum gate time using optimal control theory, we find that higher energy levels can help make two-qubit gates significantly faster than the reference value based on simple qubits. This speedup is a result of the higher coupling strength between higher energy levels. We then analyze the situation where the pulse optimization algorithm avoids pulses that excite the higher levels. We find that in this case the presence of the additional states can lead to a significant reduction in the maximum achievable gate speed. We also compare the optimal control gate times with those obtained using the cross-resonance/selective-darkening gate protocol. We find that the latter, with some parameter optimization, can be used to achieve a relatively fast implementation of the CNOT gate. These results can help the search for optimized gate implementations in realistic quantum computing architectures, such as those based on superconducting qubits. They also provide guidelines for desirable conditions on anharmonicity that would allow optimal utilization of the higher levels to achieve fast quantum gates.