Modulational-instability-free pulse compression in anti-resonant hollow-core photonic crystal fiber

Gas-filled hollow-core photonic crystal fiber (PCF) is used for efficient nonlinear temporal compression of femtosecond laser pulses, two main schemes being direct soliton-effect self-compression, and spectral broadening followed by phase compensation. To obtain stable compressed pulses, it is crucial to avoid decoherence through modulational instability (MI) during spectral broadening. Here we show that changes in dispersion due to spectral anti-crossings between the fundamental core mode and core wall resonances in anti-resonant-guiding hollow-core PCF can strongly alter the MI gain spectrum, enabling MI-free pulse compression for optimized fiber designs. In addition, higher-order dispersion can introduce MI even when the pump pulses lie in the normal dispersion region.