The structured illumination is adopted widely in the super-resolution microscopy imaging. Here, we studied the ghost imaging scheme with sinusoidal structured speckle illumination, whose spatial resolution can surpass the Rayleigh-resolution limit by a factor of 2. In addition, ghost image with a higher spatial resolution can be realized by a pseudo-modulation structured illumination, whose modulation frequency breaks the upper limit of imaging system. Finally, our research verifies that the structural speckle illumination, a free-standing sub-Rayleigh technology, can be grafted with a variety of sub-Rayleigh ghost imaging schemes to further improve the spatial resolution of ghost image, such as the pseudo-inverse ghost imaging.