Abstract: Generative Pre-trained Transformer (GPT) models have showcased outstanding ability in language understanding and generation, yet they confront inherent limitations in directly generating ...