Topic: latent space

A new latent-space language model called NCP-ArchPreview has been introduced, which extends autoregressive pretraining by incorporating Next Concept Prediction (NCP) alongside standard next-token prediction. This advancement aims to enhance the model's ability to understand and generate more complex linguistic concepts.

arxiv.org↗