Jamba’s appearance indicates an era shift in the case of LLMs, which efficiently deal with the constraints of the regular SSM and the Transformers types of architectures. Venturing into context ...