SiliconANGLE

AI21 Labs’ Jamba infuses Mamba to bring more context to transformer-based LLMs

Generative artificial intelligence startup AI21 Labs Ltd., a rival to OpenAI, has unveiled what it says is a groundbreaking new AI model called Jamba that goes beyond the traditional transformer-based ...
SiliconANGLE

AI21 Labs’ updated hybrid SSM-Transformer model Jamba gets longest context window yet

OpenAI rival AI21 Labs Ltd. today lifted the lid off of its latest competitor to ChatGPT, unveiling the open-source large language models Jamba 1.5 Mini and Jamba 1.5 Large. The new models are based ...
VentureBeat

New Transformer architecture could enable powerful LLMs without GPUs

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Matrix multiplications (MatMul) are the ...
Geeky Gadgets

Diffusion LLMs Arrive : Is This the End of Transformer Large Language Models (LLMs)?

The development of large language models (LLMs) is entering a pivotal phase with the emergence of diffusion-based architectures. These models, spearheaded by Inception Labs through its new Mercury ...
Wired

How ChatGPT and Other LLMs Work—and Where They Could Go Next

AI-powered chatbots such as ChatGPT and Google Bard are certainly having a moment—the next generation of conversational software tools promise to do everything from taking over our web searches to ...
InfoQ

Microsoft and Tsinghua University Present DIFF Transformer for LLMs

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Vivek Yadav, an engineering manager from ...
Semiconductor Engineering

Transformers At The Edge: Efficient LLM Deployment

Since the groundbreaking 2017 publication of “Attention Is All You Need,” the transformer architecture has fundamentally reshaped artificial intelligence research and development. This innovation laid ...