Abu Dhabi, United Arab Emirates - Monday, 12. August 2024
The Falcon Mamba 7B is the no. 1 globally performing open source State Space Language Model (SSLM), as independently verified by Hugging Face
SSLMs have a low memory cost and don’t require additional memory to generate arbitrary long blocks of text
Falcon Mamba 7B also outperforms traditional transformer architecture models such Meta’s Llama 3.1 8B and Mistral’s 7B
New model reflects the innovation and pioneering approach of Abu Dhabi in AI research and development
The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by
...
Read more »