간편하게 보는 뉴스는 유니콘뉴스
UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture

· 등록일 Aug. 13, 2024 16:20

· 업데이트일 2024-08-14 00:00:20

ABU DHABI, UNITED ARAB EMIRATES--(Business Wire / Korea Newswire)--The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), has released a new large language model in its Falcon series, the Falcon Mamba 7B. The new model is the no. 1 globally performing open source State Space Language Model (SSLM) in the world, as independently verified by Hugging Face.

UAE’s Technology Innovation Institute Revolutionizes AI Language Models With New Architecture (Photo: AETOSWire) Technology Innovation Institute (TII): Performance benchmarks - (Infographic: AETOSWire) As the first SSLM for Falcon, it departs from prior Falcon models which all use a transformer-based architecture. This new Falcon Mamba 7B model is yet another example of the pioneering research the institute is conducting and the breakthrough tools and products it makes available to the community in an open source format.

H.E. Faisal Al Bannai, Secretary General of ATRC and Adviser to the UAE President for Strategic Research and Advanced Technology Affairs, said: “The Falcon Mamba 7B marks TII’s fourth consecutive top-ranked AI model, reinforcing Abu Dhabi as a global hub for AI research and development. This achievement highlights the UAE’s unwavering commitment to innovation.”

For transformer architecture models, Falcon Mamba 7B outperforms Meta’s Llama 3.1 8B, Llama 3 8B, and Mistral’s 7B on the newly introduced benchmarks from HuggingFace. Meanwhile for the other SSLMs, Falcon Mamba 7B beats all other open source models in the old benchmarks and it will be the be first model on HuggingFace’s new tougher benchmark leaderboard.

Dr. Najwa Aaraj, Chief Executive of TII, said: “The Technology Innovation Institute continues to push the boundaries of technology with its Falcon series of AI models. The Falcon Mamba 7B represents true pioneering work and paves the way for future AI innovations that will enhance human capabilities and improve lives.”

State Space models are extremely performant at understanding complex situations that evolve over time, such as a whole book. This is because SSLMs do not require additional memory to digest such large bits of information.

Transformer based models, on the other hand, are very efficient at remembering and using information they have processed earlier in a sequence. This makes them very good at tasks like content generation, however, because they compare every word with every other word, this requires significant computational power.

SSLMs can find applications in various fields such as estimation, forecasting, and control tasks. Similar to the transformer architecture models, they also excel in Natural Language Processing tasks and can be applied to machine translation, text summarization, computer vision, and audio processing.

Dr. Hakim Hacid, Acting Chief Researcher of the TII’s AI Cross-Center Unit, said: “As we introduce the Falcon Mamba 7B, I’m proud of the collaborative ecosystem of TII that nurtured its development. This release represents a significant stride forward, inspiring fresh perspectives and further fueling the quest for intelligent systems. At TII, we’re pushing the boundaries of both SSLM and transformer models to spark further innovation in generative AI.”

Falcon LLMs have been downloaded over 45 million times, proving the outstanding success of the models. Falcon Mamba 7B will be released under TII Falcon License 2.0, the permissive Apache 2.0-based software license which includes an acceptable use policy that promotes the responsible use of AI. More information on the new model can be found at FalconLLM.TII.ae.

*Source: AETOSWire

View source version on businesswire.com: https://www.businesswire.com/news/home/20240812019509/en/

Website: https://www.tii.ae/ Contact The Technology Innovation Institute
Senior Director of Communications
Jennifer Dewan
[email protected]
This news is a press release provided by The Technology Innovation Institute. Korea Newswire follows these editorial guidelines. The Technology Innovation Institute News ReleasesSubscribeRSS UAE의 테크놀로지 이노베이션 인스티튜트, 새로운 아키텍처로 AI 언어 모델 혁명 주도 선도적인 글로벌 과학 연구 센터이자 아부다비의 첨단기술연구위원회(Advanced Technology Research Council) (ATRC)의 응용 연구 중추인 테크놀로지 이노베이션 인스트튜트(Technology Innovation Institute) (TII)가 팔콘 시리즈에 새로운 대형 언어 모델인 팔콘 맘바 7B(Falcon Mamba 7B)를 출시했다. 새로... 8월 13일 16:20 Falcon 2: UAE’s Technology Innovation Institute Releases New AI Model Series, Outperforming Meta’s New Llama 3 The Technology Innovation Institute (TII), a leading global scientific research center and the applied research pillar of Abu Dhabi’s Advanced Technology Research Council (ATRC), today launched a second iteration of its renowned large language model (LLM) - Falcon 2. Within this series,... 5월 15일 12:30 ... More  More News Technology Science Artificial Intelligence New Product Overseas The Technology In... All News Releases 
배포 분야
인기 기사12.24 10시 기준
서울--(뉴스와이어)--인공지능(AI) 다국어 챗봇 기술과 독보적인 다이렉트 예약 솔루션을 기반으로 빠르게 성장하고 있는 호텔 솔루션 회사 트리플라(tripla Co., Ltd.)가 지난달 대만을 기반으로 하는 중화권 호텔 솔루션 강자 SureHigh International Technology Group(이하 Surehigh)을 인수했다고 발표했다. ...
서울--(뉴스와이어)--하나은행(은행장 이승열)은 22일 서민금융진흥원(원장 이재연)과의 협약 체결을 통해 서민금융진흥원의 고유목적사업 재원으로 612억원을 출연하고, 취약계층 금융지원을 위한 상호 협력을 강화해 나가기로 했다고 밝혔다. 이번에 하나은행에서 출연하는 612억원은 서민금융진흥원에 출연을 결정한 9개 은행 중 가장 큰...
DENVER--(Business Wire / Korea Newswire)--Newmont Corporation (NYSE: NEM, TSX: NGT, ASX: NEM, PNGX: NEM) and Project C.U.R.E. announce a five-year agreement to deliver medical supplies and life-saving training for healthcare providers in developing countries...
서울--(뉴스와이어)--GS리테일이 운영하는 편의점 GS25는 지난 8일 선보인 요아정허니요거트초코볼파르페(이하 요아정파르페)가 부동의 아이스크림 판매 1위 상품인 월드콘의 매출을 제치고 GS25의 아이스크림 분류 중 1위에 올랐다고 밝혔다. 왼쪽부터...
안양--(뉴스와이어)--LS전선은 미래 성장동력 확보를 위한 ‘제4회 기술공모’를 진행한다고 26일 밝혔다. 2024년 LS전선 기술공모전 포스터 ‘기술공모(Open R&D)’는 국내 유수의 대학, 연구기관과...
벨링햄, 워싱턴--(뉴스와이어)--세계 최고 수준의 에이전트 중심형 부동산 중개법인이자 eXp World Holdings, Inc.(eXp 월드 홀딩스, 나스닥: EXPI)의 핵심 자회사인 eXp Realty®(eXp 리얼티®)가 ‘Thrive’ 프로그램을 새로 론칭한다고 발표했다. 서로 문화적 가치를 공유하고 생산적인 팀이 eXp Realty...
API
fg
유니콘뉴스는 보도자료 배포 서비스입니다.
여기에 뉴스를 등록하면 언론이 보도하고 널리 배포됩니다.