Pythia-2.8b ni modeli ya lugha iliyoundwa na Booz Allen Hamilton, datasaur.ai, EleutherAI, Indraprastha Institute of Information Technology
Delhi, McLean, Stability AI, University of Amsterdam na University of Cambridge (Marekani, Uingereza, India, Uholanzi), iliyotolewa 3 Aprili 2023.
Uzito wake (weights) uko wazi: mtu yeyote anaweza kuipakua, kuiendesha na kuitumia hata kibiashara.
Ina vigezo (parameters) bilioni 2.8.
Naweza kuiendesha mwenyewe?
Ndiyo, kwenye simu janja au kifaa chenye uwezo mkubwa zaidi.
SimuRAM ya GB 6–8
Kompyuta mpakatoRAM ya GB 16
Kompyuta yenye uwezo mkubwaGB 24 hadi 64 (kadi ya michoro au Mac yenye uwezo mkubwa)
Sevazaidi ya GB 64
Inahitaji takriban GB 2.7 za kumbukumbu (RAM) ikibanwa hadi biti 4.
Programu za simu zinazoendesha modeli bila intaneti (kwa mfano PocketPal) zinapakua toleo lililobanwa.
RWKV-5 (Eagle) 7BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
Wazi7.5BKompyuta mpakato
C
RWKV-6 (Finch) 3BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha