Polyglot-Ko-12.8B

Polyglot-Ko-12.8B ni modeli ya lugha iliyoundwa na EleutherAI (Marekani), iliyotolewa 4 Juni 2023.

Uzito wake (weights) uko wazi: mtu yeyote anaweza kuipakua, kuiendesha na kuitumia hata kibiashara.

Ina vigezo (parameters) bilioni 12.9.

Naweza kuiendesha mwenyewe?

Ndiyo, kwenye kompyuta mpakato au kifaa chenye uwezo mkubwa zaidi.

  1. SimuRAM ya GB 6–8
  2. Kompyuta mpakatoRAM ya GB 16
  3. Kompyuta yenye uwezo mkubwaGB 24 hadi 64 (kadi ya michoro au Mac yenye uwezo mkubwa)
  4. Sevazaidi ya GB 64

Inahitaji takriban GB 8.7 za kumbukumbu (RAM) ikibanwa hadi biti 4.

Programu kama Ollama au LM Studio zinapakua na kuendesha modeli kwenye kompyuta yako, bila intaneti.

Modeli nyingine za EleutherAI

  1. RWKV-5 (Eagle) 7BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi7.5BKompyuta mpakato
  2. RWKV-6 (Finch) 3BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi3.1BSimu
  3. YaRN (Llama 2 13B)EleutherAI, Nous Research na University of GenevaNov 2023Lugha
    Wazi, kwa masharti13BKompyuta mpakato
  4. YaRN (Llama 2 70B)EleutherAI, Nous Research na University of GenevaNov 2023Lugha
    Wazi, kwa masharti70BKompyuta yenye uwezo mkubwa
  5. Llemma 34BCarnegie Mellon University (CMU), EleutherAI, Princeton University, University of Cambridge, University of Toronto, University of Washington na Vector InstituteOkt 2023Hisabati, Lugha
    Wazi, kwa masharti34BKompyuta yenye uwezo mkubwa
  6. Llemma 7BCarnegie Mellon University (CMU), EleutherAI, Princeton University, University of Cambridge, University of Toronto, University of Washington na Vector InstituteOkt 2023Hisabati, Lugha
    Wazi, kwa masharti7BKompyuta mpakato