GPT-J-6B

GPT-J-6B ni modeli ya lugha iliyoundwa na EleutherAI na LAION (Marekani, Ujerumani), iliyotolewa 1 Mei 2021.

Uzito wake (weights) uko wazi: mtu yeyote anaweza kuipakua, kuiendesha na kuitumia hata kibiashara.

Ina vigezo (parameters) bilioni 6.05.

Naweza kuiendesha mwenyewe?

Ndiyo, kwenye kompyuta mpakato au kifaa chenye uwezo mkubwa zaidi.

  1. SimuRAM ya GB 6–8
  2. Kompyuta mpakatoRAM ya GB 16
  3. Kompyuta yenye uwezo mkubwaGB 24 hadi 64 (kadi ya michoro au Mac yenye uwezo mkubwa)
  4. Sevazaidi ya GB 64

Inahitaji takriban GB 4.6 za kumbukumbu (RAM) ikibanwa hadi biti 4.

Programu kama Ollama au LM Studio zinapakua na kuendesha modeli kwenye kompyuta yako, bila intaneti.

Matokeo ya majaribio

Maarifa ya jumla (MMLU)Maswali ya kuchagua jibu katika masomo 57, kutoka historia hadi sheria. Kipimo maarufu cha modeli za zamani.
25.7%

Modeli nyingine za EleutherAI

  1. RWKV-5 (Eagle) 7BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi7.5BKompyuta mpakato
  2. RWKV-6 (Finch) 3BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi3.1BSimu
  3. YaRN (Llama 2 13B)EleutherAI, Nous Research na University of GenevaNov 2023Lugha
    Wazi, kwa masharti13BKompyuta mpakato
  4. YaRN (Llama 2 70B)EleutherAI, Nous Research na University of GenevaNov 2023Lugha
    Wazi, kwa masharti70BKompyuta yenye uwezo mkubwa
  5. Llemma 34BCarnegie Mellon University (CMU), EleutherAI, Princeton University, University of Cambridge, University of Toronto, University of Washington na Vector InstituteOkt 2023Hisabati, Lugha
    Wazi, kwa masharti34BKompyuta yenye uwezo mkubwa
  6. Llemma 7BCarnegie Mellon University (CMU), EleutherAI, Princeton University, University of Cambridge, University of Toronto, University of Washington na Vector InstituteOkt 2023Hisabati, Lugha
    Wazi, kwa masharti7BKompyuta mpakato