RWKV-4 World (7B)

RWKV-4 World (7B) ni modeli ya lugha iliyoundwa na RWKV Foundation (Kimataifa), iliyotolewa 26 Juni 2023.

Uzito wake (weights) uko wazi: mtu yeyote anaweza kuipakua, kuiendesha na kuitumia hata kibiashara.

Ina vigezo (parameters) bilioni 7.39.

Naweza kuiendesha mwenyewe?

Ndiyo, kwenye kompyuta mpakato au kifaa chenye uwezo mkubwa zaidi.

  1. SimuRAM ya GB 6–8
  2. Kompyuta mpakatoRAM ya GB 16
  3. Kompyuta yenye uwezo mkubwaGB 24 hadi 64 (kadi ya michoro au Mac yenye uwezo mkubwa)
  4. Sevazaidi ya GB 64

Inahitaji takriban GB 5.4 za kumbukumbu (RAM) ikibanwa hadi biti 4.

Programu kama Ollama au LM Studio zinapakua na kuendesha modeli kwenye kompyuta yako, bila intaneti.

Modeli nyingine za RWKV Foundation

  1. RWKV-5 (Eagle) 7BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi7.5BKompyuta mpakato
  2. RWKV-6 (Finch) 3BContextual AI, EleutherAI, Guangdong Laboratory of Artificial Intelligence and Digital Economy (Pazhou Lab), Harvard University, New York University (NYU), Ohio State University, Pennsylvania State University, RWKV Foundation, Tsinghua University, University of British Columbia (UBC), University of California Santa Barbara (UCSB), University of California Santa Cruz, University of Chinese Academy of Sciences, University of Edinburgh na Wroclaw Tech (Wrocław University of Science and Technology)Sep 2024Lugha
    Wazi3.1BSimu