Ni izihe gahunda z'ibanze muri Generative AI?

Ni izihe gahunda z'ibanze muri Generative AI?

Igisubizo kigufi: Imiterere y'ibanze ni imiterere minini, ikoreshwa muri rusange mu gukora imibonano mpuzabitsina (AI) yatojwe ku makuru manini kandi manini, hanyuma igahuzwa n'imirimo myinshi (kwandika, gushakisha, kwandika, amashusho) binyuze mu gushishikariza, gutunganya neza, ibikoresho, cyangwa kubikuramo. Niba ukeneye ibisubizo byizewe, bihuze n'ibisobanuro (nk'ibyakozwe na RAG), inzitizi zisobanutse neza, n'igenzura, aho kubireka bigakora imibonano mpuzabitsina.

Ibintu by'ingenzi byakunzwe:

Ibisobanuro : Uburyo bumwe bw'ibanze bwatojwe bwakoreshejwe mu mirimo myinshi, ntabwo ari umurimo umwe kuri buri buryo.

Guhindura : Koresha uburyo bwo gushishikariza, gutunganya neza, LoRA/adaptateri, RAG, n'ibikoresho kugira ngo uyobore imyitwarire.

Uburyo bwo gukora : Butuma inyandiko, amashusho, amajwi, kode, n'uburyo ibikubiye muri konti bikoreshwa mu buryo butandukanye.

Ibimenyetso by'ubuziranenge : Shyira imbere ubushobozi bwo kugenzura ibintu, kugabanya ibintu bitagaragara neza, ubushobozi bwo gukoresha uburyo bwinshi, no kwemeza neza ibintu.

Kugenzura ingaruka : Teganya kubona ibintu bitagaragara neza, kubogama, kubura amakuru ajyanye n'ubuzima bwite, no kwinjizwa mu buryo bwihuse binyuze mu buyobozi no gupima.

Ni izihe ngero z'ibanze muri Generative AI?

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Kompanyi y'ubuhanga bwo gukora imibonano mpuzabitsina (AI) ni iki?
Sobanukirwa uburyo ibigo bya AI byubaka ibicuruzwa, amatsinda, n'uburyo bwo kwinjiza amafaranga.

🔗 Kode y'ubuhanga bwo gukora imibonano mpuzabitsina (AI) isa ite?
Reba ingero za kode ya AI, kuva kuri moderi za Python kugeza kuri API.

🔗 Algorithm y'ubukorano bw'ubwenge (AI) ni iki?
Menya icyo algorithms za AI ari cyo n'uko zifata ibyemezo.

🔗 Ikoranabuhanga rya AI ni iki?
Suzuma ikoranabuhanga ry'ingenzi rya AI rikoresha ikoranabuhanga ryikora, isesengura, na porogaramu z'ubwenge.

1) Imiterere y'ibanze - ibisobanuro bitarimo igihu 🧠

Icyitegererezo cy'ibanze ni icyitegererezo kinini, gikoreshwa muri rusange cya AI cyatojwe ku makuru manini (ubusanzwe ni menshi cyane) bityo gishobora guhuzwa n'imirimo myinshi, atari imwe gusa ( NIST , Stanford CRFM ).

Aho kubaka icyitegererezo cyihariye cya:

  • kwandika amabaruwa

  • gusubiza ibibazo

  • gusesengura PDF

  • gukora amashusho

  • gushyira mu byiciro amatike y'inkunga

  • guhindura indimi

  • gutanga ibitekerezo ku makode

...utoza icyitegererezo kimwe kinini cy’ibanze "cyiga isi" mu buryo bw’ibarurishamibare budasobanutse neza, hanyuma ukagihuza n’imirimo yihariye ukoresheje uburyo bwo kugikemura, kugikosora neza, cyangwa ibikoresho byongewemo ( Bommasani et al., 2021 ).

Mu yandi magambo: ni moteri rusange ushobora kuyobora.

Kandi yego, ijambo ry'ingenzi ni "rusange." Ayo ni yo mayeri yose.

2) Ni iki gishushanyo mbonera cya Fondasiyo muri Generative AI? (Uko gihuye neza) 🎨📝

None se, ni iki gikoresho cy’ibanze muri Generative AI? Ni cyo gikoresho cy’ibanze gitanga imbaraga ku buryo bushobora gukora ibintu bishya - inyandiko, amashusho, amajwi, kode, videwo, n’ibindi byinshi… bivanze n’ibyo byose ( NIST , NIST Generative AI Profile ).

Uburyo bwo gukora imibonano mpuzabitsina (AI) mu buryo bwa Generative ntabwo ari uguhanura gusa amazina nka "spam / not spam". Ni ugukora umusaruro usa n'uwakozwe n'umuntu.

  • ibika

  • ibisigo

  • ibisobanuro by'ibicuruzwa

  • ibishushanyo

  • indirimbo

  • porogaramu z'igerageza

  • amajwi y'ubukorano

  • kandi rimwe na rimwe ibintu bidafite ishingiro byizewe 🙃

Imiterere y'ibanze ni cyane hano kubera ko:

Ni "urwego rw'ibanze" - nk'ifu y'umugati. Ushobora kuyiteka mu ifu ya baguette, pizza, cyangwa sinamoni… ntabwo ari ikigereranyo cyiza, ariko urabyumva 😄

3) Impamvu bahinduye byose (n'impamvu abantu batareka kubivugaho) 🚀

Mbere y’uko hakorwa imashini zishingiye ku ikoranabuhanga, ubuhanga bwinshi bwo gukora imibonano mpuzabitsina (AI) bwari bushingiye ku nshingano zabwo:

  • gutoza icyitegererezo cyo gusesengura amarangamutima

  • gutoza undi guhindura

  • gutoza undi mu gushyira amashusho mu byiciro

  • guhugura undi muntu kugira ngo yemerwe izina ry'ikigo

Ibyo byaragenze neza, ariko byari bitinze, bihenze, kandi byari… byoroshye.

Abanyamideli ba fondasiyo barayihinduye:

Iyo porogaramu yo kongera gukoresha ni yo ikoreshwa cyane. Ibigo bishobora kubaka ibintu 20 hejuru y'umuryango umwe w'icyitegererezo, aho kongera kuvumbura uruziga inshuro 20.

Nanone, ubunararibonye bw'umukoresha bwarushijeho kuba busanzwe:

  • "Ntabwo ukoresha igikoresho cyo gusesengura"

  • Uvugana n'umunyamideli nk'aho ari umukozi ukorana nawe ufasha udasinzira ☕🤝

Hari igihe biba bimeze nk'umukozi dukorana utumvikana neza kuri byose, ariko yego. Gukura.

4) Igitekerezo cy'ingenzi: imyitozo mbere yo kuyitoza + guhuza n'imimerere 🧩

Hafi ya moderi zose z’ishingiro zikurikiza icyerekezo runaka ( Stanford CRFM , NIST ):

Imyitozo mbere yo kwitoza (icyiciro cyo "kwinjira muri interineti") 📚

Icyitegererezo gitozwa ku makuru manini kandi manini hakoreshejwe uburyo bwo kwigira bwigenzurwa ( NIST ). Ku byerekeye ingero z'indimi, akenshi bivuze guhanura amagambo abura cyangwa ikimenyetso gikurikiraho ( Devlin et al., 2018 , Brown et al., 2020 ).

Intego si ukuyigisha umurimo umwe gusa. Intego ni ukubigisha uburyo rusange bwo kubisobanura :

  • ikibonezamvugo

  • ibintu (ubwoko bwa)

  • uburyo bwo gutekereza (rimwe na rimwe)

  • uburyo bwo kwandika

  • imiterere y'ikode

  • umugambi rusange wa muntu

Guhindura imiterere (icyiciro cyo "gutuma birushaho kuba ingirakamaro") 🛠️

Hanyuma uyihindura ukoresheje kimwe cyangwa byinshi muri ibi bikurikira:

  • gusaba (amabwiriza mu mvugo yoroheje)

  • Gutunganya amabwiriza (kuyatoza gukurikiza amabwiriza) ( Wei et al., 2021 )

  • gutunganya neza (amahugurwa ku makuru y'urubuga rwawe)

  • LoRA / adaptateri (uburyo bwo gukosora ibintu byoroheje) ( Hu et al., 2021 )

  • RAG (gukuramo ibintu byinshi - icyitegererezo gisuzuma inyandiko zawe) ( Lewis et al., 2020 )

  • ikoreshwa ry'ibikoresho (imikorere yo guhamagara, kureba sisitemu z'imbere, nibindi)

Niyo mpamvu umuntu umwe w’inyuguti ashobora kwandika inkuru y’urukundo… hanyuma agafasha gukemura ikibazo cya SQL nyuma y’amasegonda atanu 😭

5) Ni iki gituma icyitegererezo cy'ishingiro kiba cyiza? ✅

Iki ni igice abantu basimbuka, hanyuma bakicuza nyuma.

Icyitegererezo cy'ishingiro "cyiza" si "kinini" gusa. Kinini kirafasha, yego ... ariko si cyo kintu cyonyine. Verisiyo nziza y'icitegererezo cy'ishingiro akenshi igira:

Guhuza bikomeye 🧠

Ikora neza mu mirimo myinshi idakeneye kongera gutozwa imirimo yihariye ( Bommasani et al., 2021 ).

Uburyo bwo kuyobora no kugenzura 🎛️

Ishobora gukurikiza amabwiriza nk'aya mu buryo bwizewe:

  • "vuga muri make"

  • "koresha ingingo z'amasasu"

  • "Andika mu ijwi ry'ubucuti"

  • "Ntugatangaze amakuru y'ibanga"

Hari aba moderi beza ariko baranyerera. Nk'aho ugerageza gufata agasabune mu bwogero. Birafasha, ariko birahindagurika 😅

Kutagira ubushake bwo kubona ibintu mu buryo bugaragara (cyangwa nibura kuba umuntu utazi neza ibintu) 🧯

Nta gishushanyo mbonera kidahura n'ibintu bitagaragara, uretse ibyiza:

  • gabanya ibitekerezo bidafite ishingiro

  • kwemera ko hari icyo utazi kenshi

  • komeza kwegera imiterere yatanzwe mu gihe ukoresha uburyo bwo kugarura amakuru ( Ji et al., 2023 , Lewis et al., 2020 )

Ubushobozi bwiza bwo gukoresha uburyo bwinshi (igihe bikenewe) 🖼️🎧

Niba urimo kubaka abafasha basoma amashusho, basobanura imbonerahamwe, cyangwa basobanukirwa amajwi, uburyo bwinshi bwo gukora ibintu ni ingenzi cyane ( Radford et al., 2021 ).

Igitekerezo cyiza ⚡

Gutinda n'ikiguzi ni ingenzi. Imodoka ikomeye ariko igenda buhoro ni nk'imodoka ya siporo ifite ipine ryacitse.

Imyitwarire y'umutekano no guhuza ibintu 🧩

Ntabwo ari “kwanga byose” gusa, ahubwo:

Inyandiko + urusobe rw'ibinyabuzima 🌱

Ibi bisa nkaho byumye, ariko ni ukuri:

  • ibikoresho

  • imikandara ya eval

  • amahitamo yo kohereza

  • kugenzura ibigo

  • inkunga yo gutunganya neza

Yego, ijambo "ecosystem" ni ijambo ridasobanutse neza. Nanjye ndaryanga. Ariko rirakomeye.

6) Imbonerahamwe yo kugereranya - amahitamo asanzwe y'icyitegererezo cy'ishingiro (n'icyo ari cyo cyiza) 🧾

Hasi hari imbonerahamwe ifatika, idahuje neza gato. Si "urutonde rumwe rw'ukuri," ahubwo ni nk'ibyo abantu bahitamo mu gasozi.

ubwoko bw'igikoresho / icyitegererezo abari aho igiciro gikwiye impamvu bikora
LLM y'Ubwishingizi (uburyo bwo kuganira) amakipe ashaka umuvuduko n'ubuhanga ishingiye ku ikoreshwa / kwiyandikisha Gukurikira amabwiriza meza, imikorere myiza muri rusange, akenshi ni byiza "kuva mu isanduku" 😌
LLM ifunguye (ishobora kwiyubakira) abubatsi bashaka kugenzura ikiguzi cya infra (n'umutwe) Ishobora guhindurwa, ijyanye n'ubuzima bwite, ishobora gukoreshwa mu gace utuyemo… niba ukunda gukora ibintu mu masaha ya saa sita z'ijoro
Igikoresho gitanga amashusho akwirakwira abahanga mu guhanga udushya, amakipe y'abashushanya ubuntu kugeza ku kwishyura Gutunganya amashusho neza cyane, ubwoko butandukanye bw'imideli, uburyo bwo gukora ibintu busubiramo (nanone: intoki zishobora kuba zifunze) ✋😬 ( Ho et al., 2020 , Rombach et al., 2021 )
Uburyo bwinshi bwo "kubona-ururimi" porogaramu zisoma amashusho n'inyandiko bishingiye ku ikoreshwa Igufasha kubaza ibibazo ku mashusho, amashusho, ibishushanyo - biratangaje ( Radford et al., 2021 )
Icyitegererezo cy'ishingiro cyo gushyiramo gushakisha + sisitemu za RAG igiciro gito kuri buri guhamagara Ihindura inyandiko mo vekteri zo gushakisha mu buryo bw'imvugo, gushyira hamwe, gutanga inama - ingufu za MVP zituje ( Karpukhin et al., 2020 , Douze et al., 2024 )
Icyitegererezo cy'ishingiro ry'imvugo kuva ku nyandiko ibigo byo guhamagara, abarema bishingiye ku ikoreshwa / aho uherereye Kwandika byihuse, inkunga mu ndimi nyinshi, bihagije ku majwi asakuza (ubusanzwe) 🎙️ ( Whisper )
Icyitegererezo cy'ishingiro ry'inyandiko mu buryo bw'ururimi amatsinda y'ibicuruzwa, itangazamakuru bishingiye ku ikoreshwa Gutanga amajwi karemano, imiterere y'amajwi, kubara inkuru - bishobora gutera ubwoba ( Shen et al., 2017 )
LLM yibanda ku mibare abakora porogaramu ishingiye ku ikoreshwa / kwiyandikisha Ni umuhanga mu miterere ya kode, gukosora amakosa, no kuvugurura… ntabwo ari umuntu usoma ibitekerezo 😅

Menya ukuntu "icyitegererezo cy'ibanze" kitavuga gusa "chatbot". Uburyo bwo gushyiramo ibintu mu buryo busanzwe n'uburyo bwo kuvuga nabwo bushobora kuba ubw'ibanze, kuko ari bugari kandi bushobora kongera gukoreshwa mu mirimo itandukanye ( Bommasani et al., 2021 , NIST ).

7) Irebere neza: uburyo ibyitegererezo by'ururimi byiga (version ya vibe) 🧠🧃

Ingero z'ibanze ku rurimi (zikunze kwitwa LLM) zikunze guhugurwa ku makusanyirizo menshi y'inyandiko. Ziga zihanura ibimenyetso ( Brown et al., 2020 ). Nibyo. Nta mukungugu w'ibanga.

Ariko igitangaje ni uko guhanura ibimenyetso bihatira icyitegererezo kwiga imiterere ( CSET ):

  • ikibonezamvugo n'imyandikire

  • isano ku ngingo

  • imiterere isa n'iy'ibitekerezo (rimwe na rimwe)

  • urukurikirane rusanzwe rw'ibitekerezo

  • uburyo abantu basobanura ibintu, baganira, basaba imbabazi, baganira, bigisha

Ni nko kwiga kwigana ibiganiro bya miliyoni ariko ntusobanukirwe uko abantu babigenza. Ibyo bisa nkaho bitagakwiye gukora… nyamara bigakomeza gukora.

Gukabya gato: muri rusange ni nko gushyira inyandiko z'abantu mu bwonko bunini bushobora kuba bushobora kubaho.
Icyo gihe nanone, iyo mvugo ni ikivume gato. Ariko turagenda 😄

8) Irebere neza: moderi zo gukwirakwiza (impamvu amashusho akora mu buryo butandukanye) 🎨🌀

Ibishushanyo mbonera by’ishingiro bikunze gukoresha gukwirakwiza ( Ho et al., 2020 , Rombach et al., 2021 ).

Igitekerezo cy'ingenzi:

  1. ongera urusaku ku mashusho kugeza igihe asanzwe ari televiziyo idahinduka

  2. gutoza icyitegererezo cyo gusubiza inyuma urwo rusaku intambwe ku yindi

  3. Mu gihe cyo gukura, tangira n'urusaku hanyuma "uhindure" ishusho uyobowe n'agace k'ifoto ( Ho et al., 2020 )

Iyi niyo mpamvu gukora amashusho bisa nkaho ari ugukora ifoto, uretse ko ifoto ari ikiyoka cyambaye inkweto mu iduka rinini 🛒🐉

Uburyo bwo gukwirakwiza ibintu ni bwiza kuko:

  • bakora amashusho meza cyane

  • bashobora kuyoborwa cyane n'inyandiko

  • Bashyigikira uburyo bwo kuvugurura ibintu mu buryo busubiramo (guhindura, gushushanya, kongera uburebure) ( Rombach et al., 2021 )

Hari n'igihe bagorwa no kugira ibibazo bikurikira:

  • ishusho y'inyandiko imbere mu mashusho

  • ibisobanuro birambuye ku miterere y'umubiri

  • imiterere y'umuntu ihoraho mu bice bitandukanye (iri gutera imbere, ariko iracyariyongera)

9) Irebere neza: moderi z'ifatizo zifite imiterere myinshi (inyandiko + amashusho + amajwi) 👀🎧📝

Uburyo bw'ishingiro ry'uburyo bwinshi bugamije gusobanukirwa no gutanga amakuru mu bwoko butandukanye bw'amakuru:

Impamvu ibi ari ingenzi mu buzima busanzwe:

  • serivisi z'abakiriya zishobora gusobanura amashusho y'ifoto

  • Ibikoresho byo kwinjira bishobora gusobanura amashusho

  • porogaramu z'uburezi zishobora gusobanura ibishushanyo

  • abakora bashobora gusubiramo imiterere vuba

  • ibikoresho by'ubucuruzi bishobora "gusoma" ishusho y'ishusho y'ikibaho no kuyishyira mu ncamake

Munsi y'inyuma, sisitemu za multimodal zikunze guhuza ibipimo:

  • hindura ishusho mo ishyirwamo

  • hindura inyandiko mo emboddings

  • Menya ahantu hahuriweho aho "injangwe" ihura na pikseli z'injangwe 😺 ( Radford et al., 2021 )

Ntabwo buri gihe biba ari byiza cyane. Hari igihe bidodwa hamwe nk'igitambaro. Ariko birakora.

10) Gutunganya neza ugereranije no gushishikariza ugereranije na RAG (uburyo uhindura icyitegererezo cy'ibanze) 🧰

Niba ugerageza gukora icyitegererezo cy'ibanze gifatika ku rwego runaka (amategeko, ubuvuzi, serivisi ku bakiliya, ubumenyi bw'imbere mu kigo), ufite ibintu bike ushobora gukora:

Gushishikariza 🗣️

Byihuse kandi byoroshye cyane.

  • ibyiza: nta myitozo, gusubiramo ako kanya

  • Ingorane: bishobora kuba ukudahuza, imipaka y'aho ibintu biherereye, intege nke zihuse

Gutunganya neza 🎯

Toza icyitegererezo cyawe neza kurushaho.

  • ibyiza: imyitwarire ihamye, ururimi rwiza rw'urubuga, bishobora kugabanya igihe cyo gushakisha amakuru

  • Ingorane: ikiguzi, ibisabwa ku ireme ry'amakuru, ibyago byo gushyiramo ibintu byinshi cyane, kubungabunga

Gutunganya ibintu byoroheje (LoRA / adaptateri) 🧩

Verisiyo ikora neza yo gutunganya neza ( Hu et al., 2021 ).

  • ibyiza: bihendutse, modular, byoroshye guhinduranya

  • ibibi: biracyakeneye amahugurwa n'isuzumabumenyi

RAG (ivugururwa ry’ibikoresho byo kongera ubushobozi bwo kubikuramo) 🔎

Icyitegererezo gikura inyandiko zijyanye n'ubumenyi bwawe n'ibisubizo ukoresheje ( Lewis et al., 2020 ).

  • ibyiza: ubumenyi bugezweho, inyandiko zitangwa imbere mu kigo (niba ubishyira mu bikorwa), kongera kwitoza bike

  • Ibyiza: ubwiza bwo kugarura ibintu bushobora kubikora cyangwa kubihindura, bisaba gukatwa neza no gushingwa

Ibivugwaho by'ukuri: sisitemu nyinshi zikora neza zihuza uburyo bwo gushishikariza abandi + RAG. Gutunganya neza birakomeye, ariko si ngombwa buri gihe. Abantu babyihutira cyane kuko bisa nkaho ari byiza cyane 😅

11) Ingaruka, imipaka, n'igice kivuga ngo "ndakwinginze ntugakoreshe iki gikorwa mu buryo butari bwo" 🧯😬

Imiterere y'ibikoresho by'ibanze irakomeye, ariko ntabwo ihamye nk'iya porogaramu gakondo. Bameze nk'umuntu usanzwe ukora akazi k'ubuhanga kandi ufite ikibazo cyo kutigirira icyizere.

Inzitizi z'ingenzi zo gutegura:

Kurota ibintu bitagaragara 🌀

Moderi zishobora guhanga:

  • amasoko y'impimbano

  • ibintu bitari byo

  • intambwe zishoboka ariko zitari zo ( Ji et al., 2023 )

Ingaruka mbi:

  • RAG ifite imiterere ishingiye ku shingiro ( Lewis et al., 2020 )

  • umusaruro utoroshye (schemas, guhamagara ibikoresho)

  • amabwiriza asobanutse neza yo “ntugakeke”

  • inzego z'igenzura (amategeko, igenzura ritandukanye, isuzuma ry'abantu)

Ubwiyongere n'imiterere mibi ⚠️

Kubera ko amakuru y'amahugurwa agaragaza abantu, ushobora kubona:

Ingaruka mbi:

  • gutunganya umutekano

  • itsinda ritukura

  • ibiyungurura ibikubiye mu bikubiyemo

  • Imipaka yitondewe ya domaine ( NIST Generator AI Profile )

Amakuru bwite n'isohoka ry'amakuru 🔒

Niba ushyira amakuru y'ibanga mu gice cy'icyitegererezo, ugomba kumenya:

  • uburyo bibikwa

  • niba ikoreshwa mu mahugurwa

  • ni iki kibaho mu igenamigambi

  • Ni iki kigenzura ibyo ikigo cyawe gikeneye ( NIST AI RMF 1.0 )

Ingaruka mbi:

Guterwa inshinge vuba (cyane cyane hamwe na RAG) 🕳️

Iyo moderi isoma inyandiko itizewe, iyo nyandiko ishobora kugerageza kuyihindura:

Ingaruka mbi:

  • amabwiriza ya sisitemu yo kwitandukanya

  • isukura ibikubiye mu bubiko byakuwemo

  • koresha politiki zishingiye ku bikoresho (atari ibyo gushishikariza gusa)

  • ikizamini hakoreshejwe uburyo bwo guhangana ( OWASP Cheat Sheet , NIST Generative AI Profile )

Ntabwo ngerageza kugutera ubwoba. Gusa… ni byiza kumenya aho imbaho ​​zo hasi zivugira.

12) Uburyo bwo guhitamo icyitegererezo cy'ifatizo cy'ikoreshwa ryawe 🎛️

Niba urimo guhitamo icyitegererezo cy'ishingiro (cyangwa ucyubakiraho), tangira ukoresheje ibi bikurikira:

Sobanura icyo urimo gukora 🧾

  • inyandiko gusa

  • amashusho

  • amajwi

  • ivanze n'uburyo bwinshi

Shyiraho umurongo wawe w'amakuru 📌

Niba ukeneye uburyo bwo gukora ibintu neza cyane (imari, ubuzima, amategeko, umutekano):

Hitamo intego yawe yo gutinda ⚡

Ikiganiro ni ako kanya. Gusobanura neza itsinda bishobora kugenda buhoro.
Niba ukeneye igisubizo cyihuse, ingano y'icyitegererezo n'uburyo bwo kwakira amakuru ni ngombwa.

Ibikenewe ku ikarita ku bijyanye n'ubuzima bwite n'amategeko 🔐

Amwe mu makipe asaba:

Kuringaniza ingengo y'imari - no kwihangana kuri gahunda 😅

Kwiyinjiza mu buryo bwikora bitanga ububasha ariko byongera ingorane.
Uburyo bwo gucunga API biroroshye ariko bushobora guhenda kandi budahinduka cyane.

Inama ntoya ifatika: igishushanyo mbonera gifite ikintu cyoroshye mbere, hanyuma kigakomera nyuma. Gutangirana n'uburyo "butunganye" akenshi bigabanya umuvuduko wabyo byose.

13) Ni iki gishushanyo mbonera cya Fondasiyo muri Generative AI? (Icyitegererezo cyihuse cyo mu mutwe) 🧠✨

Reka tubigarure. Ni iki gishushanyo mbonera cya Fondation Models muri Generative AI?

Ni:

  • moderi nini, rusange zahuguwe ku makuru yagutse ( NIST , Stanford CRFM )

  • ishoboye gukora ibikubiye mu nyandiko (inyandiko, amashusho, amajwi, nibindi) ( NIST Generator AI Profile )

  • ihuzwa n'imirimo myinshi binyuze mu gushakisha, gutunganya no kugarura ibintu ( Bommasani et al., 2021 )

  • urwego rw'ibanze rutanga imbaraga ku bicuruzwa byinshi bigezweho bya AI

Si imiterere imwe cyangwa ikirango kimwe. Ni icyiciro cy'abantu bakora nk'urubuga.

Icyuma gishushanyijeho fondasiyo ntabwo kimeze nk'icyuma gipima ubushyuhe ahubwo kimeze nk'igikoni. Ushobora guteka amafunguro menshi muri cyo. Ushobora no gutwika umugati niba utitayeho… ariko igikoni kiracyari cyiza cyane 🍳🔥

14) Incamake n'ibyo wafata ✅🙂

Imiterere y'ibanze ni moteri zishobora kongera gukoreshwa za AI ikora. Zitozwa mu buryo bwagutse, hanyuma zigahuzwa n'imirimo yihariye binyuze mu gushishikariza, gutunganya no kugarura ( NIST , Stanford CRFM ). Zishobora kuba zitangaje, zidasukuye, zifite imbaraga, ndetse rimwe na rimwe zigasebanya - byose icyarimwe.

Incamake:

  • Icyitegererezo cy'ibanze = Icyitegererezo cy'ibanze cy'intego rusange ( NIST )

  • Ikoranabuhanga rya AI rikora = gukora ibikubiye mu nyandiko, atari ugushyira mu byiciro gusa ( NIST Generative AI Profile )

  • Uburyo bwo guhuza ibintu (gushishikariza, RAG, gutunganya ibintu) butuma biba ingirakamaro ( Lewis et al., 2020 , Hu et al., 2021 )

  • Guhitamo icyitegererezo bireba inyungu: ubunyangamugayo, ikiguzi, gutinda, ubuzima bwite, umutekano ( NIST AI RMF 1.0 )

Niba hari ikintu cyose wubaka ukoresheje ubuhanga bwo gukora ibintu bya gihanga (AI), gusobanukirwa ibishushanyo mbonera by'ishingiro si amahitamo. Ni igorofa ryose inyubako ihagazeho… kandi yego, rimwe na rimwe igorofa irahungabana gato 😅

Ibibazo Bikunze Kubazwa

Imiterere y'ibanze, mu magambo yoroshye

Icyitegererezo cy'ibanze ni icyitegererezo kinini cya AI gikoreshwa muri rusange cyatojwe ku makuru menshi kugira ngo gishobore gukoreshwa mu mirimo myinshi. Aho kubaka icyitegererezo kimwe kuri buri murimo, utangirana n'icyitegererezo gikomeye "cy'ibanze" hanyuma ukagihindura uko bikenewe. Uko guhinduka akenshi bibaho binyuze mu gushishikariza, gutunganya neza, kugarura (RAG), cyangwa ibikoresho. Igitekerezo nyamukuru ni ubugari hamwe no kuyobora neza.

Uburyo ibishushanyo mbonera by'ibanze bitandukanye n'ibishushanyo mbonera gakondo by'ubukorano bushingiye ku ikoranabuhanga (AI)

Ubuhanga bwo gukora imibonano mpuzabitsina gakondo bukunze gutoza icyitegererezo gitandukanye kuri buri gikorwa, nko gusesengura amarangamutima cyangwa guhindura. Imiterere y'ibanze ihindura iyo miterere: ibanza itozwe rimwe, hanyuma ikongera gukoreshwa mu bintu byinshi n'ibicuruzwa. Ibi bishobora kugabanya imbaraga zisubirwamo no kwihutisha gutanga ubushobozi bushya. Ihiganwa ni uko bishobora kuba bitazwi neza nka porogaramu za kera keretse wongeyeho imbogamizi n'igerageza.

Ibyitegererezo by'ibanze mu gukora imibonano mpuzabitsina ikora neza (AI)

Muri generative AI, foundation models ni sisitemu y'ibanze ishobora gukora ibintu bishya nk'inyandiko, amashusho, amajwi, kode, cyangwa ibisubizo byinshi. Ntabwo bigarukira gusa ku gushyira amazina cyangwa gushyira mu byiciro; bitanga ibisubizo bisa n'ibyakozwe n'abantu. Kubera ko biga imiterere migari mu gihe cyo kwitoza mbere y'uko bitangira, bashobora guhangana n'ubwoko bwinshi bw'uburyo bworoshye n'imiterere. Ni "urwego rw'ibanze" inyuma y'uburambe bwinshi bwo kwiteza imbere muri iki gihe.

Uburyo ibishushanyo mbonera by'ishingiro byiga mu gihe cyo gutangira imyitozo

Inyinshi mu ngero z'ibanze z'indimi ziga zihanura ibimenyetso, nk'ijambo rikurikira cyangwa amagambo abura mu nyandiko. Iyo ntego yoroshye ibasunikira gushyira mu bikorwa imiterere nk'ikibonezamvugo, imitangire, n'uburyo busanzwe bwo gusobanura. Bashobora kandi kwinjiza ubumenyi bwinshi bw'isi, nubwo atari ko buri gihe bwizewe. Ingaruka ni ishusho rusange ikomeye ushobora kuyobora nyuma ukagera ku murimo runaka.

Itandukaniro riri hagati yo gushishikariza, gutunganya neza, LoRA, na RAG

Gushishikariza ni bwo buryo bwihuse bwo kuyobora imyitwarire ukoresheje amabwiriza, ariko bushobora kuba bworoshye. Gukosora neza bitoza icyitegererezo cyawe kurushaho kugira ngo kigire imyitwarire ihamye, ariko byongera ikiguzi n'uburyo bwo kubungabunga. LoRA/adaptateri ni uburyo bworoshye bwo gutunganya neza akenshi buhendutse kandi bukoresha uburyo bwa modular. RAG ikuramo inyandiko zikenewe kandi ikagira igisubizo cy'icyitegererezo ikoresheje iyo ngingo, ibi bifasha mu kugira ubushya no gushimangira.

Igihe cyo gukoresha RAG aho gukoresha uburyo bwo kuyitunganya neza

RAG akenshi ni amahitamo akomeye iyo ukeneye ibisubizo bishingiye ku nyandiko zawe zigezweho cyangwa ubumenyi bwawe bwite. Ishobora kugabanya "gutekereza" binyuze mu gutanga icyitegererezo gifite aho gihuriye n'igihe cyo gutanga amakuru. Gutunganya neza ni byiza iyo ukeneye uburyo buhamye, interuro, cyangwa imyitwarire idashobora gutangazwa neza n'uburyo bwo gushishikariza. Sisitemu nyinshi zifatika zihuza uburyo bwo gushishikariza + RAG mbere yo kugera ku buryo bwo gukosora.

Uburyo bwo kugabanya kubona ibintu mu buryo butari bwo no kubona ibisubizo byizewe kurushaho

Uburyo busanzwe ni ugukoresha imiterere y’icyitegererezo (RAG) kugira ngo ikomeze kuba hafi y’aho iherereye. Ushobora kandi kugabanya ibisubizo ukoresheje imiterere y’icyitegererezo, ugasaba ko ibikoresho bihamagara intambwe z’ingenzi, kandi wongereho amabwiriza asobanutse neza ya "ntukeke". Ibyiciro byo kugenzura nabyo birakenewe, nko kugenzura amategeko, kugenzura, no gusuzuma abantu ku birebana n’ikoreshwa ry’ibintu bikomeye. Fata icyitegererezo nk’umufasha ushoboka, atari isoko y’ukuri nk’uko bisanzwe.

Ingaruka zikomeye ku miterere y'ishingiro mu gukora

Ingaruka zikunze kugaragara zirimo kubona ibintu mu buryo butari bwo, imiterere ishingiye ku buryo butari bwo cyangwa yangiza ituruka ku makuru y’amahugurwa, no kubura amakuru y’ibanga mu gihe amakuru y’ingenzi adafashwe neza. Sisitemu zishobora kandi kwibasirwa no gushyirwamo vuba, cyane cyane iyo moderi isoma inyandiko zitizewe zo mu nyandiko cyangwa ku mbuga za interineti. Ingaruka zikunze kugaragara zirimo ubuyobozi, guhuza abantu, kugenzura uburyo bwo kubona amakuru, imiterere y’uburyo bwo gusaba amakuru mu buryo bwizewe, n’isuzumabumenyi rihamye. Tegura izi ngaruka hakiri kare aho kuzikosora nyuma.

Gutera inshinge vuba n'impamvu ari ingenzi muri sisitemu za RAG

Gushyiramo amakuru vuba ni igihe inyandiko itizewe igerageza guhindura amabwiriza, nko "kwirengagiza amabwiriza yabanje" cyangwa "guhishura amabanga." Muri RAG, inyandiko zakuwemo zishobora kuba zirimo ayo mabwiriza mabi, kandi icyitegererezo gishobora kuyakurikiza niba utitonze. Uburyo busanzwe ni ugutandukanya amabwiriza ya sisitemu, gusukura ibikubiye mu nyandiko, no kwishingikiriza kuri politiki zishingiye ku bikoresho aho kwishingikiriza gusa ku mabwiriza. Gupima hakoreshejwe uburyo bw'impinduka bifasha kugaragaza aho intege nke zigaragara.

Uburyo bwo guhitamo icyitegererezo cy'ifatizo cy'ikoreshwa ryawe

Tangira usobanura ibyo ukeneye gukora: inyandiko, amashusho, amajwi, kode, cyangwa ibisohoka mu buryo butandukanye. Hanyuma shyiraho umurongo wawe w'ukuri - domaine zifite ubunyangamugayo bwinshi akenshi zikenera gushingirwaho (RAG), kwemeza, ndetse rimwe na rimwe n'isuzuma ry'abantu. Tekereza ku gutinda n'ikiguzi, kuko moderi ikomeye igenda buhoro cyangwa ihenze ishobora kugorana kohereza. Amaherezo, gushyira ku murongo ibikenewe mu bijyanye n'ubuzima bwite n'iyubahirizwa ry'amategeko mu mahitamo yo gushyiraho no kugenzura.

Amareferensi

  1. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - Icyitegererezo cy'Ishingiro (Inyandiko y'amagambo) - csrc.nist.gov

  2. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - NIST AI 600-1: Umwirondoro w'ubuhanga bwo gukora imibonano mpuzabitsina - nvlpubs.nist.gov

  3. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - NIST AI 100-1: Gahunda yo Kugenzura Ingaruka za AI (AI RMF 1.0) - nvlpubs.nist.gov

  4. Ikigo cya Stanford cy’Ubushakashatsi ku Miterere y’Ishingiro (CRFM) - Raporo - crfm.stanford.edu

  5. arXiv - Ku mahirwe n'ingaruka z'icyitegererezo cy'ishingiro (Bommasani et al., 2021) - arxiv.org

  6. arXiv - Ingero z'indimi ni nke cyane (Brown et al., 2020) - arxiv.org

  7. arXiv - Kubona amakuru menshi ku bijyanye n'ubumenyi bwa NLP (Lewis et al., 2020) - arxiv.org

  8. arXiv - LoRA: Guhindura Inyuguti z'Indimi nini mu buryo bwo hasi (Hu et al., 2021) - arxiv.org

  9. arXiv - BERT: Imyitozo y’ibanze y’Abahindura Ururimi mu buryo bwimbitse (Devlin et al., 2018) - arxiv.org

  10. arXiv - Ingero z'Ururimi Zinonosoye ni Abantu Bizewe (Wei et al., 2021) - arxiv.org

  11. Isomero rya ACM Digital - Ubushakashatsi ku Kurota mu Ivuka ry'Ururimi Kamere (Ji et al., 2023) - dl.acm.org

  12. arXiv - Kwiga Ingero Zishobora Gukoreshwa mu Kugenzura Ururimi Rusanzwe (Radford et al., 2021) - arxiv.org

  13. arXiv - Uburyo bwo Gukuraho Urusaku mu Gukwirakwiza Ibitekerezo (Ho et al., 2020) - arxiv.org

  14. arXiv - Guhuza amashusho afite ubushobozi bwo gusesengura amashusho hakoreshejwe uburyo bwo kuyakwirakwiza buteruye (Rombach et al., 2021) - arxiv.org

  15. arXiv - Gusubiza ibibazo by'ibanga mu buryo burambuye (Karpukhin et al., 2020) - arxiv.org

  16. arXiv - Isomero rya Faiss (Douze et al., 2024) - arxiv.org

  17. OpenAI - Tumenyesha Whisper - openai.com

  18. arXiv - Uburyo bwa TTS karemano hakoreshejwe Conditioning WaveNet ku Byahanuwe na Mel Spectrogram (Shen et al., 2017) - arxiv.org

  19. Ikigo cy'Umutekano n'Ikoranabuhanga Rigezweho (CSET), Kaminuza ya Georgetown - Imbaraga zitangaje zo guhanura ijambo rikurikira: ingero z'indimi nini zasobanuwe (igice cya 1) - cset.georgetown.edu

  20. USENIX - Gukuramo amakuru y'amahugurwa mu buryo bunini bw'indimi (Carlini et al., 2021) - usenix.org

  21. OWASP - LLM01: Gutera inshinge vuba - genai.owasp.org

  22. arXiv - Ibirenze ibyo wasabye: Isesengura ryimbitse ry'ibibazo bishya byo gutera inshinge ku buryo bunini bw'indimi bukoreshwa mu buryo bwa porogaramu (Greshake et al., 2023) - arxiv.org

  23. Urukurikirane rw'inyandiko z'uburiganya za OWASP - Inyandiko z'uburiganya zo kwirinda inshinge vuba za LLM - cheatsheetsery.owasp.org

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog