Gutegura mbere y'ubuhanga bwa AI ni iki?

Gutegura mbere y'ubuhanga bwa AI ni iki?

Igisubizo kigufi: Gutegura porogaramu y’ubuhanga bwa gihanga (AI) ni uruhererekane rw’intambwe zishobora gusubirwamo zihindura amakuru mashya kandi afite impinduka nyinshi mu buryo buhamye, harimo gusukura, gukosora, gupima, gushyira mu byiciro, no guhindura amashusho. Ni ingenzi kuko niba amakuru y’amahugurwa n’ayo mu musaruro bitandukanye, moderi zishobora gutsindwa bucece. Niba intambwe "yize" ibipimo, shyira ku makuru y’amahugurwa gusa kugira ngo wirinde ko habaho gusohoka.

Gutunganya amakuru y’ubuhanga bwa gihanga (AI) ni ibintu byose ukora ku makuru y’ibanze mbere yo kuyahugura (ndetse rimwe na rimwe no mu gihe cy’amahugurwa) cyangwa mu gihe cy’ubushakashatsi kugira ngo icyitegererezo kibe cyakwigiraho. Si "gusukura" gusa. Ni ugusukura, gutunganya, gupima, gusimbuza, kongera no gupakira amakuru mu buryo buhamye butazahungabanya icyitegererezo cyawe nyuma. [1]

Ibintu by'ingenzi byakunzwe:

Ibisobanuro : Gutegura mbere y'igihe bihindura imbonerahamwe, inyandiko, amashusho, n'inyandiko z'amakuru mo ibintu byiteguye gukoreshwa.

Guhuza : Koresha impinduka zimwe mu gihe cy'imyitozo no mu gihe cyo gusuzuma kugira ngo wirinde gutsindwa gutandukanye.

Kuvunika : Shyira ibikoresho byo gupima, gupima, na tokeniser ku makuru y'amahugurwa gusa.

Kongera gukosorwa : Kubaka imiyoboro ifite imibare ishobora gupimwa, ntabwo ari imiyoboro ya mudasobwa isanzwe.

Gukurikirana umusaruro : Gukurikirana uko ibintu bigenda bihindagurika kugira ngo umusaruro udakomeza kwiyongera buhoro buhoro.

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Uburyo bwo kugerageza moderi za AI kugira ngo urebe imikorere yazo mu buzima busanzwe
Uburyo bufatika bwo gusuzuma ukuri, gukomera, no kubogama vuba.

🔗 Ese ni AI ikoreshwa mu kwandika ubutumwa mu buryo bwa "text-to-speak" kandi ikora ite?
Isobanura iby'ibanze bya TTS, imikoreshereze y'ingenzi, n'imbogamizi zisanzwe muri iki gihe.

🔗 Ese AI ishobora gusoma neza inyandiko y'inyuguti zigororotse uyu munsi?
Ikubiyemo ibibazo byo kumenya, ibikoresho byiza, n'inama zo gukoresha neza.

🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina (AI) buteye neza mu mirimo isanzwe
Isesengura ibintu by'ukuri, ibipimo ngenderwaho, n'uburyo ibintu byizewe mu buzima busanzwe.

Gutunganya AI mbere y'uko ikorwa mu mvugo isanzwe (n'icyo atari cyo) 🤝

Gutunganya mbere y’ubuhanga bwa gihanga (AI) ni uguhindura ibintu byinjizwa mu buryo bwa mbere (imbonerahamwe, inyandiko, amashusho, inyandiko) bikajya mu buryo buteguye icyitegererezo. Niba amakuru ari akajagari kadasobanutse, gutunganya mbere y’igihe ni ugushyira amazina ku dusanduku, kujugunya imyanda yangiritse, no gukusanya ibintu kugira ngo ubashe kunyuramo nta nkomyi.

Si moderi ubwayo. Ni ibintu bituma moderi ishoboka:

  • guhindura ibyiciro mu mibare (ifite isura imwe, iy'icyitegererezo, nibindi) [1]

  • gupima umubare munini w'imibare mu byiciro byoroheje (uburinganire, ubunini bwa minini, nibindi) [1]

  • gushyira inyandiko mu ma toni y'amarangamuntu yinjiye (kandi akenshi agapfukamunwa ko kwita ku bandi) [3]

  • guhindura ingano/gukata amashusho no gukoresha uburyo bwo guhindura ibintu mu buryo bukwiye [4]

  • kubaka imiyoboro ishobora gusubiramo kugira ngo amahugurwa n'ibitekerezo by' "ubuzima busanzwe" bitatandukanye mu buryo butoroshye [2]

Icyitonderwa gito: "gutegura mbere" birimo ikintu cyose kibaho buri gihe mbere yuko moderi ibona ibyo umuntu yinjiza . Amakipe amwe agabanya ibi mo "ubuhanga bw'imikorere" ugereranije n' "gusukura amakuru", ariko mu buzima busanzwe iyo mirongo ntisobanutse neza.

 

Gutegura ikoreshwa rya AI mbere y'uko ikorwa

Impamvu gutunganya imashini za gihanga (AI) mbere y'uko abantu babyemera ari ingenzi cyane kurusha uko abantu babyemera 😬

Icyitegererezo ni ikintu gihuza imiterere, ntabwo ari ikintu gisoma ibitekerezo. Iyo ibitekerezo byawe bidahuye, icyitegererezo cyiga amategeko adahuye. Ibyo si filozofiya, ni ikintu kibabaje cyane.

Gutegura mbere y'igihe bigufasha:

  • Kunoza uburyo inyigisho zihamye ushyira ibintu mu buryo bufatika abapima bashobora gukoresha neza (cyane cyane iyo harimo gupima/guhindura inyuguti). [1]

  • Gabanya urusaku utuma ibintu bigaragara nk'ibintu umuntu ashobora gukoresha mu buryo busanzwe (aho gufata mu mutwe ibintu bidasanzwe).

  • Irinde uburyo bwo gucika intege bucecetse nko kuvogera no gutoza/gutanga ibitagenda neza (ubwoko busa n' "butangaje" mu kwemeza hanyuma imiterere y'isura ikorwa). [2]

  • Kongera kwihutisha isubiramo kuko repeatable transforms beat notebook spaghetti buri munsi w'icyumweru.

Nanone, niho "imikorere myinshi y'icyitegererezo" ikomoka. Nk'aho… bitangaje cyane. Hari igihe bisa nkaho ari akarengane, ariko ibyo ni ukuri 🙃

Ni iki gituma umuyoboro mwiza wo gutunganya AI uba mwiza ✅

"Verisiyo nziza" yo gutunganya mbere y'igihe akenshi igira ibi bikurikira:

  • Ishobora gusubirwamo : ibyinjizwa bimwe → umusaruro umwe (nta kwibeshya keretse iyo ari ukwiyongera ku bushake).

  • Guhuza uburyo bwo gutanga imyitozo : icyo ukora cyose mu gihe cy'imyitozo gikoreshwa kimwe mu gihe cyo gutanga ingero (ibipimo bimwe byashyizwemo, amakarita y'icyiciro kimwe, imiterere imwe ya tokenizer, nibindi). [2]

  • Kutagira ikibazo cyo gusohoka : nta kintu na kimwe mu isuzuma/ikizamini bigira ingaruka ku ntambwe iyo ari yo yose yo kwitwara neza . (Byinshi kuri uyu mutego mu kanya gato.) [2]

  • Igaragara : ushobora kugenzura icyahindutse (imibare y'imiterere, kubura, umubare w'ibyiciro) bityo rero gukosora amakosa ntabwo ari ubuhanga bushingiye ku miterere.

Niba gutunganya porogaramu yawe ari urukuta rw'utunyangingo twa mudasobwa twitwa final_v7_really_final_ok … urabizi uko bimeze. Ikora kugeza igihe itabikora 😬

Ibintu by'ingenzi by'ibanze mu gutunganya imashini za gihanga (AI) 🧱

Tekereza gutunganya mbere y'igihe nk'urutonde rw'ibintu by'ingenzi uhuza mu muyoboro.

1) Gusukura no kwemeza 🧼

Imirimo isanzwe:

  • Kuraho ibyakopewe

  • Gukemura agaciro kabuze (gukuraho, kwemeza, cyangwa kwerekana ko kabuze mu buryo bweruye)

  • gushyira mu bikorwa ubwoko, ibice, n'urwego

  • kumenya amakuru yinjiye nabi

  • hindura imiterere y'inyandiko (ahantu hera, amategeko agenga imyandikire, imiterere ya Unicode)

Iki gice ntabwo ari cyiza cyane, ariko kirinda amakosa adasanzwe. Ndabivuga n'urukundo.

2) Gushyira amakuru mu byiciro 🔤

Moderi nyinshi ntizishobora gukoresha imigozi idasazwe nka "red" cyangwa "premium_user" .

Uburyo busanzwe:

  • Ihinduranya ry'amakuru rimwe (icyiciro → inkingi ebyiri) [1]

  • Inyuguti zisanzwe (icyiciro → umubare w'intege nke) [1]

Ikintu cy'ingenzi si uburyo bwo gukosora inyandiko uhisemo - ni uko ikarita igumana uburyo bumwe kandi "ntihindure imiterere" hagati y'amahugurwa n'ibitekerezo. Uko ni ko urangira ufite icyitegererezo gisa neza hanze kandi gikunda kwibasirwa kuri interineti. [2]

3) Gupima imiterere no kuvugurura imiterere 📏

Gupima imiterere y'ibintu ni ingenzi iyo ibintu biba ku byiciro bitandukanye cyane.

Ibitabo bibiri bya kera:

  • Guhuza imiterere : gukuraho ikigereranyo n'ubusumbane bw'igice [1]

  • Ingano ntoya cyane : shyira buri kintu mu cyiciro cyagenwe [1]

Nubwo ukoresha moderi "zihangana cyane", gupima akenshi bituma imiyoboro yoroshye gutekerezaho - kandi bikagorana kuyicikamo ku buryo butagenze neza.

4) Ubuhanga mu by'ingenzi (akaba ari uburiganya bw'ingirakamaro) 🧪

Aha niho worohereza akazi k'icyitegererezo ukoresheje ibimenyetso byiza:

  • ibipimo (gukanda / amashusho)

  • amadirishya azenguruka (iminsi ya nyuma ya N)

  • umubare w'ibyabaye (ibyabaye kuri buri mukoresha)

  • guhindura logi ku gukwirakwiza kw'imirizo ikomeye

Hari ubuhanzi hano. Hari igihe uzakora ikintu runaka, ukumva ufite ishema… kandi ntacyo kimaze. Cyangwa ikiruta byose, birababaza. Ibyo ni ibisanzwe. Ntugakomeze gukunda ibintu bimwe na bimwe mu buryo bw'amarangamutima - ntibagukunda 😅

5) Gutandukanya amakuru mu buryo bukwiye ✂️

Ibi bisa n'ibigaragara kugeza ubwo bitagaragara:

  • kugabanywa ku buryo butunguranye kw'amakuru ya IID

  • kugabanya igihe hakurikijwe ibihe

  • kugabanywamo ibice mu matsinda iyo ibintu bisubiramo (abakoresha, ibikoresho, abarwayi)

Kandi icy'ingenzi: gabanya mbere yo gushyiramo isuzuma ryiga ku makuru . Niba intambwe yawe yo gutegura isuzuma "yiga" ibipimo (nk'uburyo, amagambo, amakarita y'icyiciro), igomba kubyiga binyuze mu mahugurwa gusa. [2]

Gutunganya ubuhanga bwa gihanga (AI) hakurikijwe ubwoko bw'amakuru: urutonde, inyandiko, amashusho 🎛️

Gutegura mbere y'uko imashini itunganywa bihindura imiterere bitewe n'icyo ugaburira icyitegererezo.

Amakuru yo mu mbonerahamwe (amapaji, ububiko, ububiko bw'amakuru) 📊

Intambwe zisanzwe:

  • ingamba zo kubura agaciro

  • isesengura ry'ibyiciro [1]

  • gupima inkingi z'imibare [1]

  • Uburyo bwo gucunga ibintu budasanzwe (amategeko agenga domaine arusha "gukata ibintu mu buryo butunguranye" igihe kinini)

  • ibintu byakuwemo (iteranya, gutinda, imibare igenda ihinduka)

Inama z'ingirakamaro: sobanura neza amatsinda y'inkingi (imibare ugereranyije n'ibiranga ibyiciro ugereranyije n'ibiranga). Umuntu wawe w'ejo hazaza azagushimira.

Amakuru y'inyandiko (NLP) 📝

Gutegura inyandiko mbere y'inyandiko akenshi biba birimo:

  • gushyira mu byiciro by'amanota/amagambo magufi

  • guhindura indangamuntu z'inyongera

  • gufunga/gukata

  • kubaka udupfukamunwa two kwita ku bintu byo gupfunyika [3]

Itegeko rito rigabanya ububabare: ku bijyanye no gushyiraho ibikoresho bishingiye kuri transformer, kurikiza imiterere y’icyitegererezo cy’imashini ya tokenizer kandi ntukore freestyle keretse ufite impamvu. Freestyle ni uburyo urangira "bitoza ariko biratangaje."

Amashusho (uburyo bwo kureba mudasobwa) 🖼️

Uburyo busanzwe bwo gutunganya mbere:

  • hindura ingano / gabanya imiterere ijyanye

  • impinduka zishingiye ku ntego zo gusuzuma

  • impinduka zitunguranye zo kongera amahugurwa (urugero, gukata ku buryo butunguranye) [4]

Hari ikintu abantu batitaho: "guhindura ibintu mu buryo butunguranye" si ikintu cy'ingenzi gusa - bagerageza gukoresha uburyo busanzwe buri gihe bahamagawe. Ni byiza cyane mu guhugura abantu batandukanye, kandi ni bibi cyane mu gusuzuma niba wibagiwe kuzimya uburyo butunguranye. [4]

Umutego abantu bose bagwamo: gusohora amakuru 🕳️🐍

Gusohoka ni igihe amakuru aturuka mu isuzuma yinjira mu mahugurwa - akenshi binyuze mu kuyatunganya mbere y’uko asohoka. Bishobora gutuma icyitegererezo cyawe gisa n’ikidasanzwe mu gihe cyo kwemeza, hanyuma kikagutenguha mu buzima busanzwe.

Imiterere isanzwe yo gusohora amazi:

  • gupima hakoreshejwe imibare yuzuye y'amakuru (aho kuba imyitozo gusa) [2]

  • amakarita y'icyiciro cyo kubaka hakoreshejwe gari ya moshi + ikizamini hamwe [2]

  • iyo ari yo yose ya fit() cyangwa fit_transform() "ireba" itsinda ry'ibizamini [2]

Itegeko ry'ibanze (ryoroshye, ry'ubugome, rifite akamaro):

  • Ikintu cyose gifite yo kwihuta kigomba kuba gikwiriye mu myitozo gusa.

  • Hanyuma uhindura ubwishingizi/igerageza ukoresheje transformer yashyizweho. [2]

Kandi niba ushaka "ese bishobora kuba bibi gute?" gut-check: inyandiko za scikit-learn zigaragaza urugero rw'isohoka ry'amakuru aho gahunda itari yo yo gutunganya mbere itanga ubuziranenge bwa 0.76 ku ntego zitunguranye - hanyuma ikagabanuka ikagera kuri ~ 0.5 iyo isohoka ry'amakuru rimaze gukosorwa. Uko ni ko isohoka ry'amakuru rishobora kugaragara nabi. [2]

Gutegura mbere y'uko ibintu bitunganywa nta kajagari 🏗️

Imiterere myinshi irananirwa gukora atari uko iyo miterere ari "mibi", ahubwo ni uko ukuri kw'ibyo umuntu yinjiza bihinduka - cyangwa umuyoboro wawe ugakora.

Gutegura mbere y’umusaruro bigamije umusaruro akenshi biba birimo:

  • Ibikoresho byabitswe (amakarita ya encoder, params za scaler, tokenizer config) bityo inference ikoresha impinduka zimwe na zimwe zizewe [2]

  • Amasezerano akomeye yo kwinjira (inkingi/ubwoko/urwego byitezwe)

  • Gukurikirana ko ibintu bihindagurika kandi bigahinduka , kuko amakuru ajyanye n'umusaruro azagenda ahindagurika [5]

Niba ushaka ibisobanuro bifatika: Vertex AI Model Monitoring ya Google itandukanya skew-serving training (ikwirakwizwa ry’umusaruro ritandukanye n’iry’amahugurwa) n’ihindagurika ry’ibitekerezo (ihindagurika ry’ikwirakwizwa ry’umusaruro uko igihe kigenda gihita), kandi ishyigikira ikurikiranwa haba ku bijyanye n’imiterere y’ibyiciro n’imibare. [5]

Kuko ibintu bitunguranye birahenze. Kandi si ibintu bishimishije.

Imbonerahamwe yo kugereranya: ibikoresho bisanzwe byo gutunganya mbere y'uko ibintu bikorwa + ibikoresho byo gukurikirana (n'uwo bigamije) 🧰

Igikoresho / isomero Ibyiza kuri Igiciro Impamvu bikora (n'ubunyangamugayo buke)
itegurwa rya scikit-learn Imiyoboro ya ML yo mu mbonerahamwe Ubuntu Ibyuma bipima neza + ibipima (OneHotEncoder, StandardScaler, nibindi) hamwe n'imyitwarire itegerejwe [1]
Amatoni yo guhoberana mu maso Gutegura uburyo bwo kwinjira muri NLP Ubuntu Ikora indangamuntu z'inyongera + udupfukamunwa two kwita ku muntu buri gihe mu buryo butandukanye [3]
ihinduka ry'urumuri Iyerekwa rihindura + kongera ubushobozi Ubuntu Uburyo bwiza bwo kuvanga impinduka zishingiye ku mahame n'izishingiye ku buryo butunguranye mu muyoboro umwe [4]
Igenzura ry'icyitegererezo cya Vertex AI Gutahura ikirere gitembera/gihindagurika mu gicuruzwa Kwishyura (ibicu) Imashini zigenzura zigaragaza uburyo bwo kuzunguruka/gutembera hamwe n'amatangazo iyo ingano zirenze [5]

(Yego, ameza aracyafite ibitekerezo. Ariko nibura ni ibitekerezo by'ukuri 😅)

Urutonde rw'ibintu byakozwe mbere yo gutunganya ushobora gukoresha 📌

Mbere yo guhugurwa

  • Sobanura igishushanyo mbonera cy'ibyinjira (ubwoko, ibice, intera zemewe)

  • Igenzura ribura agaciro n'inshuro ebyiri

  • Gutandukanya amakuru mu buryo bukwiye (gukoresha uburyo butunguranye / bushingiye ku gihe / bigashyirwa mu matsinda)

  • Gutegura mbere yo gukora imyitozo gusa ( fit / fit_transform iguma muri gari ya moshi) [2]

  • Bika ibikoresho byabanje gutunganywa kugira ngo igitekerezo gishobore kongera kubikoresha [2]

Mu gihe cy'amahugurwa

  • Koresha uburyo bwo kongeramo ibikoresho mu buryo butunguranye gusa aho bikenewe (ubusanzwe amahugurwa agabanyijemo ibice gusa) [4]

  • Komeza isuzuma mbere yo gutunganya ibintu [4]

  • Kurikirana impinduka zabanje gukorwa nk'impinduka z'icyitegererezo (kuko ari zo)

Mbere yo kohereza

  • Menya neza ko inference ikoresha inzira imwe yo gutunganya ibintu hamwe n'ibindi bikoresho [2]

  • Gushyiraho uburyo bwo kugenzura imihindagurikire y'ikirere (ndetse n'igenzura ry'ibanze ry'ibiranga rirafasha cyane) [5]

Kwibira mu buryo bwimbitse: amakosa akunze kugaragara mu gutunganya mbere y'igihe (n'uburyo bwo kuyarinda) 🧯

Ikosa rya 1: “Nzakora ibintu byose vuba vuba” 😵

Iyo ubara ibipimo byo gupima amakuru ku makuru yose, uba urimo gusohora amakuru y'isuzuma. Bikwiranye na gari ya moshi, hindura ibisigaye. [2]

Ikosa rya 2: ibyiciro birimo kugenda bijya mu kajagari 🧩

Niba ikarita yawe y'icyiciro ihinduka hagati y'amahugurwa n'incamake, icyitegererezo cyawe gishobora gusobanura nabi isi bucece. Komeza gukosora ikarita ukoresheje ibikoresho byabitswe. [2]

Ikosa rya 3: kongera umubare mu buryo butunguranye mu isuzuma 🎲

Guhindura ibintu mu buryo butunguranye ni byiza cyane mu myitozo, ariko ntibikwiye "gushyirwa mu ibanga" iyo ugerageza gupima imikorere. (Guhinduka mu buryo butunguranye bivuze guhindagurika.) [4]

Amagambo ya nyuma 🧠✨

Gutunganya ubuhanga bwa AI ni ubuhanga buhanitse bwo guhindura ukuri guhindagurika mu buryo buhoraho. Bikubiyemo gusukura, gukosora, gupima, gushyira mu byiciro, guhindura amashusho, ndetse n'ibirenzeho, imiyoboro n'ibindi bikoresho bishobora gusubiramo.

  • Kora isuzuma mbere y’igihe ubyifuza, ntabwo ari ukwifata nk’aho ubyifuza. [2]

  • Banza utandukanye, hindura uko ubyifuza mu myitozo gusa, wirinde ko usohoka. [2]

  • Koresha uburyo bujyanye no gutunganya inyandiko (tokenizers ku nyandiko, transforms ku mashusho). [3][4]

  • Genzura uko umusaruro uhindagurika/uhindagurika kugira ngo moderi yawe idahita ihinduka ibidafite umumaro. [5]

Kandi niba warahuye n'ikibazo, ibaze uti:
“Ese iyi ntambwe yo gutunganya amakuru mbere y'igihe yaba igifite ishingiro ndamutse nyikoresheje ejo ku makuru mashya?”
Niba igisubizo ari “uhh… wenda?”, icyo ni cyo gisubizo cyawe 😬

Ibibazo Bikunze Kubazwa

Mu magambo make, gutegura mbere y'ubuhanga bwa AI ni iki?

Gutegura porogaramu y’ubuhanga bwa gihanga (AI) ni intambwe zishobora gusubirwamo zihindura amakuru y’ibanze asakuza kandi afite ihindagurika ryinshi mu buryo buhamye, icyitegererezo gishobora kwigiraho. Bishobora kuba birimo gusukura, kwemeza, gusimbuza ibyiciro, gupima agaciro k’imibare, gushyira mu byiciro inyandiko, no gushyira mu bikorwa impinduka z’amashusho. Intego ni ukureba ko amahugurwa n’igenamigambi ry’umusaruro bibona "ubwoko bumwe" bw’inyandiko, kugira ngo icyitegererezo kidahinduka nyuma.

Kuki gutunganya mbere y’ubuhanga bwa AI ari ingenzi cyane mu musaruro?

Gutegura mbere y’igihe ni ingenzi kuko moderi ziba zifite ubushobozi bwo kwita ku buryo bworoshye ku buryo zishyirwa mu bikorwa. Niba amakuru y’amahugurwa yashyizwe mu byiciro, agashyirwa mu buryo bwa "encoded", agashyirwa mu buryo bwa "token", cyangwa agahindurwa mu buryo butandukanye n’uko amakuru y’umusaruro akorwa, ushobora kubona amakosa yo mu buryo bwa "train/serve" asa neza utari kuri interineti ariko akananirwa buhoro buhoro kuri interineti. Imiyoboro ikomeye yo gutunganya mbere y’igihe inagabanya urusaku, ikongera ubushobozi bwo kwiga, kandi ikihutisha gusubiramo kuko utari gukuramo "spaghetti" yo mu gitabo.

Ni gute nakwirinda gusohora amakuru mu gihe cyo kuyatunganya mbere y'uko asohoka?

Itegeko ryoroshye rirakora: ikintu cyose gifite yo guhuza kigomba kuba gihuye n'amakuru y'amahugurwa gusa. Ibyo birimo scalers, encoders, na tokeniser biga ibipimo nk'uburyo, amakarita y'icyiciro, cyangwa amagambo. Ubanza gutandukanya, ugahuza n'itsinda ry'amahugurwa, hanyuma ugahindura ubwishingizi/igerageza ukoresheje transformer yashyizweho. Gusohoka bishobora gutuma ubwishingizi busa neza "mu buryo bw'amayobera" hanyuma bigasenyuka mu ikoreshwa ry'umusaruro.

Ni izihe ntambwe zikunze gukoreshwa mu gutunganya amakuru ajyanye n'imbonerahamwe?

Ku makuru ajyanye n'imbonerahamwe, umuyoboro usanzwe urimo gusukura no kwemeza (ubwoko, intera, agaciro kabura), gukosora ibice (gushyuha kimwe cyangwa ibisanzwe), no gupima imibare (uburinganire cyangwa ubunini bwa minini). Imiyoboro myinshi yongeraho ubuhanga bushingiye ku miterere nk'ibipimo, amadirishya azunguruka, cyangwa imibare. Akamenyero gafatika ni ugusobanura neza amatsinda y'inkingi (imibare ugereranyije n'ibiranga ibice ugereranyije n'ibiranga ibice) kugira ngo impinduka zawe zikomeze kuba zimwe.

Gutegura inyandiko mbere y'igihe bikora gute ku buryo bwo kuyikoresha?

Gutunganya inyandiko mbere y’inyandiko akenshi bivuze gushyira mu majwi (tokenization) mu majwi (token/subwords), kuyahindura mu majwi y’inyongera (input IDs), no gucunga uburyo bwo gukata no gukata (padding/discuncation) kugira ngo bihuzwe. Uburyo bwinshi bwo gukora transformer butuma habaho uburyo bwo kwibanda ku majwi (attention mask) hamwe n’amajwi (IDs). Uburyo busanzwe ni ugukoresha uburyo bwa tokenizer bw’icyitegererezo aho gukoresha uburyo bwa "advanced improvisation", kuko itandukaniro rito mu miterere ya tokeniser rishobora gutuma "ikora neza ariko igakora ibintu mu buryo butunguranye".

Ni iki gitandukanye no gutunganya amashusho mbere yo kuyakoresha mu kwigira ku mashini?

Gutegura amashusho mbere y’uko akorwa bifasha mu gufata imiterere n’amapikseli mu buryo buhamye: guhindura ingano/guhinga, guhuza, no gutandukanya neza impinduka zishingiye ku buryo buhamye n’izishingiye ku buryo butunguranye. Mu isuzuma, impinduka zigomba kuba zishingiye ku buryo butunguranye kugira ngo ibipimo bigereranywe. Mu ihugurwa, kongera imiterere ku buryo butunguranye (nk’ibihingwa bidasanzwe) bishobora kongera imbaraga, ariko uburyo butunguranye bugomba gushyirwa ku murongo ku buryo bugambiriye ku gice cy’amahugurwa, ntabwo bugomba gusigwa ku buryo butunguranye mu gihe cy’isuzuma.

Ni iki gituma umuyoboro utegura mbere yo gutunganya ibintu "uba mwiza" aho kuba woroshye?

Umuyoboro mwiza wo gutunganya porogaramu za AI ushobora kongera gukoreshwa, ukirinda gusohoka, kandi urashobora kugaragara. Umuyoboro wo kongera gukoreshwa bivuze ko ubwinjiriro bumwe butanga umusaruro umwe keretse iyo kutagira gahunda ari ukwiyongera ku bushake. Umuyoboro woroshye gusohoka bivuze ko intambwe zo gukora zidakora ku kwemeza/gupima. Umuyoboro woroshye gusohoka bivuze ko ushobora kugenzura imibare nko kubura, umubare w'ibyiciro, n'uburyo ibintu bikwirakwizwa bityo gukosora amakosa bigashingira ku bimenyetso, ntabwo ari ugutekereza ku mutima. Imiyoboro irusha urutonde rw'ibitabo bya mudasobwa igihe cyose.

Ni gute nakomeza gukora imyitozo no gutegura isuzuma ry’ibizamini?

Icy'ingenzi ni ugukoresha ibikoresho bimwe byizwe neza mu gihe cyo gusuzuma: ibipimo bya scaler, encoder mappings, na tokenizer configs. Urashaka kandi amasezerano yo kwinjira (inkingi ziteganijwe, ubwoko, n'ibice) kugira ngo amakuru yo gukora adashobore kwinjira bucece mu miterere idakwiye. Guhuza si "gukora intambwe zimwe" gusa - ni "gukora intambwe zimwe hamwe n'ibipimo bimwe na mappings."

Ni gute nakurikirana ibibazo byo gutunganya mbere y'igihe nko kudohoka no kudohoka uko igihe kigenda gihita?

Nubwo hari inzira ikomeye, amakuru y’umusaruro arahinduka. Uburyo busanzwe ni ugukurikirana impinduka mu miterere y’ibicuruzwa no kumenya niba hari amahugurwa atagenda neza (umusaruro utandukanye n’amahugurwa) ndetse n’impinduka mu mikorere (impinduka mu musaruro uko igihe kigenda gihita). Igenzura rishobora kuba ryoroheje (igenzura ry’ibanze mu mikoreshereze y’ibikoresho) cyangwa rigacungwa (nk’igenzura rya Vertex AI Model). Intego ni ugufata impinduka mu mikoreshereze y’ibikoresho hakiri kare - mbere yuko bigenda bigabanya buhoro buhoro imikorere y’itsinda.

Amareferensi

[1] scikit-learn API:
sklearn.preprocessing (encoders, scalers, normalization) [2] scikit-learn: Ingaruka zisanzwe - Amakuru asohoka n'uburyo bwo kuyarinda
[3] Inyandiko za Transformers zo mu maso zihuza: Tokenizers (amarangamuntu yinjiye, udupfukamunwa two kwitondera)
[4] Inyandiko za PyTorch Torchvision: Transforms (Reforms/Normalize + random transforms)
[5] Inyandiko za Google Cloud Vertex AI: Incamake y'igenzura ry'icyitegererezo (skew & drift)

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog