Ese ubuhanga bwo gukora imashini (AI) buzasimbura abahanga mu by'amakuru (Data Engineers)?

Ese ubuhanga bwo gukora imashini (AI) buzasimbura abahanga mu by'amakuru (Data Engineers)?

Igisubizo kigufi: AI ntabwo izasimbura burundu injeniyeri z'amakuru; izikora akazi gasubirwamo nko kwandika SQL, gukata imiyoboro y'amazi, ibizamini, n'inyandiko. Niba uruhare rwawe ahanini ari akazi gashingiye ku mutungo muto, gashingiye ku matike, karagaragara cyane; niba ufite icyizere, ibisobanuro, imiyoborere, n'uburyo bwo guhangana n'impanuka, AI igufasha kwihuta cyane.

Ibintu by'ingenzi byakunzwe:

Ubwishingizi : Shyira imbere inshingano ku bisubizo, aho gukora code vuba gusa.

Ubwiza : Kubaka ibizamini, uburyo bwo kubibona, n'amasezerano kugira ngo imiyoboro ikomeze kwizerwa.

Ubuyobozi : Gukomeza ibanga, kugenzura uburyo abantu binjira, kubika amakuru no kugenzura ibikorwa by’abantu.

Ubudakoresha neza : Fata ibyavuye mu bushakashatsi bwa AI nk'impapuro z'igenzura; ubisuzume kugira ngo wirinde amakosa yizewe.

Guhindura inshingano : Mara umwanya muto wo kwandika boilerplate kandi umarane umwanya munini wo gushushanya sisitemu ziramba.

Ese ubuhanga bwo gukora imibonano mpuzabitsina (AI) buzasimbura abahanga mu by'amakuru (Data Engineers)?

Niba umaze iminota irenga itanu uzenguruka amatsinda y’amakuru, wumvise imvugo isubiramo - rimwe na rimwe iravugwa mu buryo butuje, rimwe na rimwe itangirwa mu nama nk'aho ari inkuru ihindagurika: Ese ubuhanga bwo gukora ubushakashatsi ku ikoranabuhanga (AI) buzasimbura abahanga mu by'amakuru (Data Engineers)?

Kandi… ndabyumva. AI ishobora gukora SQL, kubaka imiyoboro, gusobanura ibimenyetso bya stack, draft dbt models, ndetse no gutanga inama ku mishinga y'ububiko ifite icyizere giteye ubwoba. GitHub Copilot kuri SQL Ku bijyanye na dbt models GitHub Copilot
Bisa nkaho kureba forklift yiga guhuza. Biratangaje, biteye ubwoba gato, kandi ntuzi neza icyo bivuze ku kazi kawe 😅

Ariko ukuri ntabwo gusobanutse neza nk'uko umutwe w'amakuru ubivuga. Ubuhanga bwo gukora imibonano mpuzabitsina (AI) burimo guhindura cyane ikoranabuhanga ry'amakuru. Burimo kwihutisha uduce duto kandi dushobora gusubiramo. Burimo kwihutisha ibihe bya "Nzi icyo nshaka ariko sinshobora kwibuka imiterere y'amakuru". Burimo kandi kubyara ubwoko bushya bw'akajagari.

Reka rero tubishyire mu bikorwa neza, nta cyizere cyuzuye cyangwa ubwoba bukabije.

Ingingo ushobora gukunda gusoma nyuma y'iyi:

🔗 Ese ubuhanga bwo gukora imibonano mpuzabitsina bugiye gusimbura abahanga mu by'imirasire?
Uburyo gushushanya ubuhanga bwo gukora amashusho bihindura imikorere, ubunyangamugayo, n'inshingano z'ejo hazaza.

🔗 Ese ubuhanga bwo gukora igenzura (AI) buzasimbura abacungamari?
Reba imirimo y'ibaruramari AI ikora yikora n'ibisigaye ari abantu.

🔗 Ese ubuhanga mu by'ubuhanga mu by'ubwenge (AI) buzasimbura abashoramari mu mabanki?
Sobanukirwa ingaruka za AI ku masezerano, ubushakashatsi, n'imibanire y'abakiriya.

🔗 Ese ubuhanga bwo gukora imibonano mpuzabitsina (AI) buzasimbura abakozi b'ubwishingizi?
Menya uburyo ubuhanga mu gukora imibonano mpuzabitsina (AI) buhindura ubwishingizi, ubucuruzi, n'ubufasha ku bakiliya.

Impamvu ikibazo "AI isimbura abahanga mu by'ikoranabuhanga" gikomeje kugaruka 😬

Ubwoba buturuka ahantu runaka: ikoranabuhanga ry’amakuru rifite akazi kenshi gashobora gusubirwamo .

  • Kwandika no kuvugurura SQL

  • Inyandiko zo gushyira mu nyubako

  • Gushushanya imirima kuva kuri gahunda imwe ujya ku yindi

  • Gukora ibizamini n'inyandiko z'ibanze

  • Gukosora amakosa y'imiyoboro y'amazi… bishobora guteganya kubaho

Ubuhanga mu by'ubwenge (AI) ni umuhanga mu buryo budasanzwe mu miterere ishobora gusubiramo. Kandi igice cy'ikoranabuhanga ry'amakuru ni cyo - imiterere ishyizwe ku miterere. Ibitekerezo bya kode ya GitHub Copilot

Nanone, imiterere y'ibikoresho yamaze "guhisha" ingorane:

Rero iyo AI igaragaye, ishobora kumva nk'igice cya nyuma. Iyo agace kamaze gukurwaho, kandi AI ikabasha kwandika kole… hasigaye iki? 🤷

Ariko dore ikintu abantu barengaho: kwandika amakuru si ukwandika gusa . Kwandika ni cyo gice cyoroshye. Igice kigoye ni ugutuma ibintu bidasobanutse neza, bya politiki kandi bihinduka mu bucuruzi byitwara nk'uburyo bwizewe.

Kandi ubuhanga bwo gukora imibonano mpuzabitsina (AI) buracyahanganye n'ubwo budasobanutse. Abantu nabo barahangana - barushaho gukora ibishushanyo mbonera.

Ibyo abahanga mu by'ikoranabuhanga bakora umunsi wose (ukuri kudasobanutse neza) 🧱

Reka tuvugishe ukuri - izina ry'akazi "Injeniyeri w'amakuru" risa n'aho urimo kubaka moteri za roketi mu mibare gusa. Mu by'ukuri, urimo kubaka icyizere .

Umunsi usanzwe ni "guhimba algorithme nshya" gusa, ahubwo ni byinshi:

  • Kuganira n'amatsinda yo hejuru ku bijyanye n'ibisobanuro by'amakuru (birababaza ariko ni ngombwa)

  • Gusuzuma impamvu igipimo cyahindutse (no kumenya niba ari ukuri)

  • Guhangana n'ihindagurika ry'ibishushanyo mbonera n'ibitangaza bivuga ngo “hari umuntu wongeyeho inkingi saa sita z'ijoro”

  • Kugenzura ko imiyoboro y'amazi idahinduka, ishobora kugaruzwa, kandi igaragara

  • Gushyiraho imigozi yo kurinda kugira ngo abasesenguzi bo hasi badakora dashboards zidafite ishingiro ku buryo butunguranye

  • Gucunga ikiguzi kugira ngo ububiko bwawe butahinduka umuriro w'amafaranga 🔥

  • Kugenzura uburenganzira bwo kugera ku bintu, kugenzura, kubahiriza amategeko no kubika amahame ya GDPR (Komisiyo y'Uburayi) Imipaka yo kubika (ICO)

  • Kubaka amakuru abantu bashobora gukoresha batagutumyeho ibibazo 20 kuri DM

Igice kinini cy'akazi ni icy'imibanire n'abandi n'imikorere:

  • “Ni nde nyiri aya meza?”

  • “Ese iyi nsobanuro iracyafite agaciro?”

  • "Kuki CRM ikohereza hanze kopi ebyiri?"

  • "Ese dushobora kohereza iki gipimo ku bayobozi nta soni?" 😭

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) bushobora gufasha mu bice bimwe na bimwe by'ibi, yego. Ariko kuyisimbuza burundu ni ikintu kidashoboka.

Ni iki gituma verisiyo ikomeye y'ubuhanga mu gusesengura amakuru iba uruhare rukomeye? ✅

Iki gice gifite akamaro kuko ikiganiro cyo gusimbura abandi gikunze gufata ko abahanga mu by'amakuru ari "abubatsi b'imiyoboro." Ibyo ni nko gufata ko abatetsi ahanini "batema imboga." Ni igice cy'akazi, ariko si ko biri.

Injeniyeri ukomeye w’amakuru ubusanzwe bivuze ko ashobora gukora byinshi muri ibi:

  • Igishushanyo mbonera cy'impinduka
    Impinduka z'amakuru. Amakipe arahinduka. Ibikoresho birahinduka. Injeniyeri mwiza yubaka sisitemu zidasenyuka buri gihe iyo ukuri gutangiye 🤧

  • Sobanura amasezerano n'ibyo witeze
    "umukiriya" bivuze iki? "Ikora" bivuze iki? Bigenda bite iyo ikibazo kigeze nyuma? Amasezerano akumira akajagari kurusha uko code ikora. Open Data Contract Standard (ODCS) ODCS (GitHub)

  • Shyiraho uburyo bwo kureba muri byose.
    Ntabwo ari "byagenze" gusa, ahubwo ni "byagenze neza." Ubushya, ubusumbane mu bwinshi, guturika kw'ibintu bidafite akamaro, impinduka mu gukwirakwiza amakuru. Uburyo bwo kureba amakuru (Dynatrace) Uburyo bwo kureba amakuru ni iki?

  • Hindura ibintu nk'ibi:
    Umuvuduko w'umuntu mukuru ugereranije n'ukuri, ikiguzi ugereranije n'igihe gito, ubworoherane ugereranije n'ubworoshye. Nta muyoboro utunganye, ni imiyoboro ushobora kubaho gusa.

  • Guhindura ibyo ubucuruzi bukeneye muri sisitemu zirambye
    Abantu basaba ibipimo, ariko icyo bakeneye ni umusaruro w'amakuru. Ubuhanga bwo gukora imibonano mpuzabitsina (AI) bushobora kwandika kode, ariko ntibushobora kumenya mu buryo bw'amayobera ubucuruzi.

  • Gutuza amakuru Igishimwa
    gikomeye kuri platform y'amakuru ni uko nta muntu ubivugaho. Amakuru adashoboka ni amakuru meza. Kimwe n'amazi. Uyabona gusa iyo yananiwe 🚽

Niba urimo gukora ibi bintu, ikibazo kigira kiti “Ese ubuhanga mu gukora imashini (AI) buzasimbura abahanga mu gukora imashini?” gitangira kumvikana nabi gato. Ubuhanga mu gukora imashini (AI) bushobora gusimbura imirimo , ntabwo ari ubunyamwuga .

Aho ubuhanga bwo gukora imibonano mpuzabitsina (AI) busanzwe bufasha abahanga mu by'ikoranabuhanga (kandi ni byiza cyane) 🤖✨

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) si ubucuruzi gusa. Iyo bukoreshejwe neza, ni uburyo bwo kongera imbaraga mu buryo bwemewe.

1) SQL yihuta kandi ikora neza

  • Gutegura ihurizo ry'ibice by'ingenzi

  • Kwandika imikorere y'idirishya utifuzaga gutekerezaho

  • Guhindura logique y'ururimi rworoshye mo uduce tw'ibibazo

  • Guhindura ibibazo bibi muri CTEs zishobora gusomwa GitHub Copilot kuri SQL

Ibi ni byinshi kuko bigabanya ingaruka za "page idafite ubusa". Uracyakeneye kwemeza, ariko utangirira kuri 70% aho kuba 0%.

2) Gukosora amakosa no gukosora imbogamizi z'imitsi

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) ni bwiza kuri:

  • Gusobanura ubutumwa bw'amakosa

  • Gutanga inama aho wareba

  • Gusaba "kugenzura imiterere idahuye" intambwe zo mu bwoko bwa GitHub Copilot
    Ni nko kugira injeniyeri muto udacogora udasinzira kandi rimwe na rimwe akabeshya yiyizeye 😅

3) Gutunganya inyandiko no kongera amakuru mu kataloge

Byakozwe mu buryo bwikora:

  • Ibisobanuro by'inkingi

  • Incamake y'icyitegererezo

  • Ibisobanuro ku bijyanye n'umurongo

  • "Iyi mbonerahamwe ikoreshwa iki?" inyandiko za dbt

Ntabwo ari byiza cyane, ariko bigabanya umuvumo w'imiyoboro idafite ibyangombwa.

4) Isuzuma ry'inyubako no kugenzura

AI ishobora gutanga igitekerezo:

  • Ibizamini by'ibanze byo gusesagura

  • Igenzura ry'umwihariko

  • Ibitekerezo by'ubunyangamugayo ku birebana n'ubunyangamugayo

  • "Iki gipimo ntikigomba kugabanuka" imiterere y'ibizamini bya dbt Amakuru meza yitezweho: Ibitezweho

Na none - uracyafata icyemezo cy'ingenzi, ariko byihutisha ibice bisanzwe.

5) Kode y'umuyoboro wa "kole"

Imiterere ya config, scaffolds za YAML, orchestration DAG drafts. Ibyo bintu birasubirwamo kandi AI irya isubiramo mu gitondo 🥣 Apache Airflow DAGs

Aho ubuhanga bwo gukora imibonano mpuzabitsina (AI) bukigorana (kandi iyi ni yo shingiro ryabyo) 🧠🧩

Iki ni cyo gice cy'ingenzi cyane, kuko gisubiza ikibazo cyo gusimbuza hakoreshejwe imiterere nyayo.

1) Ibisobanuro bitasobanutse neza n'ibihindagurika

Uburyo bwo gutekereza mu bucuruzi ntabwo bukunze kuba bwiza. Abantu bahindura ibitekerezo hagati mu nteruro. "Umukoresha ukoresha" ahinduka "umukoresha u ...

AI ntabwo ishobora kwemera ko ibyo bintu bidasobanutse neza. Irashobora kubyibwira gusa.

2) Kubazwa no kubazwa ingaruka

Iyo umuyoboro w'amazi wangiritse kandi dashboard y'abakozi ikagaragaza ubuswa, umuntu agomba:

  • gupima

  • ingaruka ku itumanaho

  • gikosore

  • gukumira kongera kugaruka

  • andika isuzuma ry'urupfu

  • gufata icyemezo niba ubucuruzi bushobora kwizera imibare yo mu cyumweru gishize

Ubuhanga mu by'ubwenge (AI) bushobora gufasha, ariko ntibushobora kubazwa mu buryo bufite ishingiro. Imiryango ntikora ku buryo bugaragara - ikora ku nshingano zayo.

3) Gutekereza kuri sisitemu

Uburyo bwo gukusanya amakuru ni urusobe rw'ibinyabuzima: kwinjiza amakuru, kuyabika, kuyahindura, kuyatunganya, kuyayobora, kuyagenzura, kuyagenzura mu biciro, SLA. Impinduka mu mihindagurikire y'urwego rumwe. Ibitekerezo bya Apache Airflow

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) bushobora gutanga inama zo kunoza ibikorwa byo mu gace runaka bigatera ibibazo ku isi yose. Ni nko gusana urugi rusa n'urusaku ukuraho urugi 😬

4) Umutekano, ubuzima bwite, kubahiriza amategeko

Aha niho inzozi zo gusimbura zipfira.

AI ishobora kwandika politiki, ariko kuzishyira mu bikorwa mu mutekano ni ubuhanga nyabwo.

5) "Ibitazwi bitazwi"

Ibibazo by’amakuru akenshi ntibikunze kugaragara neza:

  • API y'umucuruzi ihindura bucece imiterere y'amagambo

  • Igitekerezo cy'ahantu hagenwe kirahinduka

  • Gusubiza inyuma bisubiramo igice kimwe

  • Uburyo bwo kongera kugerageza butera kwandika kabiri

  • Uburyo bushya bw'ibicuruzwa butanga imiterere mishya y'ibikorwa

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) burushaho kuba butoroshye iyo ibintu bitazwi neza.

Imbonerahamwe yo kugereranya: ni iki kirimo kugabanya iki, mu bikorwa 🧾🤔

Hasi hari igitekerezo gifatika. Si "ibikoresho bisimbura abantu," ahubwo ni ibikoresho n'uburyo bigabanya imirimo imwe n'imwe.

Igikoresho / uburyo Abareba Ishusho y'ibiciro Impamvu bikora
Kopilote za kode za AI (SQL + Python abafasha) GitHub Kopilote Injeniyeri zandika code nyinshi Ku buntu kugeza ku kwishyura Ni umuhanga mu gukata, guhindura ibintu, gushushanya… rimwe na rimwe yirata mu buryo bwihariye cyane
Ibihuza bya ELT byacunzwe na Fivetran Amakipe arambiwe no gukoresha inyubako Kwiyandikisha Ikuraho ububabare bwo kunywa ubwabyo, ariko ikagabanya uburyo bushya bushimishije
Uburyo bwo kugenzura amakuru (Dynatrace) Umuntu wese ufite SLA Hagati kugeza ku kigo cy'ubucuruzi Ifata ibintu bitagenda neza hakiri kare - nk'amatangazo y'umwotsi ku miyoboro 🔔
Imiterere y'impinduka (icyitegererezo cy'igenamigambi) dbt Isesengura + DE hybrids Ubusanzwe igikoresho + kubara Bituma logic ikoreshwa mu buryo bwa modular kandi ishobora gupimwa, spaghetti nkeya
Katalogu z'amakuru + imiterere y'amakuru dbt Urwego rw'amakuru Amashyirahamwe afite urujijo mu bipimo Biterwa, mu bikorwa Isobanura "ukuri" rimwe - igabanya impaka zidashira zo gupima
Umuziki ukoresheje imbonerahamwe za Apache Airflow Amakipe ashishikajwe n'urubuga Ikiguzi cyo gufungura + imikorere Igena imikorere isanzwe; DAG nke z'urubura
Inyandiko zifashijwe na AI zikorwa na dbt docs Amakipe yanga kwandika inyandiko Ihendutse kugeza ku iciriritse Akora inyandiko "zihagije" kugira ngo ubumenyi budashira
Politiki z'imiyoborere zikoresha ikoranabuhanga Urwego rw'ibanga rwa NIST Ibidukikije bigenzurwa Ikigo cy'ubucuruzi Ifasha mu gushyira mu bikorwa amategeko - ariko iracyakeneye abantu kugira ngo bashyireho amategeko

Reba ikibura: umurongo uvuga ngo "kanda buto kugira ngo ukureho abashinzwe injeniyeri z'amakuru." Yego… uwo murongo ntubaho 🙃

None se… ubuhanga bwo gukora imibonano mpuzabitsina (AI) buzasimbura abahanga mu by'amakuru (Data Engineers), cyangwa buzahindura inshingano? 🛠️

Dore igisubizo kitari gitangaje: Ubuhanga bwo gukora imibonano mpuzabitsina (AI) buzasimbura ibice bimwe na bimwe by'imikorere, ntabwo ari umwuga.

Ariko bizahindura imiterere y'uruhare. Kandi niwirengagiza ibyo, uzumva ukandamijwe.

Ni iki gihinduka:

  • Igihe gito cyo kwandika imbonerahamwe y'ibintu

  • Gushakisha inyandiko igihe gito

  • Gusuzuma, kwemeza, gushushanya igihe kinini

  • Igihe kinini cyo gusobanura amasezerano n'ibiteganyijwe mu bwiza bw'amasezerano y'amakuru afunguye (ODCS)

  • Gukoresha igihe kinini mu bufatanye n'ibicuruzwa, umutekano, imari

Iyi ni impinduka ntoya: ikoranabuhanga ry’amakuru rigenda rigabanuka ku “kubaka imiyoboro” ahubwo rirushaho “kubaka sisitemu yizewe y’ibicuruzwa by’amakuru.”

Kandi mu buryo butuje, ibyo bifite agaciro gakomeye, ntabwo ari bike.

Nanone - kandi ngiye kuvuga ibi nubwo byaba bisa nkaho ari ibintu bikomeye - ubuhanga bwo gukora imibonano mpuzabitsina (AI) byongera umubare w'abantu bashobora gukora amakuru , ibyo bikaba byongera gukenera umuntu wo gukomeza ibintu byose neza. Gutanga umusaruro mwinshi bisobanura urujijo rushobora kwiyongera. GitHub Copilot

Ni nko guha buri wese imyitozo ngororamubiri. Ni byiza cyane! Ubu umuntu agomba gushyira mu bikorwa itegeko rivuga ngo "ndakwinginze ntugacukure umuyoboro w'amazi" 🪠

Urusobe rw'ubuhanga bushya rugumana agaciro (ndetse no mu buhanga bwa gihanga ahantu hose) 🧠⚙️

Niba ushaka urutonde rw'ibintu "bishobora kuzaza", rumeze gutya:

Imitekerereze yo gushushanya sisitemu

  • Igenamiterere ry'amakuru rikomeza impinduka

  • Impinduka mu itsinda ugereranije n'impinduka mu gushakisha amashusho (streaming)

  • Gutinda, ikiguzi, no gutekereza ku buryo bwizewe

Ubwubatsi bw'ubuziranenge bw'amakuru

Imiyoborere n'imiterere y'ibyizerwa

Gutekereza ku rubuga

  • Ingero zishobora kongera gukoreshwa, inzira z'izahabu

  • Imiterere isanzwe yo kwinjiza, guhindura, no gupima ibizamini bya Fivetran

  • Ibikoresho byihariye bidashonga

Itumanaho (yego, mu by'ukuri)

  • Kwandika inyandiko zisobanutse neza

  • Ibisobanuro byo guhuza

  • Kuvuga "oya" mu kinyabupfura ariko mu buryo buhamye

  • Gusobanura aho ibintu bihurira nta kuntu bisa nka roboti 🤖

Niba ushoboye kubikora, ikibazo kigira kiti “Ese ubuhanga bwo gukora imibonano mpuzabitsina (AI) buzasimbura abahanga mu by’amakuru?” kigabanuka cyane. Ubuhanga bwo gukora imibonano mpuzabitsina (AI) buhinduka urugingo rwawe rwo hejuru, ntabwo ari ugusimbura.

Ibintu bifatika aho imirimo imwe n'imwe yo gukora amakuru igabanuka 📉

Sawa, reba vuba ukuri, kuko si izuba gusa na confetti ya emoji 🎉

Inshingano zimwe na zimwe zigaragara cyane:

  • Imirimo yo kwinjira gusa aho byose ari ibihuza bisanzwe Ibihuza bya Fivetran

  • Amatsinda akora cyane cyane imiyoboro yo gutanga raporo isubiramo nta ngaruka nyinshi ku rubuga rwa interineti

  • Amashyirahamwe aho imashini zikora amakuru zifatwa nk' "inkende za SQL" (bikabije, ariko ni ukuri)

  • Imirimo y'abafite uburenganzira buke aho akazi ari amatike gusa no gukoporora no gupakira

Gukoresha ibikoresho bya AI hamwe n'ibikoresho bicungwa neza bishobora kugabanya ibyo bikenewe.

Ariko no muri icyo gihe, gusimbuza bisanzwe bisa nka:

  • Abantu bake bakora akazi kamwe gasubiramo

  • Gushyira imbaraga mu gutunga no kwizerwa kuri platform

  • Impinduka igana ku "umuntu umwe ashobora gushyigikira imiyoboro myinshi"

Rero yego - imiterere y'umubare w'abantu ishobora guhinduka. Inshingano zirahinduka. Inyito zirahinduka. Icyo gice ni ukuri.

Nubwo bimeze bityo ariko, uburyo bwo kugira inshingano bufite ubwishingizi bwinshi kandi bwizewe cyane burakomeje.

Incamake isoza 🧾✅

Ese ubuhanga bwo gukora imashini za siyansi (AI) buzasimbura abahanga mu by'ikoranabuhanga (Data Engineers)? Ntabwo ari mu buryo busobanutse kandi bwuzuye abantu batekereza.

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) buza:

Ariko ubuhanga mu by'ibanze mu bijyanye n'amakuru ni:

AI ishobora kugufasha muri ibyo… ariko ntabwo ari yo “yigenga”.

Niba uri injeniyeri w’amakuru, icyo gikorwa cyoroshye (si cyoroshye, ariko cyoroshye):
shyira mu gaciro ku mutungo bwite, ireme, gutekereza ku mbuga nkoranyambaga, no gutumanaho. Reka ubuhanga bwo gukora imibonano mpuzabitsina (AI) bukore neza mu gihe urimo utunganya ibice by’ingenzi.

Kandi yego - rimwe na rimwe bivuze kuba umuntu mukuru mu cyumba. Ntabwo ari mwiza cyane. Ariko ufite imbaraga nkeya 😄

Ese ubuhanga bwo gukora imashini (AI) buzasimbura ba Injeniyeri b'amakuru?
Buzasimbura imirimo imwe n'imwe, buhindure urwego, kandi butume abahanga mu gukora imashini nziza z'amakuru barushaho kugira agaciro. Iyo ni yo nkuru nyayo.

Ibibazo Bikunze Kubazwa

Ese ubuhanga bwo gukora imashini zikora imibonano mpuzabitsina (AI) buzasimbura burundu abahanga mu by'ikoranabuhanga (data ingredients)?

Mu bigo byinshi, ubuhanga mu by’ubukorano (AI) bushobora gufata imirimo runaka kuruta gusiba inshingano burundu. Bushobora kwihutisha SQL drafting, scaffolding, inyandiko za mbere zitangwa, no gukora ibizamini by’ibanze. Ariko ikoranabuhanga ry’amakuru rinafite uburenganzira ku mutungo no kubazwa, hamwe n’umurimo udasanzwe wo gutuma ubucuruzi butinjira mu buryo busanzwe bukora nk’uburyo bwizewe. Ibyo bice biracyakeneye ko abantu bahitamo uko "igikwiye" gisa no gufata inshingano iyo ibintu byangiritse.

Ni ibihe bice by'ikoranabuhanga ry'amakuru AI isanzwe ikora mu buryo bwikora?

AI ikora neza ku mirimo isubirwamo: kwandika no kuvugurura SQL, gukora skeletons za dbt mode, gusobanura amakosa asanzwe, no gukora imbonerahamwe z'inyandiko. Ishobora kandi gukora ibizamini nko kugenzura ubusa cyangwa ubuziranenge no gukora code ya "glue" y'ibikoresho byo gutunganya. Intsinzi ni imbaraga - utangira wegereye igisubizo gikora - ariko ugomba kwemeza ko ari cyo kandi ukareba ko gihuye n'aho utuye.

Niba AI ishobora kwandika SQL na pipelines, ni iki gisigaye ku bahanga mu by'ikoranabuhanga?

Byinshi: gusobanura amasezerano y'amakuru, gucunga uburyo bwo gushakisha amakuru, no kwemeza ko imiyoboro y'amakuru idahinduka, igaragara kandi ishobora kugaruzwa. Abahanga mu by'amakuru bamara igihe bakora ubushakashatsi ku mpinduka mu bipimo, bakubaka inzira zo kurinda abakoresha amakuru, no gucunga ibiciro n'uburyo bwo kwizerwa. Akazi gakunze kuba mu kubaka icyizere no gutuma urubuga rw'amakuru "rutuje," bivuze ko ruhamye bihagije ku buryo nta muntu ugomba kubitekerezaho umunsi ku wundi.

Ni gute ubuhanga bwo gukora imibonano mpuzabitsina (AI) buhindura akazi ka buri munsi k'umuhanga mu by'ikoranabuhanga (integrator)?

Ubusanzwe igabanya igihe cyo gushakisha no kwandika, bityo umara umwanya muto wandika ariko umara umwanya munini usuzuma, wemeza, kandi ushushanya. Iyo mpinduka ituma uruhare rugaragara mu gushyiraho ibyo witeze, amahame y’ubuziranenge, n’imiterere ishobora kongera gukoreshwa aho kwandika ibintu byose mu buryo bw’intoki. Mu by’ukuri, ushobora gukora akazi kenshi k’ubufatanye n’ibicuruzwa, umutekano, n’imari - kuko umusaruro wa tekiniki uba woroshye kuwukora, ariko ukagorana kuwuyobora.

Kuki ubuhanga bwo gukora imibonano mpuzabitsina (AI) bugorana n'ibisobanuro bidasobanutse neza by'ubucuruzi nka "umukoresha ukora"?

Kubera ko imiterere y'ubucuruzi idahinduka cyangwa ngo ibe nyayo - ihindura umushinga hagati kandi igatandukana bitewe n'abafatanyabikorwa. Ubuhanga mu by'ubwenge bukora (AI) bushobora kwandika ibisobanuro, ariko ntibushobora gufata icyemezo iyo ibisobanuro bihindutse cyangwa hakavuka amakimbirane. Ubuhanga mu by'ikoranabuhanga akenshi busaba ibiganiro, kwandika ibitekerezo, no guhindura ibisabwa mu masezerano arambye. Kuba akazi ko "guhuza abantu" ni impamvu nyamukuru ituma uruhare rudashira nubwo ibikoresho bigenda bitera imbere.

Ese ubuhanga bwo gukora igenzura ry’amakuru, ubuzima bwite, no kubahiriza amategeko bishobora gukora mu mutekano?

Ubuhanga bwo gukora imibonano mpuzabitsina (AI) bushobora gufasha gutegura politiki cyangwa gutanga ibitekerezo, ariko gushyira mu bikorwa mu buryo bwizewe biracyasaba ubuhanga nyabwo no kugenzura neza. Ubuyobozi bukubiyemo kugenzura uburyo bwo kwinjira mu buryo, gucunga PII, amategeko yo kugumana abantu, inzira zo kugenzura, ndetse rimwe na rimwe n'imbogamizi zo gutura mu gihugu. Aha ni ahantu hashobora kuba hari ibyago byinshi aho "hafi neza" bitemewe. Abantu bagomba gushyiraho amategeko, kugenzura iyubahirizwa ry'amategeko, no gukomeza kubazwa ibyavuye mu kubahiriza amategeko.

Ni ubuhe bumenyi bukomeje kuba ingirakamaro ku bahanga mu by'ikoranabuhanga mu gihe ubuhanga bwo gukora imibonano mpuzabitsina butera imbere?

Ubuhanga butuma sisitemu zikomera: gutekereza ku miterere ya sisitemu, ubuhanga mu by’ikoranabuhanga, no gushyiraho uburyo buhamye bushingiye ku mbuga nkoranyambaga. Amasezerano, kwitegereza, uburyo bwo guhangana n’ibibazo, n’isesengura ry’impamvu nyamukuru biba ingenzi cyane iyo abantu benshi bashobora gukora amakuru vuba. Itumanaho rinahinduka itandukaniro - guhuza ibisobanuro, kwandika inyandiko zisobanutse neza, no gusobanura impinduka nta makimbirane ni igice gikomeye cyo gukomeza kwizerwa kw’amakuru.

Ni izihe nshingano z’ubuhanga mu gusesengura amakuru ziri mu kaga gakomeye bitewe n’ubuhanga mu bya siyansi n’ibikoresho bicungwa?

Inshingano zibanda ku buryo bworoshye ku miyoboro isubiramo cyangwa imiyoboro isanzwe yo gutanga raporo zigaragara cyane, cyane cyane iyo imiyoboro ya ELT icungwa ikorera ahantu henshi. Akazi gafite imitungo mike, gashingiye ku matike gashobora kugabanuka kuko ubuhanga bwo gukora ibintu mu buryo bwa AI no gukoresha ikoranabuhanga bigabanya imbaraga kuri buri muyoboro. Ariko ibi akenshi bisa nkaho ari abantu bake bakora imirimo isubiramo, atari "abahanga mu bya mudasobwa batagira amakuru." Inshingano z'abafite imitungo ikomeye zishingiye ku kwizerwa, ireme, no kwizerana zigumaho.

Nigute nakoresha ibikoresho nka GitHub Copilot cyangwa dbt hamwe na AI nta kajagari?

Fata ibyavuye mu bushakashatsi bwa AI nk'umushinga, ntabwo ari icyemezo. Bikoreshe mu gukora uduce tw'ibibazo, kunoza uburyo bwo gusoma, cyangwa gukoresha ibizamini bya dbt na docs, hanyuma ubishyire mu bikorwa ukoresheje amakuru nyayo n'ibimenyetso by'inyongera. Bihuze n'amahame akomeye: amasezerano, amahame ngenderwaho yo gutanga amazina, kugenzura uburyo bwo kureba, n'uburyo bwo gusuzuma. Intego ni ugutanga vuba udasize inyuma uburyo bwo kwizera, kugenzura ikiguzi, cyangwa imiyoborere.

Amareferensi

  1. Komisiyo y'Uburayi - Uburinzi bw'amakuru bwasobanuwe: amahame ya GDPR - commission.europa.eu

  2. Ibiro by'Umuyobozi w'Itangazamakuru (ICO) - Imbibi zo kubika - ico.org.uk

  3. Komisiyo y'Uburayi - Amakuru ashobora kubikwa igihe kingana iki kandi ni ngombwa kuyavugurura? - commission.europa.eu

  4. Ikigo cy'Igihugu cy'Ubuziranenge n'Ikoranabuhanga (NIST) - Urwego rw'Ibanga - nist.gov

  5. Ikigo cy'Umutekano wa Mudasobwa cya NIST (CSRC) - SP 800-92: Ubuyobozi bwo gucunga ububiko bw'amakuru ku mutekano wa Mudasobwa - csrc.nist.gov

  6. Ikigo cy'Umutekano wa Interineti (CIS) - Gucunga Inyandiko z'Igenzura (Igenzura rya CIS) - cisecurity.org

  7. Inyandiko za Snowflake - Politiki zo gukoresha umurongo - docs.snowflake.com

  8. Inyandiko za Google Cloud - Umutekano ku rwego rwa BigQuery - docs.cloud.google.com

  9. BITOL - Amasezerano y'Amakuru Afunguye (ODCS) v3.1.0 - bitol-io.github.io

  10. BITOL (GitHub) - Amasezerano y'amakuru afunguye - github.com

  11. Uburyo bwo Kohereza Ingufu za Apache - Inyandiko (zihamye) - airflow.apache.org

  12. Apache Airflow - DAGs (ibitekerezo by'ingenzi) - airflow.apache.org

  13. Inyandiko za dbt Laboratwari - dbt ni iki? - docs.getdbt.com

  14. Inyandiko za dbt Laboratwari - Ibyerekeye moderi za dbt - docs.getdbt.com

  15. Inyandiko za dbt Laboratwari - Inyandiko - docs.getdbt.com

  16. Inyandiko za dbt Laboratwari - Ibizamini by'amakuru - docs.getdbt.com

  17. Inyandiko za dbt Laboratwari - dbt Semantic Layer - docs.getdbt.com

  18. Inyandiko za Fivetran - Gutangira - fivetran.com

  19. Fivetran - Ibihuza - fivetran.com

  20. Inyandiko za AWS - Ubuyobozi bw'abakora porogaramu za AWS Lambda - docs.aws.amazon.com

  21. GitHub - GitHub Copilot - github.com

  22. Inyandiko za GitHub - Kubona ibitekerezo bya kode muri IDE yawe ukoresheje GitHub Copilot - docs.github.com

  23. Microsoft Learn - GitHub Copilot ya SQL (VS Code extension) - learn.microsoft.com

  24. Inyandiko za Dynatrace - Uburyo bwo kureba amakuru - docs.dynatrace.com

  25. DataGalaxy - Kureba amakuru ni iki? - datagalaxy.com

  26. Inyandiko z'Ibitekerezo Bikomeye - Incamake y'Ibitekerezo - docs.greatexpectations.io

Shaka ubuhanga bwa AI bugezweho mu iduka ryemewe rya AI Assistant Store

Ku bijyanye natwe

Garuka kuri blog