Igisubizo kigufi: Gupima ubuziranenge bw'ubwenge (AI) bikoresha uburyo bwo gutoza icyitegererezo ku mashusho afite ubushobozi bwo hasi n'ubunini, hanyuma bigakoreshwa mu guhanura pixel z'inyongera zizewe mu gihe cyo kongera ubushobozi. Niba icyitegererezo cyabonye imiterere cyangwa amasura asa mu myitozo, gishobora kongeramo ibisobanuro bifatika; bitabaye ibyo, gishobora "guhindura" ibintu nk'urumuri, uruhu rw'umutuku, cyangwa urumuri muri videwo.
Ibintu by'ingenzi byakunzwe:
Iteganyagihe : Icyitegererezo gitanga ibisobanuro bifatika, ntabwo ari ukwiyubaka burundu kw'ukuri.
Guhitamo icyitegererezo : CNN zikunze kuba zihamye; GAN zishobora kugaragara neza ariko zigashobora guhanga udushya.
Igenzura ry'ibintu byakozwe : Reba isura y'inyuma, imiterere isubirwamo, "inyuguti hafi ya zose", n'amasura asa n'ay'iplastike.
Guhagarara kw'amashusho : Koresha uburyo bw'igihe runaka cyangwa uzabona uburyo bwo gushyuha no kunyerera kw'amashusho kuva kuri frame kugera kuri frame.
Gukoresha neza : Niba ukuri ari ngombwa, garagaza uburyo ikoreshwa kandi ufate ibyavuye mu bushakashatsi nk'icyitegererezo.
Ushobora kuba warabibonye: ishusho ntoya, ishaje ihinduka ikintu gisobanutse neza ku buryo cyacapwa, gishyirwa ahagaragara cyangwa kigashyirwa mu kiganiro nta gushidikanywaho. Bisa n'uburiganya. Kandi - mu buryo bwiza - ni nk'aho ari 😅
Rero, Uburyo AI Upscaling ikora bushingira ku kintu cyihariye kuruta "mudasobwa yongera ibisobanuro" (ikoresha intoki) kandi hafi ya "icyitegererezo gihanura imiterere ishoboka ifite ubushobozi bwo hejuru bushingiye ku miterere yize mu ngero nyinshi" ( Deep Learning for Image Super-resolution: A Survey ). Iyo ntambwe yo guhanura ni umukino wose - niyo mpamvu AI upscaling ishobora kugaragara neza cyane… cyangwa se ikoze muri pulasitiki… cyangwa nk'aho injangwe yawe yakuze ifite ubwanwa bw'inyongera.
Ingingo ushobora gukunda gusoma nyuma y'iyi:
🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina (AI) bukora
Menya iby'ibanze ku miterere, amakuru, n'ibitekerezo muri AI.
🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina (AI) bwiga
Reba uburyo amakuru y'amahugurwa n'ibitekerezo byongera imikorere y'icyitegererezo uko igihe kigenda gihita.
🔗 Uburyo ubuhanga bwo gukora imibonano mpuzabitsina bugaragaza ibintu bitagenda neza
Sobanukirwa imiterere y'ibishushanyo n'uburyo ubuhanga bwo gukora imibonano mpuzabitsina bugaragaza imyitwarire idasanzwe vuba.
🔗 Uburyo AI ihanura ibipimo
Suzuma uburyo bwo guhanura bugaragaza ibimenyetso kandi bugateganya ibikenewe mu gihe kizaza.
Uburyo AI Upscaling ikora: igitekerezo cy'ingenzi, mu magambo ya buri munsi 🧩
Gushyira hejuru bivuze kongera ubushobozi bwo kureba: pikseli nyinshi, ishusho nini. Gushyira hejuru mu buryo busanzwe (nk'ibice bibiri) mu buryo busanzwe bigabanya pikseli kandi bigahindura ihinduka ( interpolation ya Bicubic ). Ni byiza, ariko ntibishobora guhanga bishya - bihinduranya gusa.
Kuzamura ubuhanga bwa AI bigerageza ikintu gikomeye kurushaho (cyangwa "super-resolution" mu isi y'ubushakashatsi) ( Deep Learning for Image Super-resolution: A Survey ):
-
Ireba uburyo bwo gushyiramo amakuru make
-
Amenya imiterere (inkombe, imiterere, imiterere yo mu maso, imitako y'inyandiko, ubudodo bw'imyenda…)
-
Ihanura uko verisiyo ifite resitora nyinshi ikwiye kumera
-
Ikora amakuru y'inyongera ya pixel ajyanye n'iyo miterere
Ntabwo ari "kugarura ukuri neza," nko "gutekereza ibintu byizewe cyane" ( Image Super-Resolution Using Deep Convolutional Networks (SRCNN) ). Niba ibyo bisa nkaho biteye amakenga, ntabwo wibeshye - ariko nanone niyo mpamvu bikora neza cyane 😄
Kandi yego, ibi bivuze ko kongera ubushobozi bwa AI mu buryo bw'ibanze ari ugusuzuma ibintu bitagaragara… ariko mu buryo butanga umusaruro kandi burangwa no kubahiriza pixel.
Ni iki gituma verisiyo nziza yo kongera ubushobozi bwa AI iba nziza? ✅🛠️
Niba urimo ucira urubanza umuntu ukoresha AI (cyangwa se uburyo bwo gushyiraho porogaramu), dore ibikunze kuba ingenzi cyane:
-
Gusubiramo neza nta guteka cyane.
Gushyira hejuru neza byongera ubushyuhe n'imiterere, ntabwo byongera urusaku rukabije cyangwa imyenge y'impimbano. -
Imiterere y'inkombe
Imirongo isukuye iguma isukuye. Imiterere mibi ituma impande zinyeganyega cyangwa zigasa n'imirongo y'imbere. -
Ishusho y'umusatsi
ntabwo ikwiye kuba nk'uburoso bwo gusiga amarangi. Itafari ntikwiye kuba nk'ikimenyetso gisubirwamo. -
Uburyo bwo gufata urusaku no gukanda
Amashusho menshi ya buri munsi ashyirwa mu buryo bwa JPEG kugeza ku rupfu. Umuntu mwiza wo hejuru ntabwo yongera ibyo byangiritse ( Real-ESRGAN ). -
Kumenya isura n'inyandiko Kumenya
isura n'inyandiko ni ahantu horoshye ho kubona amakosa. Abantu beza babifata neza (cyangwa bafite uburyo bwihariye). -
Guhuza hagati y’amashusho (kuri videwo)
Iyo ibisobanuro birambuye bizimya ishusho kuva kuri shusho kugeza kuri shusho, amaso yawe azataka cyane. Videwo irakomeza kubaho cyangwa igapfa bitewe no kudahinduka kw’igihe runaka ( BasicVSR (CVPR 2021) ). -
Ibipimo bifite ishingiro
Urashaka utumashini duhuza n'ibyavuye mu bikorwa nyabyo: denoise, deblur, gukuraho ibihangano, kubika ibinyampeke, gutyaza… ibintu by'ingirakamaro.
Itegeko rituje rihoraho: kongera urwego "ruza" akenshi ni ryo utabona neza. Bisa nkaho wari ufite kamera nziza kuruta izindi 📷✨
Imbonerahamwe yo kugereranya: amahitamo azwi yo kongera ubushobozi bwa AI (n'icyo ari cyo cyiza) 📊🙂
Dore igereranya rifatika. Ibiciro biragoye kubikora kuko ibikoresho bitandukanye bitewe n'uruhushya, amapaki, ikiguzi cyo kubara, n'ibindi bintu byose bishimishije.
| Igikoresho / Uburyo | Ibyiza kuri | Ishusho y'ibiciro | Impamvu bikora (mu buryo bugaragara) |
|---|---|---|---|
| Abakora mudasobwa bakomeye mu buryo bwa Topaz ( Ifoto ya Topaz , Videwo ya Topaz ) | Amafoto, videwo, uburyo bworoshye bwo gukora | Yishyuwe | Moderi zikomeye rusange + uburyo bwinshi bwo kuzitunganya, zikunda "gukora gusa"… ahanini |
| Ibiranga ubwoko bwa Adobe "Super Resolution" ( Adobe Enhance > Super Resolution ) | Abafotora basanzwe muri urwo rwego | Kwiyandikisha | Ivugurura ry’ibintu mu buryo buhamye, ubusanzwe rikorwa mu buryo busanzwe (ridafite filime) |
| Ubwoko bwa Real-ESRGAN / ESRGAN ( Real-ESRGAN , ESRGAN ) | Gukora ibintu byawe bwite, abakora umushinga, imirimo y'itsinda | Ubuntu (ariko bihenze) | Ni nziza cyane mu miterere yayo, ishobora kuba iryoshye ku maso niba utitonze |
| Uburyo bwo kongera ingano bushingiye ku gukwirakwiza ( SR3 ) | Imirimo yo guhanga, ibisubizo bigezweho | Ibivanze | Ashobora gukora ibintu birambuye neza - ashobora no guhimba ibidafite ishingiro, bityo… yego |
| Abakinnyi bakomeye mu mikino (mu buryo bwa DLSS/FSR) ( NVIDIA DLSS , AMD FSR 2 ) | Imikino n'uburyo bwo kuyikina mu gihe nyacyo | Bihujwe | Ikoresha amakuru y'ingendo n'ibyabanje kwigwa - gutsinda mu buryo bworoshye 🕹️ |
| Serivisi zo kongera ubushobozi bwa cloud | Ubworoherane, intsinzi zihuse | Kwishyura kuri buri ikoreshwa | Yihuta + ishobora kwaguka, ariko uhinduranya uburyo bwo kugenzura ndetse rimwe na rimwe n'ubuhanga |
| Abahanga mu bya AI bakomeye bibanda kuri videwo ( BasicVSR , Topaz Video ) | Amashusho ya kera, anime, ububiko | Yishyuwe | Amayeri y'igihe gito yo kugabanya ubwiza bw'amashusho + moderi zihariye |
| Kongera ikoranabuhanga rya telefoni/galeri "y'ubwenge" | Gukoresha ibintu bisanzwe | Harimo | Moderi zoroheje zakozwe kugira ngo zikore neza, ntabwo ari nziza cyane (ziracyari ingirakamaro) |
Gushushanya ukwemera gutangaje: "Paid-ish" ikora akazi kenshi muri iyo mbonerahamwe. Ariko urabyumva 😅
Ibanga rikomeye: abanyamideli biga ikarita kuva kuri resitora nto kugeza kuri resitora nini 🧠➡️🖼️
Ishingiro rya byinshi mu kongera ubushobozi bwa AI ni uburyo bwo kwigira bugenzurwa ( Image Super-Resolution Using Deep Convolutional Networks (SRCNN) ):
-
Tangira n'amashusho afite ubushobozi bwo hejuru ("ukuri")
-
Bahe urugero rw'ingero ntoya ("input")
-
Tegura icyitegererezo cyo kongera kubaka ubushobozi bwo kongera ubushobozi bw'umwimerere bwo kongera ubushobozi bw'amashanyarazi ukoresheje ubushobozi bwo hasi
Uko igihe kigenda gihita, icyitegererezo cyiga isano nk'iyi:
-
“Ubu bwoko bw'ibihushisho bikikije ijisho akenshi biba iby'amaso”
-
"Iyi pixel cluster ikunze kugaragaza inyandiko ya serif"
-
“Ubu buryo bwo kuzenguruka bumeze nk'umurongo wo hejuru y'inzu, ntabwo ari urusaku rutunguranye”
Ntabwo ari ugufata mu mutwe amashusho runaka (mu buryo bworoshye), ni ukwiga imiterere y'ibarurishamibare ( Deep Learning for Image Super-resolution: A Survey ). Tekereza nko kwiga ikibonezamvugo cy'imiterere n'impande. Si ikibonezamvugo cy'ubusizi, nk'… ikibonezamvugo cya IKEA 🪑📦 (ikigereranyo kidasobanutse, ariko cyegereye bihagije).
Ibinyobwa n'ibirungo: ibibaho mu gihe cyo kwemeza (iyo ugeze hejuru) ⚙️✨
Iyo wohereje ishusho mu ikoranabuhanga rya AI, ubusanzwe habaho inzira nk'iyi:
-
Gutegura mbere y'uko itunganywa
-
Hindura umwanya w'amabara (rimwe na rimwe)
-
Guhindura agaciro ka pikseli
-
Shyira ishusho mu duce duto niba ari nini (reba VRAM reality 😭) ( Real-ESRGAN repo (amahitamo ya tile) )
-
-
Gukuramo ibintu bishya
-
Ibice bya mbere by'inyuma bipima impande, inguni, n'imiterere y'aho ibintu biherereye
-
Uduce twimbitse tw’inyuma tumenya imiterere: imiterere, imiterere, ibice byo mu maso
-
-
Kubaka bundi bushya
-
Iyi moderi ikora ikarita y'imiterere ifite ubushobozi bwo hejuru
-
Hanyuma ibyo bigahindura umusaruro wa pixel nyayo
-
-
Nyuma yo gutunganya
-
Gukosora ku buryo bushoboka
-
Denoise idakenewe
-
Gukuraho ibihangano by'ubukorikori ku buryo butunguranye (guterana, guhagarara kw'inyuma, kuziba)
-
Ikintu kimwe kidasobanutse: ibikoresho byinshi bishyirwa mu matiles, hanyuma bigavanga imigozi. Ibikoresho byiza bihisha imbibi z'amatiles. Ibikoresho bya Meh bisiga ibimenyetso byoroheje by'urusobe rw'amatiles niba ubyitegereje. Kandi yego, uzabyitegereza, kuko abantu bakunda gusuzuma inenge ntoya kuri 300% nk'udusimba duto 🧌
Imiryango y'ingenzi y'icyitegererezo ikoreshwa mu kongera ubushobozi bwa AI (n'impamvu bumva batandukanye) 🤖📚
1) Uburyo bwo gukora ibintu bushingiye kuri CNN (uburyo busanzwe bwo gukora ibintu)
Imiyoboro y'ubwonko ya Convolutional ni myiza cyane ku miterere y'aho umuntu aherereye: impande, imiterere, imiterere mito ( Image Super-Resolution Using Deep Convolutional Networks (SRCNN) ).
-
Ibyiza: byihuse, bihamye, ibintu bike bitunguranye
-
Ibibi: bishobora kugaragara nk'aho "byatunganyijwe" gato iyo bisunitswe cyane
2) Gutera hejuru hakoreshejwe GAN (uburyo bwa ESRGAN) 🎭
GANs (Generative Adversarial Networks) zitoza icyuma gitanga amashusho kugira ngo gikore amashusho afite ubuziranenge buhanitse umuntu utandukanya abandi adashobora gutandukanya n'ay'ukuri ( Generative Adversarial Networks ).
-
Ibyiza: imiterere itangaje, imiterere itangaje
-
Ibibi: bashobora guhanga ibintu birambuye bitariho - rimwe na rimwe bitari byo, rimwe na rimwe bidasanzwe ( SRGAN , ESRGAN )
GAN ishobora kuguha ubwo bwenge butangaje. Ishobora kandi guha umuntu ufotora ifoto yawe indorerwamo nyinshi. Rero… hitamo intambara zawe 😬
3) Kuzamura urwego rw'impinduka (ikarita y'ubuhanga) 🌫️➡️🖼️
Uburyo bwo gukwirakwiza ibintu bugabanya urusaku intambwe ku yindi kandi bushobora kuyoborwa kugira ngo butange imiterere irambuye ( SR3 ).
-
Ibyiza: ishobora kuba nziza cyane mu gusobanura ibintu birambuye, cyane cyane ku mirimo yo guhanga
-
Ibibi: bishobora kuva ku mwirondoro/imiterere y'umwimerere iyo imiterere iteye ubwoba ( SR3 )
Aha niho "kongera ubushobozi" bitangira kuvanga no "kongera ubushobozi bwo gutekereza." Hari igihe ibyo ari byo wifuza. Hari igihe atari byo.
4) Kongera ubwiza bwa videwo mu buryo bw'igihe 🎞️
Gukoresha videwo mu kongera ubushobozi bwo gukora amashusho akenshi byongera uburyo bwo kumenya uko ibintu bigenda:
-
Ikoresha amafuremu yegeranye kugira ngo ihamye amakuru arambuye ( BasicVSR (CVPR 2021) )
-
Agerageza kwirinda ibintu bihindagurika kandi bikurura
-
Akenshi bihuza super-resolution na denoise na deinterlacing ( Topaz Video )
Niba kongera ubwiza bw'ishusho ari nko kugarura ishusho imwe, kongera ubwiza bw'amashusho ni nko kugarura igitabo cy'ishusho utiriwe uhindura izuru ry'umuntu buri rupapuro. Ibyo biragoye kurusha uko bisa.
Impamvu rimwe na rimwe kongera ubushobozi bwa AI bisa n'aho ari impimbano (n'uko wabibona) 👀🚩
Kuzamura imiterere y'ubuhanga bwa gihanga (AI) birananirwa kumenyekana. Umaze kumenya imiterere, uzabona ahantu hose, nko kugura imodoka nshya hanyuma ukumva iyo moderi kuri buri muhanda 😵💫
Ibivugwa bisanzwe:
-
Shyira uruhu rwa shashi ku maso (urusaku rwinshi cyane + koroshya)
-
Utuzu tw’imbere tw’impande (ahantu hazwi cyane nk’aho hakozwe cyane) ( Interpolation ya Bicubic )
-
Imiterere isubirwamo (inkuta z'amatafari ziba ibishushanyo byo gukoporora no gupakira)
-
Ishusho ntoya iteye ubwoba ivuga "algorithm"
-
Guhindura inyandiko aho inyuguti ziba hafi y'inyuguti (ubwoko bubi cyane)
-
Uburyo bwo guhindura ibintu burambuye aho ibintu bito bihinduka mu buryo butunguranye, cyane cyane mu mikorere y'ikwirakwizwa ( SR3 )
Igice kigoye: hari igihe ibi bihangano bisa "byiza" iyo ubyitegereje. Ubwonko bwawe bukunda ubuhanga. Ariko nyuma y'akanya gato, wumva ... nta cyo ushoboye.
Uburyo bwiza ni ugukora zoom out no kureba niba isa neza ku ntera isanzwe yo kureba. Niba isa neza gusa kuri zoom ya 400%, ntabwo ari intsinzi, ni ibintu byo kwishimisha 😅
Uburyo AI Upscaling ikora: uruhande rw'imyitozo, nta mutwe w'imibare 📉🙂
Guhugura abantu bafite ubushobozi bwo gukora imyitozo ngororamubiri (super-resolution models) akenshi bikubiyemo:
-
Amakuru yahujwe (inyongera ifite ubushobozi bwo hasi, intego ifite ubushobozi bwo hejuru) ( Image Super-Resolution ikoresha Deep Convolutional Networks (SRCNN) )
-
Imikorere y'igihombo ihana ivugurura ritari ryo ( SRGAN )
Ubwoko busanzwe bw'igihombo:
-
Gutakaza pixel (L1/L2)
Bitera imbaraga gukora neza. Bishobora gutanga ibisubizo byoroshye gato. -
Kubura ubushobozi bwo kubona
bigereranya ibintu byimbitse (nk'aho "ibi bisa ") aho kugereranya pixels nyazo ( Kubura ubushobozi bwo kubona (Johnson et al., 2016) ). -
Igihombo cy’abahanganye (GAN)
Gitera imbaraga mu kuba impamo, rimwe na rimwe ku giciro cyo gukoresha ukuri kw’ibintu uko biri ( SRGAN , Generative Adversarial Networks ).
Hariho intambara ihoraho:
-
Bigire ukuri ku bya mbere
vs. -
Bikore biryoshye cyane mu maso
Ibikoresho bitandukanye bihurira ahantu hatandukanye kuri ubwo buryo. Kandi ushobora guhitamo kimwe bitewe niba urimo gusubiza amafoto y'umuryango cyangwa gutegura poster aho "ubwiza" ari ingenzi kuruta ukuri kw'ubucamanza.
Imikorere ifatika: amafoto, scan za kera, anime, na videwo 📸🧾🎥
Amafoto (amafoto, imiterere y'ahantu nyaburanga, amafoto y'ibicuruzwa)
Ubusanzwe, uburyo bwiza bwo gukora ni ubu:
-
Uruhu rworoheje mbere na mbere (niba bikenewe)
-
Ifite imiterere ihamye kandi ihamye
-
Ongeramo ibinyampeke niba ibintu bisa neza cyane (yego, mu by'ukuri)
Ibinyampeke ni nk'umunyu. Ifunguro rya nimugoroba rirenze urugero, ariko nta na kimwe gishobora kuryoha gato 🍟
Guskana kwa kera n'amashusho acucitse cyane
Ibi biragoye kuko moderi ishobora gufata ibice byo gukandagira nk' "imiterere."
Gerageza:
-
Gukuraho cyangwa gukuraho ibisasu byakozwe n'abantu
-
Hanyuma igiciro cyo hejuru
-
Hanyuma gutyaza urumuri (ntabwo ari byinshi cyane… ndabizi, buri wese arabivuga, ariko aracyabivuga)
Anime n'ubuhanzi bw'imirongo
Ubuhanzi bw'umurongo bugira akamaro muri:
-
Ibyuma bibungabunga impande zisukuye
-
Kugabanya imiterere y'ibintu bidasanzwe
Gutera imiterere ya Anime bikunze kugaragara neza kuko imiterere yayo yoroshye kandi ihoraho. (Amahirwe ni uko).
Videwo
Videwo yongeraho intambwe z'inyongera:
-
Urusaku
-
Deinterlace (ku masoko amwe n'amwe)
-
Igipimo cyo hejuru
-
Gutunganya cyangwa gushimangira igihe gito ( BasicVSR (CVPR 2021) )
-
Gusubiramo ibinyampeke ku buryo bworoshye kugira ngo bihuzwe
Iyo urenze ku buryo buhoraho, uhita ubona ko ibintu byose bibengerana bihita bishira. Iyo ubibonye, ntushobora kubikuraho. Nk'intebe ishyushye mu cyumba gituje 😖
Guhitamo imikoreshereze nta gukeka cyane (urupapuro ruto rw'uburiganya) 🎛️😵💫
Dore imyumvire myiza yo gutangira:
-
Niba amasura asa n'ay'iplastike.
Gabanya urusaku, gabanya gutyaza, gerageza uburyo bwo kubungabunga isura. -
Niba imiterere isa cyane,
shyiramo utudomo duto two "gukosora amakuru arambuye" cyangwa "gusubiza amakuru arambuye", nyuma yo gukoresha utudomo duto. -
Niba impande zirimo urumuri
, reba uburyo bwo gukata inkombe. -
Niba ishusho isa cyane na "AI"
Gerageza gukomeza kugendera ku mahame. Hari igihe igikorwa cyiza kiba gito cyane.
Nanone: ntugakoreshe 8x nziza kuko ubishoboye. 2x cyangwa 4x nziza akenshi ni byo byiza. Nyuma y'ibyo, usaba modeli kwandika inkuru z'abafana kuri pikseli zawe 📖😂
Imyitwarire myiza, ukuri, n'ikibazo kitoroshye cy' "ukuri" 🧭😬
Kongera ubushobozi bwa AI bigabanya umurongo:
-
Gusubiza ibintu mu buryo bushya bisobanura kugarura ibyari bihari
-
Kongera bivuze kongeramo ibitari
Ku mafoto y'umuntu ku giti cye, akenshi biba byiza (kandi ni byiza). Ku bijyanye n'itangazamakuru, ibimenyetso by'amategeko, amashusho y'ubuvuzi, cyangwa ikindi kintu cyose aho ukuri ari ngombwa… ugomba kwitonda ( OSAC/NIST: Ubuyobozi Busanzwe bwo Gucunga Ishusho y'Ikoranabuhanga , Amabwiriza ya SWGDE yo Gusesengura Ishusho y'Ikoranabuhanga ).
Itegeko ryoroshye:
-
Niba hari ingaruka nyinshi, fata ko kongera ikoranabuhanga rya AI ari illustrative , atari ukugaragaza ko ari ingenzi.
Nanone, gutangaza amakuru ni ingenzi mu bijyanye n'umwuga. Si ukubera ko ubuhanga bwo gukora imibonano mpuzabitsina ari bubi, ahubwo ni ukubera ko abareba amakuru bakwiye kumenya niba amakuru yasubiwemo cyangwa yafashwe. Ibyo ni ... kubaha gusa.
Inyandiko zisoza n'incamake ngufi 🧡✅
Rero, Uburyo AI Upscaling ikora ni ubu: moderi ziga uburyo ibisobanuro birambuye bifitanye isano n'imiterere ifite ubushobozi bwo hasi, hanyuma zigateganya pixels z'inyongera zizewe mu gihe cyo kongera ubushobozi ( Deep Learning for Image Super-resolution: A Survey ). Bitewe n'umuryango w'icyitegererezo (CNN, GAN, diffusion, video-temporal), ubwo buhanuzi bushobora kuba ubw'ifatizo kandi bwizerwa… cyangwa bukagira ubutwari kandi rimwe na rimwe budafite aho buhuriye 😅
Incamake yihuse
-
Uburyo gakondo bwo kuzamura uburebure bwa pikseli ( Bicubic interpolation )
-
Kuzamura ubushobozi bwa AI bihanura ibisobanuro bibura hakoreshejwe imiterere yizwe ( Image Super-Resolution Using Deep Convolutional Networks (SRCNN) )
-
Ibisubizo byiza bituruka ku buryo bwiza bwo kwifata no kwirinda
-
Reba imiterere y'urumuri, isura isa n'ibisigazwa, imiterere isubiramo, n'impinduka muri videwo ( BasicVSR (CVPR 2021) )
-
Guteza imbere ibintu akenshi ni "uburyo bwo kongera kubaka ibintu bushoboka," ntabwo ari ukuri gutunganye ( SRGAN , ESRGAN )
Niba ubishaka, mbwire icyo urimo kongera ubwiza (amasura, amafoto ya kera, videwo, anime, gusesengura inyandiko), kandi ndakugira inama yo gushyiraho ingamba zigamije kwirinda ingorane zisanzwe zo "kureba neza" 🎯🙂
Ibibazo Bikunze Kubazwa
Kongera ubushobozi bwa AI n'uko ikora
Kuzamura imiterere y’ubuhanga mu bya siyansi (akenshi byitwa "super-resolution") byongera ubushobozi bw’ishusho binyuze mu guhanura ibisobanuro birambuye by’imiterere y’ubuhanga mu byakoreshejwe mu gihe cy’imyitozo. Aho kugira ngo habeho gusa pixels nka bicubic interpolation, moderi yiga impande, imiterere, amasura, n’imirongo isa n’inyandiko, hanyuma igatanga amakuru mashya ya pixels ahuye n’ayo mashusho yize. Ni "kugarura ukuri" cyane ahubwo ni "gutekereza ibintu bifatika" nk'ibisanzwe.
Kongera ingano ya AI ugereranije na bicubic cyangwa ihinduka rya gakondo
Uburyo gakondo bwo kongera uburebure (nk'ibicubic) ahanini buhuza hagati ya pikseli zisanzweho, bukoroshya impinduka zidakozwe mu buryo bushya. Gushyira uburebure bwa AI bigamije kongera imiterere ishoboka binyuze mu kumenya ibimenyetso bigaragara no guhanura uko verisiyo z'ibyo bimenyetso zigaragara cyane. Niyo mpamvu ibisubizo bya AI bishobora kumvikana neza cyane, ndetse n'impamvu bishobora kwinjiza ibintu bishya cyangwa "guhimba" ibisobanuro bitari mu isoko.
Impamvu amasura ashobora kugaragara nk'ibisigazwa cyangwa agasa neza cyane
Ubusanzwe amasura afite ibisigazwa biva mu gukurura urusaku no koroshya uruhu, bijyana no gukarisha imiterere yarwo isanzwe. Ibikoresho byinshi bivura urusaku n'imiterere myiza y'uruhu kimwe, bityo "gusukura" ishusho bishobora gusiba imyenge n'utundi duce duto. Uburyo busanzwe ni ukugabanya gukarisha no gukarisha, gukoresha uburyo bwo kubungabunga isura niba buhari, hanyuma ukongera gushyiramo akantu gato kugira ngo umusaruro ugaragare nk'uwa plastiki nkeya kandi ugaragare neza.
Ibikoresho bisanzwe byo kongera ubushobozi bwa AI byo kwitondera
Ibimenyetso bisanzwe birimo ibirahuri bikikije impande, imiterere isubirwamo (nk'amatafari yo gukoporora no gupakira), itandukaniro rito ry'inyuguti, n'inyandiko ihinduka "inyuguti hafi ya zose." Mu mikorere ishingiye ku gukwirakwiza, ushobora kandi kubona uburyo bwo gukurura amakuru aho ibintu bito bihinduka mu buryo butunguranye. Kuri videwo, uburyo bwo gukurura no gukurura amakuru ku mashusho ni ibimenyetso binini bitukura. Niba bisa neza gusa kuri zoom ikabije, imiterere ishobora kuba ikomeye cyane.
Uburyo GAN, CNN, n'abashinzwe iterambere ry'ikwirakwizwa ry'amakuru bakunda gutandukana mu musaruro
Uburyo bwa super-resolution bushingiye kuri CNN bukunze kuba buhamye kandi bushobora kwiteganwa, ariko bushobora kugaragara nk "bwatunganyijwe" iyo busunitswe cyane. Amahitamo ashingiye kuri GAN (ESRGAN-style) akunze gutanga imiterere itangaje n'ubuhanga bugaragara, ariko ashobora gutuma ibintu bitagenda neza, cyane cyane ku maso. Kuzamura imiterere bishingiye ku gukwirakwiza bishobora gutanga ibintu byiza kandi bishoboka, ariko bishobora kuva ku miterere y'umwimerere niba ubuyobozi cyangwa imbaraga bikomeye cyane.
Ingamba zifatika zo kwirinda isura "y'ubuhanga bwo gukora imibonano mpuzabitsina"
Tangira gukoresha uburyo bwo kuboneza urubyaro: 2× cyangwa 4× mbere yo kugera ku bintu bikomeye. Niba amasura asa n'ay'iplastike, shyira inyuma urusaku rworoshye hanyuma ukarishe hanyuma ugerageze uburyo bwo kumenya isura. Niba imiterere ibaye myinshi cyane, gabanya uburyo bwo kongeramo ibice hanyuma utekereze kongeramo uduce duto nyuma. Niba impande ziraka, gabanya uburyo bwo gukarishya hanyuma urebe ko hagaragara neza cyangwa hadakoreshejwe ibikoresho. Mu miyoboro myinshi, "hafi" intsinzi kuko irinda ukuri kw'ibintu.
Gufata amashusho ya scan ashaje cyangwa amashusho yashyizwemo JPEG nyinshi mbere yo kongera ubwiza
Amashusho apfunyitse aragoye kuko moderi zishobora gufata ibikoresho bya block nk'imiterere nyayo no kubikuza. Uburyo busanzwe bwo gukora ni ukubanza gukuraho cyangwa gukuraho ibikoresho bya artifact, hanyuma kongera uburebure, hanyuma gukarisha urumuri gusa iyo bikenewe. Ku bijyanye na scan, gusukura buhoro buhoro bishobora gufasha moderi kwibanda ku miterere nyayo aho kwibanda ku kwangirika. Intego ni ukugabanya "ibimenyetso by'imiterere y'impimbano" kugira ngo umuntu uzamuka adahatirwa gukekeranya yizeye bivuye ku bintu byumvikana.
Impamvu kongera ubwiza bwa videwo bigoye kurusha kongera ubwiza bwa videwo
Kuzamura amashusho bigomba kuba bihuye ku mashusho yose, atari byiza gusa ku ishusho imwe idahinduka. Iyo ibisobanuro bihindagurika biva ku mashusho bijya ku mashusho, ibisubizo bihita bihindagurika. Uburyo bwo kwibanda kuri videwo bukoresha amakuru y'igihe aturuka ku mashusho yegeranye kugira ngo bukomeze gusanwa no kwirinda ibintu bibengerana. Imikorere myinshi irimo kandi gukuramo urusaku, gukuramo inyuguti ku masoko amwe, no kongera gukoresha ibinyampeke ku buryo urukurikirane rwose ruhurirana aho kuba rutyaye.
Iyo kongera ikoranabuhanga rya AI bidakwiye cyangwa ari ibintu bishobora guteza akaga kwishingikirizaho
Kuzamura ubuhanga mu gukora isuzuma ry’ubukorano (AI) ni byiza ko bifatwa nk'inyongera, si ikimenyetso. Mu bihe bikomeye nko mu itangazamakuru, ibimenyetso by’amategeko, amashusho y’ubuvuzi, cyangwa imirimo yo mu rwego rw’ubugenzacyaha, gukora pixel "zizewe" bishobora kuyobya kuko bishobora kongeramo amakuru atari yafashwe. Uburyo bwiza bwo gukoresha filime ni ukuyikoresha mu buryo bw'ikigereranyo no kugaragaza ko inzira ya AI yongeye kubaka amakuru. Niba ukuri ari ingenzi, komeza inyandiko z’umwimerere kandi wandike buri ntambwe n’imiterere y’isesengura.
Amareferensi
-
arXiv - Kwiga byimbitse ku ishusho Super-resolution: Ubushakashatsi - arxiv.org
-
arXiv - Ishusho Ikomeye Ikoresha Imiyoboro Ifite Impinduka Zimbitse (SRCNN) - arxiv.org
-
arXiv - Real-ESRGAN - arxiv.org
-
arXiv - ESRGAN - arxiv.org
-
arXiv - SR3 - arxiv.org
-
NVIDIA Developer - NVIDIA DLSS - developer.nvidia.com
-
AMD GPUOpen - FidelityFX Super Resolution 2 - gpuopen.com
-
Umuryango wa Computer Vision Foundation (CVF) Ufunguye - BasicVSR: Gushakisha Ibice by'ingenzi muri Videwo Super-Resolution (CVPR 2021) - openaccess.thecvf.com
-
arXiv - Imiyoboro y'Abanzi Bakuru - arxiv.org
-
arXiv - SRGAN - arxiv.org
-
arXiv - Ibihombo byo mu buryo bw'imitekerereze (Johnson et al., 2016) - arxiv.org
-
GitHub - Real-ESRGAN repo (amahitamo y'amatafari) - github.com
-
Wikipedia - Interuro ya Bicubic - wikipedia.org
-
Labs za Topaz - Ifoto ya Topaz - topazlabs.com
-
Topaz Labs - Videwo ya Topaz - topazlabs.com
-
Ikigo cy'Ubufasha cya Adobe - Adobe Enhance > Super Resolution - helpx.adobe.com
-
NIST / OSAC - Ubuyobozi Busanzwe bwo Gucunga Ishusho y'Ikoranabuhanga mu by'Ubushakashatsi (Verisiyo ya 1.0) - nist.gov
-
SWGDE - Amabwiriza yo gusesengura amashusho y’ubushakashatsi - swgde.org