Ukukopela kuhlanganisa ukutusa ngemibono yomunye umuntu, amagama, noma izithombe, umkhuba ocatshangwayo okungenangqondo ezindaweni zezemfundo nezomsebenzi. Kungabonwa abafundi abangahle baphinde babize amagama omunye umuntu ngephutha ngaphandle kokuchaza okufanelekile. Njengoba izimpawu ezicashuniwe zingasetshenziswa lapho kushiwo okuthile, kungaphunyuka kalula ekubambeni komhloli futhi kudlulele ohlakeni lokugcina. Kodwa-ke, akufezeki ngokuphelele, ikakhulukazi njengoba abahloli bokukopela bathola ukuchazwa ngamagama ngendlela ephumelela kakhulu kulezi zinsuku.
Ukuthola ukuphimisela ngamagama kungaba umsebenzi oyinselele, njengoba kuhlanganisa ukuhlonza ukufana nomehluko phakathi kwamathekisthi. Ezigabeni ezilandelayo, sizongena engxoxweni ebanzi mayelana nezindlela ezivamile nezindlela ezisetshenziswayo ukuze kuhlungwe izimo zokubeka ngamafuphi.
Abahloli bokukopela bakuthola kanjani ukuphimisela: Izindlela ezifanele zihloliwe
Esimeni semfundo sanamuhla, abahloli bokukopela bathuthuke kakhulu, bedlula kuphela ukuhlaba umkhosi umbhalo okopishiwe futhi nokuthola okuqukethwe okuchazwe ngenye indlela. Lesi sihloko sihlola izindlela ezivumela lawa mathuluzi ukuhlonza ngempumelelo ukuphimisela amagama.
1. Ukufanisa intambo
Le ndlela ihlanganisa ukuqhathanisa imibhalo ezingeni lomlingiswa noma igama ukuze ukhombe ukufana ncamashi. Izinga eliphezulu lokufana ngokulandelana kwezinhlamvu noma ukukhethwa kwamagama phakathi kwamatheksthi amabili kungabonisa ukuphimisela. Lawa mathuluzi asebenzisa ama-algorithms ayinkimbinkimbi angacabangela ngisho nencazelo yomongo yamagama, akwenze kube nzima nakakhulu ukuthi izinto ezikopishiwe, ezishiwo ngamagama zingabonwa.
2. Ukufana kwe-cosine
Ukufana kwe-cosine kungenye yezindlela lapho abahloli bokukopela bathola ukuphimisela. Ilinganisa ukufana phakathi kwemibhalo emibili ngokusekelwe ku-engeli phakathi kwezethulo zabo ze-vector endaweni enobukhulu obuphezulu. Ngokumela imibhalo njengamavekhtha wamafrikhwensi egama noma ashumekiwe, lawa mathuluzi angakwazi ukubala amaphuzu afanayo we-cosine ukuze athuthukise ikhono lawo lokuthola okuqukethwe okuchazwe ngenye indlela.
3. Amamodeli wokuqondanisa amagama
Lawa mamodeli aqondanisa amagama noma imishwana phakathi kwemibhalo emibili ukuze kubonakale ukuxhumana kwawo. Ngokuqhathanisa amasegimenti aqondanisiwe, ungathola ukuphimisela ngokusekelwe ekufaneni nasekuhlukeni ekulandeleni okufanisiwe.
4. Ukuhlaziywa kwe-semantic
Le ndlela yokusebenza ibandakanya ukuhlaziya incazelo nesimo samagama nemisho emibhalweni. Amasu afana nokuhlaziya okucashile kwe-semantic (LSA), ukushumeka kwamagama (okufana ne-Word2Vec noma i-GloVe), noma amamodeli okufunda ajulile afana ne-BERT angakwazi ukuthwebula ubudlelwano be-semantic phakathi kwamagama futhi akhombe ukuphimisela okusekelwe ekufanisweni kwezethulo zawo ze-semantic.
I-5. Ukufunda ngomshini
Ama-algorithms okufunda komshini ogadiwe angaqeqeshwa kumasethi edatha alebulwe wamapheya abekwe ngamagama nangacaciswanga emibhalo. Lawa mamodeli angafunda amaphethini nezici ezihlukanisa izimiselo futhi zingasetshenziswa ukuhlukanisa izimo ezintsha zombhalo njengezicaciswe ngamagama noma cha.
6. Ukuhlaziywa kwe-N-gram
Ama-N-grams amaqoqo amagama aseduze kwelinye. Uma uhlola ukuthi la maqembu avela kangaki emibhalweni ehlukene bese uwaqhathanisa, ungathola imishwana efanayo noma ukulandelana. Uma kunamaphethini amaningi afanayo, kungasho ukuthi umbhalo kungenzeka ukuthi uhunyushwe ngamagama.
7. Eduze kokutholwa kwempinda
Indlela yokugcina lapho abahloli bokukopela bathola ukuphimisela kahle.
Ama-algorithms okuthola okuseduze kwempinda avame ukusetshenziswa ekutholeni amagama ambalwa ukuze akhombe amasegimenti ombhalo abonisa izinga eliphezulu lokufana noma acishe afane. Lawa ma-algorithms enziwe ngokukhethekile ukuze abone okuqukethwe okuchazwe ngamagama ngokuqhathanisa ukufana kombhalo ezingeni elinemininingwane.
Iyiphi indlela evame ukusetshenziswa yisoftware yokuvimbela ukukopela?
Izixazululo zobuchwepheshe ezisetshenziswa izinsiza zokuvimbela ukukopela ngokuvamile zincike ekuhlaziyweni kwe-n-gram. Ngokusebenzisa ubuchwepheshe obusekelwe ku-n-gram, lawa masevisi afinyelela izinga lokunemba eliphezulu ngokumangalisayo. Lena enye yezindlela ezingcono kakhulu abahloli bokukopela bathola ukuphimisela, okuvumela ukukhonjwa nokugqanyiswa kwamagama okuyiwona abhalwe kabusha.
Amamechanics wokuthi abahloli bokukopela bakuthola kanjani ukuphimisela
Izinsizakalo zokuvimbela ukukopa ngokuvamile zisebenzisa inqubo yokunyathelisa iminwe ukuze iqhathanise amadokhumenti. Lokhu kuhilela ukukhipha ama-n-gram adingekayo kumadokhumenti ukuze aqinisekiswe futhi aqhathaniswe nama-n-grams awo wonke amadokhumenti kusizindalwazi sawo.
Isibonelo
Ake sithi kunomusho: « Le mont Olympe est la plus haute montagne de Grèce. »
The n-amagremu (ngokwesibonelo, amagremu ama-3) kulo musho kuzoba:
- Le mont Olympe
- i-Mont Olympe est
- Olympe est la
- yikho okuningi
- la plus haute
- intaba ephakeme kakhulu
- haute montagne de
- i-montagne de Grece
Icala 1. Ukushintshwa
Uma igama lithathelwa indawo elinye igama, namanje amanye amagama n-amagremu fanisa futhi kungenzeka ukuthola ukushintshwa kwegama ngokuhlaziywa okwengeziwe.
Umusho oshintshiwe: "The entabeni I-Olympe est la plus haute montagne de I-Péloponnèse. "
| Original 3-amagremu | 3-amagremu wombhalo oshintshiwe |
| Le mont Olympe i-Mont Olympe est Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece | Le entabeni Olympus entabeni Olympe est Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de I-Montagne de I-Péloponnèse |
Icala 2. Kushintshwe ukuhleleka kwamagama (noma imisho, izigaba)
Lapho ukuhleleka komusho kushintshiwe, amanye ama-3-grams afanayo ngakho-ke kungenzeka ukubona ushintsho.
Umusho oshintshiwe: « La plus haute montagne de Grèce est Le mont Olympe. »
| Original 3-amagremu | 3-amagremu wombhalo oshintshiwe |
| Le mont Olympe i-Mont Olympe est Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece | La plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece de Grece est Grece est Le est Le mont Le mont Olympe |
Icala 3. Kwengezwe amagama amasha
Lapho amagama amasha engezwa, asekhona ama-3-gram afanayo ngakho-ke kuyenzeka ukuthi kutholakale ushintsho.
Umusho oshintshiwe: « Le mont Olympe est kusukela kude la plus haute montagne de Grèce. »
| Original 3-amagremu | 3-amagremu wombhalo oshintshiwe |
| Le mont Olympe i-Mont Olympe est Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece | Le mont Olympe i-Mont Olympe est Olympe est de kude kakhulu kude kakhulu lala plus la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece |
Icala 4. Ususe amagama athile
Lapho igama lisusiwe, kusekhona ama-3-grams afanayo ngakho-ke kungenzeka ukubona ushintsho.
Umusho oshintshiwe: « I-L'Olympe est la plus haute montagne de Grèce. »
| Original 3-amagremu | 3-amagremu wombhalo oshintshiwe |
| Le mont Olympe i-Mont Olympe est Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece | I-L'Olympe est la yikho okuningi la plus haute intaba ephakeme kakhulu haute montagne de i-montagne de Grece |
Isibonelo somhlaba wangempela
Lapho kuqedwa ukuqinisekiswa kudokhumenti langempela, izigaba ezishiwo ngamagama zivame ukuhlonzwa ngokumaka okuphazanyiswe. Lezi ziphazamiso, ezisho amagama ashintshiwe, zigqanyiswa ukuze kuthuthukiswe ukubonakala nokwehlukanisa.
Ngezansi, uzothola isibonelo sedokhumenti yangempela.
- Ingcaphuno yokuqala ivela efayeleni eliye laqinisekiswa kusetshenziswa ifayela le OXSICO isevisi yokuvimbela ukukopela:
- Ingcaphuno yesibili ivela kumbhalo womthombo wokuqala:
Ngemva kokuhlaziya okujulile kuyacaca ukuthi ingxenye ekhethiwe yombhalo ibekwe ngamafuphi ngokwenza izinguquko ezilandelayo:
| Umbhalo woqobo | Umbhalo ochazwe ngenye indlela | Izinguquko |
| isekela emisha futhi libhekene | isekela ukuqamba okusha ngaphandle kokuchazwa | Ukufaka esikhundleni |
| ulwazi lwezomnotho nezenhlalo, izinhlelo ezisebenzayo | ukuqwashisa ngezomnotho kanye nomphakathi, inhlangano ephumelelayo | Ukufaka esikhundleni |
| iziphakamiso (imibono) | isincomo | Ukushintsha, ukususwa |
| isimo sengqondo | ukuma | Ukufaka esikhundleni |
| impumelelo | Winner | Ukufaka esikhundleni |
| inqubo (Perenc, Holub-Ivan | inqubo yokuqonda (Perenc, Holub – Ivan | Ukwengezwa |
| i-pro-innovation | evumayo | Ukufaka esikhundleni |
| ukudala isimo sezulu | : ukudala isimo | Ukufaka esikhundleni |
| evumayo | ukuchuma | Ukufaka esikhundleni |
| ukuthuthukisa ulwazi | ukuqwashisa ngentuthuko | Ukufaka esikhundleni |
Isiphetho
| Ukukopa, okuvamise ukungabonakali lapho kuchazwa amagama ngamafuphi, kuseyinkinga enkulu ezifundweni. Ukuthuthuka kwezobuchwepheshe kuhlomise abahloli bokukopela ngekhono lokuhlonza ngempumelelo okuqukethwe okuchazwe ngamagama athile. Ngokukhethekile, abahloli bokukopela bathola ukuphimisela ngezindlela ezahlukahlukene njengokufanisa izintambo, ukufana kwe-cosine, nokuhlaziywa kwe-n-gram. Ngokuphawulekayo, ukuhlaziywa kwe-n-gram kuvelele ngezinga lakho eliphezulu lokunemba. Lezi ntuthuko zinciphisa kakhulu amathuba okuba izinto ezikopishiwe nezishiwo ngamagama zingabonwa, ngaleyo ndlela kuthuthukisa ubuqotho ezifundweni. |
