Ukukopa kuquka ukuzukiswa ngeengcamango, amazwi, okanye imifanekiso yomnye umntu, nto leyo eqwalaselwayo engekho mthethweni kwiindawo zemfundo kunye nezobugcisa. Isenokungaqatshelwa ngabafundi abanokuthi ngempazamo baphinde baphinde bachaze amagama omnye umntu ngaphandle kokuchazwa kakuhle. Ekubeni iimpawu zocaphulo zingasetyenziswa xa into ichazwa ngamanye amazwi, inokusinda ngokulula kumfundi ohlola iimpazamo ize idlulele kuyilo lokugqibela. Nangona kunjalo, ayifezeki ngokupheleleyo, ngakumbi kuba abahloli bokukopa bafumanisa ukuchazwa ngokufanelekileyo ngakumbi kule mihla.
Ukukhangela amabinzana amagama kunokuba ngumsebenzi onzima, njengoko kubandakanya ukuchonga ukufana nomahluko phakathi kweetekisi. Kula macandelo alandelayo, siza kuphonononga kwingxoxo ebanzi malunga neendlela eziqhelekileyo kunye nobuchule obusetyenzisiweyo ukuqonda iimeko zokuchaza amagama.
Bakubona njani abahloli bokukopa ukukopa: Iindlela ezifanelekileyo eziphononongwayo
Kwimeko yemfundo yanamhlanje, abakhangeli bokukopa baye bahambela phambili ngakumbi, begqitha ngaphaya kokubonisa kuphela umbhalo okhutshelweyo ukufumanisa umxholo ocandiweyo. Eli nqaku liphonononga iindlela ezivumela ezi zixhobo ukuba zichonge ngokufanelekileyo ukuphinda-phinda amagama.
1. Ukuthelekisa umtya
Le ndlela ibandakanya ukuthelekisa izicatshulwa kwinqanaba lomlinganiswa okanye igama ukuze kuchongwe eyona nto ihambelanayo. Iqondo eliphezulu lokufana kulandelelwano lwabalinganiswa okanye kukhetho lwamagama phakathi kweetekisi ezibini lunokuba luphawu lokutolika amagama. Ezi zixhobo zisebenzisa i-algorithms entsonkothileyo enokuthi ithathele ingqalelo intsingiselo yentsingiselo yamagama, iyenze kube nzima ngakumbi ukuba izinto ezikopayo nezicandiweyo zingabhaqwa.
2. Ukufana kweCosine
Ukufana kweCosine yenye yeendlela apho abakhangeli bokukopa bafumanisa ukucalulwa. Ilinganisa ukufana phakathi kweetekisi ezimbini ezisekelwe kwi-angle phakathi kokubonakaliswa kwe-vector kwindawo ephezulu. Ngokumela izicatshulwa njengeevekhtha zezandi zamagama okanye ezizifakelweyo, ezi zixhobo zinokubala amanqaku afanayo e-cosine ukucokisa ngakumbi isakhono sazo sokubona umxholo ocandiweyo.
3. Iimodeli zolungelelwaniso lwamagama
Le mifuziselo ilungelelanisa amagama okanye amabinzana phakathi kweetekisi ezimbini ukuze zichonge iimbalelwano zazo. Ngokuthelekisa amacandelo alungelelanisiweyo, unokubona i-paraphrase esekelwe kwizinto ezifanayo kunye nokwahluka kolandelelwano oluhambelanayo.
4. Uhlalutyo lwesemantic
Le ndlela ibandakanya ukuhlalutya intsingiselo kunye nomxholo wamagama namabinzana kwiitekisi. Ubuchwephesha obufana nohlalutyo olufihlakeleyo lwesemantic (LSA), ukufakwa kwamagama (afana ne-Word2Vec okanye iGloVe), okanye iimodeli zokufunda nzulu njenge-BERT zinokubamba unxulumano lwe-semantic phakathi kwamagama kunye nokuchonga ukuphinda-phinda okusekwe ekufanisweni kwenkcazelo yazo yentsingiselo.
5. Ukufunda ngomatshini
I-algorithms yokufunda koomatshini egadiweyo inokuqeqeshwa kwiiseti zedatha ezilebhile zemibhalo eguqulelweyo nengachazwanga ngababini. Le mifuziselo inokufunda iipatheni kunye neempawu ezahlula amabinzana amagama kwaye zinokusetyenziselwa ukuhlela iimeko ezitsha zesicatshulwa njengoko zicazululwe okanye hayi.
6. Uhlalutyo lwe-N-gram
Ii-N-grams ngamaqela amagama asondeleleneyo. Xa ujonga ukuba la maqela avela kangaphi kwiitekisi ezahlukeneyo kwaye uwathelekise, unokufumana amabinzana afanayo okanye ulandelelwano. Ukuba kukho iipateni ezininzi ezifanayo, oko kunokuthetha ukuba isicatshulwa sisenokuba sicazululwe ngokwahlukileyo.
7. Kufuphi ukubhaqwa okuphindwe kabini
Indlela yokugqibela yokuba abahloli bokukopa babone ukuguqulela ngokufanelekileyo.
I-algorithms yobhaqo ekufutshane nephindwayo isoloko isetyenziswa ekubhaqweni ngokuchaza amagama ukuze kuchongwe amacandelo okubhaliweyo abonisa umgangatho ophezulu wokufana okanye aphantse afane. Ezi algorithms ziyilwe ngokukodwa ukuqaphela umxholo ocatshangelweyo ngokuthelekisa ukufana kwesicatshulwa kwinqanaba elineenkcukacha.
Yeyiphi indlela edla ngokusetyenziswa yisoftware yokuthintela ukukopa?
Izisombululo zobuchwepheshe ezisetyenziswa ziinkonzo zokuthintela ukukopa zixhomekeke kuhlalutyo lwe-n-gram. Ngokusebenzisa itekhnoloji esekwe kwi-n-gram, ezi nkonzo zifikelela kwinqanaba eliphezulu lokuchaneka. Le yenye yezona ndlela zilungileyo abakhangeli bokukopa bafumanisa ukuguqulelwa kwamagama, okwenza ukuba kuchongwe kwaye kuqaqambise amagama kanye abhalwe ngokutsha.
Iimechanics zendlela abakhangeli bokukopa bafumanisa ngayo ukucalulwa
Iinkonzo zokuthintela ukukopa zikholisa ukusebenzisa ubuchule bokuprinta iminwe ukuthelekisa amaxwebhu. Oku kubandakanya ukutsalwa kwee-n-grams eziyimfuneko kumaxwebhu ukuze angqinisiswe kwaye kuthelekiswe nee-n-grams zawo onke amaxwebhu akwii-database zabo.
umzekelo
Masithi kukho isivakalisi: « Le mont Olympe est la plus haute montagne de Grèce. »
The n-iigram (umzekelo 3-grams) kwesi sivakalisi siya kuba:
- Le mont Olympe
- iMont Olympe est
- Olympe est la
- lelona
- la plus haute
- intaba ephakamileyo
- haute montagne de
- montagne de Grece
Ityala 1. Ukutshintshwa
Ukuba igama lifakwe endaweni yelinye igama, kusekho ezinye ze n-iigram Tshatisa kwaye kuyenzeka ukuba kubonwe indawo yegama ngohlalutyo olongezelelweyo.
Isivakalisi esitshintshiweyo: "I Intaba Olympe est la plus haute montagne de Péloponnèse. »
| I-3-grams yokuqala | I-3-grams yombhalo otshintshileyo |
| Le mont Olympe iMont Olympe est Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de montagne de Grece | Le Intaba Olympus Intaba Olympe est Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de Montagne de Péloponnèse |
Ityala lesi-2. Ukutshintsha ulandelelwano lwamagama (okanye izivakalisi, imihlathi)
Xa ulandelelwano lwesivakalisi lutshintshiwe, kusekho ezinye iigram ezi-3 ezihambelanayo ngoko kunokwenzeka ukufumanisa utshintsho.
Isivakalisi esitshintshiweyo: « La plus haute montagne de Grèce est Le mont Olympe. »
| I-3-grams yokuqala | I-3-grams yombhalo otshintshileyo |
| Le mont Olympe iMont Olympe est Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de montagne de Grece | La plus haute intaba ephakamileyo haute montagne de montagne de Grece de Grece est UGrece est Le est Le monti Le mont Olympe |
Ityala lesi-3. Kongezwe amagama amatsha
Xa amagama amatsha ongeziweyo, kusekho ezinye iigram ezi-3 ezihambelanayo ukuze ukwazi ukubona utshintsho.
Isivakalisi esitshintshiweyo: « Le mont Olympe est kude la plus haute montagne de Grèce. »
| I-3-grams yokuqala | I-3-grams yombhalo otshintshileyo |
| Le mont Olympe iMont Olympe est Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de montagne de Grece | Le mont Olympe iMont Olympe est Olympe est de kukude kude lee hayi plus la plus haute intaba ephakamileyo haute montagne de montagne de Grece |
Ityala 4. Kucinywe amagama athile
Xa igama lisusiwe, kusekho ezinye iigram ezi-3 ezihambelanayo ngoko kunokwenzeka ukuqaphela utshintsho.
Isivakalisi esitshintshiweyo: « L'Olympe est la plus haute montagne de Grèce. »
| I-3-grams yokuqala | I-3-grams yombhalo otshintshileyo |
| Le mont Olympe iMont Olympe est Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de montagne de Grece | L'Olympe est la lelona la plus haute intaba ephakamileyo haute montagne de montagne de Grece |
Umzekelo wehlabathi lokwenyani
Ekugqityweni kokuqinisekiswa kolu xwebhu lokwenene, amacandelo acazululiweyo asoloko achongwa ngokuphawula okuphazamisekileyo. Ezi ziphazamiso, ezibonisa amagama atshintshileyo, ziqaqambile ukuze kuphuculwe ukubonakala kunye nomahluko.
Ngezantsi, uya kufumana umzekelo woxwebhu lokwenyani.
- Isicatshulwa sokuqala sivela kwifayile eqinisekisiweyo ngokusebenzisa i OXSICO inkonzo yokuthintela ukukopa:
- Isicatshulwa sesibini sivela kuxwebhu lwemvelaphi yoqobo:
Emva kohlalutyo olunzulu kuyacaca ukuba inxalenye ekhethiweyo yoxwebhu yacaciswa ngokwenza olu tshintsho lulandelayo:
| Umbhalo wokuqala | Isicatshulwa esishwankathelweyo | utshintsho |
| ixhasa inguqulelo ikwaphawulwe | isekela up innovation ngaphandle kokuchazwa | Ukutshintshwa |
| ulwazi lwezoqoqosho nezentlalo, iinkqubo ezisebenzayo | ulwazi lwezoqoqosho kunye noluntu, umbutho osebenzayo | Ukutshintshwa |
| izindululo (iingcamango) | ngcebiso | Ukutshintshwa, ukucinywa |
| zengqondo | zithuba | Ukutshintshwa |
| impumelelo | winner | Ukutshintshwa |
| inkqubo (Perenc, Holub-Ivan | inkqubo yokuqonda (Perenc, Holub – Ivan | Ukongeza |
| ipro-innovation | sisihle | Ukutshintshwa |
| ukudala imozulu | : ukudala imeko | Ukutshintshwa |
| sisihle | yimpumelelo | Ukutshintshwa |
| ukuphuhlisa ulwazi | ulwazi lophuhliso | Ukutshintshwa |
isiphelo
| Ukukopa, okuhlala kungaqatshelwa kwiimeko zokwenziwa ngamabinzana amagama, kuhlala kuyinkxalabo ebalulekileyo kwizifundiswa. Inkqubela phambili yezobuchwephesha ixhobise abahloli bokukopa ngesakhono sokuchonga umxholo ocazululweyo. Ngokukodwa, abahloli bokukopa babona ukuguqulelwa ngeendlela ezahlukeneyo njengokuthelekisa umtya, ukufana kwecosine, kunye nohlalutyo lwe-n-gram. Ngokucacileyo, uhlalutyo lwe-n-gram lubalasele kwireyithi ephezulu yokuchaneka kwayo. Oku kuhambela phambili kunciphisa kakhulu amathuba okuba izinto ezichwechwelweyo nezicaciswe ngamabinzana amagama zingabhaqwa, nto leyo eyandisa imfezeko ezifundweni. |
