Kubera kumaphatikizapo kutamandidwa chifukwa cha malingaliro, mawu, kapena zithunzi za wina, zomwe zimaganiziridwa zopanda pake m'malo ophunzirira ndi akatswiri. Zitha kuzindikirika ndi ophunzira omwe amatha kubwereza mwangozi mawu a munthu wina popanda kutchulidwa koyenera. Popeza kuti zizindikiro zogwira mawu sizigwiritsiridwa ntchito pamene chinthu china chikanenedwa, chingathe kuthaŵa mosavuta kwa woŵerenga ndi kuloŵa m’ndondomeko yomaliza. Komabe, sizokayikitsa kwenikweni, makamaka popeza ofufuza akuwonetsa kuti akumasulira bwino masiku ano.
Kuzindikira mawu ofotokozera kungakhale ntchito yovuta, chifukwa kumaphatikizapo kuzindikira kufanana ndi kusiyana pakati pa malemba. M'zigawo zotsatila, tidzakambitsirana mwatsatanetsatane za njira zodziwika bwino komanso njira zomwe zimagwiritsidwa ntchito pozindikira nthawi zofotokozera.
Kodi ofufuza akuba amazindikira bwanji mawu ofotokozera: Njira zoyenera zofufuzidwa
M'maphunziro amasiku ano, zofufuza zachinyengo zapita patsogolo kwambiri, kupitilira kungolemba zolemba zomwe zidakopedwa kuti zizindikire zomwe zafotokozedwa m'mawu. Nkhaniyi ikuyang'ana njira zomwe zimathandizira zida izi kuti zizindikire bwino mawu ofotokozera.
1. Kufananiza zingwe
Njira imeneyi imaphatikizapo kuyerekezera malemba pamlingo wa munthu kapena mawu kuti atchule mafananidwe enieni. Kufanana kwakukulu kwa katsatidwe ka zilembo kapena kusankha mawu pakati pa ndime ziwiri kumatha kuwonetsa kumasulira. Zida zimenezi zimagwiritsa ntchito ma algorithms ovuta kwambiri omwe amatha kuganiziranso tanthauzo la mawu, zomwe zimapangitsa kuti zikhale zovuta kwambiri kuti zinthu zongopeka komanso zongolembedwa zikhale zovuta kuzizindikira.
2. Kufanana kwa cosine
Kufanana kwa Cosine ndi imodzi mwa njira zomwe ofufuza achinyengo amazindikira kutanthauzira. Imayesa kufanana pakati pa malemba awiri potengera ngodya pakati pa ma vector awo mu malo apamwamba kwambiri. Poyimira malemba ngati ma vector a mawu afupipafupi kapena ophatikizika, zida izi zitha kuwerengera kufanana kwa cosine kuti ziwongolere luso lawo lozindikira zomwe mwamasulira.
3. Zitsanzo za kuyanjanitsa mawu
Zitsanzozi zimagwirizanitsa mawu kapena ziganizo pakati pa malemba awiri kuti azindikire makalata awo. Poyerekeza zigawo zofananira, mutha kuzindikira zofotokozera motengera kufanana ndi kusiyana kwamayendedwe ofananira.
4. Kusanthula kwa Semantic
Njira imeneyi imaphatikizapo kupenda tanthauzo ndi nkhani ya mawu ndi ziganizo m'malemba. Njira monga latent semantic analysis (LSA), zoikamo mawu (monga Word2Vec kapena GloVe), kapena zitsanzo zakuya zophunzirira monga BERT zimatha kujambula maulalo a semantic pakati pa mawu ndikuzindikira mafotokozedwe potengera kufanana kwa mafotokozedwe awo.
5. Kuphunzira Machine
Ma aligorivimu oyang'aniridwa a makina ophunzirira amatha kuphunzitsidwa pamaseti olembedwa a malemba awiriawiri ofotokozera komanso osafotokozera. Zitsanzozi zimatha kuphunzira machitidwe ndi mawonekedwe omwe amasiyanitsa mawu ofotokozera ndipo atha kugwiritsidwa ntchito kugawira zochitika zatsopano zamawu ngati omasuliridwa kapena ayi.
6. Kusanthula kwa N-gram
N-grams ndi magulu a mawu omwe ali pafupi ndi mzake. Mukawona kuti maguluwa amawonekera kangati m'malemba osiyanasiyana ndikufananiza, mutha kupeza mawu ofanana kapena kutsatizana. Ngati pali mitundu yambiri yofananira, zitha kutanthauza kuti mawuwo adangofotokozedwa momveka bwino.
7. Kuzindikira kobwerezabwereza
Njira yomaliza yomwe ofufuza a plagiarism amazindikira kutanthauzira bwino.
Ma algorithms ozindikira pafupi ndi chibwereza nthawi zambiri amagwiritsidwa ntchito pozindikira m'mawu kuti aloze zigawo zomwe zimawonetsa kufanana kwakukulu kapena pafupifupi zofanana. Ma algorithms awa amapangidwa makamaka kuti azindikire zomwe zafotokozedwa poyerekeza kufanana kwa mawu pamlingo watsatanetsatane.
Ndi njira iti yomwe nthawi zambiri imagwiritsidwa ntchito ndi mapulogalamu oletsa kubera?
Mayankho aukadaulo omwe amagwiritsidwa ntchito ndi akatswiri oletsa kubera amadalira kusanthula kwa n-gram. Pogwiritsa ntchito ukadaulo wopangidwa ndi n-gram, mautumikiwa amafika pamlingo wolondola kwambiri. Imeneyi ndi imodzi mwa njira zabwino kwambiri zowunikira zowunikira kuti zizindikire kutanthauzira, zomwe zimathandizira kuzindikira ndikuwonetsa mawu enieni omwe adalembedwanso.
Makina amomwe ofufuza akuba amazindikira kutanthauzira
Ntchito zoletsa kukopa anthu nthawi zambiri zimagwiritsa ntchito njira yolembera zala kufananiza zikalata. Izi zikuphatikizapo kuchotsa ma n-grams ofunikira kuchokera m'malemba kuti atsimikizidwe ndi kuwafanizira ndi ma n-grams a zolemba zonse zomwe zili m'mabuku awo.
Mwachitsanzo
Tiyerekeze kuti pali sentensi: « Le mont Olympe est la plus haute montagne de Grèce. »
The n gm (mwachitsanzo, 3 g) mwa chiganizo ichi adzakhala:
- Le monte Olympe
- Mont Olympe est
- Olympe est la
- ndipamwamba kwambiri
- la plus haute
- phiri lalitali kwambiri
- haute montagne de
- montagne de Grece
Mlandu 1. Kusintha
Ngati mawuwo asinthidwa ndi mawu ena, ena a n gm match ndipo ndizotheka kuzindikira kusintha kwa mawuwo ndikuwunikanso.
Chiganizo chosinthidwa: "The phiri Olympe est la plus haute montagne de Péloponnèse. »
| 3 magalamu oyambirira | 3-gramu ya mawu osinthidwa |
| Le monte Olympe Mont Olympe est Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece | Le phiri Olympus phiri Olympe est Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de Montagne de Péloponnèse |
Mlandu 2. Anasintha masanjidwe a mawu (kapena ziganizo, ndime)
Pamene dongosolo la chiganizo lisinthidwa, komabe ma 3-grams amafanana kotero kuti n'zotheka kuzindikira kusintha.
Chiganizo chosinthidwa: « La plus haute montagne de Grèce est Le mont Olympe. »
| 3 magalamu oyambirira | 3-gramu ya mawu osinthidwa |
| Le monte Olympe Mont Olympe est Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece | La plus haute phiri lalitali kwambiri haute montagne de montagne de Grece de Grece est Grece est Le ndi Le mont Le monte Olympe |
Mlandu 3. Anawonjezera mawu atsopano
Mawu atsopanowo akawonjezedwa, pamakhalabe ma 3-grams omwe amagwirizana kotero kuti ndizotheka kuzindikira kusintha.
Chiganizo chosinthidwa: « Le mont Olympe est kuchokera kutali la plus haute montagne de Grèce. »
| 3 magalamu oyambirira | 3-gramu ya mawu osinthidwa |
| Le monte Olympe Mont Olympe est Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece | Le monte Olympe Mont Olympe est Olympe est de ndi loin kutali ndi plus la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece |
Mlandu 4. Adachotsa mawu ena
Mawuwo akachotsedwa, pamakhalabe ma 3-grams omwe amafanana kotero ndizotheka kuzindikira kusintha.
Chiganizo chosinthidwa: « L'Olympe est la plus haute montagne de Grèce. »
| 3 magalamu oyambirira | 3-gramu ya mawu osinthidwa |
| Le monte Olympe Mont Olympe est Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece | L'Olympe est la ndipamwamba kwambiri la plus haute phiri lalitali kwambiri haute montagne de montagne de Grece |
Chitsanzo chenicheni
Mukamaliza kutsimikizira mu chikalata chenicheni, magawo ofotokozera nthawi zambiri amadziwikiratu kudzera muzolemba zododometsa. Zosokoneza izi, kutanthauza mawu osinthidwa, zimawunikiridwa kuti ziwonjezeke kuwoneka ndi kusiyanitsa.
Pansipa, mupeza chitsanzo cha chikalata chenicheni.
- Chigawo choyamba chimachokera ku fayilo yomwe yatsimikiziridwa pogwiritsa ntchito fayilo ya Mtengo wa OXSICO ntchito zopewera kubera:
- Chigawo chachiwiri chikuchokera mu chikalata choyambirira:
Pambuyo pofufuza mozama zikuwonekera kuti gawo losankhidwa la chikalatacho linafotokozedwa momveka bwino posintha zotsatirazi:
| Malemba oyambirira | Mawu ofotokozera | kusintha |
| amathandizira zatsopano amadziwikanso | backs up innovation imafotokozedwanso | Kusintha |
| chidziwitso cha zachuma ndi chikhalidwe cha anthu, machitidwe ogwira mtima | chidziwitso chazachuma ndi chikhalidwe cha anthu, bungwe labwino | Kusintha |
| malingaliro (malingaliro) | malingaliro | Kusintha, kuchotsa |
| malingaliro | zochitika | Kusintha |
| bwino | wopambana | Kusintha |
| ndondomeko (Perenc, Holub-Ivan | ndondomeko yachidziwitso (Perenc, Holub - Ivan | Kuwonjezera |
| ovomereza luso | zabwino | Kusintha |
| kupanga nyengo | : kupanga chikhalidwe | Kusintha |
| zabwino | wolemera | Kusintha |
| kukulitsa chidziwitso | chidziwitso cha chitukuko | Kusintha |
Kutsiliza
| Plagiarism, yomwe nthawi zambiri imakhala yosazindikirika pamawu ofotokozera, imakhalabe yodetsa nkhawa kwambiri m'masukulu. Kupita patsogolo kwaukadaulo kwathandiza ofufuza kuti azitha kuzindikira bwino zomwe zafotokozedwa. Mwachindunji, owunikira amawona kutanthauzira m'njira zosiyanasiyana monga kufananitsa zingwe, kufanana kwa cosine, ndi kusanthula kwa n-gram. Makamaka, kusanthula kwa n-gram kumadziwika chifukwa cha kuchuluka kwake kolondola kwambiri. Kupita patsogolo kumeneku kumachepetsa mwayi wazinthu zongopeka komanso zongofotokozedwa m'mawu osazindikirika, motero zimakulitsa kukhulupirika kwamaphunziro. |
