Automatic Evaluation of Machine Translation Outputs

dc.contributor.guideManish Shrivastava
dc.coverage.spatial
dc.creator.researcherAnanya Mukherjee
dc.date.accessioned2025-11-21T10:44:31Z
dc.date.available2025-11-21T10:44:31Z
dc.date.awarded2025
dc.date.completed2025
dc.date.registered2018
dc.description.abstractHuman knowledge is predominantly encoded in natural language. Automatic understanding newlineof natural language has been a most awaited goal of AI/ML. Among several challenges of natural newlinelanguage processing and understanding, Machine Translation (MT) stands to be a major newlinetask. MT is the process of converting the source text in one natural language to another natural newlinelanguage. With the advent of neural models, the field of neural MT (NMT) has made significant newlineprogress, yet the challenge of effectively evaluating the translation quality remains critical. newlineThis thesis focuses on the automatic evaluation of machine translation outputs, addressing both newlinethe limitations of existing metrics and proposing innovative approaches to enhance evaluation newlineaccuracy. Existing widely used metrics, such as BLEU and METEOR, are scrutinized for their newlinereliance on n-gram overlap and limited linguistic insight, often failing to capture nuances of newlinelanguage such as fluency, adequacy, and semantic equivalence. To mitigate these shortcomings, newlinethis research explores advanced evaluation methods leveraging pre-trained multilingual newlineembeddings and deep learning, which model linguistic phenomena more comprehensively. newlineThis thesis introduces several novel automatic evaluation approaches (unsupervised referencebased, newlineunsupervised reference-free and supervised approaches) that integrates semantic similarity newlineand contextual relevance by employing pre-trained language models. Through extensive newlineexperimentation, our metrics are benchmarked against the traditional ones, demonstrating superior newlineperformance in correlating with human judgments. Additionally, this work investigates newlinethe existing evaluation datasets and evaluation approaches, discusses their limitations, and also newlineprovides decision trees to help the researchers choose particular evaluation criteria or a metric newlinebased on available computation and linguistic resources. newlineUltimately, this thesis contributes to the field by offering robust methodologies for MT output newlineevaluation, emphasizing the need for metrics
dc.description.note
dc.format.accompanyingmaterialNone
dc.format.dimensions
dc.format.extent
dc.identifier.researcherid
dc.identifier.urihttp://hdl.handle.net/10603/675456
dc.languageEnglish
dc.publisher.institutionComputer Science and Engineering
dc.publisher.placeHyderabad
dc.publisher.universityInternational Institute of Information Technology, Hyderabad
dc.relation
dc.rightsuniversity
dc.source.universityUniversity
dc.subject.keywordComputer Science
dc.subject.keywordComputer Science Information Systems
dc.subject.keywordEngineering and Technology
dc.titleAutomatic Evaluation of Machine Translation Outputs
dc.title.alternative
dc.type.degreePh.D.

Files

Original bundle

Now showing 1 - 5 of 17
Loading...
Thumbnail Image
Name:
80_recommendation.pdf
Size:
104.33 KB
Format:
Adobe Portable Document Format
Description:
Attached File
Loading...
Thumbnail Image
Name:
90_plagiarism_report.pdf
Size:
16.29 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
abstract.pdf
Size:
21.54 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
annexures.pdf
Size:
140.68 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
chapter10.pdf
Size:
53.7 KB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.79 KB
Format:
Plain Text
Description: