Skip to main content

Institute of Science and Technology · Computer Science and Engineering (%30 English) · Doctorate

ECTS: 7.5 T+P+L: 3+0+0 Departmental Elective
Coordinator: Dr. Öğr. Üyesi Akhtar JAMIL

Course Objective

The course aims to introduce students to the field of machine translation. The main objective of the course is to show you how modern translation systems learn to translate by reading millions of words. The goal is to provide a unifying view of machine translation as statistical and neural search in a large search space.  

Course Content

The course covers the area of machine translation (MT) in its current breadth. Lectures will put a balanced emphasis on several important types of state-of-art-systems such as phrase-based machine translation and deep-syntactic machine translation, machine translation evaluation or methods.  We cover fundamental building blocks from linguistics, machine learning, algorithms, and formal language theory, showing how they apply to real and difficult problem in artificial intelligence. Finally, a detailed gist of emerging approaches in MT such as neural network is also included in the course.

Required Resources

  • Statistical Machine Translation by Philipp Koehn, 2010
  • Neural Machine Translation by Philipp Koehn, 2019

Recommended Resources

  • Linguistic Fundamentals for Natural Language Processing by Emily Bender

Explanations

  • There will be 2 quizzes in total
  • Similarly, there will be 4 homework in total

Rules

  • User of mobile phones are strictly prohibited. In classroom or lab, if any student is caught using mobile phones, they may receive a warning first, and later may not be allowed to sit in class or lab.
  • Attendance: Attending lectures and lab is mandatory. You will NOT be allowed to enter in class after 10 minutes. You are encouraged to be in class on time. If your attendance is less than 70%, there will be no compromise and you will be withdrawn from course an DZ grade will be assigned.
  • Late submission NOT allowed: If you fail to submit your assignment/project on the specified time, you will NOT be able to get any marks.
  • Plagiarism Unacceptable: You are not allowed to directly copy and paste any code available online for your project or homework, without understanding them. If you understood and used the online material, then you must provide reference to that website or resource from where you have copied it. Otherwise, it will be considered plagiarism and no marks will be given to you.

Course Learning Outcomes

  1. Understand basics of machine translation.
  2. Know how famous and modern machine translation works
  3. Have comprehensive knowledge of language models and linguistics.
  4. Learn neural language models, neural translation model and how it is decoded.

Core Area Distribution

(46) Mathematics and Statistics%30 (48) Computing%70

Teaching Methods

ExpressionQuestion-AnswerDiscussionExercise and PracticeProblem Solving

Assessment & Evaluation

HomeworkTesting (Essay / Tests: True-Falls, multiple-choice, short answer, matching)

ECTS / Workload

ActivityQuantityDuration (h)Total Workload
Course Duration (Including Exam Week)16348
Out of Class Study Period16348
Midterm111
Quiz212
Assignment4312
Practice000
Final122

Course Schedule

WeekSubjectPreparation
1Introduction to Machine Translation(Book: Statistical MT, Chapter 1.2)
2Basics in Language and Probability(Book: Statistical MT, Chapter 2.1 and 3)
3Language Models(Book: Statistical MT, Chapter 7)
4IBM Model 1 and the EM Algorithm(Book: Statistical MT, Chapter 4.1 – 4.2)
5Phrase-Based Models(Book: Statistical MT, Chapter 5)
6Decoding(Book: Statistical MT, Chapter 6), Evaluation (Book: Statistical MT, Chapter 8)
7Introduction to Neural Networks(Book: Neural MT, Chapter 4)
8Mid termMid term
9Computation Graphs(Book: Neural MT, Chapter 5)
10Neural Language Models(Book: Neural MT, Chapter 6), Neural Translation Models (Book: Neural MT, Chapter 7)
11Decoding in Neural Translation Models(Book: Neural MT, Chapter 8), Machine Learning Tricks (Book: Neural MT, Chapter 9)
12Alternative Architectures(Book: Neural MT, Chapter 10)
13Word and Morphology(Book: Statistical MT, Chapter 10.2)
14Syntax and Semantics(Book: Neural MT, Chapter 14)
16Final ExamFinal Exam
15Adaptation and Beyond Parallel Data(Book: Neural MT, Chapter 12 and 13)