Institute of Science and Technology · Computer Science and Engineering (%30 English) · Doctorate
Course Objective
The course aims to introduce students to the field of machine translation. The main objective of the course is to show you how modern translation systems learn to translate by reading millions of words. The goal is to provide a unifying view of machine translation as statistical and neural search in a large search space.
Course Content
The course covers the area of machine translation (MT) in its current breadth. Lectures will put a balanced emphasis on several important types of state-of-art-systems such as phrase-based machine translation and deep-syntactic machine translation, machine translation evaluation or methods. We cover fundamental building blocks from linguistics, machine learning, algorithms, and formal language theory, showing how they apply to real and difficult problem in artificial intelligence. Finally, a detailed gist of emerging approaches in MT such as neural network is also included in the course.
Required Resources
- Statistical Machine Translation by Philipp Koehn, 2010
- Neural Machine Translation by Philipp Koehn, 2019
Recommended Resources
- Linguistic Fundamentals for Natural Language Processing by Emily Bender
Explanations
- There will be 2 quizzes in total
- Similarly, there will be 4 homework in total
Rules
- User of mobile phones are strictly prohibited. In classroom or lab, if any student is caught using mobile phones, they may receive a warning first, and later may not be allowed to sit in class or lab.
- Attendance: Attending lectures and lab is mandatory. You will NOT be allowed to enter in class after 10 minutes. You are encouraged to be in class on time. If your attendance is less than 70%, there will be no compromise and you will be withdrawn from course an DZ grade will be assigned.
- Late submission NOT allowed: If you fail to submit your assignment/project on the specified time, you will NOT be able to get any marks.
- Plagiarism Unacceptable: You are not allowed to directly copy and paste any code available online for your project or homework, without understanding them. If you understood and used the online material, then you must provide reference to that website or resource from where you have copied it. Otherwise, it will be considered plagiarism and no marks will be given to you.
Course Learning Outcomes
- Understand basics of machine translation.
- Know how famous and modern machine translation works
- Have comprehensive knowledge of language models and linguistics.
- Learn neural language models, neural translation model and how it is decoded.
Core Area Distribution
Teaching Methods
Assessment & Evaluation
ECTS / Workload
| Activity | Quantity | Duration (h) | Total Workload |
|---|---|---|---|
| Course Duration (Including Exam Week) | 16 | 3 | 48 |
| Out of Class Study Period | 16 | 3 | 48 |
| Midterm | 1 | 1 | 1 |
| Quiz | 2 | 1 | 2 |
| Assignment | 4 | 3 | 12 |
| Practice | 0 | 0 | 0 |
| Final | 1 | 2 | 2 |
Course Schedule
| Week | Subject | Preparation |
|---|---|---|
| 1 | Introduction to Machine Translation | (Book: Statistical MT, Chapter 1.2) |
| 2 | Basics in Language and Probability | (Book: Statistical MT, Chapter 2.1 and 3) |
| 3 | Language Models | (Book: Statistical MT, Chapter 7) |
| 4 | IBM Model 1 and the EM Algorithm | (Book: Statistical MT, Chapter 4.1 – 4.2) |
| 5 | Phrase-Based Models | (Book: Statistical MT, Chapter 5) |
| 6 | Decoding | (Book: Statistical MT, Chapter 6), Evaluation (Book: Statistical MT, Chapter 8) |
| 7 | Introduction to Neural Networks | (Book: Neural MT, Chapter 4) |
| 8 | Mid term | Mid term |
| 9 | Computation Graphs | (Book: Neural MT, Chapter 5) |
| 10 | Neural Language Models | (Book: Neural MT, Chapter 6), Neural Translation Models (Book: Neural MT, Chapter 7) |
| 11 | Decoding in Neural Translation Models | (Book: Neural MT, Chapter 8), Machine Learning Tricks (Book: Neural MT, Chapter 9) |
| 12 | Alternative Architectures | (Book: Neural MT, Chapter 10) |
| 13 | Word and Morphology | (Book: Statistical MT, Chapter 10.2) |
| 14 | Syntax and Semantics | (Book: Neural MT, Chapter 14) |
| 16 | Final Exam | Final Exam |
| 15 | Adaptation and Beyond Parallel Data | (Book: Neural MT, Chapter 12 and 13) |


