Hide menu

TDDE09 Natural Language Processing


The examination for this course is centred around the learning objectives: For each objective, there are one or more examination components that test how well you meet that objective. This page presents these components, their specific knowledge requirements, and forms of examination in detail.

Examination components

The examination for this course consists of the following components:

  • TEN1 Written examination, 2 credits (U, 3, 4, 5)
  • LAB1 Practical assignments, 2 credits (U, 3, 4, 5)
  • UPG1 Project assignments, 2 credits (U, 3, 4, 5)

In order to pass the course, you must pass (grade 3 or higher) all three components. Your final grade for the course is the median of the grades awarded for the three components. (To compute the median of three numbers, you sort them and pick the middle one.)

When will the grades be determined? For each attempted component, the examiner will make a decision about your grade within 10 working days after the component’s formal examination date. The decision about your final grade for the course will be made as soon as the grades for all components have been determined.

When does an examination component count as attempted? An examination component counts as attempted when you take an exam or submit an assignment that belongs to that component.

Failing a component and re-examination. If you attempt but do not pass an examination, your grade for the respective component will be Fail (U). In this case you have the right to be re-examined. For each attempted component, the examiner offers two re-examination attempts during the year following the course; see the section on Re-examination for detailed information about this.

TEN1 Written examination

The written exam tests how well you are able to ‘explain state-of-the-art NLP algorithms and analyse them theoretically’ (learning objective 1).

Knowledge requirements

Grade 3. You demonstrate a thorough understanding of the basic algorithms that are covered in the course. You assess the applicability, requirements, efficiency, and limitations of algorithms with simple judgements grounded in theoretical analysis. You use relevant terminology and notation with some certainty.

Grade 4. You demonstrate a thorough understanding of the basic algorithms that are covered in the course, as well as several of the more advanced algorithms. You assess the applicability, requirements, efficiency, and limitations of algorithms with well-developed judgements grounded in theoretical analysis. You use relevant terminology and notation with certainty.

Grade 5. You demonstrate a thorough understanding of the basic algorithms that are covered in the course, as well as several of the more advanced algorithms. You also show that your understanding extends to algorithms that have not been explicitly covered in the course. You assess the applicability, requirements, efficiency, and limitations of algorithms with well-developed judgements grounded in theoretical analysis. You use relevant terminology and notation with certainty.

Assessment criteria for critical judgements

Form of the examination

The written exam consists of three parts:

Part A consists of 5 items, each worth 3 points. These items test your understanding of the basic algorithms that are covered in the course. They require only compact answers, such as a short text, calculation, or diagram.

Part B consists of 3 items, each worth 6 points. These items test your understanding of the more advanced algorithms that are covered in the course. They require detailed and coherent answers with correct terminology.

Part C consists of 1 item worth 12 points. This item tests your understanding of an algorithm that has not been explicitly covered in the course. This item requires a detailed and coherent answer with correct terminology.

Exam from the previous run of the course (2017)

Grade requirements

For grade 3, you need at least 12 points in Part A. For grade 4, you additionally need at least 12 points in Part B. For grade 5, you additionally need at least 6 points in Part C. Note that you cannot use surplus points in one part to raise your score in another part.

Examination date and registration

The formal examination date for this component is the date of the written exam, which you will find in the Student Portal. In order to take the written exam, you have to register for it. The last day to register is 10 working days before the exam.

Feedback

To get feedback about how well you meet the knowledge requirements for this component, you can answer the diagnostic questions in the study materials, attend the teaching sessions, and take the optional tests. In addition, you can always get personalised feedback from the examiner (office hours Mondays, Wednesdays, and Thursdays 13-15 in Building E, Room 3G.476, or book an appointment).

Fast grading. In the interest of fast turnaround, we stop grading your exam when it becomes clear that you can no longer get a higher grade. If you want feedback on items that we have not graded, you are welcome to contact the examiner. Detailed solutions for items in Part A and Part B will be made available after the exam.

KTR1 Optional tests

During the course you can take optional tests on individual topics. When you pass the test for a topic, you earn a ‘wildcard’ for the respective item in Part A of the written exam, which automatically gives you full credit for the item. You can use at most three (3) wildcards in total, and they are only valid for the first attempt at the written exam (not the re-exams).

Questions from the tests 2017 with sample solutions

You will find the dates, times, and locations for the optional tests in the timetable. You do not need to register for the optional tests.

LAB1 Practical assignments

The practical assignments test how well you are able to ‘implement NLP algorithms and apply them to practical problems’ (learning objective 2) and ‘design and carry out evaluations of NLP components and systems’ (learning objective 3).

Knowledge requirements

Grade 3. You implement the basic algorithms that are covered in the course and apply them to practical problems according to given instructions. You make minor modifications to existing systems. You choose appropriate validation methods, use them to evaluate systems, and interpret your findings with simple judgements.

Grade 4. You implement the basic algorithms that are covered in the course, as well as several of the more advanced algorithms, and use them to independently solve practical problems. You make extensive modifications to existing systems. You choose appropriate validation methods, use them to evaluate systems, and interpret your findings with well-developed judgements.

Grade 5. You implement the basic algorithms that are covered in the course, as well as several of the more advanced algorithms, and use them to independently solve practical problems. You make extensive modifications to existing systems and implement your own systems from scratch. You choose appropriate validation methods, use them to evaluate systems, and interpret your findings with well-developed judgements.

Assessment criteria for critical judgements

Form of the examination

The assignments of this component consist of lab assignments or ‘labs’, which should be done in pairs, and a reflection paper, which is individual. The labs come at three levels:

Level A consists of 6 labs that test your command of the basic algorithms that are covered in the course. These labs come with step-by-step instructions and ready-to-run systems. The instructions ask you to provide your own implementations of individual functions in these systems, evaluate them on text data, and interpret your findings.

Level B consists of 3 labs that test your command of some of the more advanced algorithms that are covered in the course. These labs are formulated as problem specifications and come with ready-to-run systems. To solve the specified problems, you will have to make extensive modifications to these systems, evaluate them on text data, and interpret your findings.

Level C consists of 2 labs that test your command of some of the more advanced algorithms that are covered in the course. These labs are formulated as problem specifications and come with little or no code. To solve the specified problems, you will have to implement your own limited-size systems, evaluate them on text data, and interpret your findings.

The labs are examined based on written lab reports, so-called notebooks. The labs at levels B and C additionally require supplementary oral presentations; the lab assistants will contact you about this once they have okay’ed your written report. More information about the examination of the labs

The reflection paper is an academic essay in which you reflect on your learning during the lab series. The paper should contain a description and analysis of your work on the labs, and conclusions regarding the question what you take away from this part of the course. More information about the reflection paper

Grade requirements

For grade 3, you need a pass grade on all the labs at level A as well as on the reflection paper. For grade 4, you additionally need a pass grade on at least three labs at levels B or C. For grade 5, you additionally need a pass grade on the remaining labs.

Examination date and registration

The formal examination date for this component is the final examination date for the complete course, 2018-03-17. Before submitting your first lab, you and your lab partner will have to register in Webreg.

Feedback

To get feedback about how well you meet the knowledge requirements for this component, you can attend the tutored lab sessions, and make sure that you submit your assignments in time for the first due date. In addition, you can always get personalised feedback from the examiner (office hours Mondays, Wednesdays, and Thursdays 13-15 in Building E, Room 3G.476, or book an appointment).

UPG1 Project assignments

The project assignments test how well you are able to ‘seek, assess, and use scientific information within the area of NLP’ (learning objective 4). The assignments are centered around a group project in which you implement a realistic NLP system. The main purpose of this project is to give you an opportunity to show that you can make use of methods described in the NLP literature.

Knowledge requirements (group)

Grade 3. In collaboration with the other members of your group, you plan and carry out a simple project that serves its main purpose. You present the project in a way that makes it clear how you used NLP methods described in the scientific literature, what results you obtained with these methods, and how your interpret these results.

Grade 4. You satisfy all of the requirements for grade 3 and most of the requirements for grade 5.

Grade 5. In collaboration with the other members of your group, you plan and carry out a varied project that serves its main purpose well. You present the project in a way that makes it very clear how you used NLP methods described in the scientific literature, what results you obtained with these methods, and how you interpret these results.

Knowledge requirements (individual)

Grade 3. You assess the applicability, requirements, and limitations of the NLP methods that you have used with simple judgements, making it clear how you arrived at these judgements based on your project.

Grade 4. You satisfy all of the requirements for grade 3 and most of the requirements for grade 5.

Grade 5. You assess the applicability, requirements, and limitations of the NLP methods that you have used with well-developed judgements, making it very clear how you arrived at these judgements based on your project.

Assessment criteria for critical judgements

Form of the examination

The project should be done in groups of approximately 6 students, and is examined based on hand-in assignments and a project presentation. Some of these deliverables are group work, some of them are individual.

Your grade for this component is based on a weighted assessment of the following parts:

  • your pre-project reflection paper (10%)
  • your group’s project (30%)
  • your group’s presentation (20%)
  • your post-project reflection paper (40%)

Each of these parts is assessed according to criteria spelled out in the Project Rubric, and assigned a specified point score. Your grade is based on the sum of these scores.

Grade requirements

For grade 3, you need at least 30 points. For grade 4, you need at least 37 points. For grade 5, you need at least 44 points.

Examination date and registration

The formal examination date for this component is the final examination date for the complete course, 2018-03-17. You register for the examination by submitting the first deliverable.

Feedback

Detailed information on how you get feedback about how well you meet the knowledge requirements for this component is available on the Project page. In addition, you can always get personalised feedback from the examiner (office hours Mondays, Wednesdays, and Thursdays 13-15 in Building E, Room 3G.476, or book an appointment).

Rules for hand-in assignments

The following general rules apply to the submission and examination of hand-in assignments:

When you have completed an assignment, mail it to nlp-handin@ida.liu.se. You will receive an automatic confirmation and a ticket ID that you should use in all correspondence regarding your submission.

Format of the subject line. When you submit an assignment, we ask you to format the message’s subject line in a specific way such that the submission can be automatically routed to the right person. You will find details about this in the assignment’s instructions.

Each assignment has two due dates: The first date is stated in the instructions for the assignment. The second date is the course’s examination date (2018-03-17). This date is a hard deadline in the sense that you will not be able to submit or revise assignments after that date.

Why should I try to meet the first due date? If you meet the first due date, you will get formative feedback on your assignment and the chance to revise it before the course’s formal examination date.

To meet a due date, it suffices to submit the assignment before 08:00 the first working day after that date. For example, if the due date is on a Friday, it suffices to submit the assignment before 08:00 the following Monday (assuming that this is a working day).

Re-examination

There are two occasions for re-examination:

  • during the re-exam period for VT1 (formal examination date 2018-06-08)
  • during the general re-exam period after the summer break (formal examination date 2018-09-01)

After this you can be examined in connection with the next run of the course. Note that the next run can have different contents.

The following specific rules apply to the different examination components:

TEN1 Written examination

Please see the Student Portal for the dates of the written re-exams. In order to take a written re-exam, you have to register for it. The last day to register is 10 working days before the exam.

LAB1 Practical assignments

Follow these steps to participate in a re-examination of this component:

  • Re-submit all lab reports – even those which you already have a Pass on. Rules for hand-in assignments
  • Do not submit your reflection paper; instead, you will present this paper orally during the examination.
  • Register for the re-examination at least 10 working days before the relevant examination date.
  • Be prepared to give an oral presentation of your reflection paper. You should also be able to answer questions about specific labs.

UPG1 Project assignments

Follow these steps to participate in a re-examination of this component:

  • Register for the re-examination at least 10 working days before the relevant examination date.
  • Be prepared to give an oral presentation of your reflection papers. You should also be able to answer questions about your project.

Page responsible: Marco Kuhlmann
Last updated: 2017-09-22