No. The class must be taken synchronously, so that you have the ability to come to all the 12 in-person class sessions; we have found over the years that the labs are necessary and result in everyone learning more. However, if you have a medical reason why you cannot take the class synchronously, or because you are required to take another class at the same time and you need the classes or else you cannot graduate this quarter, you can ask Dan for explicit permission to take the class asynchronously. The in-person material is not recorded, so if you are taking the class asynchronously, you must do the labs yourself at home, but won't get the extra credit that the folks who come in person will get. Note: this is only for people with medical or must-graduate-this-quarter excuses.
Another exception: since the required events are all on Tuesdays, if you have a class at this time that happens to meet only on Thursdays, that's ok!
No and yes. No because the TAs are very hard-working and their workload helping the almost 400 students each year is assigned by the University based on enrollment, so auditors are asking the TAs to work for free, which isn't reasonable or sustainable. Yes because all the course material is public, and we encourage anyone who wants to learn the material to go through it on their own, as long as they don't ask the TAs to work for them! So that means if you're not in the class we encourage you to watch the videos on YouTube, and do the programming homeworks, but don't submit homeworks or quizzes to be graded, and don't ask questions on Ed that the TAs will need to spend time answering.
Week | Date | Homework | Quiz | In-class | Video Lectures and Readings (to be done by the Monday of the week unless I specify another date) |
---|---|---|---|---|---|
1 | Jan 6 and 8 |
PA 0: Setup and Tutorial
Due Fri Jan 9, 5:00pm (We'll also go over this in Thursday Jan 8's in-person tutorial ) | - |
|
Watch before Thursday:
|
2 | Jan 13 and 15 |
PA 1: Regular Expressions and Tokenization
Due Fri Jan 16, 5:00pm |
Quiz 1: Tokenization and N-gram Language Modeling Due Tue Jan 13, 11:59pm |
|
Words and Tokenization Canvas VideosN-gram Language Modeling Canvas Videos (watch before Monday Jan 12) [canvas slides pptx] [canvas slides pdf] |
3 | Jan 20 and 22 |
PA 2: Logistic Regression and Text Classification!
Due Fri Jan 23, 5:00pm |
Quiz 2: Logistic Regression and Text Classification Due Tuesday Jan 20, 11:59pm |
|
|
4 | Jan 27 and Jan 29 |
PA 3: Information Retrieva
Due Fri Jan 30, 5:00pm |
Quiz 3: Information Retrieval Due Tuesday Jan 27, 11:59pm |
|
|
5 | Feb 3 and 5 |
PA 4: Embeddings (and Computational Social Science)
Due Fri Feb 6, 5:00pm |
Quiz 4: Embeddings and NLP for CSS Due Tuesday Feb 3, 11:59pm |
|
|
6 | Feb 10 and 12 |
PA 5: Neural Networks Due Fri Feb 13, 5:00pm. |
Quiz 5: Neural Networks Due Tue Feb 10, 11:59pm |
Tuesday: Dan live Lecture (required and not recorded): "LLMs and Transformers! (Plus more on backprop if we have time)"
Thursday: No class: extra in-person TA office hours during class time in Hewlett 200 |
|
7 | Feb 17 and 19 |
PA 6: Transformers and Speech Due Fri Feb 20, 5:00pm |
Quiz 6: Transformers Due Tue Feb 17, 11:59pm. |
Tuesday: Dan live Lecture (not recorded): "Speech Processing" (optional/extra credit, you can choose to read the chapters instead)
Thursday: No class: extra in-person TA office hours during class time in Hewlett 200
|
|
8 | Feb 24 and Feb 26 | Possibly PA6b: Speech (due Wednesday 5pm) |
Quiz 7: Speech Due Tue Feb 24, 11:59pm. |
Tuesday: Lab #4: PA7 and Git (required in-person) Thursday: No class: extra in-person TA office hours during class time in Hewlett 200 |
|
9 | Mar 3 and 5 |
PA 7: Chatbot Due Wed Mar 11, 5:00pm |
Quiz 8: Recommendation Systems Due Tues Mar 3, 11:59pm |
Tuesday Lab #5: Collaborative Filtering and Ethical Use of LLMs in the Classroom (Required but you may do at home/extra credit for attending)
Thursday: No class: extra in-person TA office hours during class time in Hewlett 200 |
Recommender systems and Collaborative Filtering Canvas videos (watch by Monday Mar 2) [slides pptx] [slides pdf] |
10 | Mar 10 and 12 |
Reminder: PA 7: Chatbot due Wed Mar 11, 5:00pm |
Quiz 9: Pagerank and Networks Due Tues Mar 10, 11:59pm |
Tuesday: Dan Live Lecture (required and not recorded) Thursday: No class (but no extra office hours) |
Web graphs, Links, and PageRank (watch by Mon Mar 9) [slides pptx] [slides pdf]
Social Networks Canvas Videos (watch by Mon Mar 9) [slides pptx] [slides pdf]
|
Tuesday and Thursday 3:00-4:20
See the note at the top of the page.
Alas, we can't reply to email sent to individual staff members. If you have a question that is not confidential or personal, post it on the Ed Discussion forum! Responses are quicker and you'll also be helping others with the same question! To contact the teaching staff directly, come see us in office hours!
If that is not possible, you can also email (non-technical questions) to the course staff list, [email protected]. For urgent requests: We check the staff email list very frequently, but please don't worry if you don't hear from us right away. We will do our best to get back to you within a day or so. Just make sure to send an email as soon as you have the request so it's timestamped!
If you have a matter to be discussed privately, come to office hours or use [email protected] to make an appointment. For grading questions, please talk to us after class or during office hours.
Class announcements will be on Ed Discussion (although we will occasionally try Canvas and mailing lists). We will assume that everyone reads all announcements.
Since we occasionally reuse homeworks from previous years, we expect students not to copy, refer to, or look at the solutions in preparing their answers. It is an honor code violation to intentionally refer to a previous year's solutions. This applies both to the official solutions and to solutions that you or someone else may have written up in a previous year. It is also an honor code violation to find some way to look at the test set, or to interfere in any way with programming assignment scoring or tampering with the submit script. It's also an honor code violation to use ChatGPT or any automatic coding system to write your code for you.
Unlike prior years, students are allowed to collaborate on quizzes. However, you must each do your own work and only discuss after; each person will be uploading their own work in addition to the answers.
CS124 follows the general Stanford policy on generative AI which is that "use of or consultation with generative AI shall be treated analogously to assistance from another person. In particular, using generative AI tools to substantially complete an assignment or quiz (e.g. by entering quiz or assignment questions) is not permitted", just as having someone do your homework or quizzes for you is not permitted.
This course is a broad introduction to LLMs and other algorithms for dealing with text, speech, and networks online, including the tasks of tokenizing, classifying, searching, recommending, and transcribing information. Topics include LLMs themeselves as well as logistic regression, information retrieval, collaborative filtering, neural networks, transformers, speech recognition, social networks, safety and bias, and other large language model components, tools, and issues. This class is the broad undergrad intro to numerous grad classes like cs224N/S/U/C/V, cs246, cs276, cs336, and cs329R/X.
CS106B, Python (at the level of CS106A), CS109 (or equivalent background in probability), and programming maturity and knowledge of UNIX equivalent to CS107 (or taking CS107 or CS1U concurrently).
Most weeks, we will ask you to watch a set of video lectures (2 to 2.5 hours total). Most videos will have some in-video questions embedded in them, which you should answer. You are required to watch the videos but the embedded quizzes are not counted toward the final grade.
5 lectures will be live, and are required (except Week 7 Speech lecture is only Strongly Recommended). For all 5 the material will be on the quizzes.
There are 5 in-class labs are in which we do group problem-solving activities. The labs are required and will be tested on the quizzes, meaning that if you can't make a particular in-person lab, you must still do the exercises at home instead. But Lab 1 and Lab 4 are required to be attended in-class; the other 3 you can do at home. In-person for Labs 2, 3, 5 is worth extra credit.
After watching a week's video lectures, we will ask you to answer an open-notes, open-book review quiz (about 5-6 questions) on the content that you just learned. These quizzes are not timed, they are open book, and they may be attempted an infinite number of times. The questions, as well as the options for each question, may change and be randomly selected from a larger pool each time you take a quiz. You will not see your quiz grade/correct answers until after the due date, but the system will take the the score from the last submission of all your infinitely-allowed submissions for the quiz. So if you worry you might have got something wrong, just submit another one! Review Quizzes for each week are due 11:59pm Tuesday of the following week There are no late days for review quizzes. Because of the strict no-late-day policy, we will drop your lowest scoring quiz (i.e. we will only count your best 8 of the 9 quizzes in your final grade).
Can I work with my friends on the quiz? Yes, you can work with your pair programming partner. But you must each do the problem yourselves, and only then discuss with your partner, and you each submit separately (and you will have to show your own work in the "show your work" section when you upload the quiz answers).
You have to watch all lectures, and attendance for the 5 live lectures is required (except for the Speech lecture, which is only Strongly Recommended). The labs are required and we will test material from them on the quizzes, and labs 1 and 4 must be attended in person. However, attendance for labs 2,3,4 is only strongly recommended; you may do them yourself at home if you really cannot come to class. You can get extra credit for class participation and other things by: Coming to labs 2/3/5 in person; particularly helpful answers on the class Ed forum, helping out other students in office hours or labs, being the first person to find typos in the textbook (not counting bugs in figure or chapter numbering, since those don't appear in the full book), speaking up in the labs. Plus there will be extra credit problems on some of the labs and possibly PAs.
7 Python programming assignments. All are due Fridays at 5pm except the last one, PA7, is due on a Wednesday at 5pm.
Programming Assignment Collaboration for PA 1-6: You may talk to anybody you want about the assignments and bounce ideas off each other. And if you want, you can also choose a partner and do pair programming for PA 1-6. Pair programming has many advantages for learning!!! You and your pair-partner can discuss code, but it's important that each of you work on each part of the assignment so that you're comfortable with the whole assignment, since assignments build on each other (and we will test concepts from the assignments on the quizzes). If you choose to pair-program, you should specify in the submission who your partner is. We will use the normal automatic checks for overlap between your code and other students' code who are not your pair partner. You must describe in your writeup exactly who did what in your code.
Programming Assignment Collaboration for PA 7: PA7 is a group homework that must be done in groups. You will work together with your group, and write code together. Groups must be of size 3 or 4. To work in a group of size 2, you must get special permission from the staff. You cannot work by yourself on PA 7, because part of the goal of this homework is to learn to work on group projects. You must describe in your writeup in detail exactly who in your group did what, and who worked on which parts of the assignment/code.
You have a total of 4 free late (calendar) days to use on programming assignments 1-6. If you are pair programming, late days are still individual (i.e if one of you has used up late days, and one has not, and you submit a homework late one day, only the student without remaining late days will be penalized). You cannot use late days on PA 7. Once late days are exhausted, any PA turned in late will be penalized 20% per late day. Each 24 hours or part thereof that a homework is late uses up one full late day. However, no assignment will be accepted more than four days after its due date.
This class has a significant amount of textbook reading. Most weeks have around 25 textbook pages. The homeworks and quizzes are based heavily on the readings.