ThiscoursewascreatedbyProf.MohammadGhassemiinFallof2020aspartoftheCSE842classatMichiganStateUniversity.Thecourseprovidesastep-by-stepguidetoNLPandmakesnoassumptionsthatyouhaveabackgroundinthematerial(NLPorMachineLearning).Thecontentinthisrepositorywillteachyou:
Howtocollectandprocesstextdata.Howtogeneratetextusinglanguagemodels.Howtoclassifytextusingmachinelearning.Howtouseandtunestate-of-the-artsequence-to-sequencemodels,includingtransformers.Howtoprocessspeechsignals.AlllecturesarehostedonYoutubeandcanbeconsumedatyourownpace(seelinksbelow).Attheendof(most)everylecturethereisatutorial+homeworkassignmentthatwilldemonstratehowtoperformNLPtasksinPython.ThePythonNotebooksareavailablethroughthelinksbelow,andintheHomeworkfolder.
IntroductionLectures:a.IntroductiontotheCourseb.OverviewofSyllabusc.OverviewofCourseToolsd.OverviewoftheCourseProjectHW0:SettingupyournotebookandGitlabRepoProject:GuidelinesNLPFundamentalsandN-gramLanguageModelsOptionalReadings:Chapter2andChapter3Lecture:Introductiona.Languageanditspropertiesb.RegularExpressionsc.TextNormalizationd.EditDistancee.N-gramLanguageModelsf.GeneralizationandSmoothingHW1TutorialHW1andCodeTutorial:Basicdatamanipulations,representationsandstatisticsNiaveBayes,SentimentClassification,LogisticRegressionOptionalReadings:Chapter4andChapter5Lecture:IntroductionOverviewa.NumericalRepresentationsofTextb.NaiveBayesc.LogisticRegressiond.PerformanceMetricsHW2TutorialHW2andCodeTutorial:SupervisedlanguageclassificationmodelsandtheirassessmentVectorSemantics,Embeddings,NeuralLanguageModelsOptionalReadingsChapter6andChapter7PCAWord2VecLecture:IntroductionOverviewa.SimpleContextualRepresentationsb.GradientDescentc.NeuralNetworksd.NeuralLangaugeModelsHW3TutorialHW3andCodeTutorial:EmbeddingsandNeuralNetworksModelingTextasaSequenceOptionalReadingsChapter8andChapter9Lecture:OverviewIntroductiona.HiddenMarkovModelsb.MaximumEntropyMarkovModelsc.RecurrentNeuralNetworksHW4TutorialHW4andCodeTutorial:SequenceModelsEncoder-DecoderModels,AttentionandTransformersOptionalReadingsChapter10,Viswani,2017Lecture:OverviewIntroductiona.Encoder-DecoderNetworksb.Attentionc.TransformersHW5TutorialHW5andCodeTutorial:TransformersConstituencies,ParsingandDependencyOptionalReadingsChapter12,Chapter13,Chapter14,Chapter15Lecture:OverviewIntroductiona.ContextFreeGrammarb.ConstituencyParsingc.StatisticalConsituencyParsingd.DependencyParsingHW6andCodeTutorial:ContextfreegrammarSpeechProcessingOptionalReadingsChapter27Lecture:OverviewIntroductiona.Phoneticsb.SpeechSignalsHW7TutorialHW7andCodeTutorial:SpeechAnalysis
评论