STA 624 Applied Stochastic Processes
This is a course on stochastic processes, which involve collections of random variables indexed by time or by space. In this course you will learn the nomenclature and techniques needed for understanding the major types of stochastic processes, how to apply these processes in mathematical modeling, and how to effectively compute and simulate using these processes. We will cover materials including (not limited to) discrete-time and continurous-time Markov Chain, Reversible Markov Chain, hidden Markov Model (HMM) (see more details at a sylabus). For computing I will be teaching the basics of MATLAB, although you may utilize any environment you are familiar with for completing the assignments.
Spring Semester 2010
Text
Introduction to Stochastic Processes 2nd edit G. F. Lawler.
Instructor
Ruriko Yoshida, Assistant Professor of Statistics
- Office: 805A POT
- Phone: (859) 257-5698
- E-mail: ruriko.yoshida@uky.edu
- Office Hours: TTH 2:00 PM - 2:50 PM
Time and Place for STA624, Spring Semester 2010
- Tue and Thurs 11:00 AM - 12:15 PM, Chemistry-Physics Bldg 111
Course Website
www.polytopes.net/courses/Stat624S10
Syllabus For STA 624
We will cover Chapter 1, 2, 3, and 5. In addition, We will cover Hidden Markov Model and also applications to computational Biology (especially, to alignment problems and also evolutional model). For more details see PDF.
Schedule
- Exam 1 Thurs March 11th.
- Exam 2 Thurs April 15th.
- Final Tue May 4th at 10:30AM to 12:30PM.
Grading
There will be two in-class exams, graded homeworks, programming assignments, and a final exam: these will count 40%, 20%, 15%, and 25% of your grade, respectively.
Students with excused absences will be given a make-up exam. No homework will be made up for credit, but it's important to make it up for your own benefit. The lowest scored HW will be discarded. Late homework will not be accepted. No make up final.
STA 624 Handout
- Basic Probability (PDF)
- MATLAB Tutorial 1 (PDF)
- MATLAB Tutorial 2 (PDF)
- MATLAB Tutorial 3 (PDF)
- MATLAB Tutorial 4 (PDF)
- MATLAB Tutorial 5 (PDF)
- MATLAB Tutorial 6 (PDF)
Links
- Markov chain calculator
- Branching processes
- POISSON SIMULLATION and POISSON DISTRIBUTION
- Random walk on 1D
Exams
Write each problem neatly. If you have any question about grading, you must prove why you think so. Regrading will be in 7 days after returning. After 7 days, regrading will NOT be accepted. All exams will be in class. Calculator is allowed. They are closed book exams.
- Exam 1 March 11. Review PDF
- Exam 2 April 15.
- Final Tue May 4th at 10:30AM to 12:30PM. The description of the final project: PDF
Homework for STA 624, Spring Semester 2010
For computing problems, I recommend you to use MATLAB. But if you want to use R or SAS it is fine if you do not use pre-existing functions. Please show me what you have before hand in if you are using R or SAS. If you do not get my permission then you will get no credits.
- Homework 0: PDF, due on January 26th Tue, 2010.
- Homework 1: PDF, due on February 9th Tue, 2010.
- Homework 2: PDF, due on February 25th Thurs, 2010.
- Homework 3: PDF, due on March 25th Thurs, 2010.
- Homework 4: PDF, due on April 8th Thurs, 2010.