Skip navigation

ME 327: Design and Control of Haptic Systems

Welcome

Welcome to ME 327: Design and Control of Haptic Systems. In this class, we will study the design and control of haptic systems, which provide touch feedback to human users interacting with virtual environments and teleoperated robots. This class is aimed toward graduate students and advanced undergraduates in engineering and computer science. This class requires a solid background in dynamic systems and programming. Experience with feedback control and mechanical prototyping is also useful. Attendance is required if you are taking the class; guests/auditors are welcome. Course information and policies are contained in the syllabus. (Note that the final lecture schedule, assignment due dates, etc. are given on this web page; dates and topics listed in the syllabus are tentative.) This course focuses on device modeling (kinematics and dynamics), synthesis and analysis of control systems, design and implementation, and human interaction with haptic systems. For a course focused more on 3D haptic rendering, CS 277 Experimental Haptics is also taught. (However, the instructors of ME 327 and CS 277 do not want you to take these courses -- or any other major project class -- simultaneously due to the intense work involved in the project.)

The primary instructor is Allison Okamura, Associate Professor in Mechanical Engineering at Stanford University. Allison has been a professor in the fields of haptics and medical robotics for about 13 years. The course assistants are Andrew Stanley and Zhan Fan Quek, Ph.D. students in Mechanical Engineering with extensive experience in haptic device design, control, and human-user evaluation.

LecturesMWF 10:00-10:50 am in 60-120
Lab and Project SpaceAs needed in 550-108
Allison's Office HoursMondays 11-12, Wednesdays 9-10 in 550-107
Zhan Fan's Office HoursMondays 3-5 in 550-108
Andrew's Office HoursWednesdays 3-5 in 550-108

For announcements and questions/answers, please use piazza at http://www.piazza.com/class/me327. Grades will be posted at http://coursework.stanford.edu.

Lectures

PDFs of lecture slides will be posted before lecture when possible.
3/31Lecture 1: Introduction to haptics
4/2Lecture 2: Kinesthetic haptic devices: Design, kinematics, and dynamics
4/4Lecture 3: Device demonstrations (in MERL 126)
4/7Lecture 4: Kinesthetic haptic devices: Rendering
4/9Lecture 5: Kinesthetic haptic devices: Control (guest lecture by Nick Colonnese)
4/11Lecture 6: Kinesthetic haptic devices: Dynamics Simulations and Discussion
4/14Lecture 7: Kinesthetic haptic devices: Sensors and actuators, Maxon DC motor info
4/16Lecture 8: Tactile haptic devices: Types and applications
4/18Lecture 9: Kinesthetic haptic devices: Control and Discussion
4/21Lecture 10: Teleoperation: Implementation
4/23Lecture 11: Teleoperation: Transparency and stability
4/25Lecture 12: Surface haptics (guest lecture by David Meyer)
4/28Lecture 13: Teleoperation + Project/Presentation Discussion
4/30Lecture 14: Human haptics: Mechanoreception and Kinesthesia
5/2Lecture 15: Human haptics: Psychophysics
5/5Lecture 16: User studies and Discussion
5/7Lecture 17: Human subjects experiments: Statistics
5/9Lecture 18: Designing a commercial haptic device (guest lecture by Francois Conti)
5/12Lecture 19: Haptic Rendering: From One to Six Degrees of Freedom (guest lecture by Sonny Chan)
5/14Lecture 20: Human subjects experiment case studies: Augmentation of Stiffness Perception using Skin Stretch Feedback (by Zhan Fan Quek) and Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance (by Andrew Stanley)
5/16Lecture 21: Project updates
5/19Lecture 22: Student paper presentations - Group 2 (Adam, Amanda, Josh) and Group 6 (Darrel, Sean)
5/21Lecture 23: Student paper presentations - Group 7 (Beth, Paul, Zach) and Group 4 (Eduardo, Jee, Jung Hwa)
5/23Lecture 24: Student paper presentations - Group 1 (Cliff, Lawrence, Yuhang) and Group 5 (Joel, Tania)
5/26No Lecture (Holiday)
5/28Lecture 25: Student paper presentations - Group 3 (Dan, Jose, Mark) and Group 8 (Michael, Ben, Jake)
5/30No Lecture (Project Demonstrations 1:30-3:00pm)
6/2No Lecture (Work on user study and paper)
6/4No Lecture (Work on user study and paper)

Assignments

The dates below show when the assignment is distributed. Assignments will usually be due one week after distribution (the due date will be written on the assignment), and can be submitted in class or to the ME 327 dropbox outside the door to the area where Allison's office is. (Access to solutions is restricted to students in the class; if you are not in the class and wish to see the solutions, email Allison and please explain who you are and what you will use the solutions for.)

3/31Background survey
4/4 Assignment 1: Hapkit device modeling and construction (Hapkit Solidworks Files, Hapkit Parts List, Hapkit Assembly Instructions, Problem 4 MATLAB template, Assignment 1 Solutions)
4/11Assignment 2: Rendering on a Kinesthetic Haptic Device (Hapkit Arduino code template, Hapkit/Arduino information for novices, Hapkit Board pin mapping, Assignment 2 Solutions)
4/18Assignment 3: Haptic Controls and Vibration Feedback (Assignment 3 Solutions)
4/25Assignment 4: Teleoperation, Graphic Display, Perception (Assignment 4 Solutions) (Arduino Teleoperation Master) (Arduino Teleoperation Slave)

Students in the class will create and use their own versions of Hapkit, a new haptic device created specifically for haptics education.

Readings

Required readings will be identified in the assignments. Links to PDFs of readings are posted here, listed by discussion date.

4/11K. E. MacLean. Haptic interaction design for everyday interfaces. Reviews of Human Factors and Ergonomics, 4:149-194, 2008. {pdf}
4/11B. Hannaford and A. M. Okamura. Chapter 30: Haptics. In B. Siciliano and O. Khatib, Eds., Handbook of Robotics. Springer, pp. 718-735, 2008. {pdf}
4/11V. Hayward and K. E. MacLean. Do It Yourself Haptics, Part I. IEEE Robotics and Automation Magazine, 14(4):88-104, 2007. {pdf}
4/18D. W. Weir and J. E. Colgate. Stability of haptic displays. In M. C. Lin and M. Otaduy, Eds., Haptic Rendering: Foundations, Algorithms, and Applications. AK Peters, 2008. {pdf}
4/18R. B. Gillespie and M. R. Cutkosky. Stable user-specific rendering of the virtual wall. Proceedings of the ASME International Mechanical Engineering Conference and Exposition, DSC-Vol. 58, pp. 397-406, 1996. {pdf}
4/25K. Hashtrudi-Zaad and S. E. Salcudean, Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators. International Journal of Robotics Research, 20(6):419-445, 2001. {pdf}
4/25B. Hannaford, Design framework for teleoperators with kinesthetic feedback. IEEE Transactions on Robotics and Automation, 5(4):426-434, 1989. {pdf}
4/25J. J. Abbott and A. M. Okamura, Stable Forbidden-Region Virtual Fixtures for Bilateral Telemanipulation. ASME Journal of Dynamic Systems, Measurement, and Control, Vol. 128, pp. 53-64, 2006. {pdf}
5/5 L. A. Jones. Peripheral Mechanisms of Touch and Proprioception. Canadian Journal of Physiology and Pharmacology, 1994, 72(5): 484-487. {pdf}
5/5A. B. Vallbo and R. S. Johansson. Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. Human Neurobiology, 3:3-14, 1984. {pdf}
5/5 T. E. Murphy, R. J. Webster and A. M. Okamura, "Design and Performance of a Two-Dimensional Tactile Slip Display," Eurohaptics, pp. 130-137, 2004. {pdf}
5/5R. J. Webster III, T. E. Murphy, L. N. Verner, and A. M. Okamura, "A Novel Two-Dimensional Tactile Slip Display: Design, Kinematics and Perceptual Experiment," ACM Transactions on Applied Perception, 2(2):150-165, 2005. {pdf}

Below are the papers to be presented by students during Lectures 22-26.

5/19M. Y. Tsalamlal, N. Ouarti, and M. Ammi, "Psychophysical study of air jet based tactile stimulation," IEEE World Haptics Conference, pp. 639-644, 2013. {pdf} (presented by Group 2 -- Adam, Amanda, Josh)
5/19 A. Moscatelli, A. Naceri, and M. Ernst, "Navigation in the Fingertip," IEEE World Haptics Conference, pp. 519-523, 2013. {pdf} (presented by Group 6 -- Darrel, Sean)
5/21R. M. Pierce, E. A. Fedalei, and K. J. Kuchenbecker, "A wearable device for controlling a robot gripper with fingertip contact, pressure, vibrotactile, and grip force feedback," IEEE Haptics Symposium, pp.19-25, 2014. {pdf} (presented by Group 7 -- Beth, Paul, Zach)
5/21S. Yazdian, A. J. Doxon, D. E. Johnson, H. Z. Tan, and W. R. Provancher, "Compliance display using a tilting-plate tactile feedback device," IEEE Haptics Symposium, pp.13-18, 2014. {pdf} (presented by Group 4 -- Eduardo, Jee, Jung Hwa)
5/23J. M. Walker, A. A. Blank, P. A. Shewokis, and M. K. O'Malley, "Tactile feedback of object slip improves performance in a grasp and hold task," IEEE Haptics Symposium, pp.461-466, 2014. {pdf} (presented by Group 1 -- Cliff, Lawrence, Yuhang)
5/23S. Shayan-Amin, L. L. Kovacs, and J. Kovecses, "The role of mechanical properties on the behaviour and performance of multi-dof haptic devices," IEEE World Haptics Conference, pp. 725-730, 2013. {pdf} (presented by Group 5 -- Joel, Tania)
5/28N. Pedemonte, T. Laliberte, C. Gosselin, "A bidirectional haptic device for the training and assessment of handwriting capabilities," IEEE World Haptics Conference, pp. 599-604, 2013. {pdf} (presented by Group 3 -- Dan, Jose, Mark)
5/28 S. Paneels, M. Anastassova, S. Strachan, S. P. Van, S. Sivacoumarane, C. Bolzmacher, "What's around me? Multi-actuator haptic feedback on the wrist," IEEE World Haptics Conference, pp.407-412, 2013. {pdf} (presented by Group 8 -- Michael, Ben, Jake)

Presentation

Paper comprehension and presentation are important skills for research and development, and paper presentations will introduce the class to a wide variety of haptic systems. Each team will give one 25-minute paper presentation/activity (10-minute talk, 5-minute Q&A, 10-minute activity) to the class.

Paper presentation assignment
Presentation evaluation form

Project

The project is to develop a novel haptic system for understanding human perception and performance in virtual or teleoperated environments. The project must include bidirectional haptic interaction between a person or a robot and a real, remote, or virtual environment, and a corresponding experiment to characterize human/system capabilities.

Project assignment

Linear Amplifier Schematic
Linear Amplifier Layout
Writing Advice
Latex and Word paper templates

Final project demonstrations were shown at a "Stanford Haptics Showcase" on Friday, May 30 from 1:30-3:00 pm in Bldg. 550 grove area. The project demonstrations were joint with CS 277: Experimental Haptics. Congratulations to all the ME 327 students on their successful project demonstrations!