Introduction to Augmented Reality
- Einführung in die Erweiterte Realität -
Module IN 2018 Vorlesung + Übungen im Sommersemester 2013Prof. Gudrun Klinker, Ph.D. (with Andreas Dippon and Patrick Maier) 2V+2Ü
5 ECTS Credits The class will be taught in English. Special announcement:
Invited talk by Prof. J.Edward Swan this Friday, June 7, 14:00-15:00 at the Institute of Advanced Studies (IAS)
How Do We Measure Depth Perception in Near-Field Augmented Reality?
Time & Location
Lecture:- wednesdays, 10:15-11:45, MI 00.13.009A (Multimedia room)
Exercises:
- tuesdays, 16:00-17:30, MI 00.04.011 (HS2)
Content
Augmented Reality (AR) allows users to view computer information that is graphically embedded within the real three-dimensional world. Using a semi-transparent head-mounted display (HMD) attached to a wearable computer, a user can inspect and manipulate objects while viewing information about these objects in the HMD. This information is typically displayed as virtual objects in the real world, thus augmenting the perception of the user. The wearable computer enables users to carry their work as they normally do, without imposing constraints on their mobility or their hand. AR applications span from medical minimally invasive surgery to manufacturing, from machine inspection and repair to games and tourist guides. This class presents the technical foundations of Augmented Reality - as used in current international research and applications.More Information
Intended audience:- Diploma students: Hauptstudium Informatik I (Praktische Informatik)
- Senior bachelor students with interest in pursuing a bachelor's thesis in this area
- Master students
- Grundstudium Informatik
- First two years of Bachelor Informatik
- The class consists of both a weekly lecture and weekly exercises!
- Exercises constitute half of the credits and thus will make up half of the grade (exam questions).
- Exam questions will be based on experiences gained by attending the exercise meetings and by working on the homework. It will not be enough to just read and understand solutions to the homework. The learning experience and insights gained by struggling with the assignments is essential.
- Duration: 90 minutes
- Language: assignment sheet in English, answers can be given in English or German
- Exam date: Fr 26.07.2013, 13:00 - 14:30
- Exam Review: Thursday, 08.08.2013, 14:00 - 15:00 in Room 00.13.062 bring your student ID
- Location: 5101.EG.501 (2501, Rudolf-Mößbauer-Hörsaal) (if needed: 5101.EG.502 (2502, Physik Hörsaal 2)) There will be lists with your names on the doors.
- There will be a 0.3 bonus for good project presentations
- Repeat exam (Wiederholungsklausur)
written, 90 minutes, questions in English
Date: 25.09.2013, 08:30 - 10:00
Location: Interims Hörsaal 1.
- By appointment (email to Prof.Klinker)
- http://mailnavab.in.tum.de/mailman/listinfo/ar-class
- List will be used for
- Knowledge dissemination
- Discussion about topics and issues of exercises
Schedule
| Date | Subject | links to slides (restricted) |
|---|---|---|
| 17.4.2013 | 1. Introduction | L1-Overview.pdf |
| 24.4.2013 | no class (FVV) | - |
| 1.5.2013 | no class (1. Mai) | - |
| 8.5.2013 | 2. Coordinate Systems, Projective Geometry, Spatial Relationship Graphs | L2-CoordSys.pdf |
| 15.5.2013 | 3. Basics of Computer Vision | L3-BasicCV.pdf |
| 22.5.2013 | 4. Camera Calibration Example | L4-CamCalib.pdf Tsai87.pdf |
| 29.5.2013 | 5. Markerless Optical Tracking and Feature Detection | L5-PTAM.pdf Klein-ISMAR07.pdf Davison-ras2001.pdf |
| 5.6.2013 | 6. Tracking Devices | L6-Trackers.pdf rolland-tracking-chapter.pdf |
| 12.6.2013 | Lab Visit | - |
| 19.6.2013 | 7. Sensor Fusion and Registration | L7-SensorFusion.pdf |
| 26.6.2013 | 8. Rendering, Occlusions between Real and Virtual Objects | L8-OpenGL-Occlusions.pdf |
| 3.7.2013 | 9. Displays | L9-Displays.pdf |
| 10.7.2013 | 10. Display Calibration | L10-DisplayCalibration.pdf SPAAM-presence-2002.pdf drc-ismar04.pdf |
| 17.7.2013 | 11. AR-based Interaction | L11-ARbasedUIs.pdf |
| 16.7.2013 | Demo Day | - |
Excercises
We will use C++ in the Exercises.
Literature
Lecture (excerpts from books and papers from proceedings, journals - most relevant texts)
- The OpenGl Programming Guide - The Redbook; http://www.opengl.org/documentation/red_book/
- A. Munshi, D. Ginsburg, D. Shreiner: OpenGL ES 2.0 Programming Guide, Addison-Wesley, 2009, ISBN-10: 0-321-50279-7. (Also available as eBook from Safari).
- R. Laganiere: OpenCV 2 - Computer Vision Applications Programming Cookbook, Packt Publishing open source, 2011. [[http://www.google.de/url?sa=t&rct=j&q=laganiere%20opencv%20packtpub&source=web&cd=1&ved=0CB0QFjAA&url=http%3A%2F%2Fwww.packtpub.com%2Fsites%2Fdefault%2Ffiles%2F3241-chpater-5-transforming-images-with-morphological-operations.pdf&ei=7rq3TqCQMIegOuTEtYEC&usg=AFQjCNEgV8tmklWQTUSyMErwy4EJihKGYg&sig2=iKitowSuSCH98LyWFQTIyA&cad=rja], Online sample:[Chapter 5 on Morphological Operations
- R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online version (for personal use only): http://szeliski.org/Book/
- R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version: http://www.robots.ox.ac.uk/~vgg/hzbook/index.html
- D.Ballard and C.Brown: Computer Vision . Online version:; http://homepages.inf.ed.ac.uk/rbf/BOOKS/BANDB/bandb.htm
- R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision; Download from CALTECH.
- J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
- D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
- J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
- M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
- P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
- M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
Exercises
- A. Alexandrescu, Modern C++ Design - recommended for advanced C++
- B. Eckel, Thinking in C++ (available online)
- Chapter 3 recommended for beginners in C
- Ch. 1,2,4 recommended for beginners in C++
- Ch. 5 ff. recommended for intermediate C++
- B. Stroustrup, The C++ Programming Language - recommended as reference
- "The Red Book" - OpenGL programming guide
- OpenCV Documentation Resources
| TeachingForm | |
|---|---|
| Title: | Introduction to Augmented Reality - Einführung in die erweiterte Realität |
| Professor: | Prof. Gudrun Klinker, Ph.D. |
| Tutors: | Andreas Dippon and Patrick Maier |
| Type: | Lecture |
| Information: | 2 SWS Vorlesung + 2 SWS Übung, 5 ECTS Credits; Mi 10:15 - 11:45 Vorlesung, Di 16:00-17:30 Übung (Module IN 2018) |
| Term: | 2013SoSe |
| Abstract: | Augmented Reality (AR) allows users to view computer information that is graphically embedded within the real three-dimensional world. Using a semi-transparent head-mounted display (HMD) attached to a wearable computer, a user can inspect and manipulate objects while viewing information about these objects in the HMD. This information is typically displayed as virtual objects in the real world, thus augmenting the perception of the user. The wearable computer enables users to carry their work as they normally do, without imposing constraints on their mobility or their hand. AR applications span from medical minimally invasive surgery to manufacturing, from machine inspection and repair to games and tourist guides. This class presents the technical foundations of Augmented Reality - as used in current international research and applications. |
