Introduction to Augmented Reality
- Einführung in die Erweiterte Realität -
Module IN 2018 Vorlesung + Übungen im Wintersemester 2011/12Prof. Gudrun Klinker, Ph.D. (with Marcus Tönnis and Frieder Pankratz) 2V+2Ü
5 ECTS Credits The class will be taught in English.
Time & Location
Lecture:- thursdays, 10:15-11:45, MI 00.13.009A (Multimedia room)
Exercises: two groups (you attend only one)
- mondays, 14:15-15:45, MI 00.13.009A (Multimedia room)
- thursdays, 12:30-14:00, MI 00.13.009A (Multimedia room)
Content
Augmented Reality (AR) allows users to view computer information that is graphically embedded within the real three-dimensional world. Using a semi-transparent head-mounted display (HMD) attached to a wearable computer, a user can inspect and manipulate objects while viewing information about these objects in the HMD. This information is typically displayed as virtual objects in the real world, thus augmenting the perception of the user. The wearable computer enables users to carry their work as they normally do, without imposing constraints on their mobility or their hand. AR applications span from medical minimally invasive surgery to manufacturing, from machine inspection and repair to games and tourist guides. This class presents the technical foundations of Augmented Reality - as used in current international research and applications.More Information
Intended audience:- Diploma students: Hauptstudium Informatik I (Praktische Informatik)
- Senior bachelor students with interest in pursuing a bachelor's thesis in this area
- Master students
- Grundstudium Informatik
- First two years of Bachelor Informatik
- The class consists of both a weekly lecture and weekly exercises!
- Exercises constitute half of the credits and thus will make up half of the grade (exam questions).
- Exam questions will be based on experiences gained by attending the exercise meetings and by working on the homework. It will not be enough to just read and understand solutions to the homework. The learning experience and insights gained by struggling with the assignments is essential.
- Duration: 90 minutes
- Language: assignment sheet in English, answers can be given in English or German
- Schedule: March 1, 2012, 14:30-16:00
- Location: Lecture Hall MI HS 1
- There will be a 0.3 bonus for good project presentations
- By appointment (email to Prof.Klinker)
- http://mailnavab.in.tum.de/mailman/listinfo/ar-class
- List will be used for
- Knowledge dissemination
- Discussion about topics and issues of exercises
Schedule
| Date | Subject | links to slides (restricted) |
|---|---|---|
| 20.10.2011 | 1. Introduction | L1-Overview.pdf |
| 27.10.2011 | 2. Coordinate Systems, Projective Geometry | L2-CoordSys.pdf |
| 3.11.2011 | 3. Basics of Computer Vision | L3-BasicCV.pdf |
| 10.11.2011 | 4. Camera Calibration Example | L4-CamCalib.pdf |
| 17.11.2011 | 5. Markerless Optical Tracking and Feature Detection | L5-PTAM.pdf |
| 24.11.2011 | 6. Tracking Devices | L6-Trackers.pdf |
| 1.12.2011 | 7. AR-Related Concepts: Mixed Reality, Ubiquitous Computing, Classes of AR Presentation (M. Tönnis) | L7-Related-Concepts.pdf |
| 8.12.2011 | no class (Dies Academicus) | - |
| 15.12.2011 | 8. Sensor Fusion and Registration | L8-SensorFusion.pdf |
| 22.12.2011 | Lab Visit | - |
| Christmas break | - | |
| 12.1.2012 | 9. Rendering, Occlusions between Real and Virtual Objects | L9-OpenGL.pdf |
| 19.1.2012 | 10. Displays | L10-Displays.pdf |
| 26.1.2012 | 11. Display Calibration | L11-DisplayCalibration.pdf |
| 2.2.2012 | 12. AR-based Interaction ... in the IMETUM Hörsaal | L12-ARbasedUIs.pdf |
| last week | Student Demos: Results of Exercises | - |
Excercises
Literature
Lecture (excerpts from books and papers from proceedings, journals - most relevant texts)
- The OpenGl Programming Guide - The Redbook; http://www.opengl.org/documentation/red_book/
- R. Laganiere: OpenCV 2 - Computer Vision Applications Programming Cookbook, Packt Publishing open source, 2011. [[http://www.google.de/url?sa=t&rct=j&q=laganiere%20opencv%20packtpub&source=web&cd=1&ved=0CB0QFjAA&url=http%3A%2F%2Fwww.packtpub.com%2Fsites%2Fdefault%2Ffiles%2F3241-chpater-5-transforming-images-with-morphological-operations.pdf&ei=7rq3TqCQMIegOuTEtYEC&usg=AFQjCNEgV8tmklWQTUSyMErwy4EJihKGYg&sig2=iKitowSuSCH98LyWFQTIyA&cad=rja], Online sample:[Chapter 5 on Morphological Operations
- R. Szeliski: Computer Vision - Algorithms and Applications, Springer Verlag, 2011. Online version (for personal use only): http://szeliski.org/Book/
- R.Hartley and A.Zisserman: Multiple View Geometry in Computer Vision; Cambridge University Press, 2004. Online version: http://www.robots.ox.ac.uk/~vgg/hzbook/index.html
- D.Ballard and C.Brown: Computer Vision . Online version:; http://homepages.inf.ed.ac.uk/rbf/BOOKS/BANDB/bandb.htm
- R.Tsai: A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision; Download from CALTECH.
- J.Rolland, L.Davis, Y. Baillot: A Survey of Tracking Technology for Virtual Environments; in Fundamentals of Wearable Computers and Augmented, 2001. Download from UPenn.
- D.Allen, G.Bishop, G.Welch: Tracking - Beyond 15 Minutes of Thought; Course 11 at Siggraph 2001. Download from UNC.
- J.Rolland, H. Fuchs: Optical versus See-Through Head-Mounted Displays; in Fundamentals of Wearable Computers and Augmented, 2001. Download from citeseer.
- M.Tuceryan, Y.Genc, N.Navab: Single Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration; in Presence: Teleoperators and Virtual Environments, 11(3), 2002. Download from M. Tuceryan's home page.
- P.Milgram, Colquhoun: A Taxonomy of Real and Virtual World Display Integration; in Proc. International Symposium of Mixed Reality (ISMR 1999). Download from ebookbrowse.
- M.Weiser: The Computer for the Twenty-First Century; Scientific American, 1991. Download from ubiq.com.
Exercises
- A. Alexandrescu, Modern C++ Design - recommended for advanced C++
- B. Eckel, Thinking in C++ (available online)
- Chapter 3 recommended for beginners in C
- Ch. 1,2,4 recommended for beginners in C++
- Ch. 5 ff. recommended for intermediate C++
- B. Stroustrup, The C++ Programming Language - recommended as reference
- "The Red Book" - OpenGL programming guide
- OpenCV Documentation Resources
| TeachingForm | |
|---|---|
| Title: | Introduction to Augmented Reality - Einführung in die erweiterte Realität |
| Professor: | Prof. Gudrun Klinker, Ph.D. |
| Tutors: | Marcus Tönnis, Frieder Pankratz and Andreas Dippon |
| Type: | Lecture |
| Information: | 2 SWS Vorlesung + 2 SWS Übung, 5 ECTS Credits; Do 10:15 - 11:45 Vorlesung, Mo 14:15-15:45 und Do 12:30.14:00 Übung (Module IN 2018) |
| Term: | 2011WiSe |
| Abstract: | Augmented Reality (AR) allows users to view computer information that is graphically embedded within the real three-dimensional world. Using a semi-transparent head-mounted display (HMD) attached to a wearable computer, a user can inspect and manipulate objects while viewing information about these objects in the HMD. This information is typically displayed as virtual objects in the real world, thus augmenting the perception of the user. The wearable computer enables users to carry their work as they normally do, without imposing constraints on their mobility or their hand. AR applications span from medical minimally invasive surgery to manufacturing, from machine inspection and repair to games and tourist guides. This class presents the technical foundations of Augmented Reality - as used in current international research and applications. |
