{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T16:44:05Z","timestamp":1778258645952,"version":"3.51.4"},"reference-count":61,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,1,17]],"date-time":"2018-01-17T00:00:00Z","timestamp":1516147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>This paper presents an eye gaze controlled projected display that can be used in aviation and automotive environment as a head up display. We have presented details of the hardware and software used in developing the display and an algorithm to improve performance of point and selection tasks in eye gaze controlled graphical user interface. The algorithm does not require changing layout of an interface; it rather puts a set of hotspots on clickable targets using a Simulated Annealing algorithm. Four user studies involving driving and flight simulators have found that the proposed projected display can improve driving and flying performance and significantly reduce pointing and selection times for secondary mission control tasks compared to existing interaction systems.<\/jats:p>","DOI":"10.3390\/mti2010001","type":"journal-article","created":{"date-parts":[[2018,1,17]],"date-time":"2018-01-17T12:17:11Z","timestamp":1516191431000},"page":"1","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Eye Gaze Controlled Projected Display in Automotive and Military Aviation Environments"],"prefix":"10.3390","volume":"2","author":[{"given":"Gowdham","family":"Prabhakar","sequence":"first","affiliation":[{"name":"Indian Institute of Science, Bangalore 560012, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3054-6699","authenticated-orcid":false,"given":"Pradipta","family":"Biswas","sequence":"additional","affiliation":[{"name":"Indian Institute of Science, Bangalore 560012, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,1,17]]},"reference":[{"key":"ref_1","unstructured":"Huey, E. (1968). The Psychology and Pedagogy of Reading (Reprint), MIT Press."},{"key":"ref_2","unstructured":"Duchowski, A.T. (2007). Eye Tracking Methodology, Springer."},{"key":"ref_3","unstructured":"(2017, October 17). Testing Procedure of Tobii Tracker. Available online: https:\/\/www.tobiipro.com\/about\/quality\/."},{"key":"ref_4","unstructured":"Voronka, N., and Jacobus, C.J. (2001). Low-Cost Non-Imaging Eye Tracker System for Computer Control. (No. 6299308 B1), U.S. Patent."},{"key":"ref_5","unstructured":"Milekic, S. (2009). Using Gaze Actions to Interact with a Display. (No. 7561143 B1), U.S. Patent."},{"key":"ref_6","unstructured":"Jacob, M., Hurwitz, B., and Kamhi, G. (2013). Eye Tracking Based Selective Accentuation of Portions of a Display. (No. 2013169237 A1), WO Patent."},{"key":"ref_7","unstructured":"Farrell, S., and Zhai, S. (2005). System and Method for Selectively Expanding or Contracting a Portion of a Display Using Eye-Gaze Tracking. (No. 20050047629 A1), U.S. Patent."},{"key":"ref_8","unstructured":"Martins, F.C.M. (2003). Passive Gaze-Driven Browsing. (No. 6608615 B1), U.S. Patent."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhai, S., Morimoto, C., and Ihde, S. (1999, January 15\u201320). Manual and Gaze Input Cascaded (MAGIC) Pointing. Proceedings of the SIGCHI Conference on Human Factors in Computing System (CHI), Pittsburgh, PA, USA.","DOI":"10.1145\/302979.303053"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ashdown, M., Oka, K., and Sato, Y. (2005, January 2\u20137). Combining Head Tracking and Mouse Input for a GUI on Multiple Monitors. Proceedings of the CHI Late breaking Result, Portland, OR, USA.","DOI":"10.1145\/1056808.1056873"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dostal, J., Kristensson, P.O., and Quigley, A. (2013, January 19\u201322). Subtle Gaze-Dependent Techniques for Visualising Display Changes in Multi-Display Environments. Proceedings of the ACM International Conference of Intelligent User Interfaces (IUI), Santa Monica, CA, USA.","DOI":"10.1145\/2449396.2449416"},{"key":"ref_12","unstructured":"Zhang, Y., Bulling, A., and Gellersen, H. (May, January 27). SideWays: A Gaze Interface for Spontaneous Interaction with Situated Displays. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing System (CHI), Paris, France."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fu, Y., and Huang, T.S. (2007, January 21\u201322). hMouse: Head Tracking Driven Virtual Computer Mouse. Proceedings of the IEEE Workshop on Applications of Computer Vision, Austin, TX, USA.","DOI":"10.1109\/WACV.2007.29"},{"key":"ref_14","unstructured":"(2013, September 22). CameraMouse. Available online: http:\/\/www.cameramouse.com."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s10209-009-0147-2","article-title":"Hands-free interaction with a computer and other technologies","volume":"8","author":"Fejtova","year":"2009","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1037\/h0055392","article-title":"The Information Capacity of the Human Motor System in controlling the amplitude of movement","volume":"47","author":"Fitts","year":"1954","journal-title":"J. Exp. Psychol."},{"key":"ref_17","unstructured":"Bates, R. (September, January 30). Multimodal Eye-Based Interaction for Zoomed Target Selection on a Standard Graphical User Interface. Proceedings of the INTERACT, Edinburgh, Scotland."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1080\/10447318.2011.535752","article-title":"Combining Eye Gaze Input with a Brain\u2013Computer Interface for Touchless Human\u2013Computer Interaction","volume":"27","author":"Zandera","year":"2010","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Penkar, A.M., Lutteroth, C., and Weber, G. (2012, January 26\u201330). Designing for the Eye\u2014Design Parameters for Dwell in Gaze Interaction. Proceedings of the 24th Australian Computer-Human Interaction Conference (OZCHI 2012), Melbourne, Australia.","DOI":"10.1145\/2414536.2414609"},{"key":"ref_20","unstructured":"Grandt, M., Pfendler, C., and Mooshage, O. (2013, November 30). Empirical Comparison of Five Input Devices for Anti-Air Warfare Operators. Available online: http:\/\/dodccrp.org\/events\/8th_ICCRTS\/pdf\/035.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lutteroth, C., Penkar, M., and Weber, G. (2015, January 11\u201315). Gaze vs. Mouse: A Fast and Accurate Gaze-Only Click Alternative. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, Charlotte, NC, USA.","DOI":"10.1145\/2807442.2807461"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pfeuffer, K., and Gellersen, H. (2016, January 16\u201319). Gaze and Touch Interaction on Tablets. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan.","DOI":"10.1145\/2984511.2984514"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Voelker, S., Matviienko, A., Sch\u00f6ning, J., and Borchers, J. (2015, January 8\u20139). Combining Direct and Indirect Touch Input for Interactive Desktop Workspaces using Gaze Input. Proceedings of the 3rd ACM Symposium on Spatial User Interaction, Los Angeles, CA, USA.","DOI":"10.1145\/2788940.2788949"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1080\/00222895.1985.10735338","article-title":"Fitts\u2019 Law in Two Dimensions with Hand and Head Movements","volume":"17","author":"Jagacinski","year":"1985","journal-title":"J. Mot. Behav."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1207\/S15327108IJAP1202_4","article-title":"Improved usability of aviation automation through direct manipulation and graphical user interface design","volume":"12","author":"Kaber","year":"2002","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_26","unstructured":"Baty, D.L., and Watkins, M.L. (1979). An Advanced Cockpit Instrumentation System: The Co-Ordinated Cockpit Displays."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/0040-1625(88)90055-8","article-title":"Technological change in the military aircraft cockpit industry","volume":"33","author":"Sokol","year":"1988","journal-title":"Technol. Forecast. Soc. Chang."},{"key":"ref_28","unstructured":"Furness, T.A. (October, January 29). The super cockpit and its human factors challenges. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Dayton, OH, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Thomas, P., Biswas, P., and Langdon, P. (2015, January 2\u20137). State-of-the-Art and Future Concepts for Interaction in Aircraft Cockpits. Proceedings of the HCI International, Los Angeles, CA, USA.","DOI":"10.1007\/978-3-319-20681-3_51"},{"key":"ref_30","unstructured":"MacKenzie, I.S., Sellen, A., and Buxton, W. (May, January 27). A comparison of input devices in elemental pointing and dragging tasks. Proceedings of the CHI\u201991 Conference on Human Factors in Computing Systems, New Orleans, LA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.ijhcs.2017.08.003","article-title":"Performance, characteristics, and error rates of cursor control devices for aircraft cockpit interaction","volume":"109","author":"Thomas","year":"2018","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1080\/10447318.2014.1001301","article-title":"Multimodal Intelligent Eye-Gaze Tracking System","volume":"31","author":"Biswas","year":"2015","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1080\/10447318.2011.555321","article-title":"Haptic Seat Interfaces for Driver Information and Warning Systems","volume":"27","author":"Chang","year":"2011","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Miniotas, D. (2001, January 1\u20136). Application of Fitts\u2019 Law to Eye Gaze Interaction. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), The Hague, The Netherlands.","DOI":"10.1145\/633292.633496"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2368","DOI":"10.1109\/TITS.2014.2337331","article-title":"Hand Gesture Recognition in Real-Time for Automotive Interfaces: A Multimodal Vision-based Approach and Evaluations","volume":"15","author":"Trivedi","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_36","first-page":"344","article-title":"Generating a Personalized UI for the Car: A User-Adaptive Rendering Architecture","volume":"Volume 7899","author":"Feld","year":"2013","journal-title":"Lecture Notes in Computer Science, Proceedings of the International Conference on User Modeling, Adaptation, and Personalization (UMAP), Rome, Italy, 10\u201314 June 2013"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1080\/10447318.2015.1045240","article-title":"Design and Evaluation of a Touch-Based Personalizable In-vehicle User Interface","volume":"31","author":"Normark","year":"2015","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Poitschke, T., Laquai, F., Stamboliev, S., and Rigoll, G. (2011, January 9\u201312). Gaze-based interaction on multiple displays in an automotive environment. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Anchorage, AK, USA.","DOI":"10.1109\/ICSMC.2011.6083740"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Duarte, R.S., and Oliveira, B.F. (2014, January 10\u201312). Comparing the Glance Time Required to Operate Standart Interface Devices and Touchscreen Devices in Automobiles. Proceedings of the ACM Interacci\u00f3n, Puerto de la Cruz, Tenerife, Spain.","DOI":"10.1145\/2662253.2662315"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"May, K.R., Walker, B.N., and Gable, T.M. (2014, January 17\u201319). A Multimodal Air Gesture Interface for In Vehicle Menu Navigation. Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Automotive UI 2014), Seattle, WA, USA.","DOI":"10.1145\/2667239.2667280"},{"key":"ref_41","unstructured":"Weinberg, G., Knowles, A., and Langer, P. (2014, January 17\u201319). BullsEye: An Automotive Touch Interface that\u2019s always on Target. Proceedings of the 4th International Conference on Automotive UI, Portsmouth, NH, USA."},{"key":"ref_42","unstructured":"Mondragon, C.K., and Bleacher, B. (2013). Eye Tracking Control of Vehicle Entertainment Systems. (No. WO2013036632), U.S. Patent."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ruiz, J., and Lank, E. (2010, January 7\u201310). Speeding pointing in tiled widgets: Understanding the effects of target expansion and misprediction. Proceedings of the 15th International Conference on Intelligent User Interfaces (IUI\u201910), Hong Kong, China.","DOI":"10.1145\/1719970.1720002"},{"key":"ref_44","unstructured":"Seder, T.A., Szczerba, J.F., and Cui, D. (2015). Virtual Cursor for Road Scene Object Lelection on Full Windshield Head-up Display. (No. US20120174004), U.S. Patent."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Vertegaal, R. (2008, January 20\u201322). A Fitts\u2019 Law Comparison of Eye Tracking and Manual Input in the Selection of Visual Targets. Proceedings of the International Conference of Multimodal Interaction, Chania, Crete, Greece.","DOI":"10.1145\/1452392.1452443"},{"key":"ref_46","unstructured":"(2014, July 12). System Usability Scale. Available online: http:\/\/en.wikipedia.org\/wiki\/System_usability_scale."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1080\/10447318.2015.1070561","article-title":"Utilization of Visual Information Perception Characteristics to Improve Classification Accuracy of Driver\u2019s Visual Search Intention for Intelligent Vehicle","volume":"31","author":"Kim","year":"2015","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_48","unstructured":"(2017, October 03). Flight Manual for the Package Eurofighter Typhoon Professional. Available online: https:\/\/www.afs-design.de\/pdf\/AFS_EFpro_English.pdf."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.procs.2014.11.010","article-title":"Eye-Gaze Tracking based Interaction in India","volume":"39","author":"Biswas","year":"2014","journal-title":"Procedia Comput. Sci."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ware, C., and Mikaelian, H.M. (1987, January 5\u20139). An Evaluation of an Eye Tracker as a Device for Computer Input. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI), Toronto, ON, Canada.","DOI":"10.1145\/29933.275627"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1207\/s15327590ijhc1001_2","article-title":"Improvement of Pointing Time by Predicting Targets in Pointing with a PC Mouse","volume":"10","author":"Murata","year":"1998","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_52","unstructured":"Pasqual, P., and Wobbrock, J. (26\u20131, January 26). Mouse pointing end-point prediction using kinematic template matching. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201914), Toronto, ON, Canada."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Biswas, P. (2016). Exploring the Use of Eye Gaze Controlled Interfaces in Automotive Environments, Springer.","DOI":"10.1007\/978-3-319-40709-8"},{"key":"ref_54","unstructured":"(2016, August 31). Tobii X3 Eye Tracker. Available online: https:\/\/www.tobiipro.com\/product-listing\/tobii-pro-x3-120\/."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A Feature Integration Theory of Attention","volume":"12","author":"Treisman","year":"1980","journal-title":"Cogn. Psychol."},{"key":"ref_56","unstructured":"(2016, July 12). HOTAS. Available online: http:\/\/www.thrustmaster.com\/products\/hotas-warthog."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Large, D., Burnett, G., Crundall, E., Lawson, G., and Skrypchuk, L. (2016, January 24\u201326). Twist It, Touch It, Push It, Swipe It: Evaluating Secondary Input Devices for Use with an Automotive Touchscreen HMI. Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (ACM AutoUI), Ann Arbor, MI, USA.","DOI":"10.1145\/3003715.3005459"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Ward, D.J., Blackwell, A.F., and MacKay, D.J.C. (2000, January 6\u20138). Dasher\u2014A Data Entry Interface Using Continuous Gestures and Language Models. Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST), San Diego, CA, USA.","DOI":"10.1145\/354401.354427"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Kern, D., Mahr, A., Castronovo, S., Schmidt, A., and M\u00fcller, C. (2010, January 11\u201312). Making Use of Drivers\u2019 Glances onto the Screen for Explicit Gaze-Based Interaction. Proceedings of the Second International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Pittsburgh, PA, USA.","DOI":"10.1145\/1969773.1969792"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Zhai, S., Hunter, M., and Smith, B.A. (2000, January 5\u20138). The Metropolis Keyboard\u2014An Exploration of Quantitative Techniques for Virtual Keyboard Design. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2000), San Diego, CA, USA.","DOI":"10.1145\/354401.354424"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Biswas, P., Twist, S., and Godsill, S. (2017, January 3\u20136). Intelligent Finger Movement Controlled Interface for Automotive Environment. Proceedings of the British HCI Conference, Sunderland, UK.","DOI":"10.14236\/ewic\/HCI2017.25"}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:51:40Z","timestamp":1760194300000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/2\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,17]]},"references-count":61,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["mti2010001"],"URL":"https:\/\/doi.org\/10.3390\/mti2010001","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1,17]]}}}