 |
|
|
|
|
| Education |
PhD, in Electrical Engineering, Automation and Robotics Research Institute, University of Texas at Arlington, USA (August 2008-May 2011)
Dissertation title: Online Learning Algorithms for Differential Dynamic Games and Optimal Control
Advisor: Frank L. Lewis (lewis[at]uta.edu)
GPA: 4.0/4.0
Master of Science (MS), in Electrical Engineering, Automation and Robotics Research Institute, University of Texas at Arlington, USA (August 2006-May 2008)
Advisor: Frank L. Lewis (lewis[at]uta.edu)
GPA (EE courses): 4.0/4.0
Diploma (Master of Science in Engineering), in Electronic and Computer Engineering, Technical University of Crete, Greece (September 2001-June 2006)
Thesis title: Adaptive Control for MAPK Cascade Models Using RBF Neural Networks (Systems Biology)
Advisor: Manolis A. Christodoulou (manolis[at]ece.tuc.gr )
Committee: N.D. Sidiropoulos, F. L. Lewis (University of Texas)
GPA: 8.6/10(>3.9/4.0), Excellent Grade.
| Research |
I am interested in Control Systems (Neural Networks for Feedback Control, Approximate Dynamic Programming, Adaptive Control, Optimal Control, Game Theory, Distributed Control, Systems Biology).
Recent media coverage of my research: Award-Winning Research Keeps Soldiers Safe, Effective.
Now I am working on Approximate Dynamic Programming and Game Theory.
Game Theory: Differential games are related closely with optimal control problems. In an optimal control problem there is single control u(t) and a single criterion to be optimized; differential game theory generalizes this to two controls u(t),v(t) and two criteria, one for each player. Each player attempts to control the state of the system so as to achieve his goal; the system responds to the inputs of both players.
Approximate Dynamic Programming: Approximate dynamic programming in continuous and discrete time systems with state feedback and output feedback controllers, H-infinity control etc.
Neural Networks for Control: Dynamical Neural Networks are well established tools used in the control of nonlinear and complex systems.
Systems Biology: Nowadays MAPK cascade models are being used to control the cell division processes and are based on the kinetic properties of three kinases and phosphatases in specific signaling pathways that transmit the information delivered to the cell by stimuli and acts like feedback controller able to adapt to it.
Adaptive Control: Adaptive control approaches enjoy the property of on line control.
Model Predictive Control.
| Professional Experience/Activities |
Faculty Project Research Scientist Center for Control, Dynamical-systems, and Computation (CCDC), Department of Electrical and Computer Engineering, University of California, Santa Barbara, (January 2012-present).
Working in the general area of network security, game theory, and multi-agent optimization. Under grants:
"A Cyber Awareness Framework for Attack Analysis, Prediction, and Visualization," MURI ARO grant, W911NF-09-1-0553, 2012-present.
Adjunct Professor Department of Electrical Engineering, The University of Texas at Arlington, (August 2011-January 2012)
Faculty Research Associate/Research Scientist Automation & Robotics Research Institute, The University of Texas at Arlington, (June 2011-January 2012).
Working on Approximate Dynamic Programming and game theory (Nash, Stackelberg, graphical games). Under grants:
"Adaptive Dynamic Programming for Real-Time Cooperative Multi-Player Games and Graphical Games," NSF grant, ECS-1128050, 2011-present.
"Design of Structured Controllers for High Performance DoD Maneuvering Systems Using Neural Networks," ARO grant, W91NF-05-1-0314, 2008-present.
"Trust Based Collaborative Control for Teams on Communication Networks," Air Force Office of Scientific Research (AFOSR) grant, FA9550-09-1-0278, 2009-present.
Member Editorial Board International Journal of Machine Intelligence and Sensory Signal Processing (IJMISSP), (November 2011-present)
Organizer and Chair special session on “Reinforcement Learning, Approximation Based Control, and Games”, IEEE Multi-Conference on Systems and Control (MSC), Colorado, September 2011
Co-Chair special session on "Approximate Dynamic Programming with feedback Control Applications", International Joint Conference on Neural Networks (IJCNN), Barcelona, 2010
International Program Committee Member (Associate Editor) for IEEE Multiconference on Systems and Control, 2011, 2012
Research Assistant Automation & Robotics Research Institute, The University of Texas at Arlington, (Sep. 2006-May 2011)
Working on Approximate Dynamic Programming. Under grants:
"Design of Structured Controllers for High Performance DoD Maneuvering Systems Using Neural Networks," ARO grant, W91NF-05-1-0314, 2008-present.
"Trust Based Collaborative Control for Teams on Communication Networks," Air Force Office of Scientific Research (AFOSR) grant, FA9550-09-1-0278, 2009-present.
"Adaptive Critics for Nonlinear Continuous-Time Systems," NSF grant, ECS-0501451, 2007-2008.
"Adaptive Dynamic Programming for Continuous Time Systems and Networked Agents on Graphs," NSF grant, ECS-0801330, July 2008-2011.
Teaching Associate and Lecturer Department of Electrical Engineering, The University of Texas at Arlington, (Jan. 2007-May 2011)
Control Systems (Spring 2007)
Electronics II (Spring 2008)
Linear Systems Engineering (Fall 2008)
Optimal Control (Spring 2009)
Control Systems (Spring 2010)
System Identification (Fall 2010)
Digital Circuits Design (Spring 2011)
Reviewer and referee for various scholarly publications including (Sep. 2006-now)
| Honors and Awards |
Best Paper Award, Session on Autonomous/Unmanned Vehicles, 27th Army Science Conference, Orlando, 2010.
Best Researcher/Student Award, UTA Automation & Robotics Research Institute, 2010.
Best Presentation Award at the World Congress of Computational Intelligence, Barcelona, July 2010.
Honors for every of the six years high school education from the Greek Ministry of Education (GPA 3.92/4).
Fellowship of the Greek State Scholarships Foundation (IKY) for the performance at my undergraduate studies.
Invited member of Tau Beta Pi (TBP) and Eta Kappa Nu (HKN) honor engineering societies.
Invited member of Golden Key International honor society.
Registered Electrical/Computer Engineer (PE), Technical Chamber of Greece (2007).
Biography appears in Marquis Who’s Who in the World since 2009, Marquis Who’s Who in Science and Engineering since 2010 and Marquis Who’s Who in America since 2012.
| Publications |
Books
[1] D. Vrabie, K. G. Vamvoudakis, and F. L. Lewis, Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles, to appear, IET press, 2012.
[2] Greg R. Hudas, Dariusz Mikulski, K. G. Vamvoudakis, F. L. Lewis, E. Gu, Decision and Control for Tactical Behaviors of Autonomous Systems, in preparation, 2011.
Patent
[1] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Control methodology for online adaptation to optimal feedback controller using integral reinforcement learning,” U.S. Patent Disclosure, pending, 2011.
Journals
[1] Kyriakos G. Vamvoudakis, F. L. Lewis, W. E. Dixon, “Online Adaptive Learning Solution for Stackelberg Games in Hierarchical Control Problems,” submitted to Automatica, 2011.
[2] M. I. Abouheaf, S. Haesaert, Kyriakos G. Vamvoudakis, F. L. Lewis, “Multi-Agent Discrete-Time Graphical Games and Policy Iteration Solutions,” submitted to Automatica, 2011.
[3] Kyriakos G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online learning algorithm for optimal control with integral reinforcement learning,” submitted to International Journal of Robust and Nonlinear Control, 2011.
[4] S. Bhasin, R. Kamalapurkar, M. Johnson, K. Vamvoudakis, F. L. Lewis, W. E. Dixon, “A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems,” submitted to Automatica, 2011.
[5] F. L. Lewis, D. Vrabie, K. G. Vamvoudakis, “Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers,” submitted to IEEE Control Systems Magazine, 2011.
[6] Kyriakos G. Vamvoudakis, F. L. Lewis, “Multi-Agent Differential Graphical Games: Online Adaptive Learning Solution for Synchronization with Optimality,” provisionally accepted in Automatica, 2011.
[7] Kyriakos G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online learning algorithm for zero-sum games with integral reinforcement learning,” accepted in Journal of Artificial Intelligence and Soft Computing Research, 2011.
[8] Kyriakos G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” to appear in Chaotic Modeling and Simulation Journal (CMSIM), 2012.
[9] Greg Hudas, K. G. Vamvoudakis, D. Mikulski and F. L. Lewis, “Online Adaptive Learning for Team Strategies in Multi-Agent Systems,” invited paper to (special issue, “Intelligent Behaviors for Tactical Unmanned Systems”) Journal of Defense Modeling & Simulation, vol. 9, no. 1, pp. 59-69, 2012.
[10] Kyriakos G. Vamvoudakis, F. L. Lewis, “Multi-Player non zero sum Games: Online Adaptive Learning Solution of Coupled Hamilton-Jacobi Equations,” Automatica, vol. 47, no. 8, pp. 1556-1569, 2011.
[11] Kyriakos G. Vamvoudakis, F. L. Lewis, “Online Neural Network Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” to appear in International Journal of Robust and Nonlinear Control, 2011.
[12] F. L. Lewis, Kyriakos G. Vamvoudakis, “Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data,” IEEE Transactions Systems, Man, and Cybernetics, Part B, vol. 41, no. 1, pp. 14-25, 2011.
[13] Kyriakos G. Vamvoudakis, and F. L. Lewis, “Online Actor-Critic Algorithm to Solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Automatica, vol. 46, no. 5, pp. 878-888, 2010. (This paper was one of the Top 25 Articles in Decision Sciences, Elsevier, April-September, 2010)
Chapters and Contributions in books
[1] K. G. Vamvoudakis, and F. L. Lewis, “Online Adaptive Learning Solution of Multi-Agent Differential Graphical Games,” to appear in Frontiers in Advanced Control Systems, ed. Ginalber Luiz Serra, to appear, INTECH, 2012.
[2] K. G. Vamvoudakis, F. L. Lewis, S. S. Ge “Neural Networks in Feedback Control Systems,” to appear in Mechanical Engineers’ Handbook, Instrumentation, Systems, Controls, and MEMS, ed. Myer Kutz, John Willey, NY, 2012.
[3] K. G. Vamvoudakis, F. L. Lewis, “Online learning algorithms for optimal control and dynamic games,” to appear in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, IEEE Press Computational Intelligence Series, 2012.
[4] S. Bhasin, R. Kamalapurkar, M. Johnson, K. G. Vamvoudakis, F. L. Lewis, W. Dixon “An actor-critic-identifier architecture for adaptive approximate optimal control,” to appear in Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, eds. F. L. Lewis, D. Liu, IEEE Press Computational Intelligence Series, 2012.
[5] K. G. Vamvoudakis, and F. L. Lewis, “Online Gaming: Real Time Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” in Advances in Reinforcement Learning, ed. Abdelhamid Mellouk, Chapter 18, INTECH, 2011.
[6] K. G. Vamvoudakis, and F. L. Lewis, “Online synchronous policy iteration method for optimal control,” in Recent Advances in Intelligent Control Systems, ed. Wen Yu, Chapter 14, Springer-Verlag, Berlin, 2009.
Conferences
[1] Kyriakos G. Vamvoudakis, and F. L. Lewis, “An Online Integral Reinforcement Learning Algorithm to Solve N-Player Nash Games,” submitted to IEEE Multi-Conference on Systems and Control, Dubrovnik, Croatia, 2012.
[2] Kyriakos G. Vamvoudakis, D. Vrabie and F. L. Lewis, “Adaptive Optimal Control Algorithm for Zero-Sum Nash Games with Integral Reinforcement Learning,” submitted to AIAA Guidance, Navigation, and Control Conference, Minneapolis, Minnesota, 2012.
[3] Kyriakos G. Vamvoudakis, and F. L. Lewis, “Policy Iteration Algorithm for distributed networks and graphical games,” Proc. 50th IEEE Conference on Decision and Control, pp. 128-135, Orlando, 2011.
[4] Kyriakos G. Vamvoudakis, and F. L. Lewis, “Non-Zero Sum Games: Online Learning Solution of Coupled Hamilton-Jacobi and Coupled Riccati Equations,” Proc. IEEE Multi-Conference on Systems and Control, pp. 171-178, Denver, Colorado, 2011.
[5] Kyriakos G. Vamvoudakis, and F. L. Lewis, “Multi-agent Differential Graphical Games,” Proc. 30th Chinese Control Conference, pp. 4932–4939, China, 2011.
[6] K. G. Vamvoudakis, D. Vrabie, F. L. Lewis, “Online Learning of Optimal Control Solutions Using Integral Reinforcement Learning and Neural Networks,” Proc. Yale Workshop on Adaptive and Learning Systems, Yale University, 2011.
[7] Kyriakos G. Vamvoudakis, D.Vrabie, and F. L. Lewis, “Online Adaptive Learning of Optimal Control Solutions Using Integral Reinforcement Learning,” Proc. IEEE Symp. ADPRL, pp. 250-257, France, 2011.
[8] Kyriakos G. Vamvoudakis, F. L. Lewis, “Online Solution of Nonlinear Two-Player Zero-Sum Games Using Synchronous Policy Iteration,” Proc. 49th IEEE Conference on Decision and Control, pp. 3040-3047, Atlanta, 2010.
[9] Kyriakos G. Vamvoudakis, M. A. Christodoulou, “Adaptive Backstepping Neural Network Control for Mechanical Pumps,” Proc. 4th Chaotic Modeling and Simulation International Conference, Agios Nikolaos, Crete, Greece, 2011.
[10] Kyriakos G. Vamvoudakis, M. A. Christodoulou, “Adaptive Control of Mixed-Interlaced forms,” Proc. 4th Chaotic Modeling and Simulation International Conference, Agios Nikolaos, Crete, Greece, 2011.
[11] Kyriakos G. Vamvoudakis, D. G. Mikulski, Greg R. Hudas, F. L. Lewis, E. Y. Gu, “Distributed Games for Multi-Agent Systems: Games on Communication Graphs ,” Proc. 27th Army Science Conference, Orlando, FL, 2010. (This paper won the best paper award at the Session on Autonomous/Unmanned Vehicles. Runner-up, best conference paper award.)
[12] Greg Hudas, F. L. Lewis and K. G. Vamvoudakis, “Online Gaming for Learning Optimal Team Strategies in Real Time,” Proceedings of SPIE, vol. 7692, 76920W, doi:10.1117/12.850231, 2010.
[13] F. L. Lewis, Kyriakos G. Vamvoudakis, “Optimal Adaptive Control for Unknown Systems Using Output Feedback by Reinforcement Learning Methods,” Proc. 8th IEEE International Conference on Control & Automation, pp. 2138 - 2145, Xiamen, June, 2010.
[14] K. Vamvoudakis, D.Vrabie, and F. L. Lewis, “Online policy iteration based algorithms to solve the continuous-time infinite horizon optimal control problem,” Proc. IEEE Symp. ADPRL, pp. 36-41, Nashville, Mar. 2009.
[15] K. G. Vamvoudakis, and F. L. Lewis, “Online Actor Critic Algorithm to solve the Continuous-Time Infinite Horizon Optimal Control Problem,” Proc. Int. Joint Conf. on Neural Networks, pp.3180-3187, Atlanta, June 2009.
[16] D.Vrabie, K. Vamvoudakis, and F. L. Lewis, “Adaptive Optimal Controllers based on Generalized policy iteration in Continuous-Time Framework,” Proc. IEEE Mediterranean Conf. Control and Automation, pp.1402-1409, Thessaloniki, June 2009.
[17]
Kyriakos G. Vamvoudakis, Manolis A. Christodoulou, “Adaptive Backstepping Control for MAPK Cascade Models Using RBF Neural Networks,” Proc. IEEE Mediterranean Conf. Control and Automation, Athens, June 2007.[18] Kyriakos G. Vamvoudakis, Manolis A. Christodoulou, “Backstepping, Interlaced and Mixed Interlaced Adaptive Nonlinear Control for Biological Models,” Intelligent Systems and Computing: Theory and Applications Conference (ISYC 06), pp. 196-219, Ayia Napa, Cyprus, July 6-7, 2006.
Tutorial
[1] Frank L. Lewis, D. Vrabie, K. G. Vamvoudakis, “ADP for Control of Continuous-Time Dynamical Systems, Multi-Player Differential Games, and Games on Graphs,” IEEE Symposium ADPRL, 2011.
Thesis
[1] Doctoral Thesis: K. G. Vamvoudakis, “Online Learning Algorithms for Differential Dynamic Games and Optimal Control,” University of Texas at Arlington, May 2011.
[2] Diploma Thesis: K. G. Vamvoudakis, “Adaptive Control for MAPK Cascade Models Using RBF Neural Networks,” Technical University of Crete, June 2006.
| Most important projects (until today) |
32-bit microprocessor: Design of a non-pipelined microprocessor with the use of Altera MaxPlus II.
32-bit microprocessor: Design of a pipelined microprocessor with the use of Altera MaxPlus II.
Design of 8-bit ALU in VLSI: Design and simulation of an 8-bit ALU in full custom VLSI using Electric.
Data Base: Design of a professional data base (implementing the simulation of a Football tournament) with the use of the language SQL and the program Microsoft SQL Server 2000.
Linear System: Design of a steam turbine with the use of Matlab.
Tiny Operating System: Implementation of a TinyOs in C programming Language (using Linux OS) and gcc.
Phonetic Gate for Entertainment in the city of Chania: Design of a phonetic gate using Voice XML and JSP for the entertainment ways in the city of Chania.
Compiler: Implementation of a full compiler for C++ (using bison, flex and C programming).
Project for information retrieval: Implementation of a search engine machine.
Project for Natural Language Processing: Implementation of greeklish - Greek translator using Perl Language.
Vending Machine: Implementation of a vending machine using AVR microcontroller and assembly.
Implementation of data structures using C++.
Programming Projects: Noah's Ark using C++, Airline Reservation System using C++ and many programs using C programming language.
Projects in: Digital Signal Processing, Digital Image Processing, Neural Networks, Video Processing, Digital Communications, Nonlinear and Adaptive Control, Optimal Control, Intelligent Control Systems and Wireless Sensor networks in Matlab, Labview and C.
| Knowledge |
Operating Systems: Windows 98, ME, 2000, XP, NT, 2003 Server, Vista, UNIX (Linux interfaces).
Programming Languages: C, C++, Assembly (MIPS, AVR), Matlab, Java (need for the data base project), UNIX script language, Voice XML, Perl, LabView.
Hardware Languages: VHDL, PLD Shell, Electric.
Data Bases: MS SQL SERVER 2000, MySql.
Desktop Tools: Office 2007, PhotoShop.
Control: Ladder (PLC).
| Foreign Languages |
Excellent knowledge of English.
Little knowledge of French.
| Hobbies |
| Personal |
Citizenship: Greek
Place of Birth: Athens, Greece
Memberships: IEEE Control Systems Society since 2002
IEEE Communications Society since 2003
IEEE Engineering in Medicine and Biology since 2002
IEEE Engineering in Computational Intelligence since 2008
American Institute of Aeronautics and Astronautics (AIAA) since 2012
Other memberships: Elected for 5 consecutive periods as a student representative to the ECE board of directors.
Favorite Team: Panathinaikos
