Holly Handley

Ph.D. in Information Technology and Engineering, George Mason University, (1999)

M.B.A. in Management Information Systems, University of Hawaii, (1995)

M.S. in Electrical Engineering, University of California, Berkeley, (1987)

B.S. in Electrical Engineering, Clarkson College, (1984)

Security Clearance

Sponsoring Organization:

Date Obtained: 2014-01-01

Professional Engineer License

Sponsoring Organization:

Date Obtained: 1989-01-01

Expertise

Research Interests

Human Viewpoint for System Architectures
Simulation Modeling of Human System Interactions
Optimization of Task Assignments and Operator Workload

Articles

Handley, H. (2021). A Retrospective of the Human Viewpoint and its Applicability to Future Systems. Systems Engineering.

Barry, P., Doskey, S., Handley, H., Tolk, A. and Wijesinghe, S. (2021). Digital Collaborators for Complex Systems Development: A Research Agenda. International Journal of System of Systems Engineering.

Handley, H. (2021). Editorial - Introduction to the Special Issue on Human Readiness Levels. Ergonomics in Design: The Quarterly of Human Factors Applications 29 (4).

Handley, H. and Tolk, A. (2021). Human Focused Metrics for Enterprise Readiness Levels. International Journal of System of Systems Engineering.

Marnewick, A. and Handley, H. (2021). Integration of International Competencies into Systems Engineering Graduate Programs. . Systems Engineering .

Efatmaneshnik, M. and Handley, H. (2020). Task Complexity Measurement Framework for Human Systems Integration. IEEE Systems Journal.

Huang, J., Gheorghe, A. V. and Handley, H. (2020). Towards Digital Engineering - The Advent of Digital Systems Engineering. International Journal of System of Systems Engineering.

McKenney, J. and Handley, H. (2020). Using the Design Science Research Method (DSRM) to develop a Skills Gap Analysis Model. IEEE Engineering Management Review.

Handley, H., Vance, E. and Heimerdinger, D. (2019). A Human Resource Framework for Enterprise Architectures. IEEE Engineering Management Review.

Kandemir, C. and Handley, H. (2019). Work process improvement through simulation optimization of task assignment and mental workload. ISI Journal: Computational & Mathematical Organization Theory.

Kandemir, C., Handley, H. and Thompson, D. (2018). A workload model to evaluate distracters and driver's aids. International Journal of Industrial Ergonomics 63 , pp. 18-36.

Handley, H. (2016). A Design Methodology for Fit-for-Purpose Human Views. Systems Engineering 19 (6) , pp. 498-509.

Handley, H., Amissah, M., Heimerdinger, D. and Vance, E. (2016). Non Legacy Viewpoint for DoDAF System of Systems Architecture. Journal of Defense Modeling & Simulation: Applications, Methodology, Technology 13 (4) , pp. 415-429.

Chancey, E., Bliss, J. P., Yamani, Y. and Handley, H. (2016). Trust and the Compliance-Reliance Paradigm: The Effects of Risk, Error Bias, and Reliability on Trust and Dependence. Human Factors: The Journal of the Human Factors and Ergonomics Society 59 (3) , pp. 333-345.

Handley, H. and Knapp, B. (2014). Where are the People? The Human View Approach for Architecting and Acquisition. Defense Acquisition Research Journal 21 (4) , pp. 851-874.

Handley, H. (2013). A Network Model for Human Interoperability. Human Factors: The Journal of the Human Factors and Ergonomics Society 56 (2) , pp. 349-360.

Handley, H. (2012). Incorporating The NATO Human View in the DoDAF 2.0 Meta Model. Systems Engineering 15 (1) , pp. 108-117.

Handley, H., Pinto, C. Ariel. and Gheorghe, A. V. (2012). Introduction to the Special Edition: Challenges, Solutions and Research. International Journal of Critical Infrastructures 8 (2&3) , pp. 91-94.

Handley, H. and Heacox, N. J. (2010). Collaborative Multinational Mission Planning System with Support for Macrocognitive processes. Theoretical Issues in Ergonomic Science.. Taylor & Fancis 11 (4) , pp. 375-386.

Handley, H. and Smillie, R. J. (2010). Human View Dynamics - The NATO Approach. Systems Engineering 13 (1) , pp. 1-8.

Handley, H. and Smillie, R. J. (2008). Architecture Framework Human View: The NATO Approach. Systems Engineering, 11 (2) , pp. 156-164.

Handley, H. and Heacox, N. J. (2004). An Integrative Decision Space Model for Simulation of Cultural Differences in Human Decision-Making.. Information Knowledge Systems Management 4 (2) , pp. 95-105.

Handley, H. and Levis, A. H. (2003). Organizational Architectures and Mission Requirements: A Model to Determine Congruence. Systems Engineering 6 (3) , pp. 184-194.

Handley, H. and Levis, A. H. (2001). A Model to Evaluate the Effect of Organizational Adaptation. Computational and Mathematical Organization Theory 7 (1) , pp. 5-44.

Handley, H. and Levis, A. H. (2001). Incorporating Heterogeneity in Command Center Interactions. Information Knowledge Systems Management 2 (4) , pp. 297-309.

Handley, H., Zaidi, Z. R. and Levis, A. H. (1999). The Use of Simulation Models in Model Driven Experiments. Systems Engineering 2 (2) , pp. 108-128.

Books

Handley, H. and Tolk, A. (2021). A Framework for Human System Engineering Applications and Case Studies. Wiley-IEEE Press.

Handley, H. (2019). The Human Viewpoint for Systems Architectures.

Book Chapters

Handley, H. (2021). Introduction to the Human System Engineering Framework In Handley, H. & Tolk, A. (Ed.). A Framework for Human System Engineering Applications and Case Studies Wiley-IEEE Press.

David, H. and Handley, H. (2021). Observations of Real-Time Control Room Simulation . In Handley, H. & Tolk, A. (Ed.). A Framework for Human System Engineering Applications and Case Studies. Wiley-IEEE Press, pp 245 - 258. (pp. pp 245 - 258) Wiley- IEEE Press.

Handley, H. and Heimerdinger, D. (2020). The Impact of Human Assurance in Satellite Operations Space Infrastructures: Resilience & Risk Governance.

Stenzler, P., Handley, H. and K, W. (2016). Identifying Human Factors Mismatches in Amusement Ride Containment Failure Advances in Human Factors in Sports and Outdoor Recreation (pp. 177-187) Springer International Publishing.

Handley, H. (2012). The Role of Architecture Frameworks in Simulation Models: The Human View Approach Engineering Principles of Combat Modeling and Distributed Simulation (pp. 811-824) John Wiley & Sons, Inc.

Smillie, R. J. and Handley, H. (2009). Human-Centered Design Focus in Systems Engineering Analysis: Human View Methodology Contemporary Ergonomics 2009 (pp. 310-319) CRC Press.

Handley, H. and Heacox, N. J. (2008). Modeling Cultural and Organizational Factors of Multinational Teams Macrocognition in Teams: Theories and Methodologies (pp. 223-236) Burlington, VT: Ashgate Publishing.

Conference Proceeding

Zohorsky, P. and Handley, H. (2022). Adapting the Human Factors Analysis and Classification System for Commercial Fishing Vessel Accidents Proceedings of the International Conference on Applied Human Factors and Ergonomics.

Handley, H. and Thompson, D. (2021). Computational Models for Workload Analysis of Driving Tasks (pp. 690-694) Proceedings of the 2021 Human Factors and Ergonomics Society 65th Annual Meeting.

Handley, H. and Eshelman-Haynes, C. (2021). Formation of Data Science Teams based on Scenario Characteristics (pp. 535-540) Proceedings of the 2021 Human Factors and Ergonomics Society 65th Annual Meeting.

Handley, H., Khallouli, W., Huang, J., Edmonson, W. and Kibret, N. (2021). Maintaining the Consistency of SysML Model Exports to XML Metadata Interchange (XMI) Vancouver, British Columbia, Canada: Proceedings of the 2021 Annual IEEE International Systems Conference (SYSCON).

Huang, J., Handley, H., Edmonson, W., Khallouli, W., Ahmed, T. and Kibret, N. (2021). Semantic Mapping from SysML to FRP Vancouver, British Columbia, Canada : Proceedings of the 2021 Annual IEEE International Systems Conference (SYSCON).

Handley, H. and Marnewick, A. (2020). A Framework of International Competencies for System Engineers Cape Town, South Africa: Proceedings of the 30th Annual INCOSE International Symposium .

Handley, H. (2020). A Human-Automation Role Strategy for Resource-Interface Conflicts Montreal, Quebec, Canada: Proceedings of the 2020 Annual IEEE International Systems Conference (SYSCON),.

Amissah, M. and Handley, H. (2020). An Executable Systems Modeling Language (ESysML): Motivations and Overview of Language Structure Redondo Beach, CA: Proceedings of the 18th Annual Conference on System Engineering Research.

Yahoodik, S., Tahami, H., Unverricht, J., Yamani, Y., Handley, H. and Thompson, D. (2020). Blink Rate as a measure of Driver Workload during Simulated Driving Proceedings of the Human Factors and Ergonomics Society 2020 Annual Meeting.

Handley, H. and Savage-Knepshield, P. (2020). Evaluating the Utility of Human Readiness Levels (HRLs) with Human System Integration Assessments (HSIAs) Proceedings of the Human Factors and Ergonomics Society 2020 Annual Meeting.

Handley, H. (2019). A Cluster Approach to Task Assignment Proceedings of the 2019 Annual IEEE International Systems Conference (SYSCON).

Handley, H. (2019). A Risk Based Approach for Human Assurance Atlanta, GA: Proceedings of the 2019 IEEE Technology & Engineering Management Conference (TEMSCON).

McKenney, M. J. and Handley, H. (2019). Identifying and Quantifying Personnel Skill Gaps Seattle, WA: Proceedings of the Human Factors and Ergonomics Society 2019 Annual Meeting.

Al-Duoli, F. A., Rabadi, G., Seck, M. and Handley, H. (2018). Hybridizing Meta-RaPS with Machine Learning Algorithms Evanston, IL: Proceedings of the IEEE Technology and Engineering Management Society 2018 International Conference.

Efatmaneshnik, M. and Handley, H. (2018). Revisiting Task Complexity: A Comprehensive Framework Vancouver, Canada: Proceedings of the 2018 Annual IEEE International Systems Conference.

Amissah, M., Toba, D., Handley, H. and Seck, M. (2018). Towards a Framework for Executable Systems Modeling: An Executable Systems Modeling Language (ESYSML) Baltimore, MD: Proceedings of SpringSim 2018.

Handley, H. (2018). User Skills as a Component of Task Complexity Vancouver, Canada: Proceedings of the 2018 Annual IEEE International Systems Conference.

Handley, H. (2017). Comparison of Alternate Human Viewpoints (pp. 1716-1719) Austin, TX: Proceedings of the Human Factors and Ergonomics Society 2017 Annual Meeting.

Handley, H. (2017). Defining Human Capability from Soldier and Task Data (pp. 791-795) Austin, TX: Proceedings of the Human Factors and Ergonomics Society 2017 Annual Meeting.

Amissah, M. and Handley, H. (2016). A Process for DoDAF Based Systems Architecting Orlando, FL: 2016 Annual IEEE Systems Conference.

Pietrzyk, V. and Handley, H. (2016). An Investigation of the Effectiveness of Mandatory Training among the US Defense Acquisition Workforce Edinburgh, Scotland: Proceedings of the IEEE Second International Symposium on System Engineering.

Handley, H., Amissah, M. and Kandemir, C. (2016). Levels of SysML Compatibility for Collaborative Human System Development Washington, DC: Proceedings of the Human Factors and Ergonomics Society 2016 Annual Meeting.

Pietrzyk, V. and Handley, H. (2016). Outcome-based Competency Model for Systems Engineering Training Edinburgh, Scotland: Proceedings of the IEEE Second International Symposium on System Engineering.

Amissah, M. and Handley, H. (2015). Data-centric Development of Architecture Models with the DM2 and MBSDF. San Antonio, TX: Proceedings of the 10th Annual System of Systems Engineering Conference.

Kandemir, C. and Handley, H. (2014). Employee Task Assignments for Organizational Modeling: A Review of Models and Applications Virginia Beach, VA: Proceedings of the Annual Meeting of the American Society of Engineering Managment.

Handley, H. and Kandemir, C. (2014). Human System Engineering Applications from Distracted Driving Simulations Virginia Beach, VA: Proceedings of the Annual Meeting of the American Society of Engineering Managment.

Handley, H. (2013). Using Architecture Models to Design Adaptive Socio-Technical Systems Baltimore, MD: Proceedings of the 2013 Conference on Complex Adaptive Systems.

Handley, H. and Pazos-Lago, M. (2012). Modeling and Evaluating Role and Team Work Processes Virginia Beach, VA: Proceedings of the American Society of Engineering Management.

Handley, H. and Tolk, A. (2011). A Human View Model for Socio-Technical Interactions Virginia Beach, VA: Proceedings of the MODSIM WORLD Conference and Expo.

Pazos-Lago, M., Handley, H., Bowling, S. R., Daniels, C., Bullington, K. and Hester, P. P. (2011). Teaching Interactively Using Web-Conferencing: The Student Perspective Lubbock, TX: Proceedings of the 32nd Annual National Conference of the American Society for Engineering Managemen.

Handley, H. and Smilie, R. J. (2009). Human-Centered Design in System Engineering Analysis: Human View Methodology and Dynamics Annapolis, MD: Proceedings of the Human System Integration Symposium.

Handley, H. and Houston, N. P. (2009). NATO Human View Architecture and Human Networks Virginia Beach, VA: MODSIM WORLD Conference and Expo.

Handley, H. (2008). HSI in Network Enabled Capability (NEC): The Human View Washington DC: Proceedings of the 2008 MANPRINT Conference,.

Handley, H. and Heacox, N. J. (2006). Multiple Criteria to Evaluate Decision Support Outcomes San Francisco, CA: Human Factors and Ergonomics Society 50th Annual Meeting.

Handley, H. and Heacox, N. J. (2005). Multicultural Considerations in Work Processes Orlando, FL: Human Factors and Ergonomics Society 49th Annual Meeting.

Heacox, N. J. and Handley, H. (2005). Separate Sides of the Same Coin: Organization Design and (Good) Design of a Decision Support Tool. Orlando, FL: Proceedings of the Human Factors and Ergonomics Society 49th Annual Meetin.

Handley, H. and Heacox, N. J. (2004). Including Organizational Cultural Parameters in Work Processes San Diego, CA: 2004 Command and Control Research and Technology Symposium.

Handley, H. and Levis, A. H. (2003). Modeling for Future Command and Control Architectures Washington, DC.: 8th International Command and Control Research and Technology Symposium, National Defense University.

Handley, H. and Levis, A. H. (2002). A Task Process Pre-experimental Model Monterey, CA: Command and Control Research and Technology Symposium, Naval Postgraduate School.

Handley, H., Wentz, L. K. and Levis, A. H. (2002). Continuity in Dynamic Coalition Operations Monterey, CA: 2002 Command and Control Research and Technology Symposium, Naval Postgraduate School.

Handley, H., Bares, M. and Levis, A. H. (2001). Levels of Interoperability in Coalition Systems Annapolis, MD: 6th International Command and Control Research and Technology Symposium, United States Naval Academy.

Handley, H. and Levis, A. H. (2000). On Organizational Adaptation via Dynamic Process Selection Monterey, CA: 2000 Command and Control Research and Technology Symposium, Naval Postgraduate School.

Handley, H., Zaidi, Z. R. and Levis, A. H. (1999). The Use of Simulation Models in Experimentation Newport, RI: 1999 Command and Control Research and Technology Symposium, United States Naval War College.

Handley, H., Zaidi, Z. R. and Levis, A. H. (1998). Pre-experimental Modeling of Adaptive Organizational Architectures Monterey, CA: 1998 Command and Control Research and Technology Symposium, Naval Postgraduate School.

Clifton, J. and Handley, H. (1995). Using the Internet to Provide Support for Distributed Interactions. Proceedings of the 28th Annual Hawaii International Conference on System Science.

Lee, E., Goel, E. and Handley, H. (1989). Gabriel: A Design Environment for Programmable DSPs Proceedings of the 26th Annual Design Automation Conference.

Presentations

Kumm, J., Handley, H. and Yamani, Y. (December , 2021). Developing a driving model for workload evaluation Poster 2021 Winter Simulation Conference .

Handley, H. (June , 2021). From Human Views to Human Readiness Levels Invited Speaker to the Federal Reserve, Cash Processing Office .

Handley, H. (May , 2021). , From Human Views to Human Readiness Levels Invited Speaker to the MITRE Modeling, Simulation, Experimentation, and Analytics Community of Practice .

Handley, H. (April , 2021). Developing Data Literacy, Invited Panelist, NATO TIDE Sprint .

Schwartz, B. and Handley, H. (March , 2021). Human Readiness Levels: Ensuring Systems are “Ready” for Human Users Poster NDIA Human Systems Conference 2021 .

Handley, H. (January , 2021). Human Readiness Levels Invited Speaker to the INCOSE International Workshop 2021, HSI Session .

Handley, H. (November , 2020). Human System Engineering Community Initatives Oral Presentation Invited Speaker, NASA Human System Integration Employee Resource Group .

Handley, H. (November , 2020). Support for Data Science as a C2 Game Changer Oral Presentation NATO SPRINT 2020 .

Handley, H. (October , 2020). Invited Panelist, Understanding Human Readiness Levels Oral Presentation The Human Factors and Ergonomics Society 2020 Annual Meeting .

Handley, H. (September , 2020). From Human Views to Human Readiness Levels Oral Presentation Invited Speaker, MITRE Human System Integration Community of Practice .

Handley, H. (September , 2020). Methods for Human System Engineering Oral Presentation Invited Speaker, Raytheon Technologies System Engineering & Architecture Symposium 2020 .

Handley, H. (March , 2020). From Human Views to Human Readiness Levels Keynote/Plenary Address Plenary Speaker, NDIA 2020 Human Systems Conference .

Handley, H. (November , 2019). Invited Panelist, HFES Government Relations Panel Oral Presentation The Human Factors and Ergonomics Society 2019 Annual Meeting Seattle, WA.

Handley, H. (February , 2019). Leadership during Technological Change: Developing Workers with Adaptive Expertise Oral Presentation ODU Leadership Series .

Handley, H. (November 03, 2018). The Human Viewpoint: Including the Human in System Architectures Oral Presentation Navy HSI Brown Bag .

Handley, H. (September 20, 2018). A Fresh Look at HSI: Survey Results Keynote/Plenary Address Army HSI Community of Practice .

Handley, H. (June 20, 2018). A Fresh Look at Human System Integration Assessments Keynote/Plenary Address Army HSI Community of Practice .

Gray, D. and Handley, H. (May , 2018). Innovative Online Teaching Strategies for Fostering Idea Generation, Problem Solving, and Entrepreneurship Across Disciplines Oral Presentation Center for Learning Technologies Faculty Summer Conference .

Handley, H. (November , 2017). Considerations of Human Systems Integration in Virtual Training and Simulation Exercises Defense Strategies Institute Military Virtual Training & Simulation Summit Arlington, VA.

Handley, H. AH. (October , 2016). A Human-Centered Approach to Address Task Complexity Lecture Aptima Inc. Arlington, VA.

Handley, H. AH. and Knapp, B. G. (October , 2016). A Human Centered Approach to Address Task Complexity NDIA 2016 Systems Engineering Conference Springfield, VA.

Amissah, M. and Handley, H. (March , 2016). Data-Centric vs. Product-Centric Modeling Paradigms in Systems Architecture Systems Engineering in DC (SEDC) 2016 Washington, DC.

Handley, H. (December , 2015). Model Based Soldier Decision Framework: Human View and Interoperability HSI Practioner's Workshop 2015 Aberdeen, MD.

Kandemir, C. and Handley, H. AH. (November , 2015). A Simulation Optimization Approach for a Task Process to Balance Mental Workload INFORMS Annual Meeting 2015 Philadelphia, PA.

Handley, H. AH. and Knapp, B. G. (October , 2015). A Human View Methodology to Address Stakeholder HSI Concerns NDIA 2015 Systems Engineering Conference Springfield, VA.

Handley, H. AH. and Knapp, B. G. (February , 2015). A Network Enabled Approach to the Human Viewpoint NDIA 2015 Human Systems Engineering Conference Alexandria, VA.

Kandemir, C. and Handley, H. AH. (November , 2014). IMprovement of Work Process Performance with Task Assignment and Mental Workload Balancing INFORMS Annual Meeting 2014 San Francisco, CA.

Amissah, M. and Handley, H. (October , 2014). Executable Modeling with DoDAF2.0: Beyond Fit for Purpose Views Annual Meeting of the American Society of Engineering Management Virginia Beach, VA.

Handley, H. and Kandemir, C. (March , 2014). Using the Human Viewpoint for Human System Integration MANPRINT Conference 2014 Washington, DC.

Handley, H. and Knapp, B. (October , 2013). The Human Viewpoint: Facilitating Human System Integration with Architecture Frameworks NDIA System Engineering Conference Arlington, VA.

Handley, H. AH. (April , 2013). The Human View Architecture Oral Presentation The Society for Modeling and SImulation International, Spring SImulation Multi-conference San Diego, CA.

Handley, H. (December , 2012). The Cost Capabilities of the DoDAF 2.0 Architecture Framework Oral Presentation Hampton Roads International Cost Estimating and Analysis Association Norfolk, VA.

Handley, H. AH., Unal, R. and Tolk, A. (June , 2012). Identifying the Cost Capabilities of the DoDAF 2.0 Architecture Framework Oral Presentation SCEA/ISPA Joint Annual Conference 2012 Orlando, FL.

Handley, H. (May , 2012). Human View Methodology and Model Based Systems Engineering Oral Presentation Volvo Technologies Knowledge Reference Group Greensboro, NC.

Handley, H. (November , 2011). Investigation of the use of Architecture Frameworks for Human-System Risk Assessment Oral Presentation Decision in Uncertainty Conference Suffolk, VA.

Handley, H. (November , 2011). Human System Engineering and the Human View Architecture Oral Presentation Volvo Technologies 2011 US Tech Event Greensboro, NC.

Handley, H. (July , 2011). Fit for Purpose Human Views with the DoDAF 2.0 Data Model Oral Presentation International Council on System Engineering, Hampton Roads Section Virginia Beach, VA.

Tolk, A., Garcia, J., Handley, H., Keating, C. and Unal, R. (June , 2011). Extending FEA and DoDAF Support to Cost Modeling Oral Presentation SCEA/ISPA joint Annual Conference 2011 Albuquerque, NM.

Handley, H. (April , 2011). Using the IMPRINT Tool for Human View Simulations Oral Presentation Scientific Research Corporation Virginia Beach, VA.

Handley, H. and Daniels, C. B. (January , 2011). Ethics and Healthcare Information Technology Oral Presentation Clinical Information for Non-Clinicians (CINC) Series Norfolk, VA.

Handley, H. AH. (November , 2010). Adapting the NATO Human View to DoDAF 2.0 Oral Presentation Cyber Security and Enterprise Architecture Conference Norfolk, VA.

Handley, H. AH. (November , 2010). Evaluating Emergent Risks in Humans and Organizations using Modeling and Simulation Oral Presentation Modeling and Simulation: Opportunities for Analyzing Emergent Risks Symposium & Workshop Norfolk, VA.

Handley, H. (November , 2010). Adapting the NATO Human View to DoDAF 2.0 Oral Presentation Scientific Research Corporation Virginia Beach, VA.

Handley, H. AH. (March , 2010). Interoperability of the Human View and IMPRINT Modeling MANPRINT Conference 2010 Washington, DC.

• 2022: Provost Fellow, Old Dominion University
• 2021: Provost Fellow, Old Dominion University
• 2020: 2020 Human Factors & Ergonomics Society (HFES) David Meister Best Paper Award , Human Factors & Ergonomics Society (HFES)
• 2020: 2020 IEEE Systems Council Featured WISE Women , IEEE
• 2018: 2018 IEEE Systems Council Distinguished Lecturer, IEEE
• 2018: 2018 HFES Science Policy Fellow , Human Factors & Ergonomics Society (HFES)
• 2016: Entsminger Fellow, Provost
• 2016: Shining Star Recognition, Division of Student Engagement and Enrollment Services
• 2015: EXCELLENCE Awards, Batten College of Engineering & Technology
• 2014: Nominated, Teaching with Technology Award, Provost
• 1985: Micciloi Scholar, Raytheon Company
• 1984: Presidential Scholar, Clarkson College
• 1982: Kodak Scholar, Eastman Kodak Company