C. Michael Holloway's Publications
last modified: 2026-10-03 (12:06)
https://bit.ly/cmhpapers

  • Daw, Zamira and Holloway, C. Michael. From Skepticism to Understanding: Correcting Misconceptions About Overarching Properties. 2025 IEEE/AIAA 44th Digital Avionics Systems Conference (DASC), September 2025. URL https://ntrs.nasa.gov/citations/20250006016
  • Chen, Mary. Detangling Safety Knowledge with Contextualism. Technical Memorandum NASA/TM-20240015747, National Aeronautics and Space Administration, January 2025. URL https://ntrs.nasa.gov/citations/20240015747
  • Holloway, C. Michael. The Friendly Argument Notation (FAN): 2023 Version. Technical Memorandum NASA/TM-20230004423, National Aeronautics and Space Administration, December 2023. URL https://ntrs.nasa.gov/citations/20230004423
  • Cohen, Sarah; Gotlieb, Rose; Holloway, C. Michael; and Lehman, Sarah. Aggregating Confidence: A Problem and A Solution. Technical Memorandum NASA/TM-20230012813, National Aeronautics and Space Administration, Hampton, Virginia, November 2023. URL https://ntrs.nasa.gov/citations/20230012813
  • (The Rock Hunters): McCardel, Finlay; Holloway, C. Michael; Wasson, Kim.; McDonnell, Neil; Graydon, Mallory.; Peña, Abel; and Lehman, Sarah. Towards a Coherent View of Evidence in Safety Assurance. Technical Memorandum NASA/TM-20230003336, National Aeronautics and Space Administration, Hampton, Virginia, April 2023. URL https://ntrs.nasa.gov/citations/20230003336
  • Daw, Zamira; Beecher, Scott; and Holloway, Michael. Leveling Arguments: Easier Said than Done. 2023 IEEE/AIAA 42nd Digital Avionics Systems Conference (DASC), Barcelona, Spain, October 2023. URL https://ntrs.nasa.gov/citations/20230009081
  • Holloway, C. Michael. False Beliefs about the Overarching Properties and Overarching Properties Related Arguments. 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC), September 2022. URL https://ntrs.nasa.gov/citations/20220008513
  • Wasson, Kimberly S. and Holloway, C. Michael. An introduction to Constructing and Assessing Overarching Properties Related Arguments (OPRAs). White paper, NASA Langley Research Center, January 2022. URL https://ntrs.nasa.gov/citations/20210025425
  • Holloway, C. Michael and Wasson, Kimberly S.: A Primer on Argument Assessment. White paper, National Aeronautics and Space Administration, Hampton, VA, USA, October 2021. URL https://ntrs.nasa.gov/citations/20210022807
  • Holloway, C. Michael and Wasson, Kimberly S. A Primer on Argument. White paper, National Aeronautics and Space Administration, Hampton, VA, USA, June 2021. URL https://ntrs.nasa.gov/citations/20210019993
  • Daw, Zamira; Beecher, Scott; Holloway, C. Michael; and Graydon, Mallory. Overarching Properties as means of compliance: An industrial case study. 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), Oct 2021, pp. 1-10.
  • Holloway, C. Michael; and Wasson, Kimberly S. A Primer on Argument (Overarching Properties Edition). White paper, National Aeronautics and Space Administration, Hampton, VA, USA, June 2020. URL https://ntrs.nasa.gov/citations/20205003337
  • Holloway, C. Michael. The Friendly Argument Notation (FAN). Technical Memorandum NASA/TM-2020-5002931, National Aeronautics and Space Administration, Hampton, VA, USA, June 2020. URL https://ntrs.nasa.gov/citations/20205002931
  • Holloway, C. Michael. a very brief informal but adequately comprehensive introduction to argument. February 2020.
  • Holloway, C. Michael. Presuppositions Predetermine Plausibility. October 2019. URL https://shemesh.larc.nasa.gov/arg/p3cmh.pdf
  • Holloway, C. Michael. Understanding the Overarching Properties. Technical Memorandum NASA/TM-2019-219650, National Aeronautics and Space Administration, Hampton, VA, USA, July 2019. URL https://hdl.handle.net/2060/20190029284
  • Holloway, C. Michael. a very brief informal but adequately comprehensive introduction to argument. July 2019. URL https://shemesh.larc.nasa.gov/arg/intro2argbycmh.pdf
  • Holloway, C. Michael. An eclectic introduction to assurance cases. April 2019. URL https://shemesh.larc.nasa.gov/arg/eclecticintro.pdf
  • Holloway, C. Michael. Understanding Assurance Cases: An Educational Presentation in Five Parts. Developed for the FAA under Annex 2 of IAI-1073. URL https://shemesh.larc.nasa.gov/arg/uac.html. Some of the material here is obsolete.
    1. Holloway, C. Michael. Understanding Assurance Cases: Module 1 - Foundation. URL https://shemesh.larc.nasa.gov/arg/uac-module1-foundation.pdf. Revised July 2020. Original September 2015
    2. Holloway, C. Michael. Understanding Assurance Cases: Module 2 - Application. URL https://shemesh.larc.nasa.gov/arg/uac-module2-application.pdf. Original September 2015
    3. Holloway, C. Michael. Understanding Assurance Cases: Module 3 - Evaluation. URL https://shemesh.larc.nasa.gov/arg/uac-module3-evaluation.pdf. Revised July 2020. Original September 2015.
    4. Holloway, C. Michael. Understanding Assurance Cases: Module 4 - Creation. URL https://shemesh.larc.nasa.gov/arg/uac-module4-creation.pdf. Revised July 2020. Original March 2016.
    5. Holloway, C. Michael. Understanding Assurance Cases: Module 5 - speculation. URL https://shemesh.larc.nasa.gov/arg/uac-module5-speculation.pdf. Revised July 2020. Original March 2016.
  • Holloway, C. Michael and Graydon, P. J. Explicate '78: Assurance Case Applicability to Digital Systems. DOT/FAA/TC-17/67, January 2018.
  • Heavner, Emily and Holloway, C. Michael. Assurance Arguments for the Non-graphically-inclined: Two Approaches. Technical Memorandum NASA/TM-2017-219650, National Aeronautics and Space Administration, Hampton, VA, USA, July 2017. URL https://hdl.handle.net/2060/20170007188.
  • Graydon, P. J. and Holloway, C. Michael. An Investigation of Proposed Techniques for Quantifying Confidence in Assurance Arguments. Safety Science, vol. 92, Feb. 2017, pp. 53-65.
  • Graydon, P. J. and Holloway, C. Michael. An Investigation of Proposed Techniques for Quantifying Confidence in Assurance Arguments. Technical Memorandum NASA/TM-2016-219195, National Aeronautics and Space Administration, Hampton, VA, USA, May 2016. URL https://hdl.handle.net/2060/20160006526.
  • Holloway, C. Michael. Explicate ’78: Assurance Case Applicability to Digital Systems. Final report to the FAA, December 2016.
  • Graydon, P. J. and Holloway, C. Michael. Planning the Unplanned Experiment: Towards Assessing the Efficacy of Standards for Safety-Critical Software. , NASA/TM-2015-218804, NASA Langley Research Center, Hampton VA, September 2015. URL https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20150018918.pdf.
  • Graydon, P. J. and Holloway, C. Michael. Planning the Unplanned Experiment: Towards Assessing the Efficacy of Standards for Safety-Critical Software. 33rd International System Safety Conference (ISSC), San Diego, CA, USA, August 2015. URL https://hdl.handle.net/2060/20160006368.
  • Holloway, C. Michael. Explicate ’78: Uncovering the Implicit Assurance Case in DO-178C. Engineering Systems for Safety. Proceedings of the 23rd Safety-critical Systems Symposium, M. Parsons and T. Anderson, eds., Safety Critical Systems Club, Bristol, UK, February 2-5 2015, pp. 205-225. URL https://hdl.handle.net/2060/20150009473, iSBN: 978-1505689082.
  • Graydon, P. J. and Holloway, C. Michael. “Evidence” Under a Magnifying Glass: Thoughts on Safety Argument Epistemology. Proceedings of the IET System Safety and Cyber Security Conference, Bristol, UK, October 2015. URL https://hdl.handle.net/2060/20160006505.
  • Holloway, C. Michael; Knight, John C.; and McDermid, John A. Neither Pollyanna nor Chicken Little: Thoughts on the Ethics of Automation. 2014 IEEE International Symposium on Ethics in Engineering, Science and Technology, Chicago, May 23-24 2014. URL https://hdl.handle.net/2060/20140010015.
  • Holloway, C. Michael. Making the Implicit Explicit: Towards an Assurance Case for DO-178C. Proceedings of the 31st International System Safety Conference, Boston, Massachusetts, August 12-16 2013. URL https://hdl.handle.net/2060/20140002745.
  • Brown, Scott and Holloway, C. Michael. Analyzing a Midair Collision Over the Hudson River. Proceedings of the 30th International Conference on Systems Safety, Atlanta, Georgia, August 6-10 2012. URL https://hdl.handle.net/2060/20120013555.
  • Johnson, Chris W.; Oltedal, H. A.; and Holloway, C. Michael. Comparing the Identification of Recommendations by Different Accident Investigators Using a Common Methodology. 7th IET International Conference on System Safety, Incorporating the Cyber Security Conference, Edinburgh, Scotland, October 15-18 2012. URL https://hdl.handle.net/2060/20120016005.
  • Holloway, C. Michael. Towards Understanding the DO-178C / ED-12C Assurance Case. 7th IET International Conference on System Safety, Incorporating the Cyber Security Conference, Edinburgh, Scotland, October 15-18 2012. URL https://hdl.handle.net/2060/20120016708.
  • Johnson, Chris W. and Holloway, C. Michael. A Possible Approach for Addressing Neglected Human Factors Issues of Systems Engineering. Proceedings of the IET 6th International Conference on System Safety, Birmingham, UK, September 20-22 2011. URL https://hdl.handle.net/2060/20110015882.
  • Holloway, C. Michael and Johnson, Chris W. Reducing our Ignorance: Finding Answers to Certain Epistemic Questions for Software Systems. Proceedings of the IET 6th International Conference on System Safety, Birmingham, UK, September 20-22 2011. URL https://hdl.handle.net/2060/20110015881.
  • Johnson, Chris W. and Holloway, C. Michael. Safety Arguments for Next Generation, Location Aware Computing. Proceedings of the IET 5th International Conference on System Safety, Manchester, UK, October 18-20 2010. URL https://hdl.handle.net/2060/20100036829.
  • Holloway, C. Michael and Johnson, Chris W. Epistemic Questions & Answers for Software System Safety. Proceedings of the 28th International System Safety Conference, Minneapolis, Minnesota, August 30 - September 3 2010. URL https://hdl.handle.net/2060/20100033212.
  • Holloway, C. Michael; Johnson, Chris W.; and Collins, Kristi R. A Safety Conundrum Illustrated: Logic, Mathematics, and Science are not Enough. Proceedings of the IET 5th International Conference on System Safety, Manchester, UK, October 18-20 2010. URL https://hdl.handle.net/2060/20100036830.
  • Holloway, C. Michael and Johnson, Chris W. Towards a Comprehensive Consideration of Epistemic Questions in Software System Safety. Proceedings of the IET 4th International Conference on System Safety, London UK, October 25-26 2009. URL https://hdl.handle.net/2060/20090040478.
  • Holloway, C. Michael. Safety Case Notations: Alternatives for the Non-Graphically Inclined? 3rd IET International Conference on System Safety, Birmingham, UK, October 20-22 2008. URL https://hdl.handle.net/2060/20080042416.
  • Holloway, C. Michael and Johnson, Chris W. How Past Loss of Control Accidents May Inform Safety Cases for Advanced Control Systems on Commercial Aircraft. Third IET Systems Safety Conference, The Institution of Engineering and Technology, NEC, Birmingham, UK, October 2008. URL https://hdl.handle.net/2060/20080042414.
  • Johnson, Chris W. and Holloway, C. Michael. A Historical Perspective on Aviation Accident Investigation. Safety Systems, vol. 17, no. 2, January 2008. Invited Paper for 50th Edition of Newsletter.
  • Johnson, Chris W.; Shea, Christine; and Holloway, C. Michael. The Role of Trust and Interaction in GPS Related Accidents: A Human Factors Safety Assessment of the Global Positioning System (GPS). Proceedings of the 26th International Conference on Systems Safety, International System Safety Society, Vancouver, Canada, August 25-29 2008. URL https://hdl.handle.net/2060/20080034491.
  • Johnson, Chris W. and Holloway, C. Michael. A Longitudinal Analysis of the Causal Factors in Major Maritime Accidents in the USA and Canada (1996-2006). The Safety of Systems: Proceedings of the 15th Safety-Critical Systems Symposium, F. Redmill and T. Anderson, eds., Springer-Verlag, London UK, February 2007, pp. 85-104. URL https://hdl.handle.net/2060/20070010578.
  • Holloway, C. Michael and Johnson, Chris W. A Look at Aircraft Accident Analysis in the Early Days: Do Early 20th Century Accident Investgation Techniques Have Any Lessons for Today? 2nd IET Systems Safety Conference, Institution for Engineeering and Technology, Savoy Place, London, UK, October 2007, pp. 235-240. URL https://hdl.handle.net/2060/20070034018.
  • Johnson, Chris W. and Holloway, C. Michael. The Dangers of Failure Masking in Fault Tolerant Software: Aspects of a Recent In-Flight Upset Event. 2nd IET Systems Safety Conference, The Institution of Engineering and Technology, Savoy Place, London, UK, October 2007, pp. 60-65. URL https://hdl.handle.net/2060/20070034017.
  • Holloway, C. Michael and Johnson, Chris W. Why System Safety Professionals Should Read Accident Reports. The First IET International Conference on System Safety, The Institution of Engineering and Technology, Savoy Place, London, June 2006, pp. 325-331. URL https://hdl.handle.net/2060/20060020178.
  • Holloway, C. Michael. Software and Accidents: A Discussion about the Past & Speculation about the Future, June 2006. Invited talk at the 2006 FAA Software and Complex Electronic Hardward Standardization Conference, Atlanta, Georgia.
  • Holloway, C. Michael. Safety, Risk, and Other Misunderstood Ideas. The First IET International Conference on System Safety, The Institution of Engineering and Technology, Savoy Place, London, June 2006.
  • Johnson, Chris W. and Holloway, C. Michael. Questioning the Role of Requirements Engineering in the Causes of Safety-Critical Software Failures. The First IET International Conference on System Safety, The Institution of Engineering and Technology, Savoy Place, London, June 2006, pp. 352-360. URL https://hdl.handle.net/2060/20060020183.
  • Greenwell, William S.; Knight, John C.; Pease, Jacob J.; and Holloway, C. Michael. A Taxonomy of Fallacies in System Safety Arguments. 24th International System Safety Conference, System Safety Society, Albuquerque, New Mexico, 31 July - 4 August 2006. URL https://hdl.handle.net/2060/20060027794.
  • Hayhurst, Kelly J. and Holloway, C. Michael. Visions of Automation and Realities of Certification. Infotech@Aerospace, Arlington, Virginia, September 2005. URL https://hdl.handle.net/2060/20050237820, the version that passed through NASA review is not nearly as good as the earlier, unpublished version.
  • Holloway, C. Michael. Why You Should Read Accident Reports, July 2005. Invited Talk at the 2005 FAA Software and Complex Electronic Hardware Standardization Conference, Norfolk, Virginia.
  • Johnson, Chris W. and Holloway, C. Michael. A Technique for Showing Causal Arguments in Accident Reports. 23rd International System Safety Conference, System Safety Society, San Diego, California, August 2005. URL https://hdl.handle.net/2060/20050214784.
  • Holloway, C. Michael and Johnson, Chris W. On the Prevalence of Organizational Factors in Recent U.S. Transportation Accidents. 23rd International System Safety Conference, System Safety Society, San Diego, California, August 2005. URL https://www.cs.virginia.edu/ cmh7p/issc05-cmhcwj-ntsbanalysis.pdf, nTRS does not have this paper available.
  • Greenwell, William S.; Knight, John C.; and Holloway, C. Michael. A Taxonomy of Fallacies in System Safety Arguments. Technical Report CS-2005-02, University of Virginia Department of Computer Science, December 2005. URL https://www.cs.virginia.edu/ techrep/CS-2005-02.pdf.
  • Johnson, Chris W. and Holloway, C. Michael. ‘Systemic Failures’ and ‘Human Error’ in Canadian TSB Aviation Accident Reports between 1996 and 2002. HCI in Aerospace 2004, EURISCO, Toulouse, France, September 2004, pp. 25-32. URL https://hdl.handle.net/2060/20040139600.
  • Holloway, C. Michael and Johnson, Chris W. Distribution of Causes in Selected US Aviation Accident Reports Between 1996 and 2003. 22nd International System Safety Conference, System Safety Society, Providence, Rhode Island, August 2004. URL https://hdl.handle.net/2060/20040085800.
  • Johnson, Chris W. and Holloway, C. Michael. The ESA/NASA SOHO Mission Interruption: Using the STAMP Accident Analysis Technique for a Software Related ‘Mishap’. Software: Practice and Experience, vol. 33, July 2003, pp. 1177-1198. URL https://onlinelibrary.wiley.com/doi/10.1002/spe.544/abstract.
  • Hayhurst, Kelly J. and Holloway, C. Michael. Considering Object Oriented Technology in Aviation Applications. 22nd Digital Avionics Systems Conference, Indianapolis, Indiana, October 12-16 2003, p. paper 3.B.1. URL https://hdl.handle.net/2060/20040034209.
  • Johnson, Chris W. and Holloway, C. Michael. The Strengths and Weaknesses of Logic Formalisms to Support the Causal Analysis of Mishaps. 21st International System Safety Conference, System Safety Society, Ottawa, Ontario, Canada, August 2003, pp. 1133-1142. URL https://hdl.handle.net/2060/20040085712.
  • Johnson, Chris W. and Holloway, C. Michael. A Survey of Logic Formalisms to Support Mishap Analysis. Reliability Engineering and Systems Safety Journal, vol. 80, no. 3, 2003, pp. 271-291. URL https://www.sciencedirect.com/science/article/pii/S095183200300053X.
  • Hayhurst, Kelly J. and Holloway, C. Michael, eds. Proceedings of the Second Workshop on the Investigation and Reporting of Incidents and Accidents, NASA Langley Research Center, NASA/CP-2003-212642, Hampton, Virginia, September 2003. URL https://hdl.handle.net/2060/20030111704.
  • Holloway, C. Michael and Hayhurst, Kelly J.: Software System Safety and the NASA Aeronautics Blueprint. 21st International System Safety Conference, G. Einarsson and B. Fletcher, eds., System Safety Society, Ottawa, Ontario, Canada, August 2003, pp. 1183-1192. URL https://hdl.handle.net/2060/20040085711.
  • Holloway, C. Michael. Issues in Software Safety: Polly Ann Smith Co. v. Ned I. Ludd. 20th International System Safety Conference, System Safety Society, Denver, Colorado, August 2002. URL https://hdl.handle.net/2060/20030013953, an earlier version of this paper was presented at the 2nd meeting of the U.S. Software System Safety Working Group, Cambridge, MA, 19-20 February 2002.
  • Hayhurst, Kelly J. and Holloway, C. Michael. Aviation Software Guidelines. IEEE Software, vol. 19, no. 5, September/October 2002.
  • Hanks, Kim; Knight, John; and Holloway, C. Michael. The Role of Natural Language in Accident Investigation and Reporting Guidelines. First Workshop on the Investigation and Reporting of Incidents and Accidents, University of Glasgow, Glasgow, Scotland, July 2002.
  • Hayhurst, Kelly J.; and Holloway, C. Michael. Challenges in Software Aspects of Aviation Systems. 26th Annual NASA Goddard Software Engineering Workshop, Greenbelt, Maryland, November 2001, pp. 7-13.
  • Holloway, C. Michael, ed.: Lfm2000: Fifth NASA Langley Formal Methods Workshop, NASA Langley Research Center, NASA/CP-2000-210100, Hampton, Virginia, June 2000. URL https://hdl.handle.net/2060/20000055716.
  • Holloway, C. Michael. An Overview of Why ... Because Analysis (WBA), March 1999. A talk delivered to my branch.
  • Holloway, C. Michael. Applying the Results of ’A Conditional Resolution of the Apparent Paradox of Self-Deception’ to Research, May 1999. A talk delivered to my branch.
  • Arthur, J. D.; Groner, M. K.; Hayhurst, Kelly J.; and Holloway, C. Michael. Evaluating the Effectiveness of Independent Verification and Validation. IEEE Computer, vol. 32, no. 10, October 1999, pp. 79-83.
  • Holloway, C. Michael. From Bridges and Rockets, Lessons for Software Systems. 17th International System Safety Conference, System Safety Society, Orlando, Florida, August 1999, pp. 598-607. URL https://hdl.handle.net/2060/20040086631, an invited presentation based on this paper was also given to the 2001 MAPLD Conference.
  • Hayhurst, Kelly J.; Holloway, C. Michael; Dorsey, Cheryl A.; Knight, John C.; Leveson, Nancy G.; McCormick, G. Frank.; and Yang, J. C.: Streamlining Software Aspects of Certification: Technical Team Report on the First Industry Workshop. Technical Memorandum TM-1998-207648, NASA Langley Research Center, April 1998. URL https://hdl.handle.net/2060/19980197325.
  • Holloway, C. Michael. Why Engineers Should Consider Formal Methods. 16th AIAA/IEEE Digital Avionics Systems Conference, Irvine, CA, vol. 1, October 1997, pp. 1.3-16 - 1.3.-22. URL https://hdl.handle.net/2060/20040105661.
  • Holloway, C. Michael and Hayhurst, Kelly J., eds.: Lfm97: Fourth NASA Langley Formal Methods Workshop, NASA Langley Research Center, NASA Conference Publication 3356, Hampton, Virginia, September 1997. URL https://hdl.handle.net/2060/19970029195.
  • Holloway, C. Michael and Butler, Rick W.: Impediments to Industrial Use of Formal Methods. IEEE Computer, vol. 29, no. 4, April 1996, pp. 25-26.
  • Holloway, C. Michael. Software Engineering and Epistemology. Software Engineering Notes, vol. 20, no. 2, April 1995.
  • Holloway, C. Michael, ed. Third NASA Langley Formal Methods Workshop, NASA Langley Research Center, NASA Conference Publication 10176, Hampton, Virginia, June 1995. URL https://hdl.handle.net/2060/19960000026.
  • Butler, R.; Caldwell, J.; Carreno, V.; Holloway, C. M.; Miner, P.; and DiVito, B. NASA Langley’s Research and Technology Transfer Program in Formal Methods. 10th Annual Conference on Computer Assurance (COMPASS 95), Gaithersburg, MD, June 1995. URL https://hdl.handle.net/2060/20040111237.
  • Holloway, C. Michael. Ada 95 and Safety-Critical Software. 14th AIAA/IEEE Digital Avionics Systems Conference, November 1995, pp. 504-509.
  • Holloway, C. M.; DiVito, B.; Guaspari, D.; and Smith, M. Formal Methods: Fact vs. Fiction, November 1994. Panel Summary and Position Papers in TRI-Ada’94, Baltimore, Maryland.
  • Butler, R. W.; DiVito, B. L.; and Holloway, C. Michael. Formal Design and Verification of a Reliable Computing Platform for Real-Time Control (Phase 3 Results). Technical Memorandum 109140, NASA Langley Research Center, August 1994. URL https://hdl.handle.net/2060/19950004461.
  • Holloway, C. Michael. Epistemology, Software Engineering, and Formal Methods. The Role of Computers in Research and Development at Langley Research Center, NASA Conference Publication 10159, October 1994, pp. 570-595. URL https://hdl.handle.net/2060/19950010038, extended abstract and presentation.
  • Johnson, S. J.; Holloway, C. M.; and Butler, R. W., eds.: Second NASA Langley Formal Methods Workshop, NASA Langley Research Center, NASA Conference Publication 10110, Hampton, Virginia, November 1992. URL https://hdl.handle.net/2060/19930003769.
  • Holloway, C. Michael. The Syntax of Dragoon: Evaluation and Recommendations. Technical Memorandum 4385, NASA Langley Research Center, July 1992. URL https://hdl.handle.net/2060/19920024004.
  • Holloway, C. Michael. A Survey of Functional Programming Language Principles. Technical Memorandum 89019, NASA Langley Research Center, September 1986. URL https://hdl.handle.net/2060/19870002073.
See also https://bit.ly/arg83 for foundational papers about OPs and associated ideas.