Dr. John T. Haman

Resume


Employment

Institute for Defense Analyses (2018 - 2022)

Department: Operational Evaluation Division / Test Science Group

Title: Research Staff Member

Roles:

Summary:

  • Ensure quality and timely production of research from inception to publication for group of ~15 analysts

    • Topics: Design of experiments, Data analysis, Artificial intelligence and autonomy, human factors and survey design, modeling and simulation verification, validation, and accreditation (M&S VV&A)
  • Advocate for statistical best practices in testing DOD programs (example)

  • Publish independent and unbiased reports to government sponsors (JAIC, DOT&E)

    • Author ~50 IDA reports or memoranda.
    • Perform data analysis, evaluation, and report to Congress
  • Present research to senior leaders and Presidential appointees in the DOD

  • Draft policy and guidance documents, and educate the DOD community on updates

  • Create tailored trainings on design and analysis topics for IDA research staff, conference attendees, and government sponsors

  • Strengthen relationships with government sponsors and academic collaborators

  • Consult on design and analysis issues across the portfolio of DOT&E programs

  • Author computer software for statistical analysis (public example: ciTools)

  • Represent my research group at conferences (JSM, DATAWorks, ISBA, MIT Lincoln Labs, MITRE technical exchange meetings, various DOD working groups)

  • Mentor new researchers and at least one intern each Summer


Education

Statistics, Ph.D., Bowling Green State University (2018)

  • Dissertation: The energy goodness-of-fit test and E-M type estimator for asymmetric Laplace distributions

  • Advisor: Dr. Maria Rizzo

  • Internships: Inst. for Defense Analyses, Travelers Insurance

  • Lecturer: Pre-calculus, Calculus, Algebra, Introduction to Statistics

  • Assistant Lecturer: General Linear Models, Generalized Linear Models

  • Extra: Graduate Student Senate. Passed both qualifying exams on first attempt

Applied Statistics, M.S., Bowling Green State University (2014)

Mathematics, B.S., Truman State University (2011)


Awards


Skills and Memberships

General

Project leadership, financial management, research, public speaking, writing with clarity and intent1, data visualization

Technical

  • Current Proffessional: R, Microsoft Office, git, TeX

  • Current Hobby: Common Lisp, Emacs Lisp, PostgreSQL

  • Used in grad school: C++, Matlab, SSH, HPC batch computing, SVN

Memberships

American Statistical Association (ASA) – Statistics in Defense and National Security section, International Test and Evaluation Association (ITEA), Mathematical Association of America, Free Software Foundation

Interests

Finding statistical solutions that fit the implicit assumptions of non-statisticians, Bayesian methods, methods for serially correlated data, optimal design of experiments, reliability/survival analysis, modeling and simulation (M&S) validation


Subset of Publications (IDA)

Couch, Mark A., Wojton, Heather M., Johnson, Thomas H., Haman, John T. and Walzl, Kerry N. 2021. Statistical Methods to Improve Warhead Fragmentation M&S. IDA Document NS D-21575.

Couch, Mark A., Grimm, David K., Butler, Lindsey D., Gardner, William G., Johnson, Thomas H. and Haman, John T. 2021. Experimental Design Methods for Full-Up System-Level (FUSL) Live Fire Testing. IDA Document NS D-22830.

Wojton, Heather M., Pagán-Rivera, Keyla, Haman, John T. and Medlin, Rebecca M. 2021. Introduction to Bayesian Analysis. IDA Document NS D-20484.

Wojton, Heather M., Thomas, Dean, Kirkpatrick, Andrea, Avery, Kelly M., Bell, Jonathan L., Haman, John T., Couch, Mark A. and Pagán-Rivera, Keyla. 2021. DOT&E Action Officer Course 2020. IDA Document NS D-20469.

Couch, Mark A., Johnson, Thomas H., Haman, John T., Walzl, Kerry N., Wojton, Heather M., Hatch-Aguilar, Thomas (NAWC-WD) and Higdon, David (Virginia Tech). 2021. DATAWorks 2021: Warhead Arena Analysis Advancements. IDA Document NS D-11038.

Couch, Mark A., Johnson, Thomas H., Haman, John T., Wojton, Heather M., Turner, Benjamin W. and Higdon, David M. 2020. An Uncertainty Analysis Case Study for Live Fire Modeling and Simulation. IDA Document NS D-13185.

Thayer, Bradley D., Goehring, Duane A. and Haman, John T. 2020. (U) MALD-N Test and Evaluation Concept. IDA Document D-14260.

Medlin, Rebecca M., Johnson, Thomas H., Anderson, Breeana G., Wojton, Heather M. and Haman, John T. 2020. DATAWorks 2020: Ballistic Miss Distance Poster. IDA Document NS D-12075.

Bell, Jonathan L., Carter, Kristina A., Haman, John T., Lawyer, Christopher T., Porter, Daniel J., Rhoads, James E. and Thayer, Bradley D. 2019. (U) Assessment Plan for Counter Unmanned Aircraft Systems (CUAS). IDA Document D-10925.

Wojton, Heather M., Porter, Daniel J., Vickers, Brian D. and Haman, John T. 2019. Pilot Training Next V2 IDA Analyses - Briefing Version. IDA Document NS D-10903.

Porter, Daniel J., Wojton, Heather M., Ashwell, Benjamin A., Bieber, Chad M., Fedele, Emily A., Haman, John T., Lane, Stephanie T. and Vickers, Brian D. 2019. Evaluating Skill Transfer from Synthetic Learning Environments: Techniques from Pilot Training Next. IDA Document NS D-10843.

Medlin, Rebecca M., Haman, John T., Avery, Matthew R. and Wojton, Heather M. 2019. The Purpose of Mixed-Effects Models in Test and Evaluation. IDA Document NS D-10853.

Wojton, Heather M., Haman, John T. and Johnson, Thomas H. 2019. Circular Prediction Regions for Miss Distance Models under Heteroscedasticity. IDA Document NS D-10662.

Wojton, Heather M., Haman, John T. and Johnson, Thomas H. 2019. Reasoning about Uncertainty in the Stan Modeling Language. IDA Document NS D-10578.

Wojton, Heather M., Flack, Andrew C., Haman, John T. and Kirshenbaum, Kevin C. 2019. Reproducible Research Mini-Tutorial. IDA Document NS D-10581.

Couch, Mark A., Haman, John T., Johnson, Thomas H. and Wojton, Heather M. 2019. Use of Design of Experiments in Survivability Testing. IDA Document NS D-10546.

Freeman, Laura J., Haman, John T. and Avery, Matthew R. 2017. Introduction to ciTools. IDA Document NS D-8702.

Haman, John T, Dennis III, John W and Johnson, Thomas H. 2022. NGFM Sequential Validation Strategy. Informal Memorandum 2022-29611.

Haman, John T, Vickers, Brian D and Khoury, George M. 2021. Operational Testing for AI-Enabled Systems (AIES). Informal Memorandum 2021-29460.

Haman, John T, Vickers, Brian D and Khoury, George M. 2021. Operational Testing for AI-Enabled Systems (AIES). Informal Memorandum 2021-29467.

Goehring, Duane A, Haman, John T and Adams, Jordon R. 2021. (U) Navy Expendable Airborne Electronic Attack or MALD N TEMP and Operational Assessment Plan Reviews. Informal Memorandum 2021-28968.

Shaw, Michael R, Corbett, Brooke M, Waters, Christopher, Williamsen, Joel E, Haman, John T, Falcon, Kathleen and Robbins, William J. 2021. IM SHORAD Operational Assessment. Informal Memorandum 2021-28300.

Johnson, Thomas H, Turner, Benjamin W, Haman, John T and Wojton, Heather M. 2020. Validation Concept Using Component Damage Data from Live Fire Vulnerability M&S. Informal Memorandum 2020-27503.

Waters, Christopher, Wittlin, Jodi L, Falcon, Kathleen, Haman, John T, Carter, Kristina A and Robbins, William J. 2020. Approval Recommendations for IM-SHORAD Operational Test Agency Test Plan and Adversarial Assessment. Informal Memorandum 2020-27198.

Bell, Jonathan L, Haman, John T, Carter, Kristina A, Thayer, Bradley D, Rhoades, Robert C, Kirshenbaum, Kevin C and Lawyer, Christopher T. 2020. CUAS FY20 Annual Report Input. Informal Memorandum 2020-26960.

Haman, John T, Bell, Jonathan L, Thayer, Bradley D, Rhoads, James E, Clutter, Justace R, Carter, Kristina A and Kirshenbaum, Kevin C. 2020. IDA Comments on DTRA Counter UAS Test Protocol 2.0. Informal Memorandum 2020-26777.

Bell, Jonathan L, Carter, Kristina A, Clutter, Justace R, Flack, Andrew C, Kirshenbaum, Kevin C, Haman, John T, Thayer, Bradley D and Rhoads, James E. 2020. E-LDIS Increment 1 and Howler CUAS Assessment at Site W. Informal Memorandum 2020-26615.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T, Kirshenbaum, Kevin C, Rhoads, James E and Thayer, Bradley D. 2020. CORIAN v1.8 Assessment. Informal Memorandum 2020-27697.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T, Kirshenbaum, Kevin C, Thayer, Bradley D and Shaw, Scott E. 2020. Site B OCONUS CUAS Assessment. Informal Memorandum 2020-27769.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T and Rhoads, James E. 2020. Site G Handhelds Report. Informal Memorandum 2020-27702.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T, Kirshenbaum, Kevin C, Rhoads, James E and Thayer, Bradley D. 2020. EnForceAir CUAS Assessment. Informal Memorandum 2020-27699.

Bell, Jonathan L, Carter, Kristina A, Clutter, Justace R, Flack, Andrew C, Haman, John T, Lawyer, Christopher T, Rhoads, James E and Thayer, Bradley D. 2020. (U) OCONUS CUAS Detailed Site A Assessment. Informal Memorandum 2020-27761.

Rhoads, James E, Thayer, Bradley D, Bell, Jonathan L, Haman, John T and Lawyer, Christopher T. 2020. Review of Past CUAS Reports. Informal Memorandum 2020-27737.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T, Lawyer, Christopher T, Rhoads, James E, Thayer, Bradley D and Waters, Christopher. 2020. OCONUS CUAS Assessment, Site C Quick Look. Informal Memorandum 2020-27759.

Thayer, Bradley D, Flack, Andrew C, Lawyer, Christopher T, Rhoads, James E, Haman, John T, Carter, Kristina A and Bell, Jonathan L. 2020. (U) OCONUS CUAS Assessment, Al Dhafra Air Base, UAE, Quick Look. Informal Memorandum 2020-26303.

Haman, John T and Vickers, Brian D. 2019. PTN V2 Cohort Learning Trajectories Weekly Update through June 21, 2019. Informal Memorandum 2019-25173.

Porter, Daniel J and Haman, John T. 2019. PTN V2 Cohort Learning Trajectories Weekly Update through May 30th, 2019. Informal Memorandum 2019-25114.

Bearden Jr, Steven D, Haman, John T and Keltz, Ilean K. 2019. JLTV Soldier Demonstration Event. Informal Memorandum 2019-25093.

McAnally, Michael O, Pellegrinelli, Christopher, Haman, John T and Adams, Jordon R. 2019. (U) Block 0 JPALS Early Fielding Report Inputs cyber annex. Informal Memorandum 2019-25064.

McAnally, Michael O, Pellegrinelli, Christopher, Adams, Jordon R and Haman, John T. 2019. Block 0 JPALS Early Fielding Report Inputs. Informal Memorandum 2019-25065.

Porter, Daniel J and Haman, John T. 2019. JSF Maintenance Survey Sampling COAs1. Informal Memorandum 2019-25014.

Porter, Daniel J and Haman, John T. 2019. PTN V2 Cohort Learning Trajectories Weekly Update through May 3rd, 2019. Informal Memorandum 2019-24995.

Wojton, Heather M, Goehring, Duane A and Haman, John T. 2019. Advanced Pilot Trainer T&E Concept Update. Informal Memorandum 2019-24969.

Pellegrinelli, Christopher, McAnally, Michael O, Adams, Jordon R and Haman, John T. 2019. Review of JPALS Test and Evaluation Master Plan. Informal Memorandum 2019-24948.

Porter, Daniel J and Haman, John T. 2019. Pilot Training Next V2 Learning Trajectories Memo. Informal Memorandum 2019-24924.

Pellegrinelli, Christopher, McAnally, Michael O, Adams, Jordon R and Haman, John T. 2019. JPALS Milestone C Decision Inputs. Informal Memorandum 2019-24920.

Bell, Jonathan L, Carter, Kristina A, Flack, Andrew C, Haman, John T, Lawyer, Christopher T, Rhoads, James E, Thayer, Bradley D and Waters, Christopher. 2019. OCONUS CUAS Assessment, Site B Quick Look. Informal Memorandum 2020-27637.


  1. But I tend to play it loosey goosey on this website!↩︎