2013 NASA IV&V Workshop Call for Papers

UPDATE: The deadline for abstract papers has been moved to June 30, 2013.


2013 NASA IV&V Workshop Call for Papers

The Fifth International Workshop on Independent Verification & Validation (IV&V) of Software

West Virginia University’s Erickson Alumni Center

Morgantown, West Virginia, USA

September 10-12, 2013

The NASA IV&V Annual Workshop offers an in-depth understanding of the challenges that V&V organizations face in assuring that system software operates safely and reliably. The goal of the workshop is to generate solutions to these challenges. This year, we will be offering topics in three different tracks, as indicated in the tables below. To participate in this workshop, you must submit an abstract (maximum 4000 characters, including spaces) by April 15, 2013. Abstracts will be reviewed for relevancy to this workshop. A new feature of this year’s workshop will give authors the option of preparing a paper that will be presented in proceedings to be published at the completion of the workshop. If an abstract is deemed relevant, the author will be invited to prepare a draft of his or her final paper. All final paper drafts will be reviewed for acceptance as either a poster presentation or an oral presentation at this year’s workshop.


All abstracts are to be written in English. An electronic version (PDF or MS Word format) should be submitted via email to Lisa Downs at Sadie.E.Downs@nasa.gov.


Important Dates

April 15, 2013              Abstract submission Due

May 15, 2013              Notification of Acceptance

June 1, 2013               Attendee Registration Opens

August 31, 2013          Final Papers/Presentations Due

August 31, 2013          Attendee Registration Closes


Contact Information

Annual IV&V Workshop Chair: Lisa Downs, Sadie.E.Downs@nasa.gov

Registration and Social Media: Bailee Morris, Bailee.R.Morris@ivv.nasa.gov and Jennifer Neptune, Jennifer.D.Neptune@ivv.nasa.gov

Corporate Sponsorships: Phil Loftis, Philip.D.Loftis@ivv.nasa.gov

Technical Committee and Annual IV&V Workshop Co-Chair: Stephen Husty, Stephen.Husty@nasa.gov





We are currently seeking technical paper, poster and demo submissions in the areas noted below.



Optimizing IV&V Planning and Execution

Analysis Framework Reuse (i.e., developer-specific mission analysis frameworks)

Development and Application of Assurance Case Structures

Efficiency Measurement and Continuous Improvement

Unified IV&V Analysis Process

IV&V Analysis Work Optimization Tips and Techniques

Application of Common Office Tools in Reducing Burden of IV&V Analysis and Evidence Collection

Use of Shared Data Dictionary for Improving Commonality of Terms of Reference Between Projects

IV&V Infrastructure and Stakeholder Community Support

IV&V Education Challenges

IV&V Skills Development and Certification

Efficient Risk Management in IV&V

Computing the Value of IV&V

Integrating NASA Assured Systems with Commercial Assured Systems

Commercial Space Systems IV&V

IV&V Challenges and Opportunities of SDLC Choices and Applicable Lessons Learned

Extending NASA IV&V Methods and Tools Applicability to Other Domains

New York City 911



Law Enforcement




IV&V Analysis Case Studies

Addressing Security Aspects of System Assurance via IV&V

Development and Application of IV&V Technical Reference Solutions

Assurance of Model-based Development

Automated Software Specification

Automated Software Design and Synthesis

IV&V of Autogenerated Code

Writing a “Good” Assurance Claim

Architecture Frameworks as Applied to NASA Systems

Software Assurance of Complex Algorithms

Criticality Analysis

Data Product IV&V

Data Integrity

Data Visualization

Patterns and Frameworks Applied to IV&V Analysis

Off-nominal Operations

Software-based Hazard Causes, Contributors and Controls




Special-Case IV&V Challenges

Challenges of IV&V of Projects Using Other Than Waterfall SDLC

Performing IV&V on an En Route Project

IV&V of Auto-generated Code

Highly Parallel Development Projects

IV&V Test Verification Methodologies

Autonomous Systems IV&V

Robotic Systems IV&V

IV&V of Early Lifecycle Artifacts

Partitioned Systems

Swarm Intelligence

Adaptive Systems

Application of Assurance Case Methodology to Assuring Autonomous Systems

Initiating and Evolving IV&V Methods

Use of Simulations in Performing IV&V

IV&V of Critical Behavior

Improving Effectiveness and Efficiency of IV&V Methods

Evolving Technology Impacts on IV&V Analysis Methodologies

The Future of Software Development and Its Impact on IV&V

Innovative Uses of Non-traditional IV&V Tools to Improve IV&V Analyses

Crowd Sourcing as a Prototype for Code Validation

Towards Content/Context-based and Collaborative IV&V

Application of Data Mining Tools to Support IV&V

Applying Social Media to IV&V

Knowledge Engineering Tools and Techniques

Knowledge Representation and Retrieval

Knowledge Visualization

Integrity, Security and Fault Tolerance Assessments in IV&V

Fault Management Architecture and Implementation IV&V

Team-based Approach to Performing IV&V of Systems

Computer-Supported Cooperative Work

Verifying Scripts

Providing Assurance of Enterprise Software, Middleware and Tools

Performance-based Design Assurance

Formal Methods: Current Tools and Practical Applications



2012 Annual IV&V Workshop Guidelines

Ashley D’Annunzio is the Executive Assistant for the Office of the Director. She is responsible for special event coordination and provides executive support to NASA’s IV&V Program.  

We look forward to your attendance at our 2012 Annual Workshop on Verification and Validation being held at the West Virginia University Erikson Alumni Center in Morgantown, WV. As the date gets closer, please be sure to check our website – https://www.nasa.gov/centers/ivv/workshops/index.html – for updates. In the meantime, below are a few guidelines and some information to help prepare you for the workshop.

Guidelines for Attendees

    • Be open-minded. Be willing to listen and learn.
    • Have fun! You have access to all the players this week. Get the most out of these interactions that you can.
    • Respect the time. The schedule will be strictly followed. Please be sure to be in the meeting rooms at the scheduled times. If you need to be late, please enter the meeting rooms as quietly as possible.
    • Respect the presenters. If you need to work on your laptop during a scheduled presentation, please leave the meeting room to do so. Please do not play games or engage in social media (unless you are bragging about the workshop ) during presentations. We have scheduled plenty of breaks for you to check email or do other work as required.
    • A small meeting room will be available all 3 days to schedule short break-out sessions. Please contact Lisa Downs (304-612-9761, Sadie.E.Downs@nasa.gov, or in-person at the Workshop) to schedule a meeting. The meeting room cannot be scheduled for longer than 2 hour slots.
    • If you require any kind of assistance during the workshop, please see a member of the Workshop Committee. The members will all be wearing shirts that say “NASA IV&V.”
    • There is no cost for food at the pre-workshop event, breakfasts, lunches, breaks, or the evening receptions (THANK YOU to the sponsors!) Also coffee, tea, juice and soda will be provided at the breakfasts and lunches however you will have to buy your own drinks at the pre-workshop event and evening receptions (cash bar).
    • All days will begin promptly at 8:00 AM. If you plan to take advantage of the breakfast, please arrive early enough to enjoy it or to take it into the conference rooms with you.  

Additional Guidelines for Posters and Demos

    • Posters should be approximately 2’ x 3’ and may be color or black and white. Electronic posters will be due to the IV&V Workshop Committee via e-mail to Bree.A.Layton@ivv.nasa.gov no later than August 15, 2012 in PDF format.  If you require additional time, please let us know by August 15th. This year, the IV&V Workshop Committee will provide printing of the posters. If you have any special requirements, please send that information as well.
    • If there are any special requirements for demo set-ups, please contact Bree Layton via email at Bree.A.Layton@ivv.nasa.gov prior to September 11th.
    • Time has been scheduled for demos and posters each day. Please ensure that you have a representative present at the scheduled times.

Additional Guidelines for Presenters

    • A laptop pre-loaded with all of the presentations will be provided in each meeting room. If you require a special set-up or would prefer to use your own laptop, please let Lisa Downs know ASAP so that we can test your setup prior to your scheduled presentation.
    • Leave your title at the door. Your presentation should focus on the method/idea. It should not be a resume or advertisement of your personal or organization’s capabilities. We are here to learn from each other. If you are interested in providing information regarding your company’s services, there are sponsorship opportunities available.
    • Don’t be afraid to introduce new ideas.
    • Respect the time and stay within your allotment (30 minutes). Timekeeping will be strict!  

If you have any additional questions, please contact Lisa Downs at 304-367-8252 or Sadie.E.Downs@nasa.gov
See you in September!

Ashley D’Annunzio
Executive Assistant
NASA’s Independent Verification & Validation Program

MMS Team Speaks to ERC Workshop

Eric Sylvania is the NASA Project Manager for the Magnetospheric Multiscale mission (MMS) IV&V effort. He is responsible for the day-to-day planning and execution of the technical and programmatic activities for the IV&V effort. Anita Berns is the Lead Engineer for the MMS IV&V effort and Brandon Miller is an analyst on the MMS IV&V Team.  

Each summer the Educator Resource Center (ERC) hosts a week-long workshop for educators on a variety of topics to supplement the curriculum and help meet national and state educational standards. In early July, the ERC hosted a group of educators for a “Space Weather” workshop, including an overview of magnetic reconnection and MMS. I, along with some other MMS IV&V team members, heard that the MMS project was going to be highlighted during the workshop, so we contacted the ERC to see if we could participate. As a result of this collaborative effort, Anita Berns, Brandon Miller and I were able to spend time with the educators in an effort to help them understand a little bit about what we do here at the NASA IV&V Program.

Project Manager Eric Sylvania and team speak to the workshop attendees about what they do for the project.

Anita and I provided the educators with an overview of the program, some insight into what IV&V is (and what IV&V is NOT!), and a few thoughts about the MMS project and the MMS IV&V effort, while Brandon provided some practical, real results from the IV&V analyses performed on MMS software. The educators were very receptive of the presentation, asked lots of questions and were very appreciative of the insight provided by the IV&V team. The IV&V team was very thankful for the opportunity to collaborate with the ERC and to be given an opportunity to talk to the folks on the front lines of our education system that will have a chance to influence the next generations of scientists, engineers and mathematicians.  

For more information about the ERC and/or opportunities to collaborate, contact Todd Ensign at todd.ensign@ivv.nasa.gov or learn more about the ERC by visiting their website at http://erc.ivv.nasa.gov.

For more information on this workshop, check out the ERC’s Josh Revels’ blog entry.  

Eric Sylvania
Project Manager
NASA’s Independent Verification & Validation Program