2013 NASA IV&V Workshop Call for Papers

UPDATE: The deadline for abstract papers has been moved to June 30, 2013.


2013 NASA IV&V Workshop Call for Papers

The Fifth International Workshop on Independent Verification & Validation (IV&V) of Software

West Virginia University’s Erickson Alumni Center

Morgantown, West Virginia, USA

September 10-12, 2013

The NASA IV&V Annual Workshop offers an in-depth understanding of the challenges that V&V organizations face in assuring that system software operates safely and reliably. The goal of the workshop is to generate solutions to these challenges. This year, we will be offering topics in three different tracks, as indicated in the tables below. To participate in this workshop, you must submit an abstract (maximum 4000 characters, including spaces) by April 15, 2013. Abstracts will be reviewed for relevancy to this workshop. A new feature of this year’s workshop will give authors the option of preparing a paper that will be presented in proceedings to be published at the completion of the workshop. If an abstract is deemed relevant, the author will be invited to prepare a draft of his or her final paper. All final paper drafts will be reviewed for acceptance as either a poster presentation or an oral presentation at this year’s workshop.


All abstracts are to be written in English. An electronic version (PDF or MS Word format) should be submitted via email to Lisa Downs at Sadie.E.Downs@nasa.gov.


Important Dates

April 15, 2013              Abstract submission Due

May 15, 2013              Notification of Acceptance

June 1, 2013               Attendee Registration Opens

August 31, 2013          Final Papers/Presentations Due

August 31, 2013          Attendee Registration Closes


Contact Information

Annual IV&V Workshop Chair: Lisa Downs, Sadie.E.Downs@nasa.gov

Registration and Social Media: Bailee Morris, Bailee.R.Morris@ivv.nasa.gov and Jennifer Neptune, Jennifer.D.Neptune@ivv.nasa.gov

Corporate Sponsorships: Phil Loftis, Philip.D.Loftis@ivv.nasa.gov

Technical Committee and Annual IV&V Workshop Co-Chair: Stephen Husty, Stephen.Husty@nasa.gov





We are currently seeking technical paper, poster and demo submissions in the areas noted below.



Optimizing IV&V Planning and Execution

Analysis Framework Reuse (i.e., developer-specific mission analysis frameworks)

Development and Application of Assurance Case Structures

Efficiency Measurement and Continuous Improvement

Unified IV&V Analysis Process

IV&V Analysis Work Optimization Tips and Techniques

Application of Common Office Tools in Reducing Burden of IV&V Analysis and Evidence Collection

Use of Shared Data Dictionary for Improving Commonality of Terms of Reference Between Projects

IV&V Infrastructure and Stakeholder Community Support

IV&V Education Challenges

IV&V Skills Development and Certification

Efficient Risk Management in IV&V

Computing the Value of IV&V

Integrating NASA Assured Systems with Commercial Assured Systems

Commercial Space Systems IV&V

IV&V Challenges and Opportunities of SDLC Choices and Applicable Lessons Learned

Extending NASA IV&V Methods and Tools Applicability to Other Domains

New York City 911



Law Enforcement




IV&V Analysis Case Studies

Addressing Security Aspects of System Assurance via IV&V

Development and Application of IV&V Technical Reference Solutions

Assurance of Model-based Development

Automated Software Specification

Automated Software Design and Synthesis

IV&V of Autogenerated Code

Writing a “Good” Assurance Claim

Architecture Frameworks as Applied to NASA Systems

Software Assurance of Complex Algorithms

Criticality Analysis

Data Product IV&V

Data Integrity

Data Visualization

Patterns and Frameworks Applied to IV&V Analysis

Off-nominal Operations

Software-based Hazard Causes, Contributors and Controls




Special-Case IV&V Challenges

Challenges of IV&V of Projects Using Other Than Waterfall SDLC

Performing IV&V on an En Route Project

IV&V of Auto-generated Code

Highly Parallel Development Projects

IV&V Test Verification Methodologies

Autonomous Systems IV&V

Robotic Systems IV&V

IV&V of Early Lifecycle Artifacts

Partitioned Systems

Swarm Intelligence

Adaptive Systems

Application of Assurance Case Methodology to Assuring Autonomous Systems

Initiating and Evolving IV&V Methods

Use of Simulations in Performing IV&V

IV&V of Critical Behavior

Improving Effectiveness and Efficiency of IV&V Methods

Evolving Technology Impacts on IV&V Analysis Methodologies

The Future of Software Development and Its Impact on IV&V

Innovative Uses of Non-traditional IV&V Tools to Improve IV&V Analyses

Crowd Sourcing as a Prototype for Code Validation

Towards Content/Context-based and Collaborative IV&V

Application of Data Mining Tools to Support IV&V

Applying Social Media to IV&V

Knowledge Engineering Tools and Techniques

Knowledge Representation and Retrieval

Knowledge Visualization

Integrity, Security and Fault Tolerance Assessments in IV&V

Fault Management Architecture and Implementation IV&V

Team-based Approach to Performing IV&V of Systems

Computer-Supported Cooperative Work

Verifying Scripts

Providing Assurance of Enterprise Software, Middleware and Tools

Performance-based Design Assurance

Formal Methods: Current Tools and Practical Applications



2012 Careers in the Corridor Event

Jess White is the STEM Initiatives Lead at NASA’s IV&V Program. He is the current coordinator for the Careers in the Corridor event. 

NASA’s IV&V Program STEM Initiatives Office held the fourth annual Careers in the Corridor (CIC) exhibition on Friday November 30, 2012. The event showcased the variety of high tech careers available in West Virginia and featured a presentation by a former space shuttle astronaut and West Virginia native, Capt. Jon McBride.

The objective of CIC is to help sophomores, juniors and seniors imagine the future they can realize by studying science, technology, engineering and mathematics. Astronaut McBride spoke about his journey to become what is now West Virginia’s only astronaut. Afterwards, he joined the students on a tour of job fair exhibits staffed by NASA and other corporate and academic recruiters. 

Among the exhibitors there were West Virginia University’s Dr. Powsiri Klinkhachorn and a few members of his WVU Robotics Team. Along with them they brought the WVU Mars Rover, which was built by the WVU Robotics Team and competed in the MARS RASC-AL RoboOps Challenge. Although the robotics held the students’ interest, many of the other vendors had the opportunity to interact with the students one-on-one, which was something they felt was very important. 

“Careers in the Corridor is one of the best communication platforms I have seem for the promotion of NASA’s STEM initiatives and inspiring the next generation of West Virginians,” vendor and TASC Office Manager Bree Layton said. 

The vendors certainly weren’t the only ones who saw the benefit of this annual event. Cynthia Howell of Heritage Christian School stated that this event was very good for her students and that she hoped that their school can participate in future IV&V educational outreach opportunities. 

A big thanks to all of those who helped make this event happen. It was a great success and one that we hope to continue for many years to come. If you are interested in becoming a vendor for next year’s event, please contact STEM Initiatives Lead Jess White at jesse.e.white@nasa.gov or Bailee Morris at bailee.r.morris@ivv.nasa.gov.

Jess White
STEM Initiatives Lead
NASA’s Independent Verification & Validation Program

IV&V's Independent Test Capability Team Competes in 2012 NASA Software of the Year

The IV&V Program’s Independent Test Capability team is chartered to acquire, develop and maintain simulation and test environments for NASA’s IV&V Program to enable dynamic analysis of NASA IV&V-supported projects. The team has worked with Global Precipitation Measurement (GPM), James Webb Space Telescope (JWST), International Space Station, Juno, Multi-Purpose Crew Vehicle (MPCV), Autonomous Flight Safety System (AFSS) and Goddard Mission Services Evolution Center (GMSEC). 

The IV&V Program’s Independent Test Capability team had the opportunity to compete in the 2012 NASA Software of the Year competition. The competition is sponsored by the NASA Chief Engineer, the NASA Chief Information Officer and the NASA Office of Safety and Mission Assurance. The purpose of the competition is to allow the agency to recognize and appreciate NASA’s team members who set high standards for significant software that is creative, usable, transferable and possesses inherent quality.

The competition requires that teams prepare and submit a significantly large packet of information detailing the characteristics of the software including commercialization potential, uniqueness and creativity, to name a few. In addition to the packet submission, each team prepares and gives a 30 minute presentation on the software. Initial submissions are evaluated at each respective NASA center and final submissions are evaluated by a software advisory panel, with representatives from across the agency. 

It was an honor for the Independent Test Capability team to be involved in this competition and to represent the IV&V Program and Goddard Space Flight Center. The team received honorable mention recognition and was the first submission from the IV&V Program. Thank you to everyone that supported the submission and especially those who provided peer reviews and letters of support. The team looks forward to its next opportunity to compete!

Independent Test Capability Team
NASA’s Independent Verification & Validation Program

Day in the Park 2012

Jess White is the STEM Initiatives Lead at NASA’s IV&V Program. He is the current coordinator for the Day in the Park event. 

Thirteen years of Day in the Park events has impacted over 10,000 West Virginia citizens with high quality NASA Science, Technology, Engineering and Mathematics (STEM) educational content. This year’s Day in the Park event was no different. On October 23-24, 2012, approximately 1,200 fifth and seventh-grade students had the unique opportunity to learn about STEM careers, NASA’s mission and what it takes to be an astronaut. With a goal of inspiring, educating and engaging learners about NASA and STEM careers, students experienced hands-on scientific and engineering presentations by former astronaut Ken Cameron, the Carnegie Science Center and the Seattle-based Museum of Flight. Also attending and serving as Master of Ceremonies was former West Virginia Congressman Alan Mollohan.

Day in the Park is provided to students each year to fight against the trend of students losing interest in science and math during pre-adolescent formative years of development. Day in the Park vendors strive to provide content that is jam packed full of the “WOW” factor in regards to science and math. While eating lunch, a student told me that they are now torn between working for NASA’s IV&V Program in Fairmont and becoming an astronaut after hearing about Mr. Cameron’s experience as a NASA astronaut. Teachers attending the event were equally impressed, stating they think these types of STEM awareness opportunities are exactly what their students need as motivation to take the steps necessary to become our nations next generation of STEM professionals. 

I could not have ‘daydreamed’ better responses from guests of our Day in the Park events! 

For more photos, visit NASA’s IV&V Program page on Facebook.

Jess White
STEM Initiatives Lead
NASA’s Independent Verification & Validation Program

OC Flight-1 Team at the State Fair

Steven Hard is the Project Manager for IV&V’s OC Flight-1 effort. He is also a member of the West Virginia University (WVU) Robotics Team in Morgantown, West Virginia.  

OC Flight-1 development team member Alan Didion and I went to the State Fair of West Virginia to join the West Virginia University Benjamin M. Statler College of Engineering and Mineral Resources (CEMR) booth set up within the West Virginia University building on the grounds. We represented WVU’s chapter of the Student Partnership for Cosmic Exploration (SPACE), which is a multi-disciplinary student group aimed at helping students get internships with NASA and broadening student awareness of Science, Technology, Engineering and Mathematics (STEM) opportunities. Alan is the co-president of SPACE, whereas I’m just a member spreading the word.

We brought with us the WVU Mars Rover, which was built by the WVU Robotics Team and competed in the Mars RASC-AL RoboOps Challenge. We also brought both a mockup and a real version of the TubeSat flying on the OC Flight-1 mission. We talked about the results of the RoboOps competition, showed a demonstration of the mobility and manipulation capabilities of the WVU Mars Rover by turning in place, performing short arc-steering translations, and retrieving rocks with the robotic arm. The vision system was also displayed using a nearby Video Graphics Array (VGA) monitor. Discussions transitioned to the Space Flight Design Challenge concept and the OC Flight-1 mission as interest propagated across the display table.

This booth was a wonderful venue for getting the word out about our efforts. We all very much enjoyed the State Fair of West Virginia and hope that our message made an impression.

Steven Hard
Project Manager
NASA’s Independent Verification & Validation Program

2012 Annual IV&V Workshop Guidelines

Ashley D’Annunzio is the Executive Assistant for the Office of the Director. She is responsible for special event coordination and provides executive support to NASA’s IV&V Program.  

We look forward to your attendance at our 2012 Annual Workshop on Verification and Validation being held at the West Virginia University Erikson Alumni Center in Morgantown, WV. As the date gets closer, please be sure to check our website – https://www.nasa.gov/centers/ivv/workshops/index.html – for updates. In the meantime, below are a few guidelines and some information to help prepare you for the workshop.

Guidelines for Attendees

    • Be open-minded. Be willing to listen and learn.
    • Have fun! You have access to all the players this week. Get the most out of these interactions that you can.
    • Respect the time. The schedule will be strictly followed. Please be sure to be in the meeting rooms at the scheduled times. If you need to be late, please enter the meeting rooms as quietly as possible.
    • Respect the presenters. If you need to work on your laptop during a scheduled presentation, please leave the meeting room to do so. Please do not play games or engage in social media (unless you are bragging about the workshop ) during presentations. We have scheduled plenty of breaks for you to check email or do other work as required.
    • A small meeting room will be available all 3 days to schedule short break-out sessions. Please contact Lisa Downs (304-612-9761, Sadie.E.Downs@nasa.gov, or in-person at the Workshop) to schedule a meeting. The meeting room cannot be scheduled for longer than 2 hour slots.
    • If you require any kind of assistance during the workshop, please see a member of the Workshop Committee. The members will all be wearing shirts that say “NASA IV&V.”
    • There is no cost for food at the pre-workshop event, breakfasts, lunches, breaks, or the evening receptions (THANK YOU to the sponsors!) Also coffee, tea, juice and soda will be provided at the breakfasts and lunches however you will have to buy your own drinks at the pre-workshop event and evening receptions (cash bar).
    • All days will begin promptly at 8:00 AM. If you plan to take advantage of the breakfast, please arrive early enough to enjoy it or to take it into the conference rooms with you.  

Additional Guidelines for Posters and Demos

    • Posters should be approximately 2’ x 3’ and may be color or black and white. Electronic posters will be due to the IV&V Workshop Committee via e-mail to Bree.A.Layton@ivv.nasa.gov no later than August 15, 2012 in PDF format.  If you require additional time, please let us know by August 15th. This year, the IV&V Workshop Committee will provide printing of the posters. If you have any special requirements, please send that information as well.
    • If there are any special requirements for demo set-ups, please contact Bree Layton via email at Bree.A.Layton@ivv.nasa.gov prior to September 11th.
    • Time has been scheduled for demos and posters each day. Please ensure that you have a representative present at the scheduled times.

Additional Guidelines for Presenters

    • A laptop pre-loaded with all of the presentations will be provided in each meeting room. If you require a special set-up or would prefer to use your own laptop, please let Lisa Downs know ASAP so that we can test your setup prior to your scheduled presentation.
    • Leave your title at the door. Your presentation should focus on the method/idea. It should not be a resume or advertisement of your personal or organization’s capabilities. We are here to learn from each other. If you are interested in providing information regarding your company’s services, there are sponsorship opportunities available.
    • Don’t be afraid to introduce new ideas.
    • Respect the time and stay within your allotment (30 minutes). Timekeeping will be strict!  

If you have any additional questions, please contact Lisa Downs at 304-367-8252 or Sadie.E.Downs@nasa.gov
See you in September!

Ashley D’Annunzio
Executive Assistant
NASA’s Independent Verification & Validation Program

2012 NASA Engineering Apprenticeship Program

Sarah Layman is the NASA Engineering and Apprenticeship Program (NEAP) assistant. She is responsible for intern on-boarding success, internship experience success, intern accountability, and presentations at IV&V and Headquarters coordination.  

Jess White is the STEM Initiatives Lead. He is responsible for ensuring internship program goals are met, if not exceeded, as well as continually seeking ways to improve internship offerings for students.  

For 20 high school interns, the summer of 2012 may not be one they forget anytime soon. The interns came from high schools located all over West Virginia, which represented the IV&V Program’s 17th class of summer high school interns. The interns participated in a full-time eight week internship experience that provided them the opportunity to better their science, technology, engineering and mathematics (STEM) skills, as well as their professional etiquette skills in NASA’s workforce. The NASA IV&V Engineering Apprenticeship Program began on June 11, 2012 and concluded on August 3, 2012. STEM Initiatives Lead Jess White feels there is a two-pronged goal possibility from this experience.

“It is our goal to provide students with real world workforce preparatory experiences, promote interest in NASA and STEM disciplines, and better prepare a future workforce and based on intern participants projects,” White said. “We are well on the way to infusing the next generation of STEM professionals into NASA’s and America’s future workforce.”  

NEAP interns Mr. White and Ms. Layman at NASA Headquarters

The high school interns had the opportunity to present their project efforts to an audience at NASA Headquarters which enabled This Week @ NASA media coverage. The video coverage can be found here. Also while at NASA Headquarters, the high school interns had the opportunity to meet NASA Administrator Charlie Bolden, who spoke to the interns and their families about the value of participating in programs like these, and how they (interns) will be responsible for leading NASA’s future missions. NEAP intern Ryder Huggins, like the other interns, realized the magnitude of this experience.

“Meeting the Administrator was a once in a lifetime experience and one I will never forget,” Huggins said.

Congratulations are due to these interns and a special thanks to the IV&V Program and mentors who volunteered their services in support of these internship initiatives.

Sarah Layman
NEAP Assistant

Jess White
STEM Initiatives Lead

NASA’s Independent Verification & Validation Program

MMS Team Speaks to ERC Workshop

Eric Sylvania is the NASA Project Manager for the Magnetospheric Multiscale mission (MMS) IV&V effort. He is responsible for the day-to-day planning and execution of the technical and programmatic activities for the IV&V effort. Anita Berns is the Lead Engineer for the MMS IV&V effort and Brandon Miller is an analyst on the MMS IV&V Team.  

Each summer the Educator Resource Center (ERC) hosts a week-long workshop for educators on a variety of topics to supplement the curriculum and help meet national and state educational standards. In early July, the ERC hosted a group of educators for a “Space Weather” workshop, including an overview of magnetic reconnection and MMS. I, along with some other MMS IV&V team members, heard that the MMS project was going to be highlighted during the workshop, so we contacted the ERC to see if we could participate. As a result of this collaborative effort, Anita Berns, Brandon Miller and I were able to spend time with the educators in an effort to help them understand a little bit about what we do here at the NASA IV&V Program.

Project Manager Eric Sylvania and team speak to the workshop attendees about what they do for the project.

Anita and I provided the educators with an overview of the program, some insight into what IV&V is (and what IV&V is NOT!), and a few thoughts about the MMS project and the MMS IV&V effort, while Brandon provided some practical, real results from the IV&V analyses performed on MMS software. The educators were very receptive of the presentation, asked lots of questions and were very appreciative of the insight provided by the IV&V team. The IV&V team was very thankful for the opportunity to collaborate with the ERC and to be given an opportunity to talk to the folks on the front lines of our education system that will have a chance to influence the next generations of scientists, engineers and mathematicians.  

For more information about the ERC and/or opportunities to collaborate, contact Todd Ensign at todd.ensign@ivv.nasa.gov or learn more about the ERC by visiting their website at http://erc.ivv.nasa.gov.

For more information on this workshop, check out the ERC’s Josh Revels’ blog entry.  

Eric Sylvania
Project Manager
NASA’s Independent Verification & Validation Program

ERC's Space Weather Reporting Workshop

Josh Revels works in IV&V’s Educator Resource Center (ERC) as the Technical Librarian. He helps maintain their social media accounts and also assists with internal communications. 

During the week of July 16, 2012, the NASA IV&V Program Educator Resource Center (ERC) was home to 12 West Virginia teachers. The teachers, who traveled from as far as Parkersburg and Paw Paw, engaged in the ERC’s 2012 Space Weather Reporting Camp. The camp was combined with the Space Weather graduate course, instructed by West Virginia University’s assistant science education professor Dr. Jeffrey Carver and research assistant professor of physics Dr. Amy Keesee. Prior to attending the hands- on activities, teachers spent time online with readings about the sun and sun-earth relationships.

This workshop was very different from others, as many teachers directly observed the sun with a special solar filter for the first time. Additional mechanisms for observing the sun included the use of “Sun Spotters”, which allowed for sunspots to be visible as a shadow of the sun appeared on a piece of paper. Alongside WVU associate professor Margie Darrah, teachers solved real-life space scenarios that involved mathematics. 

After building their very own candy, paper, or LEGO models of Magnetospheric Multiscale (MMS), the teachers took a day trip to tour NASA’s Goddard Space Flight Center, where they were able to interact with NASA mission specialists, including MMS. As part of the tour, the participants explored the Space Weather Control Center, which helped inspire the production of Space Weather Reports, much like below. 

At the end of the week, it was the teachers who were expressing their gratitude for the free ability to use the equipment available at NASA IV&V’s ERC. One teacher stated anonymously, “The most valuable part of this experience is gaining the ability to borrow kits such as the iPads, solar telescopes, sun spotters, and the electromagnetic spectrum kit.” 

The ERC staff eagerly waits for next summer’s camps and hopes it is as much of a success as the 2012 Space Weather Reporting Camp.

Josh Revels
Technical Librarian
NASA’s Independent Verification & Validation Program
Educator Resource Center

Storm signals Sun Storm Weather report from Nasa Erc on Vimeo.

CFC 5K at NASA’s IV&V Facility

IV&V Project Manager Eric Sylvania is one of the 5K event organizers. He is also responsible for organizing IV&V’s first recreational running club.

On September 15, 2012 at 9:00 a.m. hundreds of runners will gather to complete a 5,000m race, equal to about 3.1 miles, through the I-79 Technology Park in Fairmont, W.Va. So, why will they be doing this? Well, there are the obvious reasons: improved health, better well being, stress reduction, etc. However, one of the less obvious reasons some walkers and runners will be up for the challenge is the benefit to the Combined Federal Campaign, or the ‘CFC’. So, what is the CFC, you ask?

The CFC is the world’s largest and most successful annual workplace charity campaign, with more than 200 CFC campaigns throughout the country and internationally to help to raise millions of dollars each year. Pledges made by federal civilian, postal and military donors during the campaign season (September 1, 2012 to December 15, 2012) support eligible non-profit organizations that provide health and human service benefits throughout the world. The CFC supports more than 4,000 non-for-profit organizations as a result of the many campaigns conducted throughout the fiscal year. The CFC Local Federal Coordinating Committee provides oversight for the North Central West Virginia Combined Federal Campaign and also determines eligibility for the local charities that apply to participate in the campaign. For more information, go to http://www.opm.gov/cfc/. You can find out more about our local CFC chapter here.

So, on race day, when you toe the line with the other runners, remember that there are several good reasons for running the CFC 5K at NASA IV&V: health, gratification, and the list goes on. Nevertheless, the most important reason is to benefit the CFC and the many great organizations it represents. Please remember that $10 of each registration fee will be given directly to the CFC. Pre-race registration ($20) ends on August 31, 2012. After August 31, 2012, you can register up until 8:30 a.m. on race day for an additional $5 ($25 total). For more information about the race, you can visit the 5K page on our website, or iPlayOutside.

If you have any questions about partnering in support of the race, or about the race itself, please feel free to contact one of the following individuals:

Eric Sylvania; Eric.L.Sylvania@nasa.gov; (304) 367-8266

Bree Layton; Bree.A.Layton@ivv.nasa.gov; (304) 367-8359