xLM Continuous Validation - How is it done?

The above diagram depicts the key elements of our Continuous Validation Program.

Continuous validation is providing documented evidence to certify that an app not only met the pre-established acceptance criteria, but “continuous” to meet thus mitigating the risk of unknown changes.

  1. Requirements Definition: This step provides the foundation for the continuous validation framework. Your Functional, Non-functional, Regulatory, Performance, Security, Logging, Disaster Recovery, Interface requirements are specified.
     
  2. Risk Assessment: A thorough risk assessment is performed to ensure business continuity, regulatory compliance, etc.. The output of the risk assessment is applied to the testing strategies to determine:
    1. What features to test?
    2. What should be the extent of negative testing?
    3. What type of testing strategies to utilize (eg: datasets to use, N Pair Testing)?
       
  3. Specification Definition:  Your app specifications are established.  These include IaaS/PaaS, Configuration, Workflow, Interface, Security, Log Management, etc..
     
  4. Test Automation Scripts: xLM utilizes a Model Based Test Automation framework for developing various models to validate your app. We use a data designer to generate test data including randomized data. We also use combinatorial testing strategies to reduce the number of iterations while increasing your test effectiveness.
     
  5. Test Model Validation: The test automation model itself is validated to ensure that it is meets the specified objectives.
     
  6. Test Execution: The model based test automation approach provides us with the flexibility to repurpose the same model to conduct various types of tests (smoke, regression, greedy path, optimal path, load, performance, etc..). Also, such a framework lends itself more conducive to manage updates and patches. Such a framework is well suited for continuously running validation test scripts (on a periodic basis; to test patches, etc..).
     
  7. Validation Reporting: Our xLM platform provides real-time dashboard reports, KPIs, summary reports, test deviation reports and more. A real-time Validation Health Dashboard is a reality.

Photo by Ilya Pavlov on Unsplash