Robustness
Robustness of AI/ML models is analyzed by Sensitivity Analysis examining the extent to which the results are affected by changes in input data.
There are two options to perform sensitivity analysis to understand the influencing factors. They are:
- First Order Sensitivity Analysis
- Total Order Sensitivity Analysis
First Order Sensitivity Analysis
First Order Sensitivity Analysis quantifies the impact of individual input variables on the output of a model by systematically varying one variable at a time while keeping others constant. It helps to understand the most influential factors of a model.
Total Order Sensitivity Analysis
Total Order Sensitivity Analysis evaluates the influence of individual input variables as well as their interactions on the output of a model. It measures the relative importance of the variable considering both their direct and indirect impact, providing understanding of their influence on the model prediction. It helps user to understand the most critical factors of a model.