Published on: November 13, 2023
1. Introduction
Traditional method for experimenting is One Variable at a Time (OVAT) in which one variable is varied, while all others are kept constant, and its influence assessed on the target properties (Figure 1.1).
Design of Experiments is a method in which all variables are changed at the same time and their influence assessed on the target properties. It proposes testing of the most informative locations in the design space which are focused towards the interpretability of the process and space filling of the design space (Figure 1.1).
In table 1.1 OVAT and DOE experiments are compared based on different characteristics.
Figure 1.1. Graphical representation of One Variable at a Time and Design of Experiments
Table 1.1. Comparison of OVAT and DOE
A lot of gaps in design space
Better filled design space
Time to achieve optimal values
Longer (in most cases not achieved)
Faster (with the help of predictive models)
A lot (several levels are tested for each material)
Number of experiments increases fast with increasing the number of input variables
In certain region accurate in another very inaccurate
Better accuracy throughout different regions of design space
The main types of designs available in Alchemy are:
2. Screening design
Screening Design is intended to be used for identifying significant main effects from a list of many potential varied materials.
2.1. Screening design in Alchemy
Screening design in Alchemy:
- Is automatically proposed for more than 5 varied materials.
- A minimum number of experiments related to the materials must be tested in order to identify which input variables are actually relevant for the given properties.
- Analysis of the main effects is available, after all experiments are tested, with contribution of each material to the tested property and significance according to Pareto principle (the 80/20 rule).
- After the analysis in the formulation table users are advised to change constraints for materials in accordance with the contribution of each material to the tested property.
2.2. Goals
The goals of screening design are to reduce the size of design space through:
- Reducing the number of varied materials - in further experiments only significant materials should be varied while insignificant should be kept constant.
- Narrowing the constraints range.
2.3. Subtypes of screening design
Subtypes of screening designs available in Alchemy are:
3. Optimal design
Optimal Design is intended to be used for filling the design space with experimental points.
3.1. Optimal design in Alchemy
Optimal design in Alchemy:
- Is automatically proposed for 5 or less varied materials or users can choose it after completing screening design.
- Higher number of experiments than for screening are needed.
- After all experiments are tested, performance of predictive models are shown.
3.2. Goals
The goals of optimal design are to:
- Get high performance of the predictive models.
- Recommend experiments with optimal values for target properties.
3.3. Subtypes of optimal design
Subtypes of optimal design available in Alchemy:
4. Adaptive design
Adaptive Designs is intended to be used for augmenting the available dataset (historical dataset and/or designed experiments) with the experiments from the regions of design space with the highest uncertainty.
4.1. Adaptive design in Alchemy
Adaptive design in Alchemy:
- Requires previous dataset (either historical and/or designed experiments).
- Number of experiments can be any number defined by the users, although sequentially adding less experiments is recommended.
- After all experiments are tested, performance of predictive models are shown.
4.2. Goal
The goal of adaptive design is to:
- Augment dataset with experiments from the regions of design space with the highest uncertainty in order to explore thoroughly the design space for getting better performance of the models and more accurate predictions.