Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
Scientific Reports volume 12, Article number: 8944 (2022 ) Cite this article
Additive manufacturing demonstrates tremendous progress and is expected to play an important role in the creation of construction materials and final products. Contactless (remote) mechanical testing of the materials and 3D printed parts is a critical limitation since the amount of collected data and corresponding structure/strength correlations need to be acquired. In this work, an efficient approach for coupling mechanical tests with thermographic analysis is described. Experiments were performed to find relationships between mechanical and thermographic data. Mechanical tests of 3D-printed samples were carried out on a universal testing machine, and the fixation of thermal changes during testing was performed with a thermal imaging camera. As a proof of concept for the use of machine learning as a method for data analysis, a neural network for fracture prediction was constructed. Analysis of the measured data led to the development of thermographic markers to enhance the thermal properties of the materials. A combination of artificial intelligence with contactless nondestructive thermal analysis opens new opportunities for the remote supervision of materials and constructions.
The increase in the strength of materials and constructions is one of the main tasks of modern industry and engineering1. There are two main factors that affect the properties of the resulting material: composition (including changes in the bulk material and combining multiple materials together) and structure. Additive manufacturing—a set of technologies of layer-by-layer 3D-object printing—affects both factors2,3, provides unique possibilities for printing complex objects4, and shows high sustainability5 and opening recycling opportunities6,7.
In the last decade, additive technologies have become widespread not only as prototyping methods but also as methods for final product manufacturing8,9. This is due to the dramatic reduction in the cost of 3D printers using the technologies of fused deposition modeling (FDM, also known as FFF), photopolymerization (SLA, DLP), and selective laser sintering of plastic powder (SLS), as well as the availability of computer-aided design systems10,11. The fundamental features of 3D printing are low cost for organizing a fully functional production pipeline, low operating costs for entry-level equipment, waste-free manufacturing processes, high efficiency in the use of construction materials, and a “manufacturing on-demand” business model12,13.
Currently, 3D printing technologies are most effective for the one-off and small-batch manufacturing of products with complex geometries. Therefore, 3D printing has found wide application in scientific laboratories to create customized components for scientific instruments and entire laboratory installations14,15,16, in mechanical engineering17, in medicine18 for the manufacturing of prostheses19, dental aligners20, personalized hearing aids21, and other medical devices. Today, there is no area of material production that does not use 3D printing to a greater or lesser extent.
Since 3D printing is a tool for the manufacturing of functional parts, the range of construction materials for additive manufacturing has expanded rapidly in recent years22,23. If until recently the main requirement for such materials was the convenience of printing and the ability to impart the necessary aesthetic properties to products, then now mechanical strength24,25, chemical stability26, thermal and electrical conductivity27,28,29, and tribotechnical characteristics30 are at the forefront. A distinctive feature of products obtained by 3D printing methods is a layered structure, especially pronounced in the case of FDM technology, which is currently the most widespread additive manufacturing technology. This leads to a significant anisotropy of the mechanical and thermophysical properties of FDM parts31,32,33,34,35,36. Therefore, the geometrical arrangement of the structural material within one layer and the orientation of the layers of the material relative to the direction of the mechanical load are important parameters for controlling the strength of the final products, along with the type of thermoplastic polymer37. In addition, the strength of FDM parts is significantly influenced by the geometry and degree of internal filling of the part, bed temperature, and printing temperature influencing the fusion of the polymer layers38,39,40.
Achieving the maximum strength of FDM parts involves not only choosing the right structural material but also carefully optimizing the part topology and parameters of additive manufacturing41,42. Therefore, the search and analysis of correlations between the material type, printing parameters, characteristics of the destruction process, and strength of printed parts for FDM technology is an urgent task. In the present study, we demonstrated that thermal imaging provides an easy-to-use efficient opportunity for the analysis of mechanical stress effects. Nondestructive analysis, observation at a distance (contactless) and good localization are important advantages of thermal analysis (Fig. 1). Importantly, connection with video streaming makes it possible to assess the mechanical stress effect in real-time observations if a rapid algorithm for data treatment is available. This became possible with the development of such a powerful and versatile data analysis tool as artificial neural networks43.
A basic chart of important applications of nondestructive analysis of mechanical properties.
It is evident that the field experiences a very high rate of data acquisition44,45,46. These data require special approaches towards processing. Machine learning (ML) algorithms have revolutionized the area, making the automated extraction of relationships in data possible. Depending on whether correct labels are known or not, an algorithm falls into supervised or unsupervised machine learning groups47,48. This distinction here is not very strict, as newer methods were developed for situations where one has large amounts of unlabeled data and low amounts of data with labels. Another large area of machine learning is reinforcement learning, where the objective is to train an agent to perform actions, given observations and the state, to maximize the expected reward. The typical ML process includes four steps: creating a dataset, feature extraction, model training, and testing. The feature extraction process is often considered the most creative part of the data science process and is now usually performed by the algorithms themselves (for example, convolutional neural networks)49. It is important to note that in cases of volumes of data that cannot be processed on one machine, one needs to create a separate infrastructure (a Hadoop cluster, for instance)50, which becomes another step in the process.
The use of machine learning has already shown its efficiency in conjunction with additive technologies43,51,52. Currently, there are some studies aimed at applying machine learning in the field of mechanical testing of plastic and metal samples obtained using additive technologies53,54,55,56,57,58,59, including the manufacture of reactor parts60. Possible applications can be separated into three groups: a design for additive manufacturing, the manufacturing process itself, and search for structure–property/printing parameter-property relationships43. In design, researchers usually try to minimize the difference between expected and manufactured objects, create new materials, or automatically design the model to meet specific characteristics61. During the manufacturing process, one would need to control the parameters of a printer and check for defects. After that, to improve the quality of the product, relationships between printing parameters, structure, or other conditions and desired properties should be constructed.
Despite the presence of works focused on modeling thermographic data with neural networks62, there is no example usage of neural networks for fracture prediction in thermal imaging analysis. Therefore, here, we primarily focus on the task of fracture prediction from thermal images using neural networks, which is particularly important for industrial applications: analysis of the state of materials during their lifetime and prediction of possible destruction of constructions63. To do that, we aimed to develop a hardware platform for data acquisition along with software part to perform automated fracture prediction. For this work, we use 3D printed samples, showing the applicability of the approach for newly emerging technologies.
This work describes an efficient algorithm for acquiring large amounts of mechanical test data with thermographic video monitoring. The hardware part includes the universal testing machine and the thermographic camera connected to the single-board computer to improve the quality of the acquired data. The software part allows plotting time-resolved heatmaps, automated data analysis, and constructing correlations in data. As a result, we show a proof-of-concept for fracture time prediction.
To couple multiple different analysis methods, one needs to carefully design both the hardware and software parts. Each test includes three stages: printing, testing, and analysis parts.
The printing part is performed by the FDM printing method. It is the most widespread method for obtaining 3D products of various shapes and configurations. To print a model, a 3D model must be designed first. This is done using CAD software. The next step is the preparation of the model for printing. Slicer programs allow variation of the mechanical and strength properties of materials by changing the density of the part infill, layer thickness, printing speed and other various characteristics. Finally, to print the model, we used an FDM 3D printer, characterized by high operating criteria, almost identical to industrial equipment (see Fig. 2A,B).
Overview of the approach for 3D printing, tensile and thermal analysis, and data acquisition. (A) Desktop FDM 3D printer Picaso X-Pro used for plastic specimens printing; (B) printing process of one of the plastic specimens; (C) general view of the universal testing machine Tinius Olsen 25ST used for tests of tensile strength; (D) one of the plastic specimens clamped in the grips of the machine and dotted for strain analysis; (E) stress–strain curve for one of the specimens; (F) Seek Thermal Compact Pro infrared camera for thermographic analysis of the destruction process; (G) infrared camera connected to Raspberry Pi compact computer for data collection and transfer; (H–J) thermograms of the plastic specimen during the tensile test: (H) before destruction, (I) destruction moment and (J) after destruction.
Testing the strength properties of various objects for all kinds of loads, such as tensile, compression and bend testing, is essential to many areas of human production and engineering. One of the most common types of loading is tensile testing (see Fig. 2C–E). As an example, all kinds of architectural objects (for example, bridges), medical devices (such as prostheses), and even fabric textiles experience this functioning under operating conditions (see Fig. 1). To subject the obtained samples to this type of load, it was decided to use a universal testing machine, the parameters of which are described in more detail in the experimental part.
During testing, thermographic data are collected. In this work, this is done using a mobile thermographic camera connected to a board computer (see Fig. 2F,G). The hardware setup extends a previously published approach64. The data are collected during testing and well-integrated with other parts of the data processing pipeline. Finally, the data were analyzed by custom Python scripts.
Thermographic data consist of videos recorded by a thermal imaging camera in the infrared range. Each frame represents a particular moment during the thermographic test. Pixels in such frames have values of the current temperature of the object. The camera was calibrated by sampling points from the 0–100 °C range. These frames can be further processed with custom software and be a source for machine learning algorithms (see Fig. 2H–J).
For this research, the following materials were considered: polylactic acid (PLA), advanced polycarbonate (PC+), styrene-acrylonitrile copolymer (CERAMO), advanced polylactic acid (PLA+), acrylonitrile butadiene styrene (ABS), acrylonitrile butadiene styrene fiberglass-filled (ABS-GF), acrylonitrile butadiene styrene filled with carbon fiber (ABS-CF), polyethylene terephthalate glycol (PETG), high impact polystyrene (HIPS), and polylactic acid with wood fibers (WOOD).
The samples were subjected to tensile tests using a universal testing machine. The machine performs the analysis with constant traverse speed, measuring the force needed. The test is carried out until the sample’s fracture (images of the samples under test conditions are provided in Fig. 3). Data obtained at this step include stress–strain curves, maximum strain/stress values, and the same values at the fracture moment. These values can then be used to calculate the strength characteristics of the materials.
ABS-GF sample under the test conditions. The speed of movement of the upper traverse during the stretching of samples on a universal testing machine was 20 mm/min. The sample width was 13.3 mm, thickness was 3 mm, and estimated length was 80 mm. The width and thickness of the samples are taken from ASTM-D638-14 Type 1.
To characterize the strength properties of the plastics under study, a number of tensile experiments were performed for each type of material. The main characteristics obtained using a universal testing machine are presented in Table 1 and Fig. S5. The data are averaged and ranked in order of decreasing strength.
To put that into perspective, the maximum tensile loads (kg) in decreasing order can be used to create the following strength series: PLA (257) > PC+ (245) >> CERAMO (213) ≈ PLA+ (213) > ABS (188) > ABS-GF (170) > ABS-CF (161) > PETG (149) >> HIPS (105) > WOOD (78).
The same range of strength characteristics can be described for tensile strength (MPa): PLA (63.1) > PC+ (60.2) >> СERAMO (52.5) > PLA+ (52.3) > ABS (46.2) > ABS-GF (41.7) > ABS-CF (39.7) > PETG (36.6) >> HIPS (25.8) > WOOD (19.1).
It should be noted that glass-filled and carbon-filled ABS show worse physical and mechanical properties than unfilled ABS. This relationship may be due to the presence of additional components in the composition. When printing a layered structure, the solidity of the product is reduced due to poorer adhesion and reduced mutual fusion of the layers, although the individual materials themselves are claimed to be more durable.
WOOD (wood fiber-filled PLA) has the worst tensile strength, which is explained by its reinforcement with short wood fibers, which prevent hardening and affect the increase in the porosity of the structure of the product. This material has a more decorative function and should not be expected to show superior tensile properties.
The 10 out of the 15 most consistent experiments for each individual material were plotted (Fig. S4). In each series of tests, five tests were removed due to the significant number of outliers, which is caused by the complexity of additively manufactured samples with a layered structure and the characteristics of the testing machine, namely, the strain gauge can sometimes provide incorrect data. Separate, not fractured layers are perceived by the strain gauge as an unfinished experiment, after which the test continues, but, in fact, the sample is sufficiently deformed. Additionally, sometimes the test is terminated, although the sample was not destroyed. These issues are easy to control and notice during the experiment. The selection of 10 experiments out of 15 attempts provides enough statistical averaging data.
To increase the strength of the finished filled product, one needs to carefully optimize printing parameters to reduce the resulting defects and study the effect of optimization on fiber position using microscopy techniques.
All construction materials can be subjected to simple fracture under the action of a static load, in our case under the action of tension, by a plastic or brittle mechanism.
To obtain more insight into the processes occurring in the materials, we performed thermographic analysis. Figure 2I shows that at the fracture point, intense heating may be observed. Before that, materials behave differently: some heat very slowly just before the fracture, and some reduce the observed temperature. This cooling may be caused by the change in the material’s ability to reflect infrared radiation. After fracture, the heated polymer slowly cools to room temperature.
The observed behavior may be visualized as plots of the maximum frame heating (done via background subtraction, which is calculated as a linear interpolation between averages of the first and averages of the last frames) against time or a frame number (thermographic time-resolved plots, TTR plots). These relationships usually consist of a highly intensive peak, which corresponds to the material fracture event (Fig. 4A). Analysis of the thermographic imaging frame at the fracture moment enables observation of the exact place where a crack is being developed. Additionally, most of the materials show prefracture heating (although this might not be represented by TTR plots due to the low intensity of the signal) during the deformation process65,66,67. As tensile testing experiments do not result in fully elastic deformation, the process is irreversible, which means that some of the energy supplied must be released as heat.
Overview of information available from thermographic videos. (A) describes thermographic plots and maximum heating temperatures. (B) Shows the distribution of maximum heating temperatures for different materials. (C) Observed relationships between thermographic and mechanical data. (D) Shows the use of entire curves for material characterization.
In some materials, this relationship is not well pronounced (for example, WOOD). Others, such as PC+, show huge maximum heating with an average of 22 °C (Fig. 4B). PC+ is also characterized by special features, such as high temperature resistance (up to 110 °C), impact resistance and toughness, which makes this material an alternative to metals and characterizes the behavior shown in Fig. S5. Polycarbonate occupies a leading position in almost all physical and mechanical properties, apart from displacement at the point of destruction (shares leadership with ABS and PETG), maximum tensile loads and tensile strength, where PLA has a leading position, but the numerical difference between PLA and PC+ is small.
Heating temperatures also reflect some properties of the materials, in particular the total energy stored in the material during the trial. The total energy dissipation potential can be calculated from stain-stress curves as the integral of stress over strain68:
where \(\rho\) is the density of the material, \(z\) is the thickness of the sample, \(\epsilon\) is the deformation, \(\sigma\) is the stress, \({C}_{p}\) is the heat capacity, and \(\Delta T\) is the difference from the baseline temperature. The corresponding integral may be approximated as an area under the TTR plot, assuming a similar heating pattern during the trial and a small value of \({E}_{other}\) . This relationship is indeed observed for some materials (Fig. 4C). Maximum heating temperatures were also calculated, but the relationships were not well pronounced (Table S3).
To further highlight the differentiating ability of the TTR plots, corresponding data were vectorized, and dimensionality reduction analysis was applied. Converting these values into vectors and zero-filling to the same length, a good representation for the material may be obtained (Fig. 4D). For instance, in principal component analysis (PCA) plots, PC+ can be successfully separated. In t-distributed stochastic neighbor embedding (TSNE) plots, two clusters of ABS-CF and ABS-GF are observed.
Thus, it can be easily noted that thermographic observations provide another important dimension for mechanical test data. They can be used to characterize accumulated energy during the trial and possibly differentiate materials from each other. The amount of information present in TTR plots suggests that full thermographic videos are well suited for automated analysis with machine learning methods.
Fracture prediction by thermal analysis, if possible, would be one of the most practically applicable tasks in materials science. Many real constructions, such as buildings or bridges and mechanisms (such as bicycle chains), experience several forces. In some cases, they can lead to material fracture. Therefore, identification of conditions, probably leading to fracture, and prediction of time before the fraction is a crucial task for efficient monitoring.
Modeling of the fracture process was studied extensively. One of the main approaches is the finite element model (FEM). The simulations have a high computational cost, so machine learning approaches were developed. Examples include crack propagation predictions for brittle materials69,70,71 and graphene72.
Input data such as initial crack geometry or even current deformation and stress may be used efficiently to predict the fracture time. Unfortunately, in a real setting, these data are not available. Additionally, the exact type of material may be known, but the development of an algorithm not requiring information about the material as input would increase the applicability of the technology. We used thermographic camera image series as input data for the neural network regression models to solve the problem.
Three types of architectures were proposed: single-frame, multiframe, and recurrent multiframe models (Fig. 5A). They map images into high-dimensional space using convolutional encoders but differ in further processing. In the single-frame approach, only one image was used, and then the resulting vector was passed into a fully connected neural network (FCNN). This may be extended to the multiframe case if embeddings for each frame were concatenated and then passed into the FCNN. Finally, the temporal nature of the image sequences may be captured by recurrent neural networks to be more specific, long short-term memory neural networks (LSTMs). The image embeddings were passed from the convolutional encoder as well, and the last LSTM cell hidden state was passed into the FCNN. In the bidirectional case, the corresponding hidden states were concatenated and again passed into the FCNN.
Neural network analysis of thermographic images. (A) Comparison of architectures; (B) Results for the best model by material; (C) Aggregated results on the test set for the best model. Model—bidirectional LSTM model with an embedding size of 256 elements. Ten consecutive frames were used for prediction. The hidden size is equal to 256. Each batch contained 200 sequences.
The training was performed with the MSE loss function47 \({\mathcal{L}}_{MSE}\) (see more details on training in the “Methods” section):
where \(y\) and \(\widehat{y}\) are the ground truth and prediction vectors, respectively, and \({n}_{samples}\) is the number of elements in the vector.
We predicted both times before the fraction and after to increase model robustness and provide more training data.
Neural networks successfully learn the relationships, but a lack of data causes severe overfitting. To reduce its effects, batch sizes were reduced, and encoder architectures were simplified as much as possible. Batch normalization layers played the same role73.
As shown in Table 2, the recurrent approach shows the best results across the described architectures: 0.33 MSE loss (lower is better) in a single-frame case against 0.23 in a recurrent case. This is equal to 72% and 82% accuracies at the 50% value difference level. Generally, there is no significant impact of embedding vector lengths on the model’s performance, although the best model had 256 elements in the embedding vector with an MSE loss of 0.23 (mean absolute error of 0.37, root mean squared error of 0.48). Moreover, even with the same number of frames and the same length of the embedding vector, recurrent models outperform multiframe models. Bidirectional models show considerable improvement for lower dimensions. Generally, better performance is observed for a larger number of input frames in both multiframe and recurrent cases (from 7 to 10 frames). Comparison with training metrics shows a significant degree of overfitting (Table S7); however, the use of validation and testing datasets reduces the bias and helps to choose the best model based on its ability to generalize towards training data. Moreover, adding more data is highly likely to increase the performance of the model.
As a result, a neural network for fracture time prediction was developed (see Fig. 5B for results by material and Fig. 5C for aggregated results). The best model uses a convolutional encoder to generate frame embeddings and then passes them into the bidirectional LSTM network. Moreover, the model is not aware of the exact material used in the experiments, where corresponding input sequences were generated.
As no explicit modeling of the processes that occurred during the mechanical tests was made, the models can be learned purely from experimental data. Therefore, the main advantage of the approach is that the network can learn effects, which may be hard to model, and a single architecture can be used for various types of samples and objects. Moreover, predictions can be made very rapidly, reaching real-time speed.
However, the interpretability of the models is a significant limitation. As seen from the analysis of output gradients with respect to the input images, at some timesteps, the network focuses on either the bottom part of the sample (Fig. S8) or at the point of developing (10th frame at Fig. S8) or already developed (Fig. S9) fracture. Unfortunately, standard approaches such as FEM provide much more insight into internal physical processes.
The performed experiments show that materials have different temperature dynamics during mechanical testing. In some cases, it reduces the quality of the fracture time prediction. For instance, the model performance is the worst in the case of carbon-filled ABS plastic. It was proposed that the quality of the analysis can be significantly enhanced if another layer of more “thermally active” polymer was placed on top of the main materials. These experiments were performed for layers of PLA, multiple types of adhesive tape and glues.
These materials were applied to the front and back surfaces of the test sample. Experiments of such designs were carried out on a universal testing machine using a thermal imaging camera. The obtained strength properties are presented in Table S6 and Fig. S6.
According to Fig. S6, such a "modification" of carbon-filled plastic insignificantly affects the physical and mechanical parameters, which indeed confirms the feasibility of using this method to improve the temperature dynamics.
Next, consider the value of the maximum heating of ABS-CF plastic in combination with materials that improve the graphical picture of prediction. Table S6 shows that some materials increase the maximum heating value of ABS plastic reinforced with carbon fiber, and some materials, on the contrary, decrease the value, which is associated with the nature of the material used and the location of this material on the sample surface.
Finally, corresponding thermographic videos were fed into the neural network described in the previous section (Fig. 6). Most potential markers indeed enhance the thermal behavior of the materials. However, surprisingly, measurements performed on the other side of the sample are even better. This effect is likely caused by two reasons: the thermal behavior of markers is new for the neural network, so predictions are worse, which is expected. However, keeping two parts of the sample connected during the test increases its thermal activity and prolongs the crack growth process.
Results for different potential thermographic markers after neural network analysis.
Finally, attempts were made to analyze whether the described approach is applicable for more complex structures. As an example, an experiment for tensile testing of four samples at once was designed (Fig. S7). In total, five experiments were recorded, and their physical and mechanical characteristics were calculated (Table S6).
The videos were then fed into the neural network, which was retrained to operate on an image crop containing only the sample without background. Each of the five videos was cropped into four different videos for each sample, which were then fed into the neural network.
Although some signal was observed, it was hard to reproduce. For example, for one of the videos (Fig. 7), only two fracture events were predicted correctly. For the fourth sample, the event was not predicted at all, while for the second sample, the event occurred earlier. In some cases, the trend of the network prediction agreed with the experimental observations.
Results of neural network predictions for the case of four samples tested at once.
In our opinion, this is due to the influence on the output data of the built-up hold-down construction and the ripple deformation of individual samples of each test series, due to the unique character of discontinuity: synchronistic deformation of the first two dog-bones to the right or to the left relative to the center of the built-up construction, deformation of the first dog-bone in different areas of the construction, and different times between sample fractures, which, as a whole, led to the displacement of the construction relative to the vertical plane in different directions during testing. At the same time, the observed results suggest that correct prediction is possible and might be accomplished with changes in the algorithm.
This opens a new way to improve the algorithms: they should be trained on a wider variety of systems to improve the generalizability of the models. This work made a step forward in this direction, implementing an algorithm for automated fracture prediction.
In conclusion, thermographic data can be successfully used to study samples during mechanical tests. The thermal behavior of materials is another way to characterize materials and distinguish them from each other. Underlying physical reasons for such behavior were analyzed, and correlations were drawn. A new characteristic of the material’s thermal behavior—maximum heating—was introduced and calculated for ten materials (ranging from 0.80 to 19.65 °C).
As a result, the data were subjected to machine learning analysis: a neural network for fracture time prediction was developed (with MAE of 0.37 and MSE of 0.23). Comparing the model performance in cases of different materials, an approach to increase the thermal activity of the polymer was developed.
As a thermographic marker, Type 6 should be selected, as it shows the highest maximum load (182 kg), tensile strength (44.7 MPa) and maximum heating (10.60 ºC). Notably, fixation of the material should be carried out on the back of the sample to achieve the highest output characteristics. This behavior might be explained by the adhesive changing the pattern of the crack development process, which results in slower heat release rates.
Structural materials, mechanisms, building objects, and various items during operation in many fields of activity require special attention in predicting the long-term service life and their quality; therefore, the provided results confirm the importance of thermographic measurements in mechanical tests and their high potential in moving towards efficient monitoring of constructions and mechanisms during their lifetime.
All samples were made by the FDM method (fused deposition modeling) using a personal desktop 3D printer Picaso Designer X-Pro (see Fig. 2A) in 10 pieces for each type of plastic.
A typical tensile specimen (dog-bone) was made according to standard ASTM D638-14 Type I (Fig. S1A,B). The G-code was generated by Polygon X software. During printing, the plane of the samples was parallel to the XY plane of the printer build plate (Fig. S1C,D).
In all cases, printing was performed using a steel nozzle with a diameter of 0.5 mm, an extrusion width of 0.55 mm, a density of internal filling of samples of 100%, and a retraction value of 1 mm. For all materials except ABS-CF and PC+, a special adhesive was used to improve the adhesion of the part to the surface of the printer build plate. In the case of polycarbonate, the adhesion of the material to the glass was excessive, resulting in damage to the surface of the printer build plate when the finished part was removed. Therefore, for PC+, paper tape was used as the coating of the printer build plate. The temperature parameters of additive manufacturing for all materials studied in the work (Fig. S1E) are shown in Table S1.
The tests were carried out with the Tinius Olsen 25ST universal testing machine (maximum capacity 25 kN). The load weighing system of the testing machine exceeds the requirements of the following standards: ASTM E4, ISO 7500-1, and EN 10002-2; the strain measurement system of the machine exceeds the requirements of the following standards: ASTM E83, ISO 9513, EN 10002-4. During the tests, self-tightening wedge grips and a load cell with a maximum measurable load of 25 kN were used. The load cell accuracy in tensile measurements is 0.5% in the load range from 50 N to 25 kN. The tests were carried out at a moving crosshead speed of 20 mm/min. The results processing and analysis were carried out using the “Horizon” software package.
The obtained strength characteristics of unfilled plastics are comparable with the values provided in the database74 containing the characteristics of polymer materials from many manufacturers (Table S3).
Thermographic analysis was performed using a Seek Thermal Compact Pro thermal imaging camera with a highly sensitive infrared sensor. The measuring range of the temperature of this camera lies in the range from − 40 to + 330 °C. The transfer of the images obtained during shooting is carried out with a frequency of 9 fps. The camera was installed in front of the testing specimen to capture the thermal effects of the sample destruction and connected to a microcomputer.
To see whether the described approach can be extended to cases where multiple samples are tested simultaneously, a built-up hold-down construction was developed. As a result, 3D printed specimens were fixed in a testing machine by mechanical steel clamps.
The central part of the setup is a frame made of steel elements with holes assembled with bolts and nuts. It was attached to a 3D printed base (Fig. S7). Four samples were placed between two parts of the construction, fixed with bolting, and tightened with a wrench. It is important to fix the samples with force such that their deformation is minimal. Deformations lead to stress concentrations and consequently result in the destruction of the samples during testing.
As thermal effects were much harder to observe, the camera was connected to a laptop with a higher bandwidth connection than the Raspberry Pi board. However, the software and the experimental procedure were kept the same as in the previous experiments. In total, five series of tests were acquired. In every case, fracture occurred in the working section area. The results of the physical and mechanical experiments are presented in Table S6 for each set of tests.
The original software for the thermographic camera used does not give enough flexibility for automated analysis due to temperature scale constraints. There are two options. The first is to fix the scale by the lowest and the highest temperature and hope that the temperatures will not exceed them during the experiment. The second would mean keeping the scale adaptive, but in every frame of the resulting video, one would need to recognize all the text reconstructing the scale and temperatures according to the colors. The latter option is the separate task and increases the pipeline complexity dramatically.
Therefore, we developed another approach based on direct parsing of the camera’s output, connected by USB to the Raspberry Pi single-board computer (Fig. S2). The image acquisition relied on already available projects75 and was packed into a web application written using the Flask Python framework. The operator has two options: to record one image or to start video recording. The raw data are saved locally on the Raspberry Pi and then can be transferred via SFTP.
Raw data consist of numbers, which are linearly dependent on the object’s temperature. Therefore, we performed a calibration of our particular device. The resulting curve (Fig. S3) shows a high R2 value (0.993), which indeed confirms the linearity. All images were then decoded accordingly.
Another significant problem in data processing is the presence of background noise and brightening caused by other objects. It was solved by subtracting averages of multiple first frames from every from in a video.
As a result, we developed a convenient way to acquire and process large amounts of thermographic data. It includes a single-board computer to parse data from the thermographic camera directly and a web application with a user-friendly interface to operate it.
Data were processed with the NumPy76 and Pandas77 packages and plotted with Matplotlib78. Scikit-learn79 implementations of PCA and TSNE were used in dimensionality reduction. Neural networks were implemented using the PyTorch Python package80 in the PyTorch Lightning framework81. Models were trained with the Adam optimizer82.
Convolutional encoders had the following structure: conv(1, 2, 3), ReLU, batchnorm, conv(2, 4, 3), ReLU, batchnorm, maxpool(2), conv(4, 4, 3), ReLU, batchnorm, conv(4, 4, 3), ReLU, batchnorm, maxpool(2), conv(4, 4, 3), ReLU, batchnorm, maxpool(2) (optional), conv(4, 4, 3), ReLU, batchnorm, maxpool(2) (conv(a, b, c) = convolutional layer with input channels, b output channels and (c, c) – window size). The fully connected regressor applied a linear layer to the vector with shape (16), then ReLU, and finally, a linear layer to one number. Selection of the activation function was performed in the initial architecture search and was based on the metrics of the model.
Long sort-term memory neural networks are a type of recurrent neural network and perform the following transformation for each input83:
Here, \(\odot\) is the Hadamard product, and \(\sigma\) is a sigmoid function.
Therefore, at each step, the hidden states \({h}_{t-1}\) at time \(t-1\) are converted into output hidden states \({h}_{t}\) , and the same happens with cell states \({c}_{t}\) . The process is controlled by gates \(i\) , \(f\) , and \(o\) , which are called input, forget, and output gates, respectively, \(g\) is the cell state. Network weights are represented as \(W\) matrices.
For the best recurrent model, training was performed for 250 epochs with a batch size equal to 150. Ten consecutive frames were analyzed.
All necessary data are provided in this article and supplementary information.
Kutz, M. Handbook of Materials Selection (Wiley, 2002).
Parandoush, P. & Lin, D. A review on additive manufacturing of polymer-fiber composites. Compos. Struct. 182, 36–53 (2017).
Wang, Y. M. et al. Additively manufactured hierarchical stainless steels with high strength and ductility. Nat. Mater. 17, 63–70 (2018).
ADS CAS PubMed Article Google Scholar
Olsson, A., Hellsing, M. S. & Rennie, A. R. New possibilities using additive manufacturing with materials that are difficult to process and with complex structures. Phys. Scr. 92, 053002 (2017).
ADS Article CAS Google Scholar
Kucherov, F. A., Gordeev, E. G., Kashin, A. S. & Ananikov, V. P. Controlled natural biomass deoxygenation allows the design of reusable hot-melt adhesives acting in a multiple oxygen binding mode. ACS Appl. Mater. Interfaces 12, 45394–45403 (2020).
CAS PubMed Article Google Scholar
Cruz Sanchez, F. A., Boudaoud, H., Camargo, M. & Pearce, J. M. Plastic recycling in additive manufacturing: A systematic literature review and opportunities for the circular economy. J. Clean. Prod. 264, 121602 (2020).
Kucherov, F. A., Gordeev, E. G., Kashin, A. S. & Ananikov, V. P. Three-dimensional printing with biomass-derived PEF for carbon-neutral manufacturing. Angew. Chem. Int. Ed. 56, 15931–15935 (2017).
Zastrow, M. 3D printing gets bigger, faster and stronger. Nature 578, 20–23 (2020).
ADS CAS PubMed Article Google Scholar
Gordeev, E. G. & Ananikov, V. P. Widely accessible 3D printing technologies in chemistry, biochemistry and pharmaceutics: Applications, materials and prospects. Russ. Chem. Rev. 89, 1507–1561 (2020).
ADS CAS Article Google Scholar
Balakrishnan, H. K. et al. 3D printing: An alternative microfabrication approach with unprecedented opportunities in design. Anal. Chem. 93, 350–366 (2021).
CAS PubMed Article Google Scholar
Espera, A. H. et al. 3D printing of a robust polyamide-12-carbon black composite via selective laser sintering: Thermal and electrical conductivity. Macromol. Mater. Eng. 304, 1800718 (2019).
Chen, L., Cui, Y. & Lee, H. L. Retailing with 3D printing. Prod. Oper. Manag. 30, 1986–2007 (2021).
Heinen, J. J. & Hoberg, K. Assessing the potential of additive manufacturing for the provision of spare parts. J. Oper. Manag. 65, 810–826 (2019).
Tully, J. J. & Meloni, G. N. A scientist’s guide to buying a 3D printer: How to choose the right printer for your laboratory. Anal. Chem. 92, 14853–14860 (2020).
CAS PubMed Article Google Scholar
Silver, A. Five innovative ways to use 3D printing in the laboratory. Nature 565, 123–124 (2019).
ADS CAS PubMed Article Google Scholar
Kucherov, F. A., Romashov, L. V. & Ananikov, V. P. Development of 3D+G printing for the design of customizable flow reactors. Chem. Eng. J. 430, 132670 (2022).
Guo, N. & Leu, M. C. Additive manufacturing: Technology, applications and research needs. Front. Mech. Eng. 8, 215–243 (2013).
Kholgh Eshkalak, S., Rezvani Ghomi, E., Dai, Y., Choudhury, D. & Ramakrishna, S. The role of three-dimensional printing in healthcare and medicine. Mater. Des. 194, 108940 (2020).
Wang, Y., Tan, Q., Pu, F., Boone, D. & Zhang, M. A review of the application of additive manufacturing in prosthetic and orthotic clinics from a biomechanical perspective. Engineering 6, 1258–1266 (2020).
Lin, L. et al. 3D printing and digital processing techniques in dentistry: A review of literature. Adv. Eng. Mater. 21, 1801013 (2019).
Xu, X. et al. Vat photopolymerization 3D printing for advanced drug delivery and medical device applications. J. Control. Release 329, 743–757 (2021).
CAS PubMed Article Google Scholar
Jiang, Z. et al. Extrusion 3D printing of polymeric materials with advanced properties. Adv. Sci. 7, 2001379 (2020).
Fox, B. & Subic, A. An industry 4.0 approach to the 3D printing of composite materials. Engineering 5, 621–623 (2019).
Szykiedans, K. & Credo, W. Mechanical properties of FDM and SLA low-cost 3-D prints. Procedia Eng. 136, 257–262 (2016).
Croccolo, D., De Agostinis, M. & Olmi, G. Experimental characterization and analytical modelling of the mechanical behaviour of fused deposition processed parts made of ABS-M30. Comput. Mater. Sci. 79, 506–518 (2013).
Erokhin, K. S., Gordeev, E. G. & Ananikov, V. P. Revealing interactions of layered polymeric materials at solid-liquid interface for building solvent compatibility charts for 3D printing applications. Sci. Rep. 9, 20177 (2019).
ADS CAS PubMed PubMed Central Article Google Scholar
Guerra, V., Wan, C. & McNally, T. Fused deposition modelling (FDM) of composites of graphene nanoplatelets and polymers for high thermal conductivity: A mini-review. Funct. Compos. Mater. 1, 3 (2020).
Sanatgar, R. H., Cayla, A., Campagne, C. & Nierstrasz, V. Morphological and electrical characterization of conductive polylactic acid based nanocomposite before and after FDM 3D printing. J. Appl. Polym. Sci. 136, 47040 (2019).
Nguyen, N., Park, J. G., Zhang, S. & Liang, R. Recent advances on 3D printing technique for thermal-related applications. Adv. Eng. Mater. 20, 1700876 (2018).
Hanon, M. M., Alshammas, Y. & Zsidai, L. Effect of print orientation and bronze existence on tribological and mechanical properties of 3D-printed bronze/PLA composite. Int. J. Adv. Manuf. Technol. 108, 553–570 (2020).
Koch, C., Van Hulle, L. & Rudolph, N. Investigation of mechanical anisotropy of the fused filament fabrication process via customized tool path generation. Addit. Manuf. 16, 138–145 (2017).
Prajapati, H., Ravoori, D., Woods, R. L. & Jain, A. Measurement of anisotropic thermal conductivity and inter-layer thermal contact resistance in polymer fused deposition modeling (FDM). Addit. Manuf. 21, 84–90 (2018).
Zhu, D. et al. Thermal and mechanical properties of polyamide 12/graphene nanoplatelets nanocomposites and parts fabricated by fused deposition modeling. J. Appl. Polym. Sci. 134, 45332 (2017).
Somireddy, M. & Czekanski, A. Anisotropic material behavior of 3D printed composite structures: Material extrusion additive manufacturing. Mater. Des. 195, 108953 (2020).
Tronvoll, S. A., Vedvik, N. P., Elverum, C. W. & Welo, T. A new method for assessing anisotropy in fused deposition modeled parts using computed tomography data. Int. J. Adv. Manuf. Technol. 105, 47–65 (2019).
Laureto, J. J. & Pearce, J. M. Anisotropic mechanical property variance between ASTM D638–14 type i and type iv fused filament fabricated specimens. Polym. Test. 68, 294–301 (2018).
Ding, S. et al. Influence of the molding angle on tensile properties of FDM parts with orthogonal layering. Polym. Adv. Technol. 31, 873–884 (2020).
Lee, D. & Wu, G.-Y. Parameters affecting the mechanical properties of three-dimensional (3D) printed carbon fiber-reinforced polylactide composites. Polymers 12, 2456 (2020).
CAS PubMed Central Article Google Scholar
Kim, J. & Kang, B. S. Enhancing structural performance of short fiber reinforced objects through customized tool-path. Appl. Sci. 10, 8168 (2020).
Kiendl, J. & Gao, C. Controlling toughness and strength of FDM 3D-printed PLA components through the raster layup. Composites B 180, 107562 (2020).
Torres, J., Cotelo, J., Karl, J. & Gordon, A. P. Mechanical property optimization of FDM PLA in shear with multiple objectives. JOM 67, 1183–1193 (2015).
ADS CAS Article Google Scholar
Thompson, M. K. et al. Design for additive manufacturing: Trends, opportunities, considerations, and constraints. CIRP Ann. 65, 737–760 (2016).
Qi, X., Chen, G., Li, Y., Cheng, X. & Li, C. Applying neural-network-based machine learning to additive manufacturing: Current applications, challenges, and future perspectives. Engineering 5, 721–729 (2019).
Majeed, A., Lv, J. & Peng, T. A framework for big data driven process analysis and optimization for additive manufacturing. Rapid Prototyp. J. 25, 308–321 (2019).
Majeed, A. et al. A big data-driven framework for sustainable and smart additive manufacturing. Robot. Comput. Integr. Manuf. 67, 102026 (2021).
Francis, J. & Bian, L. Deep learning for distortion prediction in laser-based additive manufacturing using big data. Manuf. Lett. 20, 10–14 (2019).
Bishop, C. M. Pattern Recognition and Machine Learning (Springer, 2013).
Meng, L. et al. Machine learning in additive manufacturing: A review. JOM 72, 2363–2377 (2020).
Goodfellow, I., Bengio, Y. & Courville, A. Deep Learning (MIT Press, 2016).
Wang, C., Tan, X. P., Tor, S. B. & Lim, C. S. Machine learning in additive manufacturing: State-of-the-art and perspectives. Addit. Manuf. 36, 101538 (2020).
Khosravani, M. R., Nasiri, S. & Reinicke, T. Intelligent knowledge-based system to improve injection molding process. J. Ind. Inf. Integr. 25, 100275 (2022).
Nasiri, S. & Khosravani, M. R. Machine learning in predicting mechanical behavior of additively manufactured parts. J. Mater. Res. Technol. 14, 1137–1153 (2021).
Torre, R. & Brischetto, S. Experimental characterization and finite element validation of orthotropic 3D-printed polymeric parts. Int. J. Mech. Sci. 219, 107095 (2022).
Bao, H. et al. A machine-learning fatigue life prediction approach of additively manufactured metals. Eng. Fract. Mech. 242, 107508 (2021).
Saunders, R. et al. Mechanical behavior predictions of additively manufactured microstructures using functional Gaussian process surrogates. NPJ Comput. Mater. 7, 81 (2021).
Hassanin, H., Alkendi, Y., Elsayed, M., Essa, K. & Zweiri, Y. Controlling the properties of additively manufactured cellular structures using machine learning approaches. Adv. Eng. Mater. 22, 1901338 (2020).
Garland, A. P. et al. Deep convolutional neural networks as a rapid screening tool for complex additively manufactured structures. Addit. Manuf. 35, 101217 (2020).
Croom, B. P., Berkson, M., Mueller, R. K., Presley, M. & Storck, S. Deep learning prediction of stress fields in additively manufactured metals with intricate defect networks. Mech. Mater. 165, 104191 (2022).
Zhang, X., Saniie, J. & Heifetz, A. Detection of defects in additively manufactured stainless steel 316L with compact infrared camera and machine learning algorithms. JOM 72, 4244–4253 (2020).
ADS CAS Article Google Scholar
Goh, G. D. et al. Machine learning for 3D printed multi-materials tissue-mimicking anatomical models. Mater. Des. 211, 110125 (2021).
Muhammad, W., Brahme, A. P., Ibragimova, O., Kang, J. & Inal, K. A machine learning framework to predict local strain distribution and the evolution of plastic anisotropy & fracture in additively manufactured alloys. Int. J. Plast. 136, 102867 (2021).
Chrysochoos, A. Infrared thermography applied to the analysis of material behavior: A brief overview. Quant. Infrared Thermogr. J. 9, 193–208 (2012).
Feng, X. & Xue, F. Characterization of 3D printed bolts based on digital image correlation and infrared thermography. Mater. Des. 191, 108641 (2020).
Safari, K. H., Zamani, J., Guedes, R. M. & Ferreira, F. J. The effect of heat developed during high strain rate deformation on the constitutive modeling of amorphous polymers. Mech. Time Depend. Mater. 20, 45–64 (2016).
ADS CAS Article Google Scholar
Rittel, D. On the conversion of plastic work to heat during high strain rate deformation of glassy polymers. Mech. Mater. 31, 131–139 (1999).
Siviour, C. R., Walley, S. M., Proud, W. G. & Field, J. E. The high strain rate compressive behaviour of polycarbonate and polyvinylidene difluoride. Polymer 46, 12546–12555 (2005).
Soboyejo, W. Mechanical Properties of Engineered Materials (CRC Press, 2002).
Wang, Y. et al. StressNet: Deep learning to predict stress with fracture propagation in brittle materials. NPJ Mater. Degrad. 5, 1–10 (2021).
Hsu, Y. C., Yu, C. H. & Buehler, M. J. Using deep learning to predict fracture patterns in crystalline solids. Matter 3, 197–211 (2020).
Moore, B. A. et al. Predictive modeling of dynamic fracture growth in brittle materials with machine learning. Comput. Mater. Sci. 148, 46–53 (2018).
Lew, A. J., Yu, C. H., Hsu, Y. C. & Buehler, M. J. Deep learning model to predict fracture mechanisms of graphene. NPJ 2D Mater. Appl. 5, 1 (2021).
Ioffe, S. & Szegedy, C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. (2015).
MatWeb LLC. MatWeb. http://www.matweb.com/.
Laboratoire de Mécanique. Seek-thermal-Python. GitHub https://github.com/LaboratoireMecaniqueLille/Seek-thermal-Python.
Harris, C. R. et al. Array programming with NumPy. Nature 585, 357–362 (2020).
ADS CAS PubMed PubMed Central Article Google Scholar
McKinney, W. Data Structures for Statistical Computing in Python, 56–61 (2010). https://doi.org/10.25080/Majora-92bf1922-00a.
Hunter, J. D. Matplotlib: A 2D graphics environment. Comput. Sci. Eng. https://doi.org/10.1109/MCSE.2007.55 (2007).
Pedregosa, F. et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. (2011).
Paszke, A. et al. PyTorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems (eds Wallach, H. et al.) 8024–8035 (Curran Associates Inc, 2019).
Falcon, W. A., et al. PyTorch Lightning. GitHub. https://www.github.com/PyTorchLightning/pytorch-lightning (2019).
Kingma, D. P. & Ba, J. L. Adam: A method for stochastic optimization. in 3rd International Conference on Learning Representations, ICLR 2015: Conference Track Proceedings (2015).
Hochreiter, S. & Schmidhuber, J. Long short-term memory. Neural Comput. 9, 1735–1780 (1997).
CAS PubMed Article Google Scholar
These authors contributed equally: Daniil A. Boiko and Victoria A. Korabelnikova.
Zelinsky Institute of Organic Chemistry, Russian Academy of Sciences, Leninsky Pr. 47, Moscow, 119991, Russia
Daniil A. Boiko, Victoria A. Korabelnikova, Evgeniy G. Gordeev & Valentine P. Ananikov
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
D.A.B. performed the automated analysis and wrote the software, V.A.K. collected data and analyzed mechanical tests, E.G.G. designed the hardware part, V.P.A. designed the concept and supervised the research. All authors were involved in manuscript preparation.
Correspondence to Valentine P. Ananikov.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Boiko, D.A., Korabelnikova, V.A., Gordeev, E.G. et al. Integration of thermal imaging and neural networks for mechanical strength analysis and fracture prediction in 3D-printed plastic parts. Sci Rep 12, 8944 (2022). https://doi.org/10.1038/s41598-022-12503-y
DOI: https://doi.org/10.1038/s41598-022-12503-y
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
Scientific Reports (Sci Rep) ISSN 2045-2322 (online)
Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.