Next Article in Journal
Development of Scenarios as Problem-Space Descriptions in Aerospace Conceptual Design
Next Article in Special Issue
A Novel Approach Using Non-Experts and Transformation Models to Predict the Performance of Experts in A/B Tests
Previous Article in Journal
Space-Based Passive Orbital Maneuver Detection Algorithm for High-Altitude Situational Awareness
Previous Article in Special Issue
Air Traffic Controllers’ Rostering: Sleep Quality, Vigilance, Mental Workload, and Boredom: A Report of Two Case Studies
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Review of Training Procedures for Simulated Engine Failure after Take-Off Exercises with Twin-Engine Aircraft under 5700 ft

1
School of Engineering, Royal Melbourne Institute of Technology, Melbourne, VIC 3001, Australia
2
Australian Transport Safety Bureau, Canberra, ACT 2601, Australia
*
Author to whom correspondence should be addressed.
Aerospace 2024, 11(7), 564; https://doi.org/10.3390/aerospace11070564
Submission received: 21 May 2024 / Revised: 2 July 2024 / Accepted: 8 July 2024 / Published: 10 July 2024
(This article belongs to the Special Issue Human Factors during Flight Operations)

Abstract

:
Engine failure after take-off (or one engine being inoperative) is an exercise conducted as part of multi-engine flight training and on-going competency checking. To prepare pilots to manage a real in-flight emergency, this exercise has traditionally been conducted immediately after take-off. This has led to increased risks of fatal accidents due to the reduced height at which these exercises are typically conducted. Yet, there is variation in the heights stipulated in training procedures published by different stakeholders worldwide. Additionally, the conduct of the exercise has resulted in fatal accidents worldwide. This paper aims to review the previous literature on aviation training and aviation occurrence data to determine what empirical data exists to support the method of conducting simulated engine failures. Peer-reviewed academic publications on aviation training, aviation occurrence databases such as aviation investigation reports, and guidance materials published by aviation authorities on simulated training exercises will be included in this paper. It was found that the previous research on these exercises has focused on the transfer of motion cues or pilot responses to abnormal situations, but did not include specific data comparing pilot performance at different heights above ground level. A review of aviation occurrences found that actual engine failures occurred at higher heights that those used in simulated engine failures. A comparison of the guidance published by aviation authorities identified variations in the minimum altitude published and differing justifications for the minimum height chosen. Future research is needed to compare pilot performance during simulated engine failures to determine the ideal height to conduct the exercise to be representative of an actual engine failure while maintaining safety margins.

1. Introduction

Engine failure after take-off (or one engine inoperative) is a compulsory exercise conducted as part of multi-engine flight training as documented by the Australian aviation safety regulator, the Civil Aviation Safety Authority [1]. Similar requirements for this training apply internationally. This exercise involves an instructor simulating an engine failure on one engine and the student (or trainee) is required to identify the engine that has failed and manage the situation to keep the aircraft in controlled flight. These exercises have been conducted at a low height (below 400 ft above ground level (above ground level (AGL) is the height measured in feet above the ground. The other method of measurement is above mean sea level (AMSL), which is the height in reference to the average sea level datum), or 122 m) to represent an engine failure after take-off. However, lower heights present increased risks as the trainee and instructor have less time available to manage the situation effectively. These include a smaller margin for recovery, lower speed, and increased drag due to aircraft configuration. In multi-engine aircraft, this exercise can be conducted in a simulator. However, the manoeuvre is also conducted in real aircraft as part of the training program published by national aviation authorities. There is an increased risk with aircraft under 5700 kg as simulators for these aircraft may not be widely available and the exercise is conducted with real aircraft.
There have been several fatal accidents in Australia [2,3] and overseas [4] during the conduct of simulated engine failure after take-off exercises. In Australia, two-thirds of the accidents that were conducted at or below 400 ft, where the height was known, resulted in a fatality. A review of the Australian Transport Safety Bureau’s occurrence data found that actual engine failures on twin-engine aircraft occurred on average at 1500 ft (457 m) above mean sea level [3]. This raises the question of whether the training that pilots are doing to handle an engine failure in a multi-engine aircraft may not be reflective of the real-world evidence.
The literature review presented in this paper explores previous studies in aviation training, focusing on applied research on training for specific manoeuvres or scenarios. The review includes industry publications on training, regulations relating to engine failure training, and investigation reports and aviation occurrence data.

2. Methodology

The systematic review used a comprehensive methodology to include all relevant papers to understand the available research on aviation training, with a specific focus on studies using simulators. There were three types of papers reviewed: (1) peer-reviewed journal articles, (2) aviation investigation reports, and (3) regulatory documents on aviation training, including advisory publications and legislation.
As part of this review, research papers were searched using key words ‘aviation’ OR ‘aircraft’ AND ‘training’ AND simulator AND human factors OR human performance, as well as specific human performance topics including ‘workload’ OR ‘attention’. These terms were searched in the fields of the title, abstract, and keywords of the papers. Only papers published in English were reviewed. The databases searched included Google Scholar, Scopus, and Science Direct. These databases provide a range of sources to assist with identifying studies across multiple interdisciplinary areas.
The research question guiding the literature review was ‘Have there been any previous studies reviewing the heights used in simulated engine failures?’.
The results of the literature search were filtered by reviewing the papers’ titles, key words, and abstracts, which resulted in 54 articles selected for the review. The inclusion criteria for the review were:
  • The paper must involve participants flying an aircraft (an airplane or helicopter);
  • The paper must involve a simulator or a simulated scenario;
  • The paper must be related to training to improve and/or measure performance in operational or human factor domains;
  • The paper must be empirical or experimental research.
The research reviewed comprised of participants across a wide range of ages, genders, and flying experiences.
The second part of the review involved searching through aviation investigation reports published by investigation agencies. These agencies’ websites (in English) were searched for reports involving simulated engine failure exercises. The search terms used were ��simulate engine failure’ or ‘training AND engine failure’. The reports were then reviewed to include only twin-engine (piston or turbo-propeller) airplanes under 5700 kg and that the phase of flight at which the accident occurred was ascending (at take-off or in the climb phase). The search resulted in 12 investigation reports from agencies in Australia, the United States of America, and Canada.
The third part of the review involved searching for aviation regulatory authorities’ training publications. Regulatory authorities’ websites (in English) were searched for their published documents using the terms ‘simulated engine failure’ in twin-engine airplanes. The search yielded publications from Australia, the United States, Canada, the United Kingdom, and the European Union. These authorities were contacted by email using the publicly available email addresses from their website.

3. Literature Review

3.1. Simulator Training Research in Aviation

Since the development of aircraft, simulators have also been used as a training method [5]. The first flight simulators were a ground-based replica of an aircraft for pilots to practice using the controls. Advancements in computing technology have been applied to simulators as they can have dynamic displays and even motion. Given the lower relative cost of simulators compared to actual aircraft, it has become a cost-effective method to train pilots. Research has shown that training in the simulator reduces time learning in the aircraft [6,7]. However, another review has found that the effects of simulator training did not improve performance after an average of 5 h [8].
Many studies have repeatedly demonstrated benefits of simulator training to improve flying skills [9,10,11]. Simulator training has many benefits including training large numbers of pilots and also providing the opportunity to practice manoeuvres that are hazardous in an actual aircraft. Simulators are also recognized as a valid training technique to meet training requirements set by regulations. Further, they have also been used for training in other industries, such as medicine and shipping.
The research in aviation training using simulators ranges in focus from training in normal operations to responses to abnormal situations. Flight simulators are a common method used in aviation training as these enable exposing trainee pilots to conditions similar to real scenarios. They can also be high fidelity, meaning they are very similar to the actual aircraft, with the ability to control and program for scenarios as required. In some instances, the addition of motion cues to a simulator has improved participants’ subsequent performance [12]. It has been found that providing participants with simulator training enhances their subsequent performance in that particular skill or scenario, indicating that training transfer has occurred [13]. In the context of training for normal operations, previous research has demonstrated that simulator training has improved pilot performance with basic flight control skills [14,15,16,17,18,19,20,21], adherence to visual flight rule procedures (such as maintaining separation and coordination with other aircraft in the circuit) [22,23], instrument flying skills [23,24,25,26,27,28], landing [29,30,31,32], low-visibility procedures [33], and risk assessment skills during low level flight [34]. Improved performance in these studies were measured by there being less variation in flight path tracking, flying instructor assessments, the mean higher altitude, and fewer landing attempts.
As well as normal situations, research has demonstrated that previous experience in a simulator improves performance in response to abnormal situations in a simulator [35]. It has been found that pilots who practiced unusual attitude recovery in a simulator performed better when retested in a simulator when presented that scenario than pilots who practiced unrelated procedures [36]. This was measured by higher instructor ratings and faster task completion times.
A study on the transfer of decision-making [37] found that pilots who had practiced an abnormal scenario applied decision-making principles (situation assessment and action selection) and made fewer errors than pilots who had not previously been exposed to that scenario. Specifically, the pilots who had not previously practiced the abnormal scenario also made more errors during the action selection phase. This implied that previous experience in the decision-making phases while managing an abnormal situation transfers when again presented with the same scenario.
Other research [38] has found that when using scenario-based training with exposure to simulated emergencies involving a parachute deployment, participants using this method obtained higher observer ratings than those who only reviewed the procedure. Further, the participants who completed this training were more likely to deploy the parachute at the correct time and altitude.
As well as aircraft handling skills, judgement and decision-making can be transferred after simulator training. Connolly [39] has found that participants who received classroom training and instructional simulations where they experienced several in-flight events performed significantly better than a control group when later assessed on their ability to handle these events by instructors and demonstrated a significant amount of change compared to their first attempt. Similarly, other researchers have found that pilots in a simulated flying condition positively transferred risk-averse behaviours (flying at a higher altitude) when flying in an actual airplane when they were actively involved in the flight [40]. Further, providing feedback was only beneficial if pilots could recall similarities between the test flight and other flights.
It was found that student pilots [41] who received simulator-based training performed better than those who did not have training in upset recovery through the application of control of G forces, correcting throttle and upset recovery response. It was also found that stress adversely affected performance. This related to the pilot’s using smaller control inputs under stress to correct the upset as they became unaware of how much input they were using.
Elaborating on the previous research discussed in the paragraph above, it was found that student pilots who received simulator-based training could return the aircraft to straight and level flight quicker following an in-flight upset compared to those who did not receive additional training [42,43]. Notably, the amount of altitude loss was not significantly different between groups. A follow-up study measuring the transfer of simulator training to a real aircraft was conducted with these groups, and it was found that the pilots who received simulator-based training lost less altitude than those who did not have this training and were also able to return to straight-and-level flight quicker than those who did not receive this training. Replicating this experiment with a motion simulator [44] found that both groups that had simulator training lost less altitude than the group who did not complete this training. There was little difference in performance between the two simulator groups (high- and low-fidelity simulators), indicating that training in simulators of different fidelities can improve performance.
Similar research used a simulator to train for upset recovery from unusual attitudes, spins, and stalls using visual references [45]. It was found that pilots who completed the simulator training improved their performance more than the control group. They were able to manage the aircraft recoveries in less time, instructor ratings of performance were higher and participants experienced a decrease in reported time pressure. Although the simulator did not have motion cues, a transfer of skills to a real aircraft was demonstrated. In research where motion cues in a simulator were used to train visual flight rules pilots in spatial disorientation conditions, it was found that pilots in the motion condition had a quicker spin recovery time compared to pilots who did not have motion cues or any training [46].
As well as flying skills, research in aviation training has found that the ability to manage the stress associated with an abnormal situation can be transferred. Research found that participants who flew in a simulator with an introduced stressor and were given associated strategies to manage stress performed better when flying a real aircraft than participants who were not exposed to a stressor [47,48]. Performance was measured by pitch, roll, and lateral and longitudinal acceleration variation as well as instructor ratings.

3.2. Previous Engine Failure after Take-Off in Twin-Engine Airplanes Research

There has been research on simulated engine failure after take-off in a simulator and real aircraft. Take-off is considered one of the highest workload phases of flight based on subjective and physiological data [49,50]. The highest recording of stress was also in this phase [49,50].
Previous engine failure after take-off research evaluated the use of motion cues and whether motion training can be transferred and improve performance. Researchers examined the use of the vertical motion transfer of cues using a simulator [51]. Pilots were required to respond to an engine failure after take-off. It was found that the pilots who had motion cues believed that it helped them with the exercise. However, there were no significant differences between groups who had motion cues and those who did not when managing heading deviation. Conversely, there was a significant difference between groups concerning rudder pedal input reaction time, where the group who did not train with motion had a faster reaction time than other groups who had different levels of motion. One reason proposed by the authors is that the no-motion group may have had to rely on visual cues. As the purpose of the research was to evaluate the use of motion in simulations rather than the exercise itself, this study included limited information on the exercise’s method and did not include the aircraft’s height. The only information included about the engine failure was when it would occur, which was when the landing gear was extended.
In another study about engine failures, researchers examined the use of a motion simulator and a fixed-based simulator and whether there were any differences in performance in an engine failure after a take-off exercise [52,53,54]. It was found that there were no differences between groups. As the purpose of the research was to evaluate the use of motion in simulations rather than the exercise itself, this study included limited information on the method the exercise was conducted in and did not include the aircraft’s height when the engine failed. This research was elaborated further to assess whether pilots who undergo initial training would benefit from learning motion cues [55,56]. Still, there was no significant difference in the response times of pilots who did not receive motion cues during the transfer phase. While this research included detail for some of the heights at which the engine failed, there was no comparison between performance as the purpose of the study was to evaluate the effect of motion in training.
A similar study conducted a quasi-transfer simulator training study where pilots were involved in an engine failure after take-off training exercise with motion and without motion to examine whether training with motion cues enhances performance [57]. The results showed there were few differences in control inputs across motion conditions while managing the failure. Similar to the research conducted and described above, there was no information recorded about the height at which the engine failure occurred.
Another study on motion cue transfer used engine failure after take-off as an example scenario to examine whether these cues affected the pilot’s ability to detect the failed engine and recover the aircraft [58]. It was found that motion cues significantly affected heading deviation where pilots who had these cues deviated less from their desired heading compared to the other conditions. As the main focus of the study was to evaluate the transfer to motion cues, there is no information on the exact altitude at which the engine failure occurred except that it would occur at a random altitude after a rotation below 100 ft.
There was a study on available cues of an engine failure in twin-engine propellor aircraft focused on the available cues [59]. Specifically, the research involved on group of pilots who relied on traditional methods to identify an engine failure (aircraft yaw) and another group who had cockpit lights indicating a failure. As the purpose of the study was about optimal cues to identify the failed engine, there was limited information on the height at which the engine failure occurred except how many seconds after lift-off the failure occurred. Further, there was no comparison of pilot performance between the different times the failure was programmed.
Other researchers have conducted studies measuring workload during simulator and actual aircraft sessions, which included managing an engine failure in a twin-engine aircraft [60]. Workload was measured by rating scales and heart rate. The results showed that pilots had an increased heart rate in the simulator compared to the aircraft for this failure and had a high subjective rating for mental workload. A reason for the increase of workload in the simulator compared to the aircraft proposed in the study was that the pilots were aware of when the engine failure would occur in the simulator and may have anticipated a high workload situation. In contrast, in the aircraft, it occurred at a less predictable time. This is because their heart rate increased in anticipation of the event in the simulator, and in the aircraft, they had a lower initial heart rate but more rapid increase. The research did not specify the height at which the engine failure occurred, except that it happened around 13 min into the session, which was likely in the climb or cruise phase. The failure also occurred at different times in the session; in the simulator, it occurred after take-off and in the aircraft during cruise flight at a safe altitude.
Researchers conducted research on a pilot’s stress responses to an abnormal situation, using engine failure after take-off as an example [61]. Stress was defined by the authors in this study as the negative appraisal of a situation. The results found that the participants’ visual search rate predicted the instructor’s evaluation and heading deviation. As the purpose of the research was to evaluate pilots’ stress responses, there is no information on the specific height at which the engine failure occurred.
Other research conducted to evaluate heart rate variability during emergency situations included engine and alternator failures [62]. One of the engine failures was during take-off. It was found that the pilots’ heart rate increased the most when the engine failure occurred during take-off compared to the other situations. Although the research included different heights for the engine failure, the specific heights were not specified as the purpose was to compare heart rates across conditions.
As well as stress, research has been conducted into managing surprise, or responses to unexpected events. Casner et al. [63] conducted research on pilot training in abnormal situations where pilots were exposed to variations in cues. One of the abnormal situations was an engine failure after take-off and the measures were whether they continued the take-off and their lateral control of the aircraft. It was found that of the 18 pilots, 2 aborted the take-off after the critical take-off speed. Based on the information in the study, it was ascertained that the engine failure occurred during a take-off roll, as the study referenced critical speeds. As the purpose of the study was to evaluate the pilot response to an unexpected abnormal situation, limited information was provided about when the engine failure occurred.
Similarly, research found that pilots who practised engine and rudder failures in an unexpected or variable manner required less time to manage a related failure during a surprise test compared to pilots who practiced these failures in a predictable manner [64]. In this study, the timings (or blocks) the engine failure occurred at were gear lever up, speed 65 kt, rotate, altitude 270 ft, gear halfway up, and altitude 310 ft. The pilots in the unexpected/variable group were only advised that there would be a malfunction, but not specifically during which block, whereas the control group were advised before each block that a failure would occur. Further, a surprise test occurred at 55 kt, with the height not specified. This study did not include a performance comparison for each block of engine failure, for instance, between the different heights and speeds for each block.
As part of the Australian Transport Safety Bureau’s investigation into a collision with terrain near Renmark, South Australia, involving a Cessna Conquest, the Australian Transport Safety Bureau occurrence data between 2008 and 2017 of checking or training accidents and actual engine failures or malfunctions were reviewed [3]. Of the 24 occurrences for a twin-engine, VH-registered aircraft under 5700 kg conducting training or check flights, there were three accidents, one of which resulted in fatalities during simulated engine failure after take-off. Outside of this period, a fatal accident during a simulated training exercise occurred in 2019. It was found that the fatal simulated training accidents occurred at or below 400 ft, where height was known.
In the same period, 405 actual engine failures or malfunctions were reported. Forty-three percent were in the take-off/climb phases of flight (up to 7600 ft). Nine of the 405 accidents resulted in accidents (2%), but 7 of the 9 [engine failures or malfunctions] accidents were in the take-off/climb phases of flight. The two fatal accidents occurred at or above 1500 ft AGL.
A review of the data shows that accidents occurring after an engine failure are rare. However, when accidents occur, they are likely to be during the take-off/climb phases of flight. Additionally, the fatal accidents during actual engine failures occurred at higher altitudes compared to those occurring during training.
Furthermore, the report noted [3] (pp. 62–63)
At present there is insufficient information available to accurately assess the accident rate associated with simulated engine failures, compared to the accident rate of actual engine failures occurring after take-off. Specifically, there is no data collected about the number of time asymmetric exercises are conducted in aircraft in Australia, in either flight training or company-based training and checking, which means the exposure is unknown.
Without knowing the exposure rate and how the training exercises are being conducted, including whether they accurately represent the conditions of a real engine failure, the ATSB could not determine whether the benefits of conducting simulated engine failures at a low level outweighed the risks. Further research in this area is required to answer that question.

3.3. Simulated Engine Failure after Take-Off

In Australia, pilots are required to meet competencies outlined in Part 61 of the Manual of Standards. To obtain the multi-engine aeroplane class rating, the pilot completes the aeroplane advanced manoeuvres unit of competency, which includes performing stall recovery in simulated partial and complete engine failure conditions.
In Australia, the Civil Aviation Safety Authority’s Civil Aviation Advisory Publication 5.23-1(2) Multi-engine aeroplane operations and training identified conducting flight operations at a low level as a risk. The publication acknowledged that [1] (p. 19)
Any flight operation at low altitude has potential dangers. Trainers have debated over the decades on the value of practicing engine failures after an actual take-off near the ground. The consensus is that despite the risks, pilots must be trained to manage these situations in multi-engine aircraft.
The publication also stipulated that instructors should consider not simulating engine failures below 400 ft above ground level to provide a safety margin. A strategy discussed to manage the risk was a thorough briefing after planning the exercise to reduce the level of in-flight analysis required, especially if a critical decision has to be made following an engine failure after take-off. The aim is to reduce the workload that may distract from the critical task of flying the aircraft.
Before simulating engine failures in multi-engine aircraft, instructors must be aware of the implications and be sure of their actions. The publication states that the instructor should consult the aircraft flight manual or pilot operating handbook for the manufacturer’s recommended method of simulating an engine failure. If there is no recommended method, then the publication guidance can be used. Before undertaking the task, the instructor must ensure that the aircraft is not in a dangerous situation to start with, such as the aircraft flying too slow, too low, in an unsuitable configuration, or hazardous weather (wind, ice, or visibility) being present. The publication also emphasizes that there is no benefit to introducing more risks than the emergency being trained for. Though there is guidance available for the conduct of the exercise, it is still the instructor’s discretion on when the engine failure is simulated.
The publication recommends that simulating an engine failure at a low level is done by closing the throttle for piston aircraft. After the engine has failed, the pilot must identify which engine is not producing power and maintain control at an optimal speed. Procedures include
  • Controlling the aeroplane. Prevent yaw with the rudder and adjust the nose attitude to a position where the aircraft can maintain or accelerate to the best single-engine rate-of-climb speed (VYSE). The wing may also be required to be lowered towards the serviceable engine.
  • The pilot must ensure that full power is applied to the good engine and the gear and flap are selected up—‘Pitch up, mixture up, throttle(s) up, gear up, flap up’.
  • The pilot must identify the failed engine (dead leg, dead engine method) but maintain control of the aircraft during this process.
  • Once the failed engine is confirmed, the pilot must close the throttle of the failed engine and confirm that the engine noise does not change or that no yaw occurs towards the live engine. They also need to visually identify the failed engine propeller lever before activation.
To manage an engine failure situation, the pilot must maintain control of the aircraft at an optimal speed. The pilot must stay above VMCA, which is the minimum control speed of an aircraft, to maintain directional control with one engine inoperative and adjust the aircraft attitude to achieve the best single-engine angle of climb speed (VXSE) or best single-engine rate of climb speed (VYSE) so that optimum climb performance is attained for the flight situation.
Several countries publish minimum heights at which the exercise can be conducted in their respective documents. Based on the guidance documents, the most common height appears to be 400 ft. A summary is found in Table 1.
The United States Federal Aviation Administration’s Commercial Pilot—Airplane Airman Certification Standards [65] (p. 18) stated that
On multiengine practical tests, where the failure of the most critical engine after lift off is required, the evaluator must consider the local atmospheric conditions, terrain, and type of aircraft used. The evaluator must not simulate the failure of an engine until attaining at least VSSE (minimum safe single-engine speed)/VXSE (best single-engine angle of climb speed)/VYSE (best single-engine rate-of-climb speed) and an altitude not lower than 400 feet AGL’.
The Federal Aviation Administration publication, Flying twins safely [66] (p. 8) provided additional guidance and noted that
Low-altitude engine failure is never worth the risks involved. Multiengine instructors should approach simulated engine failures below 400 feet AGL with extreme caution, and failures below 200 feet AGL should be reserved for simulators and training devices.
The Federal Aviation Administration Airplane flying handbook [67] (p. 36) noted that
When training in an airplane, initiation of a simulated engine inoperative emergency at a low altitude occurs typically at a minimum of 400 feet AGL to mitigate the risk involved and only after the learner has successfully mastered engine inoperative procedures at higher altitudes. Initiating a simulated low-altitude engine inoperative emergency in the airplane at an extremely low altitude, immediately after liftoff, or below VSSE creates a situation where there are non-existent safety margins.
Transport Canada’s [68] (p. 37) Instructor guide and multi-engine class rating stated that ‘it is not recommended to simulate engine failures below 500 ft AGL’.
The United Kingdom Civil Aviation Authority’s [69] (p. 3) Guidance to training captains and trainees, simulation of engine failure in aeroplanes states ‘that for multi-engined single-pilot aeroplanes it is recommended that engine failure shall not be simulated until reaching a minimum height of 300 ft above ground level’. This guidance also includes that an in-flight shutdown can only be conducted above 5000 ft.
The European Union Aviation Safety Agency’s [70] (p. 1102) Easy Access Rules for Air Operations (Regulation (EU) No 965/2012), under one engine inoperative stated that ‘the steady gradient of climb at an altitude of 400 ft above the take-off surface’ should be demonstrated. These published heights are of importance as this is where many of the accidents have occurred.
In response to a question about their documents, the Federal Aviation Administration reported that 400 ft was deemed adequate to mitigate the risks and increase safety during multi-engine training and testing upon reviewing previous engine failure after take-off accidents. This height was also used, as it was referenced in the aircraft certification requirements Title 14 of the Code of Federal Regulations (14CFR) Part 23 at the time.
The Civil Aviation Safety Authority of Australia reported that 400 ft was used in their guidance, as it was used in previous editions of the document. The regulator advised that there are no plans to update the guidance.
When asked about the reasons for the 400 ft minimum height choice, the European Union Aviation Safety Agency referred to the Certification specification for Normal, Utility, Aerobatic and Commuter Aeroplanes which includes performance requirements with one engine inoperative. Specifically, one engine inoperative is to be demonstrated by a positive steady gradient of climb at an altitude of 400 ft.
A review of guidance materials from New Zealand, Hong Kong, and Singapore found that no minimum height was stipulated for conducting simulated engine failure after take-off exercises. Representatives from these countries’ civil aviation authorities indicated in their response that it was at the instructor’s discretion to select a height suitable for the student to practice this manoeuvre, as they are the subject matter experts. It should be noted that this is a small sample of regulators and it is unknown what other countries’ publications state (due to difficulties in searching for training documents, only materials in English are referenced).

3.4. Simulated Engine Failure after Take-Off Accident Investigations

Accident investigation reports involving simulated engine failure exercises with twin-engine airplanes under 5700 kg from Australia, the United States, and Canada from the past 20 years were reviewed. Half of the accidents listed in Table 2 below show that the simulated engine failure was conducted at or below 400 ft.
Based on the investigation reports, if an accident occurred when the engine failure was simulated at a lower height, it was more likely to be fatal. All the accidents where the height of the exercise was below 400 ft had fatal injuries.

3.5. Summary

Current research into the conduct of simulated engine failure after take-off in twin-engine aeroplanes under 5700 kg is limited. The only previous research that has used this exercise focused on the transferability of motion cues or as an example of an abnormal situation to measure the pilot’s response. These research examples have limited or no information about the specific heights used in the exercises, most likely because it was not the focus of the studies.
There is variability in the published minimum height that the exercise is to be conducted at across different countries to ensure their accepted safety margins. Additionally, some countries do not specify a safe minimum height at all. Of the countries that publish a minimum height, there does not seem to be a clear reason why it was chosen. Most likely, this is because of historical regulations, aircraft performance characteristics, and the discretion of the subject matter experts, such as flying instructors. A review of the accident data indicated that actual engine failures occur higher than the training exercises [3].
No previous research specifically examines the heights used in simulated engine failure exercises, and therefore, it is not possible to evaluate whether the safety benefits outweigh the risks of conducting these exercises, as mentioned in the Australian Transport Safety Bureau investigation report [3].

4. Discussion and Conclusions

There is no previous research specifically evaluating the performance of pilots during simulated engine failures at different heights. Previous research has focused on motion cues or the exercise was used to measure pilot responses to an abnormal event. Future research should focus specifically on the heights that simulated engine failures are conducted at to compare pilot performance across these conditions. Potential heights that could be used in the study should be based on the issues discussed in this paper. Examples include the heights from previous investigation reports and published information from regulatory authorities and aircraft manuals. Variables to measure could include flight parameters such as airspeed, pitch, and time, as well as eye-tracking to ascertain the instruments that students focus on during engine failures. Subjective measures, including workload ratings and instructor scores can also be used to evaluate an individual’s experience and performance, respectively.
There is no empirical data to support the minimum height stipulated in regulatory guidance documents on conducting simulated engine failure exercises. There is also variation across countries, with different explanations for the decision to publish a particular height in their documents. It is important to evaluate the heights used in this exercise because of the risks involved and whether these are representative of actual engine failure scenarios.
As well as adding to the existing literature about how engine failure training is conducted, this research has safety implications. A review of previous occurrence data worldwide has shown that this training exercise has contributed to multiple serious and fatal injuries. Results from future research could be used to influence aviation training guidance and processes and the skill development of pilots. Further, the research benefits the aviation industry also from an economic perspective, as it has potential to reduce the risk of fatalities and the loss of aircraft, both of which have significant cost implications. As engine failure after take-off is a high workload task, improving these practices has the potential to decrease airspace complexity, which subsequently benefits all users of the shared airspace.
From an industry perspective, this review can assist regulators and policy makers when reviewing their guidance materials on the conduct of simulated engine failure training exercises. A greater knowledge of existing procedures and their success reduces further regulatory burdens, and reduces the need for agencies to conduct their own research or rely on historical evidence. Similarly, further research in this area provides additional data to manufacturers of twin-engine airplanes on its performance characteristics.

Author Contributions

Conceptualization, S.S., S.F., J.M.S. and N.B.; methodology, S.S., S.F., J.M.S. and N.B.; formal analysis, S.S., S.F., J.M.S. and N.B.; investigation, S.S., S.F., J.M.S. and N.B.; resources, S.S., S.F., J.M.S. and N.B.; writing—original draft preparation, S.S.; writing—review and editing, S.S., S.F., J.M.S. and N.B.; supervision, S.F., J.M.S. and N.B.; project administration, S.S., S.F., J.M.S. and N.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Civil Aviation Safety Authority. Multi-Engine Aeroplane Operations and Training; Civil Aviation Safety Authority: Canberra, Australia, 2015.
  2. Australian Transport Safety Bureau. Loss of Control—Embraer S.A. EMB-120ER Brasilia, VH-ANB, Darwin Airport, Northern Territory, 22 March 2010; Australian Transport Safety Bureau: Canberra, Australia, 2012.
  3. Australian Transport Safety Bureau. Loss of Control and Collision with Terrain Involving Cessna 441, VH-XMJ, 4 km West of Renmark Airport, South Australia on 30 May 2017; Australian Transport Safety Bureau: Canberra, Australia, 2020.
  4. National Transportation Safety Board. Collision with Terrain, Rome, Georgia, Beech 76, N184AA, 15 March 2008; National Transportation Safety Board: Washington, DC, USA, 2008.
  5. Lee, A.T. Flight Simulation: Virtual Environments in Aviation; Taylor & Francis: Abingdon, UK, 2016. [Google Scholar]
  6. Hays, R.T.; Jacobs, J.W.; Prince, C.; Salas, E. Flight simulator training effectiveness: A meta-analysis. Mil. Psychol. 1992, 4, 63–74. [Google Scholar] [CrossRef]
  7. McLean, G.M.T.; Lambeth, S.; Mavin, T. The use of simulation in ab initio pilot training. Int. J. Aviat. Psychol. 2016, 26, 36–45. [Google Scholar] [CrossRef]
  8. Rantanen, E.M.; Talleur, D.A. Incremental Transfer and Cost Effectiveness of Ground-Based Flight Trainers in University Aviation Programs. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Orlando, FL, USA, 26–30 September 2005. [Google Scholar]
  9. Pool, D.M.; Harder, G.A.; van Paassen, M.M. Effects of simulator motion feedback on training of skill-based control behavior. J. Guid. Control Dyn. 2016, 39, 889–902. [Google Scholar] [CrossRef]
  10. Pool, D.M.; Harder, G.A.; Damveld, H.J.; van Paassen, M.M.; Mulder, M. Evaluating Simulator-Based Training of Skill-Based Control Behavior Using Multimodal Operator Models. In Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, USA, 5–8 October 2014. [Google Scholar]
  11. Roessingh, J.J. Transfer of manual flying skills from PC-based simulation to actual flight-comparison of in-flight measured data and instructor ratings. Int. J. Aviat. Psychol. 2005, 15, 67–90. [Google Scholar] [CrossRef]
  12. Liu, D.; McSorley, J.; Blickensderfer, E.; Vincenzi, D.A.; Macchiarella, N.D. Transfer of training. In Human Factors in Simulation and Training: Theory and Methods, 2 ed.; Vincenzi, D.A., Moloua, M., Hancock, P.A., Pharmer, J.A., Ferraro, J.C., Eds.; Taylor & Francis Group: Milton, UK, 2023; pp. 103–124. [Google Scholar]
  13. Dennis, K.A.; Harris, D. Computer-based simulation as an adjunct to ab initio flight training. Int. J. Aviat. Psychol. 1998, 8, 261–276. [Google Scholar] [CrossRef]
  14. Ortiz, G.A. Effectiveness of PC-based flight simulation. Int. J. Aviat. Psychol. 1994, 4, 285–291. [Google Scholar] [CrossRef]
  15. Socha, V.; Socha, L.; Szabo, S.; Hána, K.; Gazda, J.; Kimlickova, M.; Vajdová, I.; Madoran, A.; Hanakova, L.; Nemec, V. Training of Pilots Using Flight Simulator and Its Impact on Piloting Precision. In Proceedings of the 20th International Scientific Conference, Juodkrante, Lithuania, 5–7 October 2016. [Google Scholar]
  16. Macchiarella, N.D.; Arban, P.K.; Doherty, S.M. Transfer of training from flight training devices to flight for ab-initio pilots. Int. J. Appl. Aviat. Stud. 2006, 6, 299–314. [Google Scholar]
  17. Macchiarella, N.D.; Brady, T.; Lyon, B.S. An application of high fidelity FTDs for ab initio pilot training: The way ahead. Coll. Aviat. Rev. 2008, 26, 67–75. [Google Scholar] [CrossRef]
  18. Nusseck, H.G.; Teufel, H.; Nieuwenhuizen, F.; Bülthoff, H. Learning System Dynamics: Transfer of Training in a Helicopter Hover Simulator. In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit, Honolulu, HI, USA, 18–21 August 2008. [Google Scholar]
  19. Stewart, J.E.; Dohme, J.A.; Nullmeyer, R.T. US Army initial entry rotary-wing transfer of training research. Int. J. Aviat. Psychol. 2002, 12, 359–375. [Google Scholar] [CrossRef]
  20. Stewart, J.E.; Dohme, J.A. Automated hover trainer: Simulator-based intelligent flight training system. Int. J. Appl. Aviat. Stud. 2005, 5, 25–39. [Google Scholar]
  21. Johnson, D.M.; Stewart, J.E. Utility of a personal computer-based aviation training device for helicopter flight training. Int. J. Appl. Aviat. Stud. 2005, 5, 288–307. [Google Scholar]
  22. Koglbauer, I.; Braunstingl, R. Ab initio pilot training for traffic separation and visual airport procedures in a naturalistic flight simulation environment. Transp. Res. Part F Traffic Psychol. Behav. 2018, 58, 1–10. [Google Scholar] [CrossRef]
  23. Reweti, S.; Gilbey, A.; Lynn, J. Efficacy of low-cost PC-based aviation training devices. J. Inf. Technol. Educ. Res. 2017, 16, 127–142. [Google Scholar] [CrossRef]
  24. Koonce, J.M. Predictive validity of flight simulators as a function of simulator motion. Hum. Factors 1979, 21, 215–223. [Google Scholar] [CrossRef]
  25. Taylor, H.L.; Talleur, D.A.; Rantanen, E.M.; Emanuel, T.W., Jr. The Effectiveness of a Personal Computer Aviation Training Device (PCATD), a Flight Training Device (FTD), and an Airplane in Conducting Instrument Proficiency Checks; Federal Aviation Administration: Oklahoma City, OK, USA, 2005.
  26. McDermott, J. Computer-based flight simulation: A cost effective way for general aviation pilots to improve their instrument proficiency. Int. J. Appl. Aviat. Stud. 2006, 6, 155–163. [Google Scholar]
  27. Pfeiffer, M.G.; Horey, J.D.; Butrimas, S.K. Transfer of simulated instrument training to instrument and contact flight. Int. J. Aviat. Psychol. 1991, 1, 219–229. [Google Scholar] [CrossRef]
  28. Moroney, W.F.; Hampton, S.; Biers, D.W.; Kirton, T. The Use of Personal Computer-Based Training Devices in Teaching Instrument Flying: A Comparative Study. In Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting, Los Angeles, CA, USA, 1 October 1994. [Google Scholar]
  29. Lintern, G. Transfer of landing skill after training with supplementary visual cues. Hum. Factors 1980, 22, 81–88. [Google Scholar] [CrossRef]
  30. Lintern, G.; Roscoe, S.N.; Koonce, J.M.; Segal, L.D. Transfer of landing skills in beginning flight training. Hum. Factors 1990, 32, 319–327. [Google Scholar] [CrossRef]
  31. Lintern, G.; Roscoe, S.N.; Sivier, J.E. Display principles, control dynamics, and environmental factors in pilot training and transfer. Hum. Factors 1990, 32, 299–317. [Google Scholar] [CrossRef]
  32. Lintern, G.; Taylor, H.L.; Koonce, J.M.; Kaiser, R.H.; Morrison, G.A. Transfer and quasi-transfer effects of scene detail and visual augmentation in landing training. Int. J. Aviat. Psychol. 1997, 7, 149–169. [Google Scholar] [CrossRef]
  33. Koglbauer, I.V.; Seidl, M.; Braunstingl, R.; Riesel, M.; Baciu, C. The Role of Simulator Scenarios in Learning Low Visibility Procedures in Flight. In Proceedings of the 10th International Conference Education, Reflection, Development, Cluj-Napoca, Romania, 24 June 2022. [Google Scholar]
  34. Molesworth, B.R.; Wiggins, M.W. Limitations of Skill Generalization Beyond Training. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, San Fransisco, CA, USA, 16–20 October 2006. [Google Scholar]
  35. Gawron, V.J.; Peer, J. Evaluation of airplane upset recovery training. Aviat. Psychol. Appl. Hum. Factor. 2014, 4, 74–85. [Google Scholar] [CrossRef]
  36. Koglbauer, I. Simulator training improves pilots’ procedural memory and generalization of behavior in critical flight situations. Cogn. Creier Comport. Cogn. Brain Behav. 2016, 20, 357–366. [Google Scholar]
  37. McKinney, E.H., Jr.; Davis, K.J. Effects of deliberate practice on crisis decision performance. Hum. Factors 2003, 45, 436–444. [Google Scholar] [CrossRef] [PubMed]
  38. Blickensderfer, E.L.; Strally, S.; Doherty, S. The effects of scenario-based training on pilots’ use of an emergency whole-plane parachute. Int. J. Aviat. Psychol. 2012, 22, 184–202. [Google Scholar] [CrossRef]
  39. Connolly, T.J. A simulator-based approach to training in aeronautical decision making. Coll. Aviat. Rev. 1987, 5, 3–26. [Google Scholar] [CrossRef]
  40. Molesworth, B.R.; Wiggins, M.W. Improving Pilots’ Risk Management Behaviour Through Active Involvement During Training. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, New Orleans, LA, USA, 20–24 September 2004. [Google Scholar]
  41. Rogers, R.O.; Bouquet, A.; Howell, C.; DeJohn, C. Preliminary Results of an Experiment to Evaluate Transfer of Low-Cost, Simulator-based Airplane Upset-Recovery Training; Federal Aviation Administration: Oklahoma City, OK, USA, 2007.
  42. Rogers, R.O.; Bouquet, A.; Howell, C.; DeJohn, C.A. An Experiment to Evaluate Transfer of Low-Cost Simulator-Based Upset-Recovery Training; Federal Aviation Administration: Oklahoma City, OK, USA, 2009.
  43. Rogers, R.O.; Boquet, A.; Howell, C.; DeJohn, C. A two-group experiment to measure simulator-based upset recovery training transfer. Int. J. Appl. Aviat. Stud. 2010, 10, 153–168. [Google Scholar]
  44. Leland, R.; Rogers, R.O.; Bouquet, A.; Glaser, S. An Experiment to Evaluate Transfer of Upset-Recovery Training Conducted Using Two Different Flight Simulation Devices; Federal Aviation Administration: Oklahoma, OK, USA, 2009.
  45. Koglbauer, I.; Kallus, K.W.; Braunstingl, R.; Boucsein, W. Recovery training in simulator improves performance and psychophysiological state of pilots during simulated and real visual flight rules flight. Int. J. Aviat. Psychol. 2011, 21, 307–324. [Google Scholar] [CrossRef]
  46. Kallus, K.W.; Tropper, K.; Boucsein, W. The importance of motion cues in spatial disorientation training for VFR pilots. Int. J. Aviat. Psychol. 2011, 21, 135–152. [Google Scholar] [CrossRef]
  47. McClernon, C.K.; McCauley, M.E.; O’Connor, P.E.; Warm, J.S. Stress Training Enhances Pilot Performance During a Stressful Flying Task. In Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting, San Fransisco, CA, USA, 27 September–1 October 2010. [Google Scholar]
  48. McClernon, C.K.; McCauley, M.E.; O’Connor, P.E.; Warm, J.S. Stress training improves performance during a stressful flight. Hum. Factors 2011, 53, 207–218. [Google Scholar] [CrossRef] [PubMed]
  49. Causse, M.; Dehais, F.; Faaland, P.-O.; Cauchard, F. An Analysis of Mental Workload and Psychological Stress in Pilots During Actual Flight Using Heart Rate and Subjective Measurements. In Proceedings of the 5th International Conference on Research in Air Transportation, Berkeley, CA, USA, 22–25 May 2012. [Google Scholar]
  50. Lee, Y.-H.; Liu, B.-S. Inflight workload assessment: Comparison of subjective and physiological measurements. Aviat. Space. Environ. Med. 2003, 74, 1078–1084. [Google Scholar] [PubMed]
  51. Zaal, P.M.T.; Schroeder, J.A.; Chung, W.W. Transfer of training on the vertical motion simulator. J. Aircr. 2015, 52, 1971–1984. [Google Scholar] [CrossRef]
  52. Burki-Cohen, J.S.; Soja, N.N.; Go, T.H.; Disario, R.; Boothe, E.M.; Jo, Y.J. Simulator Fidelity: The Effect of Platform Motion. In Proceedings of the International Conference on Flight Simulation, London, UK, 10–12 May 2000. [Google Scholar]
  53. Go, T.; Bürki-Cohen, J.; Soja, N. The Effect of Simulator Motion on Pilot Training and Evaluation. In Proceedings of the Modeling and Simulation Technologies Conference, Denver, CO, USA, 14–17 August 2000. [Google Scholar]
  54. Burki-Cohen, J.S.; Go, T.H.; Chung, W.W.; Schroeder, J.A.; Jacobs, S.; Longridge, T. Simulator Fidelity Requirements for Airline Pilot Training and Evaluation Continued: An Update on Motion Requirements Research. In Proceedings of the 12th International Symposium on Aviation Psychology, Dayton, OH, USA, 14–17 April 2003. [Google Scholar]
  55. Go, T.; Burki-Cohen, J.; Chung, W.; Schroeder, J.; Saillant, G.; Jacobs, S.; Longridge, T. The Effects of Enhanced Hexapod Motion on Airline Pilot Recurrent Training and Evaluation. In Proceedings of the AIAA Modelling and Simulation Technologies Conference and Exhibit, Austin, TX, USA, 11–14 August 2003. [Google Scholar]
  56. Burki-Cohen, J.; Go, T. The Effect of Simulator Motion Cues on Initial Training of Airline Pilots. In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit, San Francisco, CA, USA, 15–18 August 2005. [Google Scholar]
  57. Sparko, A.L.; Burki-Cohen, J.; Go, T.H. Transfer of Training from a Full-Flight Simulator vs. a High Level Flight Training Device with a Dynamic Seat. In Proceedings of the AIAA Modeling and Simulation Technologies Conference, Toronto, ON, Canada, 2–5 August 2010. [Google Scholar]
  58. Zaal, P.M.T.; Schroeder, J.A.; Chung, W.W. Objective motion cueing criteria investigation based on three flight tasks. Aeronaut. J. 2017, 121, 63–190. [Google Scholar] [CrossRef]
  59. Babin, A.K.; Dattel, A.R.; Klemm, M.F. An alternative method for identifying a failed engine in twin-engine propeller aircraft. Aviat. Psychol. Appl. Hum. 2020, 10, 103–111. [Google Scholar] [CrossRef]
  60. Dahlstrom, N.; Nahlinder, S. Mental workload in aircraft and simulator during basic civil aviation training. Int. J. Aviat. Psychol. 2009, 19, 309–325. [Google Scholar] [CrossRef]
  61. Vine, S.J.; Uiga, L.; Lavric, A.; Moore, L.J.; Tsaneva-Atanasova, K.; Wilson, M.R. Individual reactions to stress predict performance during a critical aviation incident. Anxiety Stress Coping 2015, 28, 467–477. [Google Scholar] [CrossRef] [PubMed]
  62. Santos, S.; Parraca, J.A.; Fernandes, O.; Villafaina, S.; Clemente-Suarez, V.J.; Melo, F. The effect of expertise during simulated flight emergencies on the autonomic response and operative performance in military pilots. Int. J. Environ. Res. Public Health 2022, 19, 9141. [Google Scholar] [CrossRef] [PubMed]
  63. Casner, S.M.; Geven, R.W.; Williams, K.T. The effectiveness of airline pilot training for abnormal events. Hum. Factors 2013, 55, 477–485. [Google Scholar] [CrossRef] [PubMed]
  64. Landman, A.; van Oorschot, P.; van Paassen, M.M.; Groen, E.L.; Bronkhorst, A.W.; Mulder, M. Training pilots for unexpected events: A simulator study on the advantage of unpredictable and variable scenarios. Hum. Factors 2018, 60, 793–805. [Google Scholar] [CrossRef] [PubMed]
  65. Federal Aviation Administration. Commercial Pilot: Airplane Airman Certification Standards; U.S. Department of Transportation: Oklahoma, OK, USA, 2018.
  66. Federal Aviation Administration. Flying Light Twins Safely; U.S. Department of Transportation: Oklahoma, OK, USA, 2008.
  67. Federal Aviation Administration. Airplane Flying Handbook; U.S. Department of Transportation: Oklahoma, OK, USA, 2021.
  68. Transport Canada. Instructor Guide: Multi-Engine Class Rating; Government of Canada: Ottawa, ON, Canada, 2010.
  69. Civil Aviation Authority. Guidance to Training Captains and Trainees—Simulation of Engine Failure in Aeroplanes; NATS Aeronautical Information Service: Southampton, UK, 2008. [Google Scholar]
  70. European Union Aviation Safety Agency. Easy Access Rules for Air Operations (Regulation (EU) No 965/2012); European Union Aviation Safety Agency: Cologne, Germany, 2022.
Table 1. Summary of the minimum heights above ground level recommended for simulated engine failures in twin-engine aircraft.
Table 1. Summary of the minimum heights above ground level recommended for simulated engine failures in twin-engine aircraft.
CountryHeight
Australia (Civil Aviation Safety Authority)400 ft
Canada (Transport Canada)500 ft
United States (Federal Aviation Administration)400 ft
United Kingdom (Civil Aviation Authority)300 ft
European Union (European Aviation Safety Agency)400 ft
Table 2. Summary of engine failure after take-off accidents.
Table 2. Summary of engine failure after take-off accidents.
HeightNumber of AccidentsNumber of Fatalities
0–100 ft22
100–200 ft24
200–300 ft22
300–400 ft23
Above 400 ft42
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sabadas, S.; Fothergill, S.; Silva, J.M.; Boston, N. A Review of Training Procedures for Simulated Engine Failure after Take-Off Exercises with Twin-Engine Aircraft under 5700 ft. Aerospace 2024, 11, 564. https://doi.org/10.3390/aerospace11070564

AMA Style

Sabadas S, Fothergill S, Silva JM, Boston N. A Review of Training Procedures for Simulated Engine Failure after Take-Off Exercises with Twin-Engine Aircraft under 5700 ft. Aerospace. 2024; 11(7):564. https://doi.org/10.3390/aerospace11070564

Chicago/Turabian Style

Sabadas, Stephanie, Selina Fothergill, Jose M. Silva, and Nathalie Boston. 2024. "A Review of Training Procedures for Simulated Engine Failure after Take-Off Exercises with Twin-Engine Aircraft under 5700 ft" Aerospace 11, no. 7: 564. https://doi.org/10.3390/aerospace11070564

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop