ICARUS Quiz – 4. Aviation Safety Quiz review

Our penultimate aviation safety quiz was held on 14 June 2020 and it produced the best result so far.

Our team with Ing. Victor Manuel del Castillo and Daniel Bustamente, both from Mexican company “Safety Management System México” created a forth set of 20 questions based on ICAO Document 9859 and Annex 19 that describes Safety Management System in aviation.

More details about the third quiz:

• 20 questions from ICAO Annex 19 and Doc 9859 SMS document with multiple choices and only one correct answer
• time limit to 30 minutes
• 1 bonus question where participants were able to make their own remarks
• 23 registered participants from all over the world successfully completed the quiz

RESULTS
We continued the style from the previous quiz with few use-cases and we are proud that this was so far the best scored quiz that gave an average score of 70.6%. What has shown as a trend is that participants who already have participated in the previous quizzes and continue to play regularly started achieving higher results.  There were 102 registered participants and 23 successfully solved the quiz with 5 of them starting but never finishing the quiz. We have noticed that the average time to resolve the quiz was higher than other quizzes with the average total time being 18 min 49 sec. We found a nice correlation with higher results if the participants take more time to solve the quiz.

From the ones who successfully solved the quiz we bring to you the following statistics:

In the graph above its noticeable that majority of the participants were between 60-80% that produced such high average score. However again the most populous set group are those ones between between 60-70% just like in the previous quizzes.  The best result this time was by the participants “HarisLy” and “9MBAB” who managed a score of 90% once again. Congratulations to all of them and also to all participants who solved the quiz.

BEST vs WORST QUESTIONS
An interesting statistic has shown the relation between correct and incorrect answers. We have made a screenshot of the statistics for both parts and have made a highlight of each.

The easiest questions by statistics were:

• 11. What is the recommended Action for a tolerable risk? (23/23 correct)
• 4. On the safety risk tolerability table, what are the 3 different Safety Risk Description? (21/23 correct)
• 18. In your opinion: What immediate consequences would there be as a result of this event in the picture? (21/23 correct)

On the other hand, we have a statistic of incorrect answers. This gives us and our participants better insight which area of their knowledge needs more focus.

The hardest questions by statistics were:

• 19. The following image shows an event during the replacement of an engine. In your opinion this is? (5/23 correct)
• 7. Personal electronic devices (particularly mobile phone) in the cockpits should be turned off from the start of the flight until the end of it, this recommendation is: (7/23 correct)
• 8. The following image shows the result of the opening of the covers of the right engine of the aircraft on climb due to not having properly activated its latches. In your opinion, this event is an? (10/23 correct)

Just like in the previous quiz, the most difficult questions were our experimental questions with use-cases. Even though they pose a risk to be interpreted in different ways, we have decided to use them again.

The image for the 19.questions which had the least number of correct answers

The answer for the hardest question is “None of the above” due to the fact this is just simple maintenance event of engine replacement. Most of the users responded that it is an aviation incident. As for the electronic devices question its recommendation is astute meaning its just a wise recommendation not mandatory requirement what a lot of participants chose.

BONUS QUESTION COMMENTS

After an advice from one of our participants, we decided to implement an idea of showcasing best comments on bonus questions in our aviation safety quiz reviews.

For this quiz the bonus question was “What methods and actions you would do to increase the safety reporting numbers from your employees?” and we received a lot of interesting comments in both English and Spanish.

We are bringing to you some of those we found very interesting:

Promote the system based on real events, and that the staff realize that the SMS is to improve processes and Operational security within the organization.
(jjgalvarro)

1. Analyze, explain and demonstrate the benefits of reporting culture to all employees through training and/or other means (information bulletin, notices, newsletters)
2. Highlight and clarify the confidentiality of the reporting scheme to all employees.
3. Establish an effective and inviolable anonymous reporting system
4. Take steps to facilitate reporters (e.g web-based reporting forms, accessible either from mobile phones)
5. Communicate to the entire company through a feedback system, the benefits on safety performance from specific received reports.
(akyriaf)

It would encourage staff through the course of human factors, especially in errors at work, implement and keep the disciplinary policy active, indicating that there would be no punishment, on the contrary that each report would help the system to detect failures and new dangers.
(gseverich)

easy reporting process described in procedures; – quick feedback on reports; – reports made by managment and top management – to show reporting inplementation examples; – organisation needs to work according the procedures, if almost nobody follows the procedures the reporting is useless;
(Vincas)