"External Knowledge Assessment" Project. Development of Knowledge Matrices for Drilling and Well Intervention Crews

Context: Why Personnel Knowledge is a Key Safety Factor

During the investigation of incidents at production facilities, including drilling and well intervention operations, a critical pattern emerges: about 50% of incidents are directly related to a lack of personnel knowledge. This statistic, obtained through internal investigations establishing cause-and-effect relationships, became the starting point for revising approaches to contractor admission to facilities.

Ruslan Mukhamediyarov, Head of Contractor Relations at Gazprom Neft PJSC, analyzes a practical case of creating an effective barrier preventing the admission of unqualified workers. The main task was to implement a knowledge verification system that would be reliable, remote, and would not create unjustified obstacles to production processes.

"External Knowledge Assessment" System: Architecture and Features

To solve the problem, an external IT testing platform adapted to the company's specific requirements was chosen. Key characteristics of the implemented system:

• 100% Remote Access: Considering the rotational work method of the personnel, testing is conducted remotely, which eliminates delays upon arrival at the facilities.
• High Throughput: The platform is capable of simultaneously testing up to 5,000 people without strict requirements for connection quality.
• AI-based Proctoring: Artificial intelligence technology identifies the test-taker, records background noise, attempts to leave the frame, or use hints, ensuring the integrity of the results.

Integration into Business Processes and Working with Threshold Values

The presentation details the process of integrating the testing system into existing business processes. The requirement to pass the assessment was included in contracts and technical specifications with contractors. Testing results are directly integrated into the automated pass issuance system: access to the facility is impossible without reaching the established threshold value.

The approach to setting threshold scores is interesting. At the initial stage, the threshold was set at 30-33% (for example, 3 correct answers out of 10) so as not to paralyze the work of contractors amid a staff shortage. However, the strategy involves an annual increase in this threshold as personnel competencies develop and targeted work is done with identified problem areas (such as working at heights, loading and unloading, and gas-hazardous work).

Development of Knowledge Matrices: A Partnership Approach

The speaker pays special attention to the process of creating content for testing. "Knowledge quanta" were developed — blocks of HSE questions tied to specific types of work (excavation, hot work, use of PPE, etc.).

A key success factor was involving not only internal specialists but also representatives of the contracting organizations themselves in the expertise. This made it possible to take into account the specifics of various equipment and technologies used by different contractors and make the knowledge matrices as relevant to real conditions as possible.

What you will learn from this webinar:

• How to automate contractor knowledge verification without harming production processes?
• How to use AI proctoring to eliminate falsifications during remote testing?
• How to properly integrate knowledge assessment requirements into contracts and the admission system?
• Why is it important to involve contractors in developing test questions and knowledge matrices?
• How to work with test threshold values amid a shortage of qualified personnel?