<?xml version="1.0" encoding="UTF-8"?>
<article article-type="Research Article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher">journal-of-information-and-optimization-sciences</journal-id>
      <journal-title-group>
        <journal-title>Journal of Information and Optimization Sciences</journal-title>
      </journal-title-group>
      <issn publication-format="electronic">2169-0103</issn>
      <issn publication-format="print">0252-2667</issn>
      <publisher>
        <publisher-name>Taru Publications</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.47974/JIOS-2252</article-id>
      <title-group>
        <article-title>Optimized multi-modal deep learning for integrated safety compliance monitoring : PPE detection, face recognition, and trade classification in industrial environments</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Nain</surname>
            <given-names>Megha</given-names>
          </name>
          <aff>Department of Computer Applications, Manipal University Jaipur, Jaipur, Rajasthan, 303007, India</aff>
        </contrib>
        <contrib contrib-type="author" corresp="yes">
          <name>
            <surname>Sharma</surname>
            <given-names>Shilpa</given-names>
          </name>
          <aff>Department of Computer Applications, Manipal University Jaipur, Jaipur, Rajasthan, 303007, India</aff>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Chaurasia</surname>
            <given-names>Sandeep</given-names>
          </name>
          <aff>Department of Computer Science &amp; Engineering, Manipal University Jaipur, Jaipur, Rajasthan, 303007, India</aff>
        </contrib>
      </contrib-group>
      <volume>47</volume>
      <issue>5-A</issue>
      <fpage>1623</fpage>
      <lpage>1631</lpage>
      <pub-date date-type="pub">
        <day>23</day>
        <month>04</month>
        <year>2026</year>
      </pub-date>
      <abstract>
        <p>Compliance monitoring of industrial safety remains a major challenge, due to the inherent flaws in single-modality schemes of implementing the highly multidimensional characteristics of workplace hazards. This paper aims to implement a multi-modal deep-learning system that can detect and identify both personal protective equipment (PPE) and facial features and classify and identify the trade to automatically check compliance with safety standards in the industry. The framework uses Detectron2 to get 82.33% on instance segmentation and bounding-box regression, 95.35% on facial recognition with pre-trained embeddings, 92% on a trade classifier based on a convolutional network, and 99.5% on tool detection with YOLO. These modules are merged to form the combined pipeline, which verifies the identity of the workers, verifies certified trade and ensures the use of PPE in real time and then overlaid the safety-status annotations upon visual results. The quantitative results show significant advantage over the existing techniques, such as the capacity to surpass the Average Precision of YOLOv3 by 72.3% in PPE detection. The work is innovative as it includes the multi-modal data in a holistic manner and effectively deals with the interdependencies of the determinants of safety compliance better than the single module models. This study, therefore, offers a scalable, optimized, data-driven model that provided the incidence of workplace accidents through automated surveillance, and where the operability of the system is ensured, by qualitative analyses in which the system is stable in identifying non-compliance situations such as a missing mask or vest, and in all modalities, the model is highly accurate.</p>
      </abstract>
      <kwd-group>
        <kwd>Multi-modal deep learning</kwd>
        <kwd>Industrial safety compliance monitoring</kwd>
        <kwd>PPE detection</kwd>
        <kwd>Face recognition</kwd>
        <kwd>Trade classification</kwd>
        <kwd>Automated workplace surveillance</kwd>
      </kwd-group>
      <custom-meta-group>
        <custom-meta>
          <meta-name>access</meta-name>
          <meta-value>open</meta-value>
        </custom-meta>
        <custom-meta>
          <meta-name>retracted</meta-name>
          <meta-value>no</meta-value>
        </custom-meta>
      </custom-meta-group>
    </article-meta>
  </front>
</article>
