You are required to read and agree to the below before accessing a full-text version of an article in the IDE article repository.

The full-text document you are about to access is subject to national and international copyright laws. In most cases (but not necessarily all) the consequence is that personal use is allowed given that the copyright owner is duly acknowledged and respected. All other use (typically) require an explicit permission (often in writing) by the copyright owner.

For the reports in this repository we specifically note that

  • the use of articles under IEEE copyright is governed by the IEEE copyright policy (available at http://www.ieee.org/web/publications/rights/copyrightpolicy.html)
  • the use of articles under ACM copyright is governed by the ACM copyright policy (available at http://www.acm.org/pubs/copyright_policy/)
  • technical reports and other articles issued by M‰lardalen University is free for personal use. For other use, the explicit consent of the authors is required
  • in other cases, please contact the copyright owner for detailed information

By accepting I agree to acknowledge and respect the rights of the copyright owner of the document I am about to access.

If you are in doubt, feel free to contact webmaster@ide.mdh.se

In-Depth Analysis of Diverse Driver Behaviors using Hybrid Multimodal Machine Learning

Authors:

Mera Abudiab , Francisco Javier Pérez Núñez , Mobyen Uddin Ahmed, Shaibal Barua, Shahina Begum, Arnab Barua

Research group:

Artificial Intelligence and Intelligent Systems

Publication Type:

Conference/Workshop Paper

Venue:

International Conference on Computer and Information Technology

Abstract

Analyzing diverse and intricate drivers’ behavior is a complex task when there is variation, modalities and heterogeneity in the datasets. SIMUSAFE dataset, encompassing scenario, vehicular, neurophysiological, and video analysis data, all describing the behavior of road users. This also characterizes the heterogeneity in drivers’ behavior in terms of risk and hurry, using both real-time on-track and in-simulator driving. This study focuses on a hybrid approach of multimodal machine learning (MML) to scrutinize drivers’ behavior, i.e., categorizing based on personalized criteria for conventional and negative driving. Here, the hybrid MML comprise unsupervised machine learning i.e. K-Means and Spectral clustering techniques to uncover hidden structures within the dataset, and subsequently using supervised machine learning i.e. Random Forest to enhance comprehension. Besides, an exploratory experiment is conducted on the heterogeneous data, hybrid MML helps to scrutinize drivers’ behavior as 'conventional' or 'negative'. According to the analysis, unveiled distinct structures shedding light on conventional and negative driving behaviors. Negative driving is defined by features such as violations, gaze, risk source, and distraction, while conventional driving encompasses the rest.

Bibtex

@inproceedings{Abudiab7105,
author = {Mera Abudiab and Francisco Javier P{\'e}rez N{\'u}{\~n}ez and Mobyen Uddin Ahmed and Shaibal Barua and Shahina Begum and Arnab Barua},
title = {In-Depth Analysis of Diverse Driver Behaviors using Hybrid Multimodal Machine Learning},
month = {March},
year = {2025},
booktitle = {International Conference on Computer and Information Technology},
url = {http://www.es.mdu.se/publications/7105-}
}