A New Fleet Management Approach Applied to Autonomous Mining Vehicles Using Q-Learning

Loading...
Thumbnail Image

Authors

Kealey, Ryan

Date

Type

thesis

Language

eng

Keyword

Fleet Management System , Q-Learning , Reinforcement Learning , Mining Dispatch , Autonomous Robot Swarm , Multi-Robot Interaction , ROS , ROS Multi-Master , Autonomous System

Research Projects

Organizational Units

Journal Issue

Alternative Title

Abstract

In modern mining practices, a new goal for the industry is a fully autonomous mine. Most original equipment manufacturers (OEMs) are working towards automating their equipment or parts of the machines' functionality. The cooperation of an autonomous fleet would increase production, worker safety, and overall efficiency. A centralized computer system monitoring each piece of equipment’s individual data stream and system overall can ultimately replace today’s dispatch models. The new system can automatically dispatch all haul trucks based on measured conditions around the mine and adapts to new changes as they happen. Linear programming based dispatch systems are predetermined and require substantial time to reach optimization. These older models are rigid and inflexible; therefore, they do not adapt to the ever-changing mine environment. The proposed system can dynamically update the dispatching plan based on maintenance needs, payload material grade, vehicle queues, and traffic patterns. The centralized computer system is controlled by an artificial intelligence (AI) algorithm, called Q-Learning, that can optimize fleet dispatching in real time. The AI manages the truck dispatch by altering vehicles’ paths, changing loading and drop-off points, and managing maintenance needs. This algorithm must be trained for each installation and mine to suit individual needs and different fleet configurations. However, as fleet sizes change, knowledge from agents can be easily shared with new agents, and unnecessary trucks can be removed without affecting the entire system. A scaled-down proof of concept was created with autonomous robots to showcase the AI and fleet behaviours for specific scenarios to demonstrate the performance of the dynamically updating Q-learning based approach to dispatching.

Description

Citation

Publisher

License

Queen's University's Thesis/Dissertation Non-Exclusive License for Deposit to QSpace and Library and Archives Canada
ProQuest PhD and Master's Theses International Dissemination Agreement
Intellectual Property Guidelines at Queen's University
Copying and Preserving Your Thesis
This publication is made available by the authority of the copyright owner solely for the purpose of private study and research and may not be copied or reproduced except as permitted by the copyright laws without written authority from the copyright owner.

Journal

Volume

Issue

PubMed ID

External DOI

ISSN

EISSN