Optimal Quantization and Approximation in Source Coding and Stochastic Control

Loading...
Thumbnail Image

Authors

Saldi, Naci

Date

2015-06-23

Type

thesis

Language

eng

Keyword

Quantization , Randomized Quantization , Markov Decision Processes , Approximation in Stochastic Control

Research Projects

Organizational Units

Journal Issue

Alternative Title

Abstract

This thesis deals with non-standard optimal quantization and approximation problems in source coding and stochastic control. The first part of the thesis considers randomized quantization. Adapted from stochastic control, a general representation of randomized quantizers that is probabilistically equivalent to common models in the literature is proposed via mixtures of joint probability measures induced by deterministic quantizers. Using this general model, we prove the existence of an optimal randomized quantizer for the generalized distribution preserving quantization problem. A Shannon theoretic version of this source coding problem is also considered, in which an optimal (minimum distortion) coding of stationary and memoryless source is studied under the requirement that the quantizer's output distribution also be stationary and memoryless possibly different than source distribution. We provide a characterization of the achievable rate region where the rate region includes both the coding rate and the rate of common randomness shared between the encoder and the decoder. In the second part of the thesis, we consider the quantization problems in stochastic control from viewpoints of information transmission and computation. The first problem studies the finite-action approximation (via quantization of the action space) of deterministic stationary policies of a discrete time Markov decision process (MDP), while the second problem considers finite-state approximations (via quantization of the state space) of discrete time Markov decision process. Under certain continuity conditions on the components of the MDP, we establish that optimal policies for the finite models can approximate with arbitrary precision optimal deterministic stationary policies for the original MDP. Combining these results leads to a constructive scheme for obtaining near optimal solutions via well known algorithms developed for finite state/action MDPs. For both problems, we also obtain explicit bounds on the approximation error in terms of the number of representation points in the quantizer, under further conditions.

Description

Thesis (Ph.D, Mathematics & Statistics) -- Queen's University, 2015-06-19 12:20:57.086

Citation

Publisher

License

Queen's University's Thesis/Dissertation Non-Exclusive License for Deposit to QSpace and Library and Archives Canada
ProQuest PhD and Master's Theses International Dissemination Agreement
Intellectual Property Guidelines at Queen's University
Copying and Preserving Your Thesis
This publication is made available by the authority of the copyright owner solely for the purpose of private study and research and may not be copied or reproduced except as permitted by the copyright laws without written authority from the copyright owner.

Journal

Volume

Issue

PubMed ID

External DOI

ISSN

EISSN