Distributed Algorithms for Solving Linear Algebraic Equations & Convex Optimization Problems

dc.contributor.authorJahvani, Mohammaden
dc.contributor.departmentChemical Engineeringen
dc.contributor.supervisorGuay, Martin
dc.degree.grantorQueen's University at Kingstonen
dc.description.abstractThis thesis investigates two problems in the area of distributed computation and decision-making over multi-agent networks: the problem of finding a solution for linear algebraic equations in a distributed way, and the distributed convex optimization problem. We develop several consensus-based continuous-time coordination algorithms to compute a least-squares solution to a linear algebraic equation of the form $Ax = b$. This system of linear equations is simultaneously solved by a group of $n$ agents, while each agent knows a proper subset of the rows of the augmented matrix $ [A \, b] $. In other words, it is assumed that no agent has access to the information needed to solve the problem independently. We show that, along the flows of the proposed algorithms, the local estimate of each agent converges exponentially to the exact (unique) least-squares solution, provided that the underlying communication network is fixed and strongly connected, and $A$ has full column rank. Then, we consider the case where each agent is equipped with a private differentiable convex cost function. The goal of the agents is to collaboratively find the optimum of the sum of all local costs through peer-to-peer communications. We assume that the communication topology is fixed and strongly connected, and the local cost functions are strongly convex with globally-Lipschitz gradients. First, we propose two modified distributed gradient dynamics to solve the distributed convex optimization problem. These algorithms are inspired by the well known distributed subgradient method. We show that the proposed network flows are guaranteed to converge asymptotically to the global minimizer under given conditions. Next, we introduce two saddle-point type distributed algorithms to improve the rate of convergence of the aforementioned algorithms at no extra communication cost. This results in an approximate saddle-point algorithm with a guaranteed exponential rate of convergence for distributed convex optimization over arbitrary strongly connected directed network.en
dc.embargo.termsI hereby request to restrict my thesis for at least a period of 6 months. Some parts of the thesis has not yet been published, and we intend to submit them for journal publication soon. Thank you, Mohammad Jahvanien
dc.relation.ispartofseriesCanadian thesesen
dc.rightsQueen's University's Thesis/Dissertation Non-Exclusive License for Deposit to QSpace and Library and Archives Canadaen
dc.rightsProQuest PhD and Master's Theses International Dissemination Agreementen
dc.rightsIntellectual Property Guidelines at Queen's Universityen
dc.rightsCopying and Preserving Your Thesisen
dc.rightsThis publication is made available by the authority of the copyright owner solely for the purpose of private study and research and may not be copied or reproduced except as permitted by the copyright laws without written authority from the copyright owner.en
dc.rightsAttribution-NonCommercial-ShareAlike 3.0 United States*
dc.subjectDistributed Convex Optimizationen
dc.subjectLinear Algebraic Equationsen
dc.subjectLeast-Squares Solutionen
dc.subjectDistributed Algorithmen
dc.titleDistributed Algorithms for Solving Linear Algebraic Equations & Convex Optimization Problemsen
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
1.48 MB
Adobe Portable Document Format
Thesis document
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
1.67 KB
Item-specific license agreed upon to submission