• Login
    View Item 
    •   Home
    • Graduate Theses, Dissertations and Projects
    • Queen's Graduate Theses and Dissertations
    • View Item
    •   Home
    • Graduate Theses, Dissertations and Projects
    • Queen's Graduate Theses and Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Automated Analysis of Load Tests Using Performance Counter Logs

    Thumbnail
    View/Open
    Malik_Haroon_201308_PhD.pdf (1.982Mb)
    Date
    2013-08-29
    Author
    Malik, Haroon
    Metadata
    Show full item record
    Abstract
    Load testing remains the most integral part of testing and measuring the performance of Large Scale Software Systems (LSS). During the course of a load test, a system under test is closely monitored, resulting in an extremely large amount of logging data, e.g., Performance counters logs. The performance counter log captures run-time system properties such as CPU utilization, disk I/O, queues, and network traffic. Such information is of vital interest to performance analysts. The information helps them to observe the system’s behavior under load by comparing it against the documented behavior of a system or with expected behavior. In practice, for LSS, it is impossible for an analyst to skim through the large amount of performance counters to find the required information. Instead, analysts often use ‘rules of thumb’. In a LSS, there is no single person with complete system knowledge. In this thesis, we present methodologies to help performance analysts to 1) more effectively compare load tests to detect performance deviations, which may, lead to Service Level Agreement (SLA) violations and 2) provide them with a smaller and manageable set of important performance counters to assist in the root cause analysis of the detected deviations.

    We demonstrate our methodologies through case studies based on load test data obtained from both a large scale industrial system and an open source benchmark system. Our proposed methodologies can provide up to 89% reduction in the set of performance counters while detecting performance deviations with few false positives (i.e., 95% average precision).
    URI for this record
    http://hdl.handle.net/1974/8223
    Collections
    • Queen's Graduate Theses and Dissertations
    • School of Computing Graduate Theses
    Request an alternative format
    If you require this document in an alternate, accessible format, please contact the Queen's Adaptive Technology Centre

    DSpace software copyright © 2002-2015  DuraSpace
    Contact Us
    Theme by 
    Atmire NV
     

     

    Browse

    All of QSpaceCommunities & CollectionsPublished DatesAuthorsTitlesSubjectsTypesThis CollectionPublished DatesAuthorsTitlesSubjectsTypes

    My Account

    LoginRegister

    Statistics

    View Usage StatisticsView Google Analytics Statistics

    DSpace software copyright © 2002-2015  DuraSpace
    Contact Us
    Theme by 
    Atmire NV