{"id":154952,"date":"2024-04-23T15:08:41","date_gmt":"2024-04-23T19:08:41","guid":{"rendered":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/?p=154952"},"modified":"2025-05-02T14:53:17","modified_gmt":"2025-05-02T18:53:17","slug":"exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits","status":"publish","type":"post","link":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/","title":{"rendered":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits"},"content":{"rendered":"\r\n<h2 class=\"wp-block-heading\">Author<\/h2>\r\n\r\n\r\n\r\n<p>Fangyu Luo<\/p>\r\n\r\n\r\n\r\n<h2 class=\"wp-block-heading\">Mentors<\/h2>\r\n\r\n\r\n\r\n<p>Fatemeh Nargesian and Adam Purtee<\/p>\r\n\r\n\r\n\r\n<h2 class=\"wp-block-heading\">Abstract<\/h2>\r\n<p>Multi-Objective Multi-Armed Bandit (MO-MAB) algorithms have emerged as powerful tools for solving complex decision-making problems with multiple conflicting objectives. Despite the adaptation of many MAB algorithms to multi-objective settings, the application of MAB principles within hyperparameter optimization (HPO) algorithms has not been explored extensively. This thesis delves into MO-MAB algorithms, examining their broad applications and potential to enhance HPO. A focal point of our investigation is the Hyperband algorithm [17], an HPO strategy predicated on MAB principles, specifically its integration with the fairness metric. Our analysis reveals instances where prioritizing fairness over accuracy yields superior model performance. By bridging the gap between multi-objective decision-making and machine learning model tuning, this research offers valuable insights and opportunities for further advancements in both fields.<\/p>\r\n<p><a href=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Fangyu-Luo-POSTER.pdf\">Multi-Objective Hyperparameter Optimization with Multi-Armed Bandits<\/a><\/p>\r\n","protected":false},"excerpt":{"rendered":"<p>This thesis delves into MO-MAB algorithms, examining their broad applications and potential to enhance HPO.<\/p>\n","protected":false},"author":6242,"featured_media":160362,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[4442,96],"tags":[],"coauthors":[8612],"class_list":["post-154952","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-archive","category-csc-archive"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day\" \/>\n<meta property=\"og:description\" content=\"This thesis delves into MO-MAB algorithms, examining their broad applications and potential to enhance HPO.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/\" \/>\n<meta property=\"og:site_name\" content=\"Senior Design Day\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-23T19:08:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-02T18:53:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png\" \/>\n\t<meta property=\"og:image:width\" content=\"672\" \/>\n\t<meta property=\"og:image:height\" content=\"285\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/351018fbcf84ed8cac6d8072ba5b347c\"},\"headline\":\"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits\",\"datePublished\":\"2024-04-23T19:08:41+00:00\",\"dateModified\":\"2025-05-02T18:53:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/\"},\"wordCount\":149,\"image\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Screen-Shot-2024-04-23-at-3.13.05-PM.png\",\"articleSection\":[\"3. Programs Archive\",\"CSC Archive\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/\",\"name\":\"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Screen-Shot-2024-04-23-at-3.13.05-PM.png\",\"datePublished\":\"2024-04-23T19:08:41+00:00\",\"dateModified\":\"2025-05-02T18:53:17+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/351018fbcf84ed8cac6d8072ba5b347c\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Screen-Shot-2024-04-23-at-3.13.05-PM.png\",\"contentUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/Screen-Shot-2024-04-23-at-3.13.05-PM.png\",\"width\":672,\"height\":285},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#website\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/\",\"name\":\"Senior Design Day\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/351018fbcf84ed8cac6d8072ba5b347c\",\"name\":\"admin\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/author\\\/seniordesign\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/","og_locale":"en_US","og_type":"article","og_title":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day","og_description":"This thesis delves into MO-MAB algorithms, examining their broad applications and potential to enhance HPO.","og_url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/","og_site_name":"Senior Design Day","article_published_time":"2024-04-23T19:08:41+00:00","article_modified_time":"2025-05-02T18:53:17+00:00","og_image":[{"url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png","width":672,"height":285,"type":"image\/png"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#article","isPartOf":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/"},"author":{"name":"admin","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/351018fbcf84ed8cac6d8072ba5b347c"},"headline":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits","datePublished":"2024-04-23T19:08:41+00:00","dateModified":"2025-05-02T18:53:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/"},"wordCount":149,"image":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png","articleSection":["3. Programs Archive","CSC Archive"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/","name":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits - Senior Design Day","isPartOf":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#primaryimage"},"image":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png","datePublished":"2024-04-23T19:08:41+00:00","dateModified":"2025-05-02T18:53:17+00:00","author":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/351018fbcf84ed8cac6d8072ba5b347c"},"breadcrumb":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#primaryimage","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png","contentUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2024\/04\/Screen-Shot-2024-04-23-at-3.13.05-PM.png","width":672,"height":285},{"@type":"BreadcrumbList","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/exploring-hyperparameter-tuning-a-survey-and-experimental-framework-utilizing-multi-objective-multi-armed-bandits\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/"},{"@type":"ListItem","position":2,"name":"Exploring Hyperparameter Tuning: A Survey and Experimental Framework Utilizing Multi-Objective Multi-Armed Bandits"}]},{"@type":"WebSite","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#website","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/","name":"Senior Design Day","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/351018fbcf84ed8cac6d8072ba5b347c","name":"admin","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/author\/seniordesign\/"}]}},"_links":{"self":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/154952","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/users\/6242"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/comments?post=154952"}],"version-history":[{"count":5,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/154952\/revisions"}],"predecessor-version":[{"id":160342,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/154952\/revisions\/160342"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/media\/160362"}],"wp:attachment":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/media?parent=154952"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/categories?post=154952"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/tags?post=154952"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/coauthors?post=154952"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}