{"id":217152,"date":"2026-05-04T11:49:26","date_gmt":"2026-05-04T15:49:26","guid":{"rendered":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/?p=217152"},"modified":"2026-05-04T11:49:26","modified_gmt":"2026-05-04T15:49:26","slug":"listk-semantic-top-k-operators-with-listwise-prompting","status":"publish","type":"post","link":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/","title":{"rendered":"ListK: Semantic Top-K Operators with Listwise Prompting"},"content":{"rendered":"\n
Author<\/h2>\n\n\n\n
Jason Shin<\/p>\n\n\n\n
Advisors and Committe Members<\/h2>\n\n\n\n
Fatemeh Nargesian, Hangfeng He, Michael Scott<\/p>\n\n\n\n
Abstract<\/h2>\n\n\n\n
Semantic operators abstract large language model (LLM) calls in SQL clauses. It is gaining traction as an easy method to analyze semi-structured, unstructured, and multimodal datasets. While a plethora of recent works optimize various semantic operators, existing methods for semantic top-K remain lackluster. Semantic top-K operators have applications in search and information retrieval scenarios where the user\u2019s intent is a ranking function expressed with a natural language query. Our ListK framework improves the latency of semantic top-K at no cost to accuracy. First, we adopt fine-tuned listwise ranker models as opposed to the pairwise prompting paradigm of prior art. Second, we design several novel algorithms that best aggregate listwise rankings. These include: 1) a deterministic listwise tournament algorithm (LTTopK), 2) Las Vegas and embarrassingly parallel listwise multi-pivot quickselect\/sort algorithms (LMPQSelect, LMPQSort), 3) a basic Monte Carlo listwise tournament filter algorithm (LTFilter), and 4) a deterministic listwise filter algorithm based on the median of medians algorithm (MFilter). The full framework provides a query optimizer for combining the above physical top-K operators that minimizes the number of LLM calls utilized by each query. We provide theoretical analysis to easily tune parameters and provide cost estimates for query optimizers. ListK empirically dominates the Pareto frontier, halving latency at virtually no cost to recall and NDCG compared to prior art.<\/p>\n\n\n\n
Author Jason Shin Advisors and Committe Members Fatemeh Nargesian, Hangfeng He, Michael Scott Abstract Semantic operators abstract large language model (LLM) calls in SQL clauses. It is gaining traction as…<\/p>\n","protected":false},"author":20562,"featured_media":222792,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[4452,4502],"tags":[],"coauthors":[25742],"class_list":["post-217152","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-current-year","category-csc"],"acf":[],"yoast_head":"\n
ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day\" \/>\n<meta property=\"og:description\" content=\"Author Jason Shin Advisors and Committe Members Fatemeh Nargesian, Hangfeng He, Michael Scott Abstract Semantic operators abstract large language model (LLM) calls in SQL clauses. It is gaining traction as…\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/\" \/>\n<meta property=\"og:site_name\" content=\"Senior Design Day\" \/>\n<meta property=\"article:published_time\" content=\"2026-05-04T15:49:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1-1200x630.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jason Shin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jason Shin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/\"},\"author\":{\"name\":\"Jason Shin\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/fd241d5e4be7de218e3275ae37fab169\"},\"headline\":\"ListK: Semantic Top-K Operators with Listwise Prompting\",\"datePublished\":\"2026-05-04T15:49:26+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/\"},\"wordCount\":236,\"image\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/ShinJason-UndergraduateHonorsThesis-Poster-1.png\",\"articleSection\":[\"1. Current Year Programs\",\"CSC\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/\",\"name\":\"ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/ShinJason-UndergraduateHonorsThesis-Poster-1.png\",\"datePublished\":\"2026-05-04T15:49:26+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/fd241d5e4be7de218e3275ae37fab169\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/ShinJason-UndergraduateHonorsThesis-Poster-1.png\",\"contentUrl\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/wp-content\\\/uploads\\\/2026\\\/04\\\/ShinJason-UndergraduateHonorsThesis-Poster-1.png\",\"width\":2500,\"height\":1875},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/listk-semantic-top-k-operators-with-listwise-prompting\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ListK: Semantic Top-K Operators with Listwise Prompting\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#website\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/\",\"name\":\"Senior Design Day\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/#\\\/schema\\\/person\\\/fd241d5e4be7de218e3275ae37fab169\",\"name\":\"Jason Shin\",\"url\":\"https:\\\/\\\/www.hajim.rochester.edu\\\/senior-design-day\\\/author\\\/jshin60\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/","og_locale":"en_US","og_type":"article","og_title":"ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day","og_description":"Author Jason Shin Advisors and Committe Members Fatemeh Nargesian, Hangfeng He, Michael Scott Abstract Semantic operators abstract large language model (LLM) calls in SQL clauses. It is gaining traction as…","og_url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/","og_site_name":"Senior Design Day","article_published_time":"2026-05-04T15:49:26+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1-1200x630.png","type":"image\/png"}],"author":"Jason Shin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jason Shin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#article","isPartOf":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/"},"author":{"name":"Jason Shin","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/fd241d5e4be7de218e3275ae37fab169"},"headline":"ListK: Semantic Top-K Operators with Listwise Prompting","datePublished":"2026-05-04T15:49:26+00:00","mainEntityOfPage":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/"},"wordCount":236,"image":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1.png","articleSection":["1. Current Year Programs","CSC"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/","name":"ListK: Semantic Top-K Operators with Listwise Prompting - Senior Design Day","isPartOf":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#primaryimage"},"image":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#primaryimage"},"thumbnailUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1.png","datePublished":"2026-05-04T15:49:26+00:00","author":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/fd241d5e4be7de218e3275ae37fab169"},"breadcrumb":{"@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#primaryimage","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1.png","contentUrl":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1.png","width":2500,"height":1875},{"@type":"BreadcrumbList","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/listk-semantic-top-k-operators-with-listwise-prompting\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/"},{"@type":"ListItem","position":2,"name":"ListK: Semantic Top-K Operators with Listwise Prompting"}]},{"@type":"WebSite","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#website","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/","name":"Senior Design Day","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/#\/schema\/person\/fd241d5e4be7de218e3275ae37fab169","name":"Jason Shin","url":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/author\/jshin60\/"}]}},"_links":{"self":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/217152","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/users\/20562"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/comments?post=217152"}],"version-history":[{"count":3,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/217152\/revisions"}],"predecessor-version":[{"id":222822,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/posts\/217152\/revisions\/222822"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/media\/222792"}],"wp:attachment":[{"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/media?parent=217152"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/categories?post=217152"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/tags?post=217152"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-json\/wp\/v2\/coauthors?post=217152"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"\"](\"https:\/\/www.hajim.rochester.edu\/senior-design-day\/wp-content\/uploads\/2026\/04\/ShinJason-UndergraduateHonorsThesis-Poster-1024x768.png\")
<\/figure>\n","protected":false},"excerpt":{"rendered":"