Doug Turnbull

“Trey Grainger and Doug Turnbull, both authors of the recently-published AI-Powered Search book (https://aipoweredsearch.com), take the stage and attempt to answer your biggest questions about search, relevance, and the evolving landscape of AI search.

Most now agree that LLMs can provide useful search judgments. In this talk, we’ll discuss the next level: an ensemble of judges to deepen our understanding of the search relevance problem.

In today’s AI based world, Reddit stands out as a deep catalog of human, subjective information. Whether product reviews or the deeply personal - Reddit searchers want to connect with other humans, not generic AI based answers.

Trey Grainger, Doug Turnbull, and Max Irwin will all be attending Haystack this year, and we will host a Q&A / Ask Me Anything on AI-powered search. The final chapter of our AI-powered search book (https://www.manning.com/books/ai-powered-search) will be released in ebook form right before Haystack (we’re just polishing off some additional on foundation models / LLMs), and the book will be coming out about a month later in print.

Recently, Bayesian Optimization of a simple Elasticsearch query has been shown to deliver the best non-neural relevance on the MSMarco Ranking Task (https://www.elastic.co/blog/improving-search-relevance-with-data-driven-query-optimization). For these reasons, at Shopify, we’ve adopted bayesian optimization as a core part of our relevance experimentation workflow.