Workshop A

LLMs Go Head-to-Head: Large Language Models vs. Legitimate Librarian Methods for Advanced Database Searching

Katie D. Sweeney, MLIS, and Barbara Slover, MLIS

Alumni Medical Library

Room L201

There comes a point in every researcher’s process when they realize that Generative AI is not exactly a silver bullet for database searching or conducting literature reviews, given the prevalence of paywalls and non-open access content. The next thought in the researcher’s mind may be something like, “okay, but can AI help me quickly write an advanced search strategy that I can then paste into PubMed?” Good question. Unfortunately, current LLMs consistently fail at this task. Allow your librarians to demonstrate how and why this is the case and help you can gain confidence doing it yourself. Crafting an accurate and precise search strategy for your research question is as useful a skill as ever.

Target Audience:

Any BU faculty, staff, or student looking to deepen their understanding of advanced database search techniques, especially those interested in why AI is currently unreliable for crafting searches and how librarians approach the process instead.

Learning Objectives:

Upon completion of this workshop, learners will be able to:

  • Describe where AI goes wrong in writing search queries.
  • Identify appropriate Mesh terms for a given topic.
  • Create a valid, accurate, and precise advanced PubMed search.
Session Outline:
  • Introduction – agenda & learning objectives (5 min)
  • Hands-on Activity – have learners open Google Form & PubMed on their computers (5 min)
  • AI Example – Define research question and go over a ChatGPT-created search; have students enter search into PubMed & fill out corresponding question in the form (10 min)
  • PubMed Advanced Search – Examine ChatGPT’s search in Search Details, describe ATM and Mesh terms; have learners fill out the corresponding question in the form (10 min)
  • Mesh Browser – Go over identifying the facets of a search, searching for Mesh terms, locating keywords and synonyms; have learners fill out the corresponding question in the form (10 min)
  • Crafting a Strategy – Add together facets in the Advanced Search, click search, and show results; have learners fill out the corresponding question in the form and submit (10 min)
  • Q&A – Answer questions, show Ask-A-Librarian button, where to get help in the future (15 min)