Skip to Main Content

Gerstein Science Information Centre

Searching the Literature: A Guide to Comprehensive Searching in the Health Sciences

Students and researchers in the health sciences are often required to conduct comprehensive searches of the literature. Follow the steps in this guide to learn how this process works.

What are AI Academic Search Engines?

GenAI search engines are search engines that typically: 

  • use generativeAI to translate the user's natural language query into a new search (eg. Boolean query or embedding-based search)
  • searches large open-access databases of scientific papers and pre-prints (eg. SemanticScholar, OpenAlex, Arxiv.org, PubMed)
  • selects results from search based on semantic/topic match algorithms
  • incorporates the use of "Retrieval Augmented Generation" to generate summaries of results (from titles/abstracts as well as available full-text articles) and provide references that are grounded in external data sources

Evaluating AI Academic Search Engines

There has been a proliferation of AI search engines since the release of ChatGPT in 2022. When considering whether to use or invest in an AI search engine, find the tool's About or FAQ section and think about: 

  • where does the data come from?
    • Most AI search engines search SemanticScholar which derives its content from more than 50 direct partnerships with publishers, data providers, and aggregators. It includes content crawled from the open web as well as trusted indexes like PubMed. This massive dataset can be amazing for discovering outliers and difficult to find information; however, because it also crawls the open web for scholarly publications, it is perhaps more vulnerable to including fraudulent publications. 
  • what kind of search is the tool running?
    • Are the results found via Boolean/keyword matching search (deterministic) or is it a "semantic" search (probabilistic)?
  • what can you do in the free version that you cannot do without a paid subscription? 
  • what features are important to your work?
    • How does the tool integrate with your existing technologies used for doing literature reviews (eg. reference managers, notetaking software).
  • how transparent is the tool about:
    • the dataset being searched
    • how your query is being translated into a search strategy
    • how results are selected 
    • how results are being summarized 
    • your data and privacy
  • are citations generated accurate (ie. correct bibliographic data) and faithful (eg. does the citation cite accurately from the primary source?)
  • are the citations generated relevant, timely, and high quality? Are known quality, relevant, and timely sources missed? 
  • is the generated summary objective and accurate? Would someone brand new to the topic be misled by the summary? 

AI Search Engine Comparison Chart

Consensus

Elicit

Scopus AI

The-literature.com

Undermind

Type of Search

Semantic

Semantic

Boolean and Semantic

Boolean

Agentic "deep" semantic search with citation trailing

Access & Fees

Free to try with limited features

Login required

Free to try with limited features

Login required

FREE (UTL Subscription)

No login required

FREE

No login required

5 free searches/month

Login required

Data Source

Semantic Scholar

Semantic Scholar

Scopus >2003

PubMed

Semantic Scholar

Unique Features

Consensus Meter” for Yes/No questions

Extracts information into columns, ability to add 1 custom column in free version

ScopusAI looks at your query and decides whether to run Boolean or Semantic search

Narrative synthesis with references

Only searches PubMed

  • Guided question development process
  • Takes its time
  • Provides detailed summary with timeline and categories

No. of Refs included in Summary

10

4 (8 for Plus users)

Literature matrix can include more

5-8

10

Varies

Search Filters

  • Publication year
  • Study type
  • OA
  • Journal SJR Quartile
  • Domain

  • Publication year
  • Study type
  • Contain keywords in abstract
  • Has PDF (OA)

n/a

n/a

  • Match score
  • Citations per year
  • Publication year

Export References

Export as CSV Cite as APA, etc. BibTeX

(Plus users only)

Export to CSV, RIS, BibTeX

Export to CSV, RIS, BibTeX, Plain text

Copy paste PMIDs back into PubMed and export from there

Available in pro only

 

Adapted from: https://libguides.hkust.edu.hk/AI-tools-literature-review/compare-ai-tools 

Presentations & Workshops

chat loading...