To be fair, most vendors of "ai academic search engines" don't talk about it , either they don't know or it's too obvious to them or they try to pretend chatgpt can't search and score easy points for why not chatgpt questions? Another easy answer is we cover only academic content (2) - ThreadSky

aarontay.bsky.social • 2 days ago

To be fair, most vendors of "ai academic search engines" don't talk about it , either they don't know or it's too obvious to them or they try to pretend chatgpt can't search and score easy points for why not chatgpt questions? Another easy answer is we cover only academic content (2)

Comments

aarontay.bsky.social•2 days ago

Microsoft copilot, ChatGPT WHEN they search are doing some type of retrieval augmented generation. The main diff is MS copilot /chatgpt search vs academic search engine is the former can "choose" to search or can respond like a usual LLM chatbot. While academic search engine ALWAYS searches

aarontay.bsky.social•2 days ago

Best way to show this is input "how are you" or a task like summarise xyz. Microsoft copilot, chatgpt will typically answer without a search , while the "ai academic search" eg Primo reasearch assistant will always search to try find relevant documents and RAG and answer with amusing results

aarontay.bsky.social•1 day ago

I suspect the fact that MS copilot/chatgpt is a LLM finetuned to be a chatbot with search as a tool has different implications in the way you should engage it vs a straight out academic search engine even one with "AI"

aarontay.bsky.social•1 day ago

Take Scopus ai or Primo Research assistant that takes your input and asks a LLM to convert your input into a boolean keyword search. I argue in this case doing a lot of typical prompt engineering tricks is suboptimal

aarontay.bsky.social•1 day ago

Eg some research suggests emotional or motivation appeals eg bribes seems to get better results from LLMs like chatgpt. But does it really make sense to input such statements when you know Primo RA is just going to try to convert what you type into Boolean keyword?

aarontay.bsky.social•1 day ago

Amazing thing if you try such long winded prompt engineering tricks, the LLM is typically smart enough to just ignore irrelevant parts and come up with a not too crazy boolean search (but typically too broad but that's another story). Its insidious because people think their extra prompt helped

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply