The New York Times: Can AI-powered search engine Perplexity replace Google? It has for me

Kevin Roose
The New York Times
A start-up called Perplexity shows what’s possible for a search engine built from scratch with artificial intelligence.
A start-up called Perplexity shows what’s possible for a search engine built from scratch with artificial intelligence. Credit: NYT

(The Shift)

For my entire adult life, whenever I’ve had a question about the world or needed to track down something online, I’ve gone to Google for answers.

But recently, I’ve been stepping out on Google with a new, artificial intelligence-powered search engine. (No, not Bing, which is dead to me after it tried to break up my marriage last year.)

Sign up to The Nightly's newsletters.

Get the first look at the digital newspaper, curated daily stories and breaking headlines delivered to your inbox.

Email Us
By continuing you agree to our Terms and Privacy Policy.

It’s called Perplexity. The year-old search engine, whose founders previously worked in AI research at OpenAI and Meta, has quickly become one of the most buzzed-about products in the tech world. Tech insiders rave about it on social media, and investors such as Jeff Bezos — who was also an early investor in Google — have showered it with cash. The company recently announced that it had raised $US74 million ($A112.5 million) in a funding round led by Institutional Venture Partners, which valued the company at $US520 million ($A790 million).

Many startups have tried and failed to challenge Google over the years. (One would-be competitor, Neeva, shut down last year after failing to gain traction.) But Google seems less invincible these days. Many users have complained that their Google search results have gotten clogged with spammy, low-quality websites, and some people have started looking for answers in places such as Reddit and TikTok instead.

Intrigued by the hype, I recently spent several weeks using Perplexity as my default search engine on both desktop and mobile. I tested both the free version and the paid product, Perplexity Pro, which costs $US20 per month and gives users access to more powerful AI models and certain features, such as the ability to upload their own files.

Hundreds of searches later, I can report that even though Perplexity isn’t perfect, it’s very good. And while I’m not ready to break up with Google entirely, I’m now more convinced that AI-powered search engines such as Perplexity could loosen Google’s grip on the search market or at least force it to play catch-up.

I’m also scared that AI search engines could destroy my job and that the entire digital media industry could collapse as a result of products like them. But I’m getting ahead of myself.

Where It Shines

At first glance, Perplexity’s desktop interface looks a lot like Google’s — a text box centred on a sparse landing page.

But as soon as you start typing, the differences become obvious. When you ask a question, Perplexity doesn’t give you back a list of links. Instead, it scours the web for you and uses AI to write a summary of what it finds. These answers are annotated with links to the sources the AI used, which also appear in a panel above the response.

I tested Perplexity on hundreds of queries, including questions about current events (“How did Nikki Haley do in the New Hampshire primary?”), shopping recommendations (“What’s the best dog food for a senior dog with joint pain?”) and household tasks (“How long does beef stew stay good in the fridge?”).

Each time, I got back an AI-generated response, generally a paragraph or two long, sprinkled with citations to websites such as NPR, The New York Times and Reddit, along with a list of suggested follow-up questions I could ask, such as “Can you freeze beef stew to make it last longer?”

One impressive Perplexity feature is “Copilot,” which helps a user narrow down a query by asking clarifying questions. When I asked for ideas on where to host a birthday party for a two-year-old, for example, Copilot asked whether I wanted suggestions for outdoor spaces, indoor spaces or both. When I selected “indoor,” it asked me to choose a rough budget for the party. Only then did it give me a list of possible venues.

Perplexity also allows users to search within a specific set of sources, such as academic papers, YouTube videos or Reddit posts. This came in handy when I was looking up how to change a setting on my house’s water heater. (Exciting stuff, I know.) A Google search yielded a bunch of less-than-helpful links to DIY tutorials, some of which were thinly veiled ads for plumbing companies. I tried the same query on Perplexity and narrowed my search to YouTube videos. Perplexity found the video I needed for my exact model of water heater, extracted the relevant information from the video and turned it into step-by-step instructions.

Under the hood, Perplexity runs on OpenAI’s GPT-3.5 model along with its own AI model — a variant of Meta’s open-source Llama 2 model. Users who upgrade to the Pro version can choose between a handful of different models, including GPT-4 and Anthropic’s Claude. (I used GPT-4 for most of my searches, but I didn’t see much of a difference in the quality of the answers when I chose other models.)

Perplexity is also refreshingly good at admitting when it doesn’t know something. Sometimes, it gave a partial response to my question, with a caveat like “No further details are provided in the search results.” Most AI chat products I’ve used lack this kind of humility; their responses sound confident even when they’re spouting nonsense.

Where Google Still Reigns

During my tests, I found Perplexity most useful for complicated or open-ended searches, such as summarizing recent news articles about a specific company or giving me suggestions for date-night restaurants. I also found it useful when what I was looking for — instructions for renewing a passport, for example — was buried on a crowded, hard-to-navigate website.

But I did sneak back to Google for a few types of searches — usually, when I was looking up specific people or trying to go to websites I already knew existed. For example, when I typed “Wayback Machine” into my browser’s search bar, I was redirected to Perplexity, which spit out a paragraph-long essay about the history of the Internet Archive, the organization that maintains the Wayback Machine. I had to hunt for a small citation link to get to the Wayback Machine’s website, which is what I wanted in the first place.

A similar thing happened when I asked Perplexity for driving directions to a work meeting. Google would have given me turn-by-turn directions from my house, thanks to its integration with Google Maps. But Perplexity doesn’t know where I live, so the best it could offer me was a link to MapQuest.

Location data is just one of the many advantages Google has over Perplexity. Size is another; Perplexity, which has just 41 employees and is based out of a shared working space in San Francisco, has 10 million monthly active users, an impressive number for a young startup but a speck compared with Google’s billions.

Perplexity also lacks a lucrative business model. Right now, the site has no ads, and fewer than 100,000 people paying for the premium version, said Aravind Srinivas, the company’s CEO. (Srinivas didn’t rule out switching to an ads-based model in the future.) And, of course, Perplexity doesn’t offer versions of Gmail, Google Chrome, Google Docs or any of the dozens of other products that make Google’s ecosystem so inescapable.

Srinivas said that while he believed Google was a formidable competitor, he thought that a small, focused startup could give it a startle.

“What makes me confident is the fact that if they want to do it better than us, they would basically have to kill their own business model,” he said.

What About Hallucinations?

One problem with AI-based search engines is that they tend to hallucinate, or make up answers, and sometimes stray from their source material. This problem has haunted several AI-search hybrids, including Google’s initial release of Bard, and it remains one of the biggest barriers to mass adoption.

In my testing, I found that Perplexity’s answers were mostly accurate — or, to be more precise, they were as accurate as the sources they drew upon.

I did find a few errors. When I asked Perplexity when Novak Djokovic’s next tennis match was, it gave me the details of a match he’d already finished. Another time, when I uploaded a PDF file of a new AI research paper and asked Perplexity to summarize it, I got a summary of an entirely different paper that was published three years ago.

Srinivas acknowledged that AI-powered search engines still made mistakes. He said that because Perplexity was a small, relatively obscure product, users didn’t expect it to be as authoritative as Google — and that Google would struggle to build generative AI into its search engine because it needed to uphold its reputation for accuracy.

“Let’s say you use our product, and we do well on 8 out of 10 queries. You’d be impressed,” Srinivas said. “Now let’s say you use Google’s product, and it only gets 7 out of 10. You’d be like, ‘How can Google get three queries wrong?’

“That asymmetry is our opportunity,” he added.

A Win for Users, a Loss for Publishers

Even though I enjoyed using Perplexity, and I’m likely to keep using it in tandem with Google, I’ll admit that I got a gnawing feeling in my stomach after seeing it spit out pristine, concise summaries of news stories, product reviews and how-to articles.

Much of today’s digital media economy still relies on a steady flow of people clicking on links from Google and being served ads on publishers’ websites.

But with Perplexity, there’s usually no need to visit a website at all; the AI does the browsing for you and gives you all the information you need right there on the answer page.

The possibility that AI-powered search engines could replace Google traffic — or spur Google to put similar features into its search engine, as it has started doing with its “search generative experience” experiment — is partly why many digital publishers are terrified right now. It’s also part of the reason some are fighting back, including the Times, which sued OpenAI and Microsoft for copyright infringement last year.

After using Perplexity and hearing about similar products being developed by other startups, I’m convinced that the worriers have a point. If AI search engines can reliably summarize what’s happening in the Gaza Strip or tell users which toaster to buy, why would anyone visit a publisher’s website ever again? Why would journalists, bloggers and product reviewers continue to put their work online if an AI search engine is just going to gobble it up and regurgitate it?

I brought these fears up to Srinivas, who responded with a diplomatic dodge. He conceded that Perplexity would probably send less traffic to websites than traditional search engines. But he said the traffic that remained would be higher quality and easier for publishers to monetize, because it would be the result of better, more targeted queries.

I’m skeptical of that argument, and I’m still nervous about what the future holds for writers, publishers and people who consume online media.

So for now, I’ll have to weigh the convenience of using Perplexity against the worry that, by using it, I’m contributing to my own doom.

This article originally appeared in The New York Times.

© 2024 The New York Times Company

Originally published on The New York Times

Latest Edition

The Nightly cover for 20-12-2024

Latest Edition

Edition Edition 20 December 202420 December 2024

Birth rates plummet as record levels of migrants join those who won’t leave: Inside our population plight.