# Search within PDF and Images (OCR)

**URL:** <https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840>\
**Category:** Product Feedback\
**Created:** [January 20, 2023, 9:02am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840 "2023-01-20T09:02:12Z")\
**Posts on this page:** 18\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lars\_Kristian\_Aasbrenn](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/lars_kristian_aasbrenn/32/18966_2.png) [@Lars\_Kristian\_Aasbrenn](https://connect.superhuman.com/u/Lars_Kristian_Aasbrenn)\
**Post date:** [January 20, 2023, 9:02am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/1 "2023-01-20T09:02:12Z")

</div>

As mentioned in the community, a reason for keeping stuff in Evernote is the ability to search for text in images and in PDF documents. It’s a great function which makes Evernote very hard to let go. If I had to pick one of them, I would go for PDF search, which I guess is less complicated to implement.  
I have been waiting for this function in Coda, but just realised that it was not mentioned in the Suggestion Box.  
So her it is! Vote on 🙂

---

<div class="post-metadata">

**Author:** ![Piet\_Strydom](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/piet_strydom/32/19269_2.png) [@Piet\_Strydom](https://connect.superhuman.com/u/Piet_Strydom)\
**Post date:** [January 20, 2023, 11:27am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/2 "2023-01-20T11:27:46Z")

</div>

I don’t use this often, but when I need it, I need it bad… 😉

---

<div class="post-metadata">

**Author:** ![Bill\_French](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/bill_french/32/49422_2.png) [@Bill\_French](https://connect.superhuman.com/u/Bill_French)\
**Post date:** [January 21, 2023, 10:24pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/3 "2023-01-21T22:24:34Z")

</div>

> [@Lars\_Kristian\_Aasbrenn](#):
>
> the ability to search for text in images and in PDF documents.

We get around this limitation with a home-grown system that was patterned after [this approach](https://mixpeek.com/learn/index-s3). Using a custom Pack we were able to use the S3 repository as the definitive source of all PDF-based information.

I think it’s safe to say that there are many more ways to do this better and cheaper given the improvements to Pack capabilities and PDFs pushed through a ML pipeline. [This guy](https://community.openai.com/t/code-from-chatgpt3-to-summarize-pdfs-in-a-folder/28274) actually had GP3 write the code to summarize and extract keywords for PDFs.

> **[Full-Text File Search on your S3 Bucket | Mixpeek](https://mixpeek.com/learn/index-s3)**
>
> Mixpeek is an intelligent file store powered by the latest extraction, indexing and searching technology. Build Google-like file search into your software with a single API.

---

<div class="post-metadata">

**Author:** ![Lars\_Kristian\_Aasbrenn](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/lars_kristian_aasbrenn/32/18966_2.png) [@Lars\_Kristian\_Aasbrenn](https://connect.superhuman.com/u/Lars_Kristian_Aasbrenn)\
**Post date:** [January 22, 2023, 2:13pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/4 "2023-01-22T14:13:12Z")

</div>

Fun to hear there are ways around, as often Coda people find. Though, this is a bit above me, sorry 🙂

---

<div class="post-metadata">

**Author:** ![Bill\_French](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/bill_french/32/49422_2.png) [@Bill\_French](https://connect.superhuman.com/u/Bill_French)\
**Post date:** [January 22, 2023, 2:26pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/5 "2023-01-22T14:26:50Z")

</div>

> [@Lars\_Kristian\_Aasbrenn](#):
>
> this is a bit above me

Indeed; it’s a lot of machinery. You might want to take a look at [Bardeen](https://www.bardeen.ai). I think they recently added some AI features that would allow you to capture summaries and keywords from a PDF and then add it to a Coda table.

Don’t let the label on this automation component mislead you - their image-to-text feature also works with PDF documents.

 ![image](https://global.discourse-cdn.com/coda1/original/3X/c/5/c5dc5bc6e69101cd4d6dcc8317bb9f7ec0185059.png)

With this, you could build a workflow recipe that is kicked off when viewing a PDF, and then harvests the text which could be added to a Coda table in full, thus achieving a full-text search inside Coda. It could also use any of Bardeen’s other AI components to extract keywords, summations, analytics, etc. and add those to the table row as well.

[Text Blaze](https://blaze.today/?ref=UDECNLKN) may also be able to do this as well, although, a mental sketch of the solution is not as obvious. Both Text Blaze and Bardeen are #no-code integration tools, so you might really enjoy them for this and many other automated workflows internal and external to Coda.

---

<div class="post-metadata">

**Author:** ![Patricia\_Hoffmann](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/patricia_hoffmann/32/34550_2.png) [@Patricia\_Hoffmann](https://connect.superhuman.com/u/Patricia_Hoffmann)\
**Post date:** [May 9, 2023, 12:01pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/6 "2023-05-09T12:01:33Z")

</div>

OMG! It would be awesome to have this feature! I voted for it 😉

---

<div class="post-metadata">

**Author:** ![Bill\_French](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/bill_french/32/49422_2.png) [@Bill\_French](https://connect.superhuman.com/u/Bill_French)\
**Post date:** [May 9, 2023, 6:09pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/7 "2023-05-09T18:09:18Z")

</div>

> [@Patricia\_Hoffmann](#):
>
> It would be awesome to have this feature!

Something about this says it will likely be made obsolete with [multi-modal AI](https://dataconomy.com/2023/03/15/what-is-multimodal-ai-gpt-4/#:~:text=is%20multimodal%20AI%3F-,Multimodal%20AI%20is%20a%20type%20of%20artificial%20intelligence%20that%20has,speech%2C%20images%2C%20and%20videos) support.

---

<div class="post-metadata">

**Author:** ![Patricia\_Hoffmann](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/patricia_hoffmann/32/34550_2.png) [@Patricia\_Hoffmann](https://connect.superhuman.com/u/Patricia_Hoffmann)\
**Post date:** [May 15, 2023, 9:12am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/8 "2023-05-15T09:12:25Z")

</div>

Have you found an easy solution so far?  
My used case is the following: I have a table with lots of PDFs. I want to search within the PDFs for certain keywords to find the PDFs that contain those keywords.

---

<div class="post-metadata">

**Author:** ![Patricia\_Hoffmann](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/patricia_hoffmann/32/34550_2.png) [@Patricia\_Hoffmann](https://connect.superhuman.com/u/Patricia_Hoffmann)\
**Post date:** [May 15, 2023, 12:02pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/9 "2023-05-15T12:02:07Z")

</div>

@coda_account Is there anything planned/in the development pipeline that will allow to search within a PDF or rather do a global keyword search on a table with many pdf files?

---

<div class="post-metadata">

**Author:** ![Lars\_Kristian\_Aasbrenn](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/lars_kristian_aasbrenn/32/18966_2.png) [@Lars\_Kristian\_Aasbrenn](https://connect.superhuman.com/u/Lars_Kristian_Aasbrenn)\
**Post date:** [May 16, 2023, 7:29am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/10 "2023-05-16T07:29:40Z")

</div>

There are two ways text can exist in PDF’s: As real text and images of text.  
For real text there is a kind of work-around by addling all PDF’s to a table, then:  
Make a Text column: “Content”, Open PDF, copy all text (select all+copy), paste in into Content.

---

<div class="post-metadata">

**Author:** ![Patricia\_Hoffmann](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/patricia_hoffmann/32/34550_2.png) [@Patricia\_Hoffmann](https://connect.superhuman.com/u/Patricia_Hoffmann)\
**Post date:** [May 16, 2023, 10:35am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/11 "2023-05-16T10:35:02Z")

</div>

This always has to be done manually though, right? There is no way to automize that the text of a PDF will automatically be pasted into a column, like “Content” or?

---

<div class="post-metadata">

**Author:** ![Lars\_Kristian\_Aasbrenn](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/lars_kristian_aasbrenn/32/18966_2.png) [@Lars\_Kristian\_Aasbrenn](https://connect.superhuman.com/u/Lars_Kristian_Aasbrenn)\
**Post date:** [May 16, 2023, 8:18pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/12 "2023-05-16T20:18:26Z")

</div>

Not with Coda or any Packs as I know. But the manual process is actually not that bad, only takes a couple of seconds:  
Open PDF in the table, Press CTRL+A, CTRL+C, Close PDF , click the column beside, CTRL-V

Again, as long as the PDF has actual text and not image.

---

<div class="post-metadata">

**Author:** ![Bill\_French](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/bill_french/32/49422_2.png) [@Bill\_French](https://connect.superhuman.com/u/Bill_French)\
**Post date:** [May 17, 2023, 1:12am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/13 "2023-05-17T01:12:15Z")

</div>

> [@Patricia\_Hoffmann](#):
>
> I want to search within the PDFs for certain keywords to find the PDFs that contain those keywords.

You need to dream bigger. What if you know some keywords that are similar, but not the ones that are present in the PDF? You’re describing a search system of the previous century. You need to be able to state queries with greater abstraction and still have it work.

> [@Lars\_Kristian\_Aasbrenn](#):
>
> There are two ways text can exist in PDF’s: As real text and images of text.

With AI, this is also known as “text”. 😉

> [@Lars\_Kristian\_Aasbrenn](#):
>
> For real text there is a kind of work-around by addling all PDF’s to a table, then:  
> Make a Text column: “Content”, Open PDF, copy all text (select all+copy), paste in into Content.

This is a terrible approach.

> [@Patricia\_Hoffmann](#):
>
> There is no way to automize that the text of a PDF will automatically be pasted into a column, like “Content” or?

There is. More on that in a moment.

> [@Lars\_Kristian\_Aasbrenn](#):
>
> But the manual process is actually not that bad, only takes a couple of seconds:

It’s literally that bad. It’s also brittle.

- It misses the texts in tables, charts, figures, call-outs and footnotes. It is an extremely weak search corpus if built this way.
- When 20 of the 80 PDFs in your library are updated, how will you know which ones to repeat this manual update process.
- When your PDFs triple in number, how will anyone perform this manual task with consistency or in a timely fashion?
- Have you tried copying the text of a multi-column document or one with embedded figures that wrap texts? It’s a mess, and this will lead to formatting issues that reduce findability. The time required to do this well is not seconds. It’s minutes and likely lots of them.

## What’s the Remedy?

Coda is (or should be the remedy). Building search systems by anyone except the platform vendor is challenging to say the least. There are security issues, cross document sharing issues, and a variety of latency issues, not to mention where does the index live? However, AGI may offer some relief. I can think of three ways for businesses to overcome this issue. Here’s one…

> Imagine an AI process that reads your PDFs and converts all the content to plain text. Further, it allows you to dump all sorts of documents into a sausage grinder and out the other end comes a ChatGPT-like application. That application can be embedded in any Coda document. And, as your PDFs change, just upload them and the entire system uses the latest information; that actually does take seconds. 😉 Lastly, this approach has an API, so you could build a search UI, or a reporting system, or integrate it’s AI capabilities with other systems. If pervasive discover, understanding, and full utilization of PDF resources truly matter to the health and competitive posture of your business you should get a free trial account and prove this approach to yourself.

This is [CustomGPT](https://customgpt.ai?fpr=bill53). It’s pricey (like $100/mo) but very powerful.

Two other approaches come to mind and parts of these ideas I’ve already experimented with. One leans on an inverted search index (designed like ElasticSearch) and the other uses a similar approach to CustomGPT, but with Google’s new PaLM 2 LLMs.

And you probably thought I was [all hat, no cattle](https://en.wikipedia.org/wiki/All_Hat_and_No_Cattle#:~:text=All%20hat%20and%20no%20cattle%20is%20an%20idiom,all%20talk%2C%20no%20action%22)! This is not my first search rodeo.

 ![CleanShot 2023-05-16 at 19.17.02@2x](https://global.discourse-cdn.com/coda1/original/3X/6/9/69a94469df2dc1ac213237400997dad7c2cdf0e1.png)

No time to explain - gotta dash.

---

<div class="post-metadata">

**Author:** ![Patricia\_Hoffmann](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/patricia_hoffmann/32/34550_2.png) [@Patricia\_Hoffmann](https://connect.superhuman.com/u/Patricia_Hoffmann)\
**Post date:** [May 17, 2023, 9:46am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/14 "2023-05-17T09:46:01Z")

</div>

Wow @Bill_French I’m impressed!  
I just looked at the CustomGPT and it seems like a super powerful tool - but yep, pricey.  
Could you share some more details on the two approaches you’ve designed? It sounds and looks awesome!

---

<div class="post-metadata">

**Author:** ![Bill\_French](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/bill_french/32/49422_2.png) [@Bill\_French](https://connect.superhuman.com/u/Bill_French)\
**Post date:** [May 17, 2023, 11:50am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/15 "2023-05-17T11:50:24Z")

</div>

> [@Patricia\_Hoffmann](#):
>
> a super powerful tool - but yep, pricey.

Indeed, on paper. In practice, probably not so much. What’s the value to an organization that can give its workers the ability to find anything or ask questions and get detailed, thoughtful answers? What’s the value of answer to questions that are presently impractical to parse?

Enterprise workers (on average) spend almost three hours a day probing information systems to get their hands on the data needed to do their work. What if you cut that by just a third. For a five-person company, it’s about 950 hours a year. At a fully burdened cost of $65/hr, that’s about $60k. Is that $1,200 SaaS investment still too much?

> [@Patricia\_Hoffmann](#):
>
> Could you share some more details on the two approaches you’ve designed?

One is the inverted index, a web service that probes Coda docs nightly and builds an index using [LUNR](https://lunrjs.com/). It’s a lot of work to build one and it’s not ideally suited for integration into Coda.

The other is an AI solution that uses text embeddings and completions to formulate a similar approach to CustomGPT. This is also not ideal because Coda, as you may know, has not exposed the complete text of documents through its API.

Inaccessibility to entire document texts leaves any third-party project whose intent is to help you find stuff, without access to all the stuff, a non-starter in my view. As long as this is the case, both of these integrated approaches are unlikely to provide comprehensive findability and discovery.

In as much as I believe any manual processes are brittle and prone to failure, exporting all Coda documents as PDFs and uploading them into [CustomGPT](https://customgpt.ai?fpr=bill53) appears to be the best we can hope for. But the payoff is significant if you can transform your data to take advantage of AGI.

---

<div class="post-metadata">

**Author:** ![Jean\_Pierre\_Traets](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/jean_pierre_traets/32/16275_2.png) [@Jean\_Pierre\_Traets](https://connect.superhuman.com/u/Jean_Pierre_Traets)\
**Post date:** [May 17, 2023, 7:22pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/16 "2023-05-17T19:22:54Z")

</div>

This has nothing to do with Coda, but found it valuable in context of the above discussed.

> <https://twitter.com/LiquidTextCorp/status/1658532833227333646?s=20>

Note, I am not affiliated, neither I have knowledge on the details.

Keep on dreaming, as the sky isn’t the limit 💪

---

<div class="post-metadata">

**Author:** ![Rickard\_Abraham](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/rickard_abraham/32/35007_2.png) [@Rickard\_Abraham](https://connect.superhuman.com/u/Rickard_Abraham)\
**Post date:** [July 16, 2023, 9:55pm UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/17 "2023-07-16T21:55:34Z")

</div>

This would be amazing to have natively in Coda! But for now, I can at least assist with the reading of text in PDFs part with my PDF Pack 🙂

> [@Released: PDF Pack](https://connect.superhuman.com/t/released-pdf-pack/41286):
>
> Hi everyone! Today I’m releasing the [PDF Pack](https://coda.io/packs/pdf-23729)! Merge PDFs into one Read the text from PDFs Get a picture for a PDF’s first page It has a lot more potential but for now this is the functionality, I’ve seen a lot of requests for these so I’m hoping it will be of some help orange_heart Here’s the interactive showcase doc for it: [PDF Pack Doc](https://coda.io/@rickard-abraham/pdf-pack)

A true OCR pack would be super cool, it seems to be pretty computationally expensive though 🤔

---

<div class="post-metadata">

**Author:** ![Rickard\_Abraham](https://yyz1.discourse-cdn.com/coda1/user_avatar/connect.superhuman.com/rickard_abraham/32/35007_2.png) [@Rickard\_Abraham](https://connect.superhuman.com/u/Rickard_Abraham)\
**Post date:** [October 13, 2023, 3:00am UTC](https://connect.superhuman.com/t/search-within-pdf-and-images-ocr/36840/18 "2023-10-13T03:00:15Z")

</div>

This birthed the idea that became my new [OCR Pack](https://connect.superhuman.com/t/released-ocr-pack/43560) 👏
