0

Anyone performed data scraping on USPTO? someone has a tool/code that can be used to extract data from USPTO and have it as SQL DB?

8
  • Is there a reason you aren't considering other patent databases like The Lens or Google Patents?
    – Eric S
    Feb 24, 2020 at 14:32
  • is there a way i can extract data from those tools? Feb 25, 2020 at 15:08
  • I gather it’s in development for The Lens. Google patents seems to provide public data: console.cloud.google.com/marketplace/details/…
    – Eric S
    Feb 25, 2020 at 17:15
  • where can i find documentation on how to use it? i can see it is SQL it is easier than USPTO search Mar 3, 2020 at 9:36
  • I’ve never done it myself. Maybe google searching?
    – Eric S
    Mar 3, 2020 at 14:48

4 Answers 4

2

Here is a python project that scrapes the USPTO raw data files and parses them into CSV files, MySQL, and PostgreSQL databases.

https://github.com/rippledj/uspto

1

IP Watchdog recently ran a story about recent developments in obtaining bulk file wrapper data from the USPTO. It also describes the efforts of various companies in "scraping" data from USPTO databases.

Some file wrapper data is available for bulk download from Patent Examination Data System. This contains complete file wrapper data, for those applications open to public inspection, from 1981 to the present (updated daily). The data prior to 1981 are incomplete. The downloads are in JSON and XML file formats, which can be imported into a database.

The USPTO also provides some large data sets as "Research Data Sets".

0

in terms of data quality and reliability, this seems the best: https://www.uspto.gov/patents/search, but without APIs.

The APIs here https://developer.uspto.gov/ibd-api/#!/bulkdata/searchPatentGrantData seem not working: i only tried grants and applications, these direct calls.

0

Data scraping is much harder than you think. While all the file wrappers are available in PDF, before electronic filing became common the originals were on paper, and the PDF is just an image file.

Sometimes the paper has handwriting on it, although this is rare.

The file wrappers have invaluable information on what prior art was cited against the application, and how the applicant amended the claims, and unfortunately there's no good way, AFAIK, to get all that automatically.

You think "Oh, I'll just OCR it" ? The OCR quality is really bad!

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .