2

I'm trying to programatically access updated application information for USPTO patents including transaction details, continuity information, and dates and codes from the Image File Wrapper (IFW) section. Here's what I've tried so far:

  1. The information I'm after is available on https://portal.uspto.gov/pair/PublicPair; however, this is a CAPATCHA website and not conducive to web-scraping.
  2. The information also is available for bulk download from http://patents.reedtech.com/ (which apparently is partnered with the USPTO to scrape data). Unfortunately, the data on Reed appears to often be much out of date compared to what is on the PublicPair site. This is the most hopeful path so far because it seems to show the data can be scraped somehow and it gives me everything I need, but is just out of date is many cases.
  3. I've tried using the USPTO bulk download API. This has a few problems. First, many of the applications I look for are not found and return "Packaging Error." (others return a package). Even when I do get a package back, I don't get transactions, IFW, continuity, etc.
  4. USPTO PAIR API - I can't get this site to work. I emailed the address at the bottom of the page and they responded: "The PAIR Bulk Data (BETA) site is being removed soon." and pointed me towards the PEDS API.
  5. PEDS - This API does give transaction detail, but nothing in the IFW or continuity.
  6. Bulk Data Downloads - The USPTO generates raw files in XML format. Perhaps I could download ALL of the historical data and generate my own transaction and continuity data? This seems like an overwhelming task, but perhaps is theoretically possible. Maybe this what Reed does? I haven't dug deep enough into this to know whether or not all the information I'm after is even there.

Any suggestions of where to look for this sort of information? Third party sites? Pay for services?

  • 1
    I fear we already have a few bulk-download questions without solutions, don't expect to much. Actually, this question could be a better answer to some of them than what we have. – DonQuiKong Jan 22 '18 at 17:04
  • 1
    The tentative plan for PEDS to integrate with Image File Wrapper (IFW) is scheduled in FY22/FY23 projects. This is an official reply from USPTO team. – Brut Feb 6 at 19:46
1

Here are two links to GitHub projects that can be used to help download and parse USPTO data.

https://github.com/USPTO/PatentPublicData

https://github.com/USPTO/bulk-data-tools

I am also in the process of building a comprehensive tool in Python that downloads, parses and builds an SQL database of all patent, application, PAIR, and classification data-sets. I should be finished in a week or two. Otherwise, the other two on Github may be fully functional and working properly.

  • 1
    Any updates on your python tool? – Joel Dominguez Apr 11 '18 at 23:26
  • You are welcome to check it out here => github.com/rippledj/uspto The app is working well, not sure if the documentation is updated. It's working with Postgres and MySql. The parsing time is about 3 weeks, but I still have a few issues to work out. I have not had time to look at the logs and see what needs attention. – rippledj Apr 11 '18 at 23:35
  • Does it gather the image file wrapper date? – EpicAdv Jul 26 '18 at 12:09
  • No, it does not gather images. It parses front-page data. However I am partway through the application parsing software and I can surely add image file – rippledj Jul 26 '18 at 17:05

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.