OneAIFW: A Lightweight Open Source Firewall for Protecting the Privacy of Big Model Data
OneAIFW (aifw) is an open source tool developed by Funstory.ai that aims to address data privacy issues in Large Language Modeling (LLM). In current big model applications, users often need to send text containing personally identifiable information (PII) or trade secrets to cloud-based models (e.g. ChatGPT, Claude, etc...
AutoForm: AI tool that extracts data from any document and automatically fills web forms
AutoForm is a tool that uses artificial intelligence technology to free users from repetitive data copying and pasting tasks. Its core function is to act as an “AI data entry agent” that can read and understand unstructured files in a variety of formats, such as PDF documents, spreadsheets, emails, web pages and even videos. AutoFo...
OCRmyPDF: scanned PDF into searchable text of the open source tool
OCRmyPDF is an open source command line tool designed to add an Optical Character Recognition (OCR) text layer to scanned PDF files, turning them into searchable, reproducible documents. It is based on Python development , using the Tesseract OCR engine , can accurately recognize the text in the image and embedded in the PDF to keep ...
Docstrange: a tool for extracting data from documents and images and converting them to multiple formats
Docstrange is an open source document processing tool that focuses on extracting data from documents and images in multiple formats and converting them to formats such as Markdown, JSON, CSV or HTML. It utilizes artificial intelligence and advanced OCR technology , support for processing PDF, Word documents, Exce...
LangExtract: open source tools to extract structured data from text
LangExtract is an open source Python library developed by Google, focusing on extracting structured data from unstructured text. It uses large language models (LLMs) such as the Google Gemini family , combined with accurate source text location and interactive visualization features to help users quickly complex text ...
Chat4Data: an AI tool for extracting web data through natural language
Chat4Data is an AI-based Chrome extension focused on simplifying web page data extraction. It makes it easy for users to access structured data on web pages through natural language conversations without writing code. Users just need to describe the required data in simple language, such as product name, price or contact information, and Chat4Dat...
ytt-mcp: server tool to get and process subtitles for YouTube videos
ytt-mcp is an open source MCP (Model Context Protocol) server tool specialized in capturing subtitles from YouTube videos and processing them. Developed by the cottongeeks team and hosted on GitHub, it is designed to help users quickly extract video subtitles with simple commands or AI tools and support further content...
WaterCrawl: transforming web content into data usable for large models
WaterCrawl is a powerful open source web crawler tool designed to help users extract data from web pages and transform it into a data format suitable for Large Language Model (LLM) processing. It is based on Python development , combined with Django, Scrapy and Celery technology , supports efficient web crawling and data ...
Dolphin
Dolphin is developed by ByteDance is an open source document image parsing tool , focusing on processing complex document images , such as text, tables , formulas and images contained in scanned or PDF files . It uses the “first analysis after the analysis” approach , through a two-stage process to achieve efficient parsing : first analyze the page layout of the document to generate ...
OneFileLLM: Integrating Multiple Data Sources into a Single Text File
OneFileLLM is an open source command line tool designed to consolidate multiple data sources into a single text file for easy input into Large Language Models (LLMs). It supports processing GitHub repositories, ArXiv papers, YouTube video transcriptions, web content, Sci-Hub papers and local files, automatically generating the structure...
Chatlog: extract and query WeChat chat logs of open source tools
Chatlog is an open source tool that focuses on extracting and querying chat logs from WeChat's local database. It supports WeChat versions 3.x and 4.0, covering Windows and macOS systems. Users can operate from the command line, terminal interface or HTTP API to view chat logs, contacts, group chats and...
DevDocs: an MCP service for quickly crawling and organizing technical documentation
DevDocs is a completely free and open source tool developed by the CyberAGI team and hosted on GitHub. It is designed for programmers and software developers to start from the URL of the technical documentation, automatically crawl the relevant pages and organize them into concise Markdown or JSON files. It has a built-in MCP ...
Free Conversion of Multiple Files to Markdown Format Based on Workers AI
serverless-markdown-convertor is a free open source tool based on Cloudflare Worker and Workers AI that converts a wide range of files to Markdown format. It supports PDF, images, Office documents ...
GPT-Crawler: Automatically Crawling Website Content to Generate Knowledge Base Documents
GPT-Crawler is an open source tool developed by the BuilderIO team and hosted on GitHub. It crawls page content by entering one or more website URLs, generating a structured knowledge file (output.json) that can be used to create a custom GPT or AI assistant. Users...
pure.md: insert "pure.md/" in front of the URL to extract clean text.
pure.md is a tool designed for AI agents and developers that focuses on quickly converting web content or files to Markdown format. It bypasses anti-crawler restrictions through proxy services, extracts the core data of a web page, and outputs a clean Markdown file. Whether it's a dynamic web page, PDF file or social media content...
Cloudsquid: upload documents and describe requirements for intelligent extraction of structured data
Cloudsquid is a company founded in 2023 in Berlin, Germany, that specializes in using artificial intelligence to simplify document processing. Its core product is an online data extraction platform that allows users to upload PDFs, images, audio, video, etc., and simply state what data needs to be extracted, such as “find out the name and amount”, and the AI will automatically finish...
PDF Craft: PDF scanned documents to Markdown open source tools
PDF Craft is an open source tool designed for scanning PDFs of books and converting them to Markdown format. It is developed by oomol-lab and hosted on GitHub for users who like to organize their eBooks. The tool runs through a local AI model and does not require an internet connection, which protects privacy and facilitates operation. It...
Supametas.AI: Extracting Unstructured Data into LLM Highly Available Data
Supametas.AI is a data processing platform that specializes in organizing web pages, documents, audio and video, and other clutter into structured data that AI can use. It supports collecting data from multiple sources, including web links, APIs, local files, etc., and then outputting it into JSON or Markdown format. The platform requires no programming experience, ordinary...
MarkPDFDown: based on the multimodal model will be converted to PDF Markdown file
MarkPDFDown is an open source tool. It utilizes a multimodal large language model to convert PDF files into Markdown format. Developed by GitHub user jorben, this tool has a simple goal: to make PDF documents easier to edit and share. It recognizes headings, lists,...
Top
