# Tools > Every listed resource, editors’ picks first. The filters below can be combined. - Search: append `?q=` to the URL. Separate several keywords with spaces; all of them must match. Matches name, repository, tags, professions, description and README. - Filter by type: append `?type=` to the URL. - Filter by profession: append `?profession=` to the URL. Separate several ids with commas; a resource matches when it suits any of them. Ids are listed at https://hebbmind.com/api/v1/professions - Filter by tag: append `?tag=` to the URL. Separate several tags with commas; a resource must carry all of them. Tags are listed at https://hebbmind.com/api/v1/tags Type CLI, Resources for Data engineering or Data analysis: 54 items. > - Data engineering: Data pipelines, warehouse modeling, ETL and data quality. > - Data analysis: Querying, statistical analysis, reporting and visualization. - [MarkItDown](https://hebbmind.com/fr/cli/markitdown.md): [CLI] Converts PDF, Word, Excel, PowerPoint, HTML, images, audio and more into Markdown that keeps headings, lists and tables, ready for LLMs to read and analyze. Maintained by Microsoft; requires Python 3.10+. - [DuckDB](https://hebbmind.com/fr/cli/duckdb.md): [CLI] In-process analytical SQL database. Its CLI queries CSV, Parquet and JSON files directly with SQL, no import or server needed, so agents can sample and aggregate large files. Officially maintained. - [PaddleOCR](https://hebbmind.com/fr/cli/paddleocr.md): [CLI] Baidu PaddlePaddle's official OCR and document parsing tool: the paddleocr command reads text from images and parses PDFs and scans into Markdown or JSON, supporting 100+ languages with models that run locally. - [uv](https://hebbmind.com/fr/cli/uv.md): [CLI] Astral's extremely fast Python package and project manager written in Rust, replacing pip, pipx, poetry, pyenv and more. Supports lockfiles and multiple Python versions, and uvx runs Python tools without installing them. - [Scrapling](https://hebbmind.com/fr/cli/scrapling.md): [CLI] Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use. - [Crawl4AI](https://hebbmind.com/fr/cli/crawl4ai.md): [CLI] Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host. - [MinerU](https://hebbmind.com/fr/cli/mineru.md): [CLI] Document parser from OpenDataLab that turns PDFs, images and Office files into Markdown or JSON, handling tables, formulas and complex layouts well, with page-by-page reading and citation anchors for agents. Parses locally by default; needs Python 3.10+. - [Tesseract OCR](https://hebbmind.com/fr/cli/tesseract.md): [CLI] Classic open-source OCR engine and CLI that reads text from images and outputs plain text, hOCR, searchable PDF or TSV. Supports 100+ languages; install the language data for each language you need. - [OpenBB Platform CLI](https://hebbmind.com/fr/cli/openbb-finance-cli.md): [CLI] Command-line edition of the open-source OpenBB investment research platform: query stock prices, financial statements, macroeconomic and other financial data from the terminal, and automate data pulls with Routine scripts. Officially maintained; some sources need API keys. - [Docling](https://hebbmind.com/fr/cli/docling.md): [CLI] Parses PDF, DOCX, PPTX, XLSX, HTML, images and audio, recovering layout, reading order, tables and formulas, and exports Markdown, HTML or lossless JSON. Started by IBM Research, now hosted by the LF AI & Data Foundation; runs fully locally. - [rclone](https://hebbmind.com/fr/cli/rclone.md): [CLI] 'rsync for cloud storage': sync and copy files across dozens of providers such as S3, Google Drive, OneDrive and Alibaba Cloud OSS, with encryption and mounting. Set up remotes with rclone config before use. - [aria2](https://hebbmind.com/fr/cli/aria2.md): [CLI] Lightweight multi-protocol command-line downloader that fetches in parallel segments from multiple sources over HTTP(S), FTP, SFTP, BitTorrent and Metalink. Resumes downloads, reads URLs in bulk from text files and offers a JSON-RPC interface for scripts or agents. - [Nushell](https://hebbmind.com/fr/cli/nushell.md): [CLI] Cross-platform shell built around structured data: pipelines pass tables instead of plain text, and you can open and query JSON, CSV, TOML and more directly. Default builds include nu --mcp, which serves it to agents as an MCP server. - [Marker](https://hebbmind.com/fr/cli/marker.md): [CLI] Converts PDFs, images, PPTX, DOCX, XLSX, EPUB and more into Markdown, JSON or HTML, preserving tables, formulas and layout, with optional LLM help for higher accuracy. Needs Python 3.10+ and PyTorch; large-scale commercial use of the model weights needs a paid license. - [Lightpanda Browser](https://hebbmind.com/fr/cli/browser.md): [CLI] Headless browser written from scratch in Zig for AI agents and automation, using less memory and running faster than headless Chrome in official benchmarks. fetch turns pages into Markdown, and it can serve CDP or MCP. Telemetry is on by default (an env var disables it); Windows needs WSL. - [jq](https://hebbmind.com/fr/cli/jq.md): [CLI] Lightweight command-line JSON processor that slices, filters, maps and transforms JSON with concise expressions and no runtime dependencies. A staple for agents parsing API responses and logs. - [OpenCLI](https://hebbmind.com/fr/cli/opencli.md): [CLI] Turns websites and Electron desktop apps into deterministic CLIs, with built-in adapters for Reddit, Hacker News, Bilibili, Zhihu, Xiaohongshu and more, and lets agents operate any page through your signed-in Chrome. Needs its companion browser extension. - [olmOCR](https://hebbmind.com/fr/cli/olmocr.md): [CLI] AI2's tool for converting PDFs and scans to Markdown with a vision LLM, handling equations, tables, handwriting and multi-column layouts, suited to bulk digitizing papers and archives. Local runs need an NVIDIA GPU with 12GB+ VRAM; otherwise use a paid OpenAI-compatible remote endpoint. - [DataX](https://hebbmind.com/fr/cli/datax.md): [CLI] Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit. - [DVC](https://hebbmind.com/fr/cli/dvc.md): [CLI] Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change. - [monolith](https://hebbmind.com/fr/cli/monolith.md): [CLI] Bundles a whole web page with its CSS, images, fonts and scripts into a single HTML file that opens offline exactly as it looked, good for archiving pages or handing them to an agent for offline analysis. It does not run JavaScript, so pre-render dynamic pages with a headless browser. - [dbt](https://hebbmind.com/fr/cli/dbt.md): [CLI] Command-line framework for warehouse modeling and ELT transformations: write models in SQL and let dbt handle dependencies, data tests and documentation. v2 is rewritten in Rust as a single binary. Maintained by dbt Labs; needs a data warehouse connection. - [pgcli](https://hebbmind.com/fr/cli/pgcli.md): [CLI] PostgreSQL command-line client with smart autocompletion and syntax highlighting. Compatible with psql environment variables, and -c runs a statement and exits, so agents can query databases non-interactively. - [LLM](https://hebbmind.com/fr/cli/llm.md): [CLI] Simon Willison's LLM CLI and Python library: call OpenAI, Claude, Gemini and local models from the terminal, with conversations logged to SQLite automatically, plus embeddings, structured extraction, tool calling and a plugin system. - [mycli](https://hebbmind.com/fr/cli/mycli.md): [CLI] MySQL terminal client with smart autocompletion and syntax highlighting, also compatible with MariaDB and TiDB. Supports --execute and batch mode with CSV or table output, so agents can run SQL directly. - [Datasette](https://hebbmind.com/fr/cli/datasette.md): [CLI] Publishes SQLite databases as browsable, queryable web pages and JSON APIs, with SQL queries, metadata and plugins, and deploys to Cloud Run and other platforms with datasette publish. Great for data exploration and data journalism. Needs Python 3.10+. - [Presidio CLI](https://hebbmind.com/fr/cli/presidio.md): [CLI] Scans files and directories for personal data such as names, emails and credit card numbers using Presidio Analyzer, with configurable entity types, confidence thresholds and ignore rules. Needs Python 3.10+ and a spaCy language model. - [pdfplumber](https://hebbmind.com/fr/cli/pdfplumber.md): [CLI] Reads the exact position of every character, line and table cell in digital PDFs: the CLI exports layout-preserving text or CSV/JSON details, and the Python API extracts tables and form fields, ideal for invoices, statements and reports. Runs locally with Python; scans need OCR first. - [usql](https://hebbmind.com/fr/cli/usql.md): [CLI] Universal psql-style SQL command line: one tool to connect to PostgreSQL, MySQL, SQLite, SQL Server, Oracle and dozens of other SQL and NoSQL databases, with support for copying data between databases. - [Miller](https://hebbmind.com/fr/cli/miller.md): [CLI] Processes CSV, TSV, JSON and other structured data like awk, sed, cut, join and sort, but by field name, for cleaning, aggregation, format conversion and pretty-printing. The command is mlr; written in Go with no runtime dependencies. - [SQLFluff](https://hebbmind.com/fr/cli/sqlfluff.md): [CLI] Linter and formatter for 20+ SQL dialects that auto-fixes most issues and handles Jinja templating and dbt projects (dbt needs a plugin), suited to warehouse code review and CI. - [Apache SeaTunnel](https://hebbmind.com/fr/cli/seatunnel.md): [CLI] Distributed data integration tool and Apache top-level project with 160+ connectors for batch, real-time and CDC sync. Define jobs in config files and run them on the built-in Zeta engine or on Flink or Spark. Requires Java. - [VisiData](https://hebbmind.com/fr/cli/visidata.md): [CLI] Terminal tool for exploring and wrangling tabular data: opens dozens of formats including CSV, JSON, Excel and SQLite for filtering, sorting, pivots and frequency counts. --batch mode replays actions headlessly or converts file formats. - [Atlas](https://hebbmind.com/fr/cli/atlas.md): [CLI] Manage database schemas as code: declare the desired schema in SQL, HCL or your ORM and Atlas plans, lints and applies migrations, and can export existing databases as HCL, SQL or Mermaid ER diagrams. Supports PostgreSQL, MySQL and a dozen other databases. - [jc](https://hebbmind.com/fr/cli/jc.md): [CLI] Converts the output of 100+ commands such as dig, ps, ls and ifconfig, plus common file formats, into JSON so agents can parse it reliably with jq or scripts. Also usable as a Python library. - [dasel](https://hebbmind.com/fr/cli/dasel.md): [CLI] Query, modify and convert JSON, YAML, TOML, XML, CSV, HCL, INI and more with one selector syntax, editing config files in place or converting between formats, handy for agents handling structured data in scripts. A single dependency-free binary that works much like jq or yq. - [Steampipe](https://hebbmind.com/fr/cli/steampipe.md): [CLI] Query cloud resources and SaaS APIs live with SQL: plugins map AWS, Azure, GCP, GitHub, Kubernetes and other services to tables you can select from directly, no ETL needed. A single binary with Postgres built in. - [Jupytext](https://hebbmind.com/fr/cli/jupytext.md): [CLI] Converts and two-way syncs Jupyter notebooks with plain Python scripts or Markdown, so agents can edit research and teaching notebooks like ordinary text and diffs stay readable. Needs a local Python environment; install with pip. - [Trafilatura](https://hebbmind.com/fr/cli/trafilatura.md): [CLI] Python library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline. - [csvkit](https://hebbmind.com/fr/cli/csvkit.md): [CLI] Veteran suite of CSV command-line tools: in2csv converts Excel and JSON to CSV, csvcut, csvgrep and csvsort filter and sort, csvstat computes statistics, and csvsql runs SQL directly against CSV files. - [Quarto](https://hebbmind.com/fr/cli/quarto-cli.md): [CLI] Posit's open-source scientific and technical publishing system built on Pandoc: embed Python, R or Julia code in Markdown or Jupyter notebooks, then quarto render produces HTML, PDF, Word, slides, websites and books. - [YouPlot](https://hebbmind.com/fr/cli/youplot.md): [CLI] Draws bar charts, histograms, line charts, scatter plots and box plots in the terminal from CSV/TSV on stdin, so you can glance at data distributions at the end of a shell pipeline. The command is uplot. - [AiPy](https://hebbmind.com/fr/cli/aipyapp.md): [CLI] Knownsec's open-source Python-use agent: describe a task in plain language and it writes and runs Python on your machine, e.g. tidying Excel files, summarizing attendance or screening resumes. Needs Python 3.11+ and a model API key such as DeepSeek; code runs locally, so back up important files. - [Camelot](https://hebbmind.com/fr/cli/camelot.md): [CLI] Open-source PDF table extraction with a camelot CLI: exports tables from financial reports, bank statements and statistical reports to Excel, CSV or Markdown, with an accuracy score. Needs Python 3.10+; handles text-based PDFs by default, scans need the ml and ocr extras. Double-check results. - [qsv](https://hebbmind.com/fr/cli/qsv.md): [CLI] Fast Rust toolkit for tabular data with nearly 80 subcommands for querying, stats, cleaning, validation, joins and format conversion on CSV and Excel. Also offers an MCP server and a Claude Cowork plugin. - [SQLMesh](https://hebbmind.com/fr/cli/sqlmesh.md): [CLI] Framework for writing data transformation models in SQL or Python, with a Terraform-like plan/apply flow, virtual data environments, unit tests and table diffs, and transpilation across 10+ SQL dialects. A Linux Foundation project and an alternative to dbt. - [Rill](https://hebbmind.com/fr/cli/rill.md): [CLI] Open-source, agent-friendly BI: define metrics and dashboards in YAML and SQL, and rill init generates project instructions and MCP config for Claude Code so agents can build business dashboards and answer questions in natural language. Local use is free; publishing to Rill Cloud needs an account. - [shot-scraper](https://hebbmind.com/fr/cli/shot-scraper.md): [CLI] Simon Willison's website screenshot CLI: batch screenshots from YAML, record demo videos, export PDF and HTML, run JavaScript in pages to extract data, and dump accessibility trees. Built on Playwright; install a browser on first use. - [sqlite-utils](https://hebbmind.com/fr/cli/sqlite-utils.md): [CLI] A CLI and Python library by Simon Willison: imports JSON and CSV straight into SQLite with automatic table creation, runs in-memory SQL queries over files, and supports full-text search and table transformations. - [Intercom CLI (Printing Press)](https://hebbmind.com/fr/cli/intercom.md): [CLI] Unofficial Intercom CLI built with Printing Press, covering the full REST API: sync conversations and contacts for offline search, bulk-tag conversations about one incident, see customer overviews and SLA reports, and pull or push help articles. US, EU and AU regions; needs an access token. Next page: https://hebbmind.com/fr/tools.md?page=2&type=cli&profession=data-engineering%2Cdata