# Tools > Every listed resource, editors’ picks first. The filters below can be combined. - Search: append `?q=` to the URL. Separate several keywords with spaces; all of them must match. Matches name, repository, tags, professions, description and README. - Filter by type: append `?type=` to the URL. - Filter by profession: append `?profession=` to the URL. Separate several ids with commas; a resource matches when it suits any of them. Ids are listed at https://hebbmind.com/api/v1/professions - Filter by tag: append `?tag=` to the URL. Separate several tags with commas; a resource must carry all of them. Tags are listed at https://hebbmind.com/api/v1/tags Type CLI, Resources for Data engineering or Design: 72 items. > - Data engineering: Data pipelines, warehouse modeling, ETL and data quality. > - Design: Interface, interaction, visual and brand design. - [MarkItDown](https://hebbmind.com/fr/cli/markitdown.md): [CLI] Converts PDF, Word, Excel, PowerPoint, HTML, images, audio and more into Markdown that keeps headings, lists and tables, ready for LLMs to read and analyze. Maintained by Microsoft; requires Python 3.10+. - [DuckDB](https://hebbmind.com/fr/cli/duckdb.md): [CLI] In-process analytical SQL database. Its CLI queries CSV, Parquet and JSON files directly with SQL, no import or server needed, so agents can sample and aggregate large files. Officially maintained. - [PaddleOCR](https://hebbmind.com/fr/cli/paddleocr.md): [CLI] Baidu PaddlePaddle's official OCR and document parsing tool: the paddleocr command reads text from images and parses PDFs and scans into Markdown or JSON, supporting 100+ languages with models that run locally. - [uv](https://hebbmind.com/fr/cli/uv.md): [CLI] Astral's extremely fast Python package and project manager written in Rust, replacing pip, pipx, poetry, pyenv and more. Supports lockfiles and multiple Python versions, and uvx runs Python tools without installing them. - [Scrapling](https://hebbmind.com/fr/cli/scrapling.md): [CLI] Adaptive web scraping framework: scrapling extract turns a page into Markdown, text or HTML in one command, with CSS selectors and browser rendering for dynamic pages, plus an MCP server (needs the ai extra). Needs Python 3.10+ and a browser install on first use. - [Crawl4AI](https://hebbmind.com/fr/cli/crawl4ai.md): [CLI] Open-source, LLM-friendly web crawler that turns pages into clean Markdown for RAG and agents. Ships the crwl CLI and supports deep crawling and question-driven data extraction (extraction needs an LLM key). Free to self-host. - [MinerU](https://hebbmind.com/fr/cli/mineru.md): [CLI] Document parser from OpenDataLab that turns PDFs, images and Office files into Markdown or JSON, handling tables, formulas and complex layouts well, with page-by-page reading and citation anchors for agents. Parses locally by default; needs Python 3.10+. - [Tesseract OCR](https://hebbmind.com/fr/cli/tesseract.md): [CLI] Classic open-source OCR engine and CLI that reads text from images and outputs plain text, hOCR, searchable PDF or TSV. Supports 100+ languages; install the language data for each language you need. - [Docling](https://hebbmind.com/fr/cli/docling.md): [CLI] Parses PDF, DOCX, PPTX, XLSX, HTML, images and audio, recovering layout, reading order, tables and formulas, and exports Markdown, HTML or lossless JSON. Started by IBM Research, now hosted by the LF AI & Data Foundation; runs fully locally. - [HyperFrames](https://hebbmind.com/fr/cli/hyperframes.md): [CLI] Write videos in HTML, CSS and frame-seekable animations, preview them from the CLI and render deterministic MP4s. Comes with agent skills for product launch videos, captions and talking-head re-edits. Maintained by HeyGen; needs Node.js 22+ and FFmpeg. - [rclone](https://hebbmind.com/fr/cli/rclone.md): [CLI] 'rsync for cloud storage': sync and copy files across dozens of providers such as S3, Google Drive, OneDrive and Alibaba Cloud OSS, with encryption and mounting. Set up remotes with rclone config before use. - [aria2](https://hebbmind.com/fr/cli/aria2.md): [CLI] Lightweight multi-protocol command-line downloader that fetches in parallel segments from multiple sources over HTTP(S), FTP, SFTP, BitTorrent and Metalink. Resumes downloads, reads URLs in bulk from text files and offers a JSON-RPC interface for scripts or agents. - [Nushell](https://hebbmind.com/fr/cli/nushell.md): [CLI] Cross-platform shell built around structured data: pipelines pass tables instead of plain text, and you can open and query JSON, CSV, TOML and more directly. Default builds include nu --mcp, which serves it to agents as an MCP server. - [Marker](https://hebbmind.com/fr/cli/marker.md): [CLI] Converts PDFs, images, PPTX, DOCX, XLSX, EPUB and more into Markdown, JSON or HTML, preserving tables, formulas and layout, with optional LLM help for higher accuracy. Needs Python 3.10+ and PyTorch; large-scale commercial use of the model weights needs a paid license. - [Lightpanda Browser](https://hebbmind.com/fr/cli/browser.md): [CLI] Headless browser written from scratch in Zig for AI agents and automation, using less memory and running faster than headless Chrome in official benchmarks. fetch turns pages into Markdown, and it can serve CDP or MCP. Telemetry is on by default (an env var disables it); Windows needs WSL. - [jq](https://hebbmind.com/fr/cli/jq.md): [CLI] Lightweight command-line JSON processor that slices, filters, maps and transforms JSON with concise expressions and no runtime dependencies. A staple for agents parsing API responses and logs. - [DESIGN.md](https://hebbmind.com/fr/cli/design-md.md): [CLI] Google Labs' DESIGN.md format and CLI: designers capture colors, typography and spacing in a file for agents; lint checks broken references and WCAG contrast, diff compares versions and export outputs design tokens for Tailwind and more. Needs Node.js; the format is in alpha. - [Rembg](https://hebbmind.com/fr/cli/rembg.md): [CLI] Removes image backgrounds with one command: single images, whole folders or watched directories, mask-only output and switchable models like U2Net and SAM. Can also run as an HTTP server or process video frames with FFmpeg. Default models run locally. - [SVGO](https://hebbmind.com/fr/cli/svgo.md): [CLI] SVG optimizer CLI and Node.js library: shrinks SVGs by removing editor metadata, comments, hidden elements and redundant attributes, processes whole directories recursively, and gives fine control through plugin config. - [Video2X](https://hebbmind.com/fr/cli/video2x.md): [CLI] ML-based video upscaling and frame interpolation using Real-ESRGAN, Real-CUGAN, RIFE and other models to upscale old low-res video or raise frame rates; video2x handles one video per run and is scriptable. Needs a Vulkan GPU; Windows, Linux and Docker builds, no native macOS. - [gallery-dl](https://hebbmind.com/fr/cli/gallery-dl.md): [CLI] Command-line tool for bulk-downloading galleries and posts from many image hosts and social platforms, with flexible file naming and config, and yt-dlp integration for video. Main development has moved to Codeberg; the GitHub repo stays in sync. - [olmOCR](https://hebbmind.com/fr/cli/olmocr.md): [CLI] AI2's tool for converting PDFs and scans to Markdown with a vision LLM, handling equations, tables, handwriting and multi-column layouts, suited to bulk digitizing papers and archives. Local runs need an NVIDIA GPU with 12GB+ VRAM; otherwise use a paid OpenAI-compatible remote endpoint. - [ImageMagick](https://hebbmind.com/fr/cli/imagemagick.md): [CLI] Veteran image processing CLI suite that converts, resizes, crops, composites and batch-processes JPEG, PNG, GIF, TIFF, PDF and many more formats, handy for agents handling images in scripts. - [DataX](https://hebbmind.com/fr/cli/datax.md): [CLI] Alibaba's open-source offline data sync tool: JSON job configs batch-sync between heterogeneous sources like MySQL, Oracle, PostgreSQL, Hive, HDFS and MaxCompute, run with python datax.py. Needs JDK 1.8+ and Python; download and unpack the official toolkit. - [DVC](https://hebbmind.com/fr/cli/dvc.md): [CLI] Version datasets and models the way Git versions code: data lives in remote storage like S3 or GCS while versions are tracked in your Git repo. Also offers reproducible pipelines and local experiment tracking, rerunning only the steps affected by a change. - [monolith](https://hebbmind.com/fr/cli/monolith.md): [CLI] Bundles a whole web page with its CSS, images, fonts and scripts into a single HTML file that opens offline exactly as it looked, good for archiving pages or handing them to an agent for offline analysis. It does not run JavaScript, so pre-render dynamic pages with a headless browser. - [dbt](https://hebbmind.com/fr/cli/dbt.md): [CLI] Command-line framework for warehouse modeling and ELT transformations: write models in SQL and let dbt handle dependencies, data tests and documentation. v2 is rewritten in Rust as a single binary. Maintained by dbt Labs; needs a data warehouse connection. - [pgcli](https://hebbmind.com/fr/cli/pgcli.md): [CLI] PostgreSQL command-line client with smart autocompletion and syntax highlighting. Compatible with psql environment variables, and -c runs a statement and exits, so agents can query databases non-interactively. - [mycli](https://hebbmind.com/fr/cli/mycli.md): [CLI] MySQL terminal client with smart autocompletion and syntax highlighting, also compatible with MariaDB and TiDB. Supports --execute and batch mode with CSV or table output, so agents can run SQL directly. - [libvips](https://hebbmind.com/fr/cli/libvips.md): [CLI] Fast, memory-efficient image processing library with a vips CLI for batch resizing, cropping, rotating, format conversion (WebP, AVIF, HEIC, TIFF and more) and thumbnails, handling very large images smoothly. Good for design and media teams processing assets in bulk. Install with Homebrew on macOS. - [Datasette](https://hebbmind.com/fr/cli/datasette.md): [CLI] Publishes SQLite databases as browsable, queryable web pages and JSON APIs, with SQL queries, metadata and plugins, and deploys to Cloud Run and other platforms with datasette publish. Great for data exploration and data journalism. Needs Python 3.10+. - [Presidio CLI](https://hebbmind.com/fr/cli/presidio.md): [CLI] Scans files and directories for personal data such as names, emails and credit card numbers using Presidio Analyzer, with configurable entity types, confidence thresholds and ignore rules. Needs Python 3.10+ and a spaCy language model. - [Manga Image Translator](https://hebbmind.com/fr/cli/manga-image-translator.md): [CLI] Batch-translates text in manga, posters and screenshots with one command: detects text, runs OCR, erases the original and typesets the translation back into the image. Japanese-focused, with 20+ languages supported. Install from source (Python 3.10+); offline models, DeepL or LLM APIs. - [usql](https://hebbmind.com/fr/cli/usql.md): [CLI] Universal psql-style SQL command line: one tool to connect to PostgreSQL, MySQL, SQLite, SQL Server, Oracle and dozens of other SQL and NoSQL databases, with support for copying data between databases. - [Miller](https://hebbmind.com/fr/cli/miller.md): [CLI] Processes CSV, TSV, JSON and other structured data like awk, sed, cut, join and sort, but by field name, for cleaning, aggregation, format conversion and pretty-printing. The command is mlr; written in Go with no runtime dependencies. - [SQLFluff](https://hebbmind.com/fr/cli/sqlfluff.md): [CLI] Linter and formatter for 20+ SQL dialects that auto-fixes most issues and handles Jinja templating and dbt projects (dbt needs a plugin), suited to warehouse code review and CI. - [Apache SeaTunnel](https://hebbmind.com/fr/cli/seatunnel.md): [CLI] Distributed data integration tool and Apache top-level project with 160+ connectors for batch, real-time and CDC sync. Define jobs in config files and run them on the built-in Zeta engine or on Flink or Spark. Requires Java. - [VisiData](https://hebbmind.com/fr/cli/visidata.md): [CLI] Terminal tool for exploring and wrangling tabular data: opens dozens of formats including CSV, JSON, Excel and SQLite for filtering, sorting, pivots and frequency counts. --batch mode replays actions headlessly or converts file formats. - [Atlas](https://hebbmind.com/fr/cli/atlas.md): [CLI] Manage database schemas as code: declare the desired schema in SQL, HCL or your ORM and Atlas plans, lints and applies migrations, and can export existing databases as HCL, SQL or Mermaid ER diagrams. Supports PostgreSQL, MySQL and a dozen other databases. - [jc](https://hebbmind.com/fr/cli/jc.md): [CLI] Converts the output of 100+ commands such as dig, ps, ls and ifconfig, plus common file formats, into JSON so agents can parse it reliably with jq or scripts. Also usable as a Python library. - [BackgroundRemover](https://hebbmind.com/fr/cli/backgroundremover.md): [CLI] Removes backgrounds from images and videos with one AI command: batch whole folders, use a portrait model, refine edges or swap in a solid color, and output transparent MOV or composite video onto a new background. Runs locally; install PyTorch and ffmpeg first. Models download on first run. - [dasel](https://hebbmind.com/fr/cli/dasel.md): [CLI] Query, modify and convert JSON, YAML, TOML, XML, CSV, HCL, INI and more with one selector syntax, editing config files in place or converting between formats, handy for agents handling structured data in scripts. A single dependency-free binary that works much like jq or yq. - [FontForge](https://hebbmind.com/fr/cli/fontforge.md): [CLI] Open-source font editor: fontforge -script runs Python scripts headlessly to batch-edit glyphs, convert between OTF, TTF, UFO and other formats, and generate fonts, for type design and font processing. Homebrew installs the CLI version; install the desktop app for the GUI. - [stable-diffusion.cpp](https://hebbmind.com/fr/cli/stable-diffusion-cpp.md): [CLI] Diffusion model inference in pure C/C++: one sd-cli command runs SD, FLUX, Qwen Image, Wan and more locally to create or edit images and short videos, with Metal acceleration on Mac. No cloud needed; bring your own model weights and use a release binary or build from source. - [VTracer](https://hebbmind.com/fr/cli/vtracer.md): [CLI] Converts raster images like JPG and PNG to SVG, handling color tracing, black-and-white line art and unevenly lit scans, for vectorizing logos, illustrations and old drawings. The CLI is a 1.0 preview installed with cargo (needs Rust); a desktop app is also available. - [Trafilatura](https://hebbmind.com/fr/cli/trafilatura.md): [CLI] Python library and CLI for extracting main web content: fetches pages, crawls via sitemaps and RSS feeds, strips headers, footers and other noise, and outputs TXT, Markdown, JSON, XML and more with metadata. Also processes downloaded HTML offline. - [pastel](https://hebbmind.com/fr/cli/pastel.md): [CLI] Command-line color tool: generate, mix, lighten and darken colors, convert between HEX, RGB, HSL, Lab and more, build gradients and sets of distinct colors, pick readable text colors for a background, and simulate color blindness. Install via Homebrew; no account or API key. - [csvkit](https://hebbmind.com/fr/cli/csvkit.md): [CLI] Veteran suite of CSV command-line tools: in2csv converts Excel and JSON to CSV, csvcut, csvgrep and csvsort filter and sort, csvstat computes statistics, and csvsql runs SQL directly against CSV files. - [pngquant](https://hebbmind.com/fr/cli/pngquant.md): [CLI] Lossy PNG compression CLI: converts images to 8-bit PNGs that keep transparency, usually 60-80% smaller, with batch processing and a quality range setting. Handy for slimming down web assets, slides and article images. Install via Homebrew on macOS; no account. - [gifski](https://hebbmind.com/fr/cli/gifski.md): [CLI] High-quality GIF encoder built on pngquant: turns video frames or PNG sequences into animations, using cross-frame palettes and temporal dithering for thousands of colors per frame. Can take video piped straight from ffmpeg. Next page: https://hebbmind.com/fr/tools.md?page=2&type=cli&profession=data-engineering%2Cdesign