Skip to content

CLI tool written in Deno to scrape URLs and download linked media files

Notifications You must be signed in to change notification settings

tomholford/media-downloader

Repository files navigation

media-downloader

image

A basic media downloading tool written in Typescript for Deno. Pass in a URL, select which filetypes you're interested in, and it will scrape the HTML and download all the linked files that match the filter.

Prerequisites

Usage

  • -u - (required) the URL to scrape for media links
  • -p - (optional) the output path for writing files; defaults to ./output/
  • -t - (optional) the filetype(s) to download; defaults to several common image formats
  • -R - (optional) after finishing downloading, scan the output directory and remove duplicates

Example

deno run --allow-net --allow-write --allow-read --unstable media_downloader.ts -t jpg -t png -u https://dribbble.com/shots

Install

  1. Clone this repo
  2. Run this command
deno install --allow-net --allow-write --allow-read --unstable --name media-downloader main.ts
  1. Then, use it like so:
media-downloader -u https://example.com

macOS

You will also need to add the deno executables path to your bash_profile:

export PATH="/Users/[your username]/.deno/bin:$PATH"

Supported Sites

This tool has been confirmed to work with imageboards [e.g., 4chan) and thisvid. Feel free to open a PR to contribute more sites to this list.

Roadmap

  • Support <img> tags
  • Multiple parallel requests
  • progress bar
  • CI
  • release binaries
  • tests

About

CLI tool written in Deno to scrape URLs and download linked media files

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published