AhmadIbrahiim /Website-downloader

💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js

★ 6,130⑂ 1,411👁 45⑃ 49● 54▤ 0
HTMLMITCreated 2019-10-26website-downloader.onrender.com
+6
日增长
6,130
stars
1,411
forks
45
watchers
49
prs
54
issues
0
releases

README

Complete Website Downloader 💾
Download the complete source code of any website (including all assets) 🔨.

👉 Live Demo: https://website-downloader.onrender.com

!enter image description here


  !CodeFactor



 Description 📒
 Website downloader works with wget and archiver to download all websites assets and compress then sends it back to the user through socket channel
 
 wget params the being used
 
 wget --mirror --convert-links --adjust-extension --page-requisites 
--no-parent http://example.org

 Explanation of the various flags:

 - --mirror – Makes (among other things) the download recursive.
- --convert-links – convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing.
- --adjust-extension – Adds suitable extensions to filenames (html or css) depending on their content-type.
- --page-requisites – Download things like CSS style-sheets and images required to properly display the page offline.
- --no-parent – When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site
 Deploy on cloud providers








 Requirements 📦

- Node.js 16 or newer
- wget on the PATH. The app shells out to it, and nothing will download without it:
  - Debian/Ubuntu: apt install wget
  - macOS: brew install wget
  - Windows: winget install JernejSimoncic.Wget

 How to run it 🤔

- git clone https://github.com/AhmadIbrahiim/Website-downloader.git
- cd Website-downloader
- $ npm install
- $ npm start
- http://localhost:3000/

 Optional settings

| Variable | Default | What it does |
| --- | --- | --- |
| PORT | 3000 | Port the server listens on |
| DOWNLOAD_QUOTA | 100m | Size ceiling passed to wget, so one request cannot fill the disk |
| DOWNLOAD_TIMEOUT_MS | 300000 | How long a single download may run before it is stopped |



 How To Contribute:
 - Open Issue(s) with any bugs you notice.
 - Please create Pull Requests if you think it would be an added value towards our program.

 Liked it ? You can buy a coffee:



Thank you,

Email: [email protected]

https://www.ahmed-ibrahim.com

Top issues

Discussions

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON