Skip to content

@ArchiveTeam Archive Team

Change the repository type filter

All

    Repositories list

    679 repositories

    • youtube-grab

      Public
      Archiving all metadata from YouTube (everything except videos themselves due to size)
      Lua
      •
      The Unlicense
      •2•23•5•2•Updated Jul 14, 2024Jul 14, 2024

    • ArchiveBot

      Public
      ArchiveBot, an IRC bot for archiving websites
      javascriptircarchivinghaxerubypython
      Python
      •
      MIT License
      •72•352•138•36•Updated Jul 13, 2024Jul 13, 2024

    • ludios_wpull

      Public
      wpull fork with fixes and faster parsing using html5-parser; used by grab-site; should go away when wpull is similarly improved
      HTML
      •
      GNU General Public License v3.0
      •5•25•11•0•Updated Jul 7, 2024Jul 7, 2024

    • grab-site

      Public
      The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
      crawlerspiderarchivingcrawlwarc
      Python
      •
      Other
      •130•1.3k•78•14•Updated Jul 7, 2024Jul 7, 2024

    • priimage-items

      Public
      Managing items for priimage-grab.
      Python
      •0•0•0•0•Updated Jun 26, 2024Jun 26, 2024

    • urls-sources

      Public
      Sources for urls-grab.
      Python
      •8•4•14•1•Updated Jun 26, 2024Jun 26, 2024

    • picdig-items

      Public
      Managing items for picdig-grab.
      Python
      •0•0•0•0•Updated Jun 26, 2024Jun 26, 2024

    • priimage-grab

      Public
      Archiving プリ画像 (pri-image).
      Lua
      •
      The Unlicense
      •1•0•0•0•Updated Jun 26, 2024Jun 26, 2024

    • picdig-grab

      Public
      Archiving picdig.
      Lua
      •
      The Unlicense
      •0•0•0•0•Updated Jun 25, 2024Jun 25, 2024

    • urls-grab

      Public
      Archiving URLs (outlinks) from a variety of sources.
      Lua
      •
      The Unlicense
      •5•15•2•0•Updated Jun 23, 2024Jun 23, 2024

    • postnews-items

      Public
      Managing items for postnews-grab.
      Roff
      •0•0•0•0•Updated Jun 23, 2024Jun 23, 2024

    • postnews-grab

      Public
      Archiving post.news.
      Lua
      •
      The Unlicense
      •0•0•0•0•Updated May 24, 2024May 24, 2024

    • warrior-dockerfile

      Public
      A Dockerfile for the ArchiveTeam Warrior
      Shell
      •57•278•9•1•Updated May 13, 2024May 13, 2024

    • grab-base-df

      Public
      Base Dockerfile for warrior project grab scripts
      Dockerfile
      •
      MIT License
      •3•4•0•1•Updated May 13, 2024May 13, 2024

    • subscene-items

      Public
      Managing items for subscene-grab.
      1•2•0•0•Updated May 4, 2024May 4, 2024

    • subscene-grab

      Public
      Archiving Subscene.
      Lua
      •
      The Unlicense
      •5•9•0•0•Updated May 3, 2024May 3, 2024

    • wpull

      Public
      Wget-compatible web downloader and crawler.
      HTML
      •
      GNU General Public License v3.0
      •77•547•176•20•Updated Apr 29, 2024Apr 29, 2024

    • roblox-marketplace-comments-grab

      Public
      Archiving comments from the Roblox Marketplace
      Lua
      •
      The Unlicense
      •0•1•0•0•Updated Apr 21, 2024Apr 21, 2024

    • roblox-marketplace-comments-items

      Public
      Managing items for roblox-marketplace-comments-grab.
      0•0•0•0•Updated Apr 10, 2024Apr 10, 2024

    • deviantart-grab

      Public
      Archiving part of DeviantArt.
      Lua
      •
      The Unlicense
      •0•0•0•0•Updated Apr 8, 2024Apr 8, 2024

    • urls-tor-grab

      Public
      Archiving some .onion URLs.
      Python
      •0•1•0•0•Updated Apr 4, 2024Apr 4, 2024

    • deviantart-items

      Public
      Managing items for deviantart-grab.
      0•0•0•0•Updated Mar 22, 2024Mar 22, 2024

    • taringa-grab

      Public
      Archiving taringa.net.
      Lua
      •
      The Unlicense
      •0•0•0•0•Updated Mar 20, 2024Mar 20, 2024

    • taringa-items

      Public
      Managing items for taringa-grab.
      Python
      •0•0•0•0•Updated Mar 19, 2024Mar 19, 2024

    • mediafire-grab

      Public
      Archiving mediafire.com URLs.
      Lua
      •
      The Unlicense
      •5•6•1•1•Updated Mar 13, 2024Mar 13, 2024

    • imgur-grab

      Public
      Archiving imgur.
      Lua
      •
      The Unlicense
      •3•65•0•0•Updated Mar 7, 2024Mar 7, 2024

    • vbox7-grab

      Public
      Archiving vbox7.
      Lua
      •
      The Unlicense
      •0•0•0•0•Updated Feb 21, 2024Feb 21, 2024

    • reddit-grab

      Public
      Grabbing everything from reddit.
      Lua
      •
      The Unlicense
      •13•60•3•0•Updated Feb 16, 2024Feb 16, 2024

    • vbox7-items

      Public
      Managing items for vbox7-grab.
      0•0•0•0•Updated Feb 1, 2024Feb 1, 2024

    • wget-lua

      Public
      Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
      crawlerscraperdownloaderspiderluaftpscrapingcrawlingarchivingwget
      C
      •
      GNU General Public License v3.0
      •14•90•11•1•Updated Jan 29, 2024Jan 29, 2024