grab-site
grab-site is a crawler for archiving websites to WARC files. It includes a dashboard for monitoring multiple crawls, and supports changing URL ignore patterns during the crawl.
Audio & MusicEducation & ReferenceSystem & HardwarePhotos & GraphicsDevelopmentSecurity & PrivacyGamesVideo & MoviesOS & UtilitiesNetwork & AdminOnline ServicesTravel & LocationAI Tools & ServicesBusiness & CommerceOffice & ProductivityNews & BooksBackup & SyncSocial & CommunicationsDocumentation BrowserPastebin ServiceRemote Work & EducationFile SharingURL ShortenerWeb BrowsersAI ChatbotGaming SoftwareExam SimulatorSport & HealthFile ManagementHome & FamilyTechnology IdentifierWebsite Monitoring ToolWebsite DownloaderProxy ServicePrevent Sleep Mode AppText to Speech ServiceGame Development ToolUSB Device ManagerFace SwapCD/DVD Tools3D ModelerUI Design ToolUsenet News ClientMinecraft LauncherSoftware Download ServiceAudio Transcription ToolCrypto WalletMarkup LanguageCrowdfunding ServiceCountdown TimerKeyboard Sound EmulatorPenetration Testing ToolText EditorOnline ShopRelational DatabaseTab ManagerFile UnlockerQR Code GeneratorStory Writing ToolInventory Management ToolCryptocurrency ExchangeCertificate AuthorityPeople Search EngineAnti-Spam ToolAndroid Root ManagerVulnerability ScannerData Breach ToolSEO ToolKaraoke PlayerCircuit SimulatorCity Building GameWeb Scraping ToolDigital Painting ToolDisposable Email ServiceForm BuilderWorld ClockLogin Sharing ServiceMinecraft ServerGIS SoftwareVirtual TabletopNAS SystemDiscord ModReddit ClientSoundboardBusiness Intelligence ToolAI Image GeneratorPrivacy ToolCDNCard GameAudio RouterAcademic Research ToolDICOM ViewerPhone SystemHRM SoftwareSound EqualizerData Mining SoftwareWorkflow Automation ToolDigital Signage SoftwareCloud Computing ServiceOnline Education ServiceBackend as a ServiceBenchmark ToolJournaling AppMouse Gestures ToolMotion Graphics SoftwareDocument ScannerCryptocurrency CoinModding AppTime Tracking ToolContext Menu ManagerPhone TrackerAnime / Manga Tracking AppLyrics DisplayerLogo MakerAI Coding AssistantAI CompanionCursor HighligterCrypto Portfolio TrackerKeystroke VisualizerImage ViewerJSON ViewerAstrology AppDocument Publishing ToolDocker ManagerIP Address Lookup ToolLoad BalancerQuiz GameImageboardIdentity Management ToolStatic Site GeneratorMail ConverterDesktop Customization ToolDating ServiceImage Upscaling AppStock Trading AppEmoji MakerQuiz MakerIT Service Management SoftwareWhiteboardMedia ManagerDarts ScorerSimulation GamesBitcoin Mining ToolTournament ManagerComic MakerCode ReviewAlarm ClockClient PortalEmail Marketing ServiceFlash PlayerGambling ServiceScreen DimmerMovie Review SiteSubtitle DownloaderAuthenticatorTech News SiteShellTest AutomationPayment Processing ServiceFile Hosting DownloaderAI Content DetectorAd NetworkDelivery Tracking App
Reverse Proxy ServerSSH ClientTerminal EmulatorSocial NetworkVirtual Desktop ManagerNetwork AnalyzerStatistical AnalyzerWeb Analytics ServiceNetwork MonitorVirtualization ToolWeb Log AnalyzerTechnology IdentifierWebsite Audit ToolUptime Monitor ServiceWebsite Monitoring ToolOperating SystemServer Management ToolRemote Desktop ToolWeb ServerIP ScannerHome Automation ToolIoT PlatformLog Management ToolVPN ServiceFirewallBusiness Intelligence ToolError LoggerIP Address Lookup ToolSEO ToolIdentity Management ToolLinux DistroRouter Custom FirmwareWi-Fi HotspotPenetration Testing ToolCloud Computing ServicePrice TrackerInternet Speed Test AppLocalhost Tunnel ServiceDynamic DNS ServiceWeb Scraping ToolMedia ServerLog AnalyzerInventory Management ToolWeb Archiving ServiceWebsite DownloaderDNS ResolverBenchmark ToolCustomer Feedback ManagerAndroid EmulatorProxy ServiceWeb Hosting ServiceCDNDDoS Protection SystemVulnerability ScannerApplication LauncherCloud Hosting Service