Showcase

ℹ Crawling https://www.casoon.de/
✔ https://www.casoon.de/ → index.html
✔ https://www.casoon.de/ki-automatisierung/ → ki-automatisierung/index.html
✔ https://www.casoon.de/agb/ → agb/index.html
✔ https://www.casoon.de/praxissoftware/ → praxissoftware/index.html
✔ https://www.casoon.de/picks/ → picks/index.html
✔ https://www.casoon.de/cloud-entwicklung/referenzarchitektur/ → cloud-entwicklung/referenzarchitektur/index.html
✔ https://www.casoon.de/kollaboration/ → kollaboration/index.html
✔ https://www.casoon.de/e-commerce/ → e-commerce/index.html
✔ https://www.casoon.de/unterlagen/ → unterlagen/index.html
✔ https://www.casoon.de/strategieberatung/ → strategieberatung/index.html
✔ https://www.casoon.de/joern-seidel/ → joern-seidel/index.html
✔ https://www.casoon.de/webentwicklung/website-planen/ → webentwicklung/website-planen/index.html
✔ https://www.casoon.de/cloud-entwicklung/ → cloud-entwicklung/index.html
✔ https://www.casoon.de/usp/ → usp/index.html
✔ https://www.casoon.de/webseiten-check/ → webseiten-check/index.html
✔ https://www.casoon.de/branchen/ → branchen/index.html
✔ https://www.casoon.de/ratgeber/ → ratgeber/index.html
✔ https://www.casoon.de/leistungskatalog/ → leistungskatalog/index.html
✔ https://www.casoon.de/webentwicklung/ → webentwicklung/index.html
✔ https://www.casoon.de/plattform-apps/ → plattform-apps/index.html
✔ https://www.casoon.de/barrierefreiheit/ → barrierefreiheit/index.html
✔ https://www.casoon.de/wartung-und-support/ → wartung-und-support/index.html
✔ https://www.casoon.de/performance-optimierung/ → performance-optimierung/index.html
✔ https://www.casoon.de/datenschutz/ → datenschutz/index.html
✔ https://www.casoon.de/softwareentwicklung/ → softwareentwicklung/index.html
✔ https://www.casoon.de/technologien/ → technologien/index.html
✔ https://www.casoon.de/seo-marketing/ → seo-marketing/index.html
✔ https://www.casoon.de/ki/ → ki/index.html
✔ https://www.casoon.de/schulsoftware/ → schulsoftware/index.html
✔ https://www.casoon.de/webentwicklung/website-mit-cms/ → webentwicklung/website-mit-cms/index.html
✔ https://www.casoon.de/chatgpt-werbung/ → chatgpt-werbung/index.html
✔ https://www.casoon.de/existenzgruendung-webdesign-foerderung/ → existenzgruendung-webdesign-foerderung/index.html
✔ https://www.casoon.de/impressum/ → impressum/index.html
✔ https://www.casoon.de/kontakt/ → kontakt/index.html
✔ https://www.casoon.de/arbeitsweise/ → arbeitsweise/index.html
✔ https://www.casoon.de/tool-engineering/ → tool-engineering/index.html
✔ https://www.casoon.de/ → output/www.casoon.de

  Pages: 36   Failed: 0   Warnings: 0   Duration: 14s

CLI utility to mirror a website (HTML + CSS) into a local folder.

Usage: site-scraper [OPTIONS] <URL>
       site-scraper <COMMAND>

Commands:
  screenshot  Only take full-page screenshots of one URL or a list of URLs (requires Chrome)
  help        Print this message or the help of the given subcommand(s)

Arguments:
  <URL>
          URL to scrape

Options:
      --max-depth <MAX_DEPTH>
          Maximum crawl depth relative to the start page

      --concurrency <CONCURRENCY>
          Number of parallel downloads
          
          [default: 4]

      --delay-ms <DELAY_MS>
          Delay between requests in milliseconds
          
          [default: 300]

      --placeholder <PLACEHOLDER>
          Image placeholder strategy: "real" (download originals), "local" (gray PNG), or "external" (placehold.co)

      --sitemap
          Include sitemap.xml URLs as seeds (default)

      --no-sitemap
          Don't use sitemap.xml URLs as seeds

      --allow-external-assets
          Download external CSS/JS (default)

      --no-allow-external-assets
          Leave external CSS/JS as-is instead of downloading

      --bot
          Identify as bot/crawler instead of simulating a browser

      --headless
          Use a headless Chrome/Chromium browser to render JavaScript (requires Chrome installed)

      --screenshot
          Save a full-page screenshot for each crawled page (requires --headless)

      --user-agent <USER_AGENT>
          Custom User-Agent header

      --referer <REFERER>
          Custom Referer header

      --device <DEVICE>
          Viewport to render with (only used with --headless)

          Possible values:
          - desktop: 1440x900 (default)
          - tablet:  768x1024
          - mobile:  375x812 with mobile emulation (scale factor, touch, mobile user agent)
          
          [default: desktop]

      --timeout <TIMEOUT>
          Seconds to wait for browser navigation before failing (only used with --headless)
          
          [default: 60]

  -h, --help
          Print help (see a summary with '-h')

  -V, --version
          Print version

Only take full-page screenshots of one URL or a list of URLs (requires Chrome)

Usage: site-scraper screenshot [OPTIONS] [URL]

Arguments:
  [URL]
          URL to screenshot

Options:
      --file <FILE>
          Text file with one URL per line (blank lines and # comments are ignored)

      --output <OUTPUT>
          Output directory (existing screenshots are kept)
          
          [default: screenshots]

      --concurrency <CONCURRENCY>
          Number of parallel browser pages
          
          [default: 2]

      --device <DEVICE>
          Viewport to render with

          Possible values:
          - desktop: 1440x900 (default)
          - tablet:  768x1024
          - mobile:  375x812 with mobile emulation (scale factor, touch, mobile user agent)
          
          [default: desktop]

      --timeout <TIMEOUT>
          Seconds to wait for browser navigation before failing
          
          [default: 60]

  -h, --help
          Print help (see a summary with '-h')

[FAIL] Invalid URL provided