Website Imports

Bring a whole website into your knowledge in one pass. An import starts as a crawl you watch working page by page, and nothing is stored until you have chosen exactly what to keep.

At a glance

  • Every import in one table — source, kind, status and when
  • One setup card — address, collection, mode, limits, exclusions
  • Live counters for pages found, read and imported
  • A select step that offers every page, with the refused listed apart
Website Imports

The imports table

Each import is one row — its source, its kind, its status, what was added and when — closed by a review chip. The tab is the running record of everything ever brought into the collection.

The setup card

One card starts a crawl: the address, the collection it feeds, a mode to crawl in, the maximum pages to take and how pages are rendered for reading. The default exclusions sit collapsed beneath, an Exclude box takes your own patterns, and Start sets it going.

Watching and selecting

While the crawl runs, the root address wears a status badge and the counters track found, read and imported with a live dot and a progress bar; the same page keeps polling, so running flips into the select step with no reload. From there a checkbox list offers every page with the refused ones listed apart, or the activity log explains each one — status, HTTP code, word count, how it was read, its score and why it was left out. Confirm submits what you deselected, so the whole list loads before it is offered.

  1. Start the crawlFill the card — the address, the collection it feeds, the mode and a page limit — then press Start.
  2. Watch it workThe counters follow the crawl live — pages found, read and imported — and the state line holds Stop while it runs and Review and import once it is done.
  3. Choose and confirmTick the pages worth keeping — Keep all, Keep none and Reset speed the sweep — then Confirm imports your selection into the collection.

Good to know — No import rights, or no collection to import into, gets a plain explanation in place of the form — never a dead end without a reason.