Detailed Progress Information

[lsg551]

Description

Right now (with the latest version being v0.6.1), each command shows a little animated progress spinner indicating the elapsed time.

⠙ Scraping... 0:03:05

This is sufficient for most commands, because they resolve before humans can even really notice them. But for other commands, such as parish fetch, which potentially allows to scrape the entire Matricula, more and detailed information would be helpful:

• multiple progress bars for
  • scheduled requests / completed requests
  • exported items
  • maybe a counter for failed items
• calculated ETA
• throttling status (see Check throttling status #80)
• bytes downloaded / written to disk
• estimation of complete disk usage after the scrape
• system stats
  • memory usage
  • CPU usage
  • network usage
• Summary with detailed stats reported by the closing log message with scraped items, failed items, bytes downloaded and written to disk, time spent etc.

Perhaps add -p,--show-progress to only show detailed information such as memory or network usage when the user specified to do so.