Introduction

Design and implement a multithreaded or asynchronous web crawler program that can crawl all web links under the same host starting from a specified URL.

A Blocking Solution

Let’s put aside the topics of efficiency and scalability, focus on the MVP that works. Given a starter url, we will use request …