Articles on: All

Web Scrapping Sample Assignment

Taiyo Scraping Challenge


Your task is to implement scraping function that outlines the logic required to extract project data from the provided website below:


http://www.adb.org/projects


Extract project data from the main projects listing page as well as from each individual project’s detail page. You would fetch the main listing, identify and parse each project entry, follow the links to the corresponding project pages, and extract any additional details from those pages.


Important:

  1. You are not required to actually perform the web scraping or fetch live data.
  2. Instead, focus on demonstrating how you would structure the scraping logic.
  3. You are expected to inspect the actual source pages and write actual scraping and HTML parsing logic, rather than providing placeholders or high-level descriptions.


Evaluation parameters:

  1. Parsing the HTML to locate and extract relevant project information as on the source (e.g., project title, description, country, etc. available attributes on the source).
  2. Structure of the extracted data
  3. How you would handle edge cases, such as:
  4. Missing fields
  5. Pagination
  6. Failed or invalid responses
  7. Design of function for maintainability and clarity


Updated on: 17/12/2025