
Template of HigherEdjobs Job listings Scraper-2025-11-27
Detail
Parameter Configuration Guide
Page_limit (Page Limit)
Purpose: Set the number of pages to extract
Use Case: Used in conjunction with Loop functionality to define when to exit the loop after reaching a specific page
Configuration Example:
page_limit: page 3
Loop Exit Condition: Stop after reaching page 3
Important Notes:
- Exit the loop when reaching page 3
- Actually completes data collection for 2 pages
- The exit condition is "reaching" the specified page, not "completing" that page
Looplist (Maximum Item Focus Count)
Purpose: Set the maximum number of items to focus on (visit) in the loop
Use Case: Used to control the number of data items extracted on a single page
Configuration Principle:
Must be set according to the actual number of items on the page
Configuration Example:
Actual page item count: 25 items
Looplist setting: ≥ 25
Important Notes:
- Maximum item focus count must be ≥ actual page item count
- Only when this condition is met can all data on the current page be collected
- If the setting value is less than the actual item count, some data will not be collected

