Web Scraper Tool
The Web Scraper Tool allows users to scrape data from a specified URL.
Steps to Use the Web Scraper Tool
Step 1: Access the Tool
- Click on
Add User Step
. - From the available options, select the
Web Scraper
Tool.
Step 2: Input the URL
You need to provide the URL of the webpage you want to scrape. You have two options for entering the URL:
- Manual Entry: Type the URL of the webpage directly into the input field.
- User Input Variable: Use a user input variable to dynamically provide the URL. To use input variables within your web scraper, use the syntax
{{variable_name}}
to access the value of an input variable. For example, if there is an input parameter named “webpageURL”, you can access its value using{{webpageURL}}
.
Step 3: Configure Guardrails Validators (Optional)
You can set up guardrails validators to ensure the scraped data meets certain criteria. Set up validators based on your specific needs. This may include rules for filtering out irrelevant data, ensuring data quality, or other criteria.