Articles tagged with Developers
Guides on browser automation and reducing repetitive work
Master XPath: How to Use contains() and contains(text()) to Find Elements
Want to find elements more effectively when automating web tasks or scraping data? Master XPath with the powerful contains() and contains(text()) functions! Whether you're dealing with dynamic IDs or partial text matches, this guide has you covered!
Is Web Scraping Legal? 5 Best Practices for Ethical Web Scraping in 2024
Learn the best practices for legal and ethical web scraping in 2024. This guide outlines 5 essential practices to help you stay compliant with privacy laws like GDPR and CFAA while scraping data from websites.
Top 6 AI Web Scrapers of 2024 (Our Honest Review)
AI is transforming data scraping! In this article, we share our 6 favorite AI web scrapers for 2024, along with a detailed breakdown of their features and our honest opinions on each.
How to Create a Scheduled Serverless Service with AWS Lambda and EventBridge
The combination of AWS Lambda and EventBridge enables you to automate tasks with minimal overhead, making it a popular choice for developers who want to focus on building features rather than managing infrastructure. In this article, we'll learn how to set up one!
10 Must-Have Chrome Extensions for Developers in 2024
Boost your productivity with these 10 essential Chrome extensions for developers! Discover how these tools can streamline your workflow and make your life easier.
The Ultimate Guide to Web Scraping for Beginners: 10 Tips for Efficient Data Extraction
In this article, we'll cover the basics of web scraping and share tips to help you improve your data extraction process. No matter if you're just starting or looking to improve your web scraping skills, you'll find practical tips to make your web scraping more efficient.
How to Use Puppeteer in AWS Lambda for Web Scraping via Serverless
In this article, we’ll explore how AWS Lambda’s serverless architecture can simplify the deployment of your Puppeteer tasks and walk you through the process of setting up Puppeteer in AWS Lambda using the Serverless framework.
How to Scrape Lists of URLs from a Web Page Using Roborabbit
Discover how to efficiently scrape URLs from websites for analyzing a site's linking structure, uncovering potential backlink opportunities, validating links, etc. using Roborabbit in this article.
How to Use a Proxy in cURL
cURL, known for its simplicity and versatility, is a preferred tool for API testing, web automation, and web scraping. In this article, we’ll learn how to use cURL with a proxy, to facilitate tasks that require enhanced privacy and security, bypass geo-restrictions, or route requests.
Follow the Journey
Sign up for our once a fortnight newsletter update on new Roborabbit features and our business journey