The scraping blog

A collection of resources to help you enhance your web-scraping skills. From product updates to articles, guides and tools to level-up your web scraping.

  • Published on

    Discord Web is the browser-based version of the popular communication platform. It allows users to access their Discord servers and chats directly from a web browser without needing to download and install the desktop application. This version is particularly useful for users who are on-the-go or using devices where installing apps is not feasible.

  • Published on

    Data aggregation is the process of collecting and summarizing data from multiple sources to provide a comprehensive view. By combining different data points, businesses can gain a holistic understanding that informs strategic decision-making. Whether it’s customer feedback, market trends, or internal metrics, aggregated data is the key to seeing the bigger picture.

  • Published on

    CSV is a straightforward, text-based format that represents data in a tabular form, where each line corresponds to a row, and fields are separated by commas. It's commonly used for spreadsheets and databases. While JSON is a more flexible format, primarily used for transmitting data between a server and a web application. It supports complex data structures with nested elements, making it ideal for APIs.

  • Published on

    To start, open the TikTok app and tap the magnifying glass icon at the bottom. This will take you to the search page where you can enter keywords, hashtags, or specific phrases. TikTok will display a range of results, including videos, users, sounds, and hashtags relevant to your search.

  • Published on

    cURL is a powerful command-line tool that allows you to transfer data to or from a server with ease. Whether you need to download files or automate large batches, cURL can help. This guide will take you through various methods for downloading files using cURL, with practical examples.

  • Published on

    PerimeterX is a security solution that protects websites and mobile applications from automated threats, including bots, fraud, and scraping activities. It analyzes traffic patterns and uses machine learning to distinguish between human users and potentially harmful bots.

  • Published on

    Proxy SwitchyOmega is a powerful tool for managing and switching between proxies quickly. If you're already familiar with the basics, you might wonder how to make the most of this versatile extension. In this article, we’ll dive into some advanced tips and tricks that can help you optimize your experience with Proxy SwitchyOmega, and how combining it with MrScraper can supercharge your web scraping efforts.

Community & Support

Head over to our community where you can engage with us and our community directly.

Questions? Ask our team via live chat 24/5 or just poke us on our official Twitter or our founder. We’re always happy to help.

Help center →
avatar

John Madrak

Founder, Waddling Technology

We're able to quickly and painlessly create automated
scrapers across a variety of sites without worrying about
getting blocked (loading JS, rotating proxies, etc.),
scheduling, or scaling up when we want more data
- all we need to do is open the site that we want to
scrape in devtools, find the elements that we want to
extract, and MrScraper takes care of the rest! Plus, since
MrScraper's pricing is based on the size of the data that
we're extracting it's quite cheap in comparison to most
other services. I definitely recommend checking out
MrScraper if you want to take the complexity
out of scraping.

avatar

Kim Moser

Computer consultant

Now that I've finally set-up and tested my first scraper,
I'm really impressed. It was much easier to set up than I
would have guessed, and specifying a selector made it
dead simple. Results worked out of the box, on a site
that is super touch about being scraped.

avatar

John

MrScraper User

I actually never expected us to be making this many
requests per month but MrScraper is so easy that we've
been increasing the amount of data we're collecting -
I have a few more scrapers that I need to add soon.
You're truly building a great product.

avatar

Ben

Russel

If you're needing a webscaper, for your latest project,
you can't go far wrong with MrScraper. Really clean,
intuitive UI. Easy to create queries. Great support.
Free option, for small jobs. Subscriptions for
larger volumes.

avatar

John Madrak

Founder, Waddling Technology

We're able to quickly and painlessly create automated
scrapers across a variety of sites without worrying about
getting blocked (loading JS, rotating proxies, etc.),
scheduling, or scaling up when we want more data
- all we need to do is open the site that we want to
scrape in devtools, find the elements that we want to
extract, and MrScraper takes care of the rest! Plus, since
MrScraper's pricing is based on the size of the data that
we're extracting it's quite cheap in comparison to most
other services. I definitely recommend checking out
MrScraper if you want to take the complexity
out of scraping.

avatar

Kim Moser

Computer consultant

Now that I've finally set-up and tested my first scraper,
I'm really impressed. It was much easier to set up than I
would have guessed, and specifying a selector made it
dead simple. Results worked out of the box, on a site
that is super touch about being scraped.

avatar

John

MrScraper User

I actually never expected us to be making this many
requests per month but MrScraper is so easy that we've
been increasing the amount of data we're collecting -
I have a few more scrapers that I need to add soon.
You're truly building a great product.

avatar

Ben

Russel

If you're needing a webscaper, for your latest project,
you can't go far wrong with MrScraper. Really clean,
intuitive UI. Easy to create queries. Great support.
Free option, for small jobs. Subscriptions for
larger volumes.