Bulk extraction for the whole state

[Kritika_Dhawale]

Hi everyone,
To extract statewide data, would it be more optimized (in terms of time) and cost-effective to proceed in batches lets say: zipcode-wise OR by selecting one category (of 19) at a time and create multiple tasks.

I am just worried about the amount of data and time it will take to execute the task if all the categories and the entire state is selected at once.

Thanks,
Kritz

[vlad]

hi @Kritika_Dhawale,

This is a good idea, but Google Maps results are limited to 400-500. Therefore to get all the data it’s recommended to use zip codes. Although it will take more time, this is the only way to ensure you will get all the places.

Here is an article about it: How to Scrape Densely Populated Areas and Categories From Google Maps? | Outscraper

[Kritika_Dhawale]

Hi @vlad
Thanks for the response.
The 400-500 limit is for “Places per one query search” - what is one query search here? Does that mean if I select “liverpool” and all postcodes for liverpool with one category - It would be counted as one query or 4 separate queries? (See attached)

Similarly if I have more than 1 category (lets say 2) selected - will that be 8 queries or just one?

Thanks

[vlad]

@Kritika_Dhawale query search is a single search term that will be used on Google, for example, “doctor, 10001, New York, NY, US” (it contains one category + one location):

Before starting the task you will see how many queries are to be created:

[Kritika_Dhawale]

Awesome, appreciate your effort.
Thanks and have a good day!

[vlad]

you are most welcome!