@doupiu В любой базе есть понятие offset и limit это нужно чтобы не блокировать базу на долго, а в случае БАС еще и интерфейс может подвиснуть )
выскабливание 1000 различных сайтов отелей ?
-
Мне нужно, чтобы очистить 1000 гостиничных сайтов, чтобы узнать цены самого дешевого номер доступен на сайте.
Каждый сайт индивидуален, и вам нужна цена, чтобы сделать различные действия, каждый раз
Как эту операцию можно выполнить самым эффективным способом, без настройки каждого сайта вручную?
спасибо
-
@Dasium said in выскабливание 1000 различных сайтов отелей ?:
Мне нужно, чтобы очистить 1000 гостиничных сайтов, чтобы узнать цены самого дешевого номер доступен на сайте.
This time, the translator greatly distorted the meaning of this phrase.
@Dasium said in выскабливание 1000 различных сайтов отелей ?:
Каждый сайт индивидуален, и вам нужна цена, чтобы сделать различные действия, каждый раз
Как эту операцию можно выполнить самым эффективным способом, без настройки каждого сайта вручную?And how do you itself determine the price on the site? If all sites are different and there is nothing in common between them, then you will have to create logic for all sites manually.
-
To get the prices need to find where in page is the "price checker", input the dates and click search, sometimes get redirected to a new page before inputing dates.
maybe there is way to indentify which are the elements of the price checker, maybe by creating only 10 templates?
What do you suggest?
How would you do it? -
@Dasium said in выскабливание 1000 различных сайтов отелей ?:
To get the prices need to find where in page is the "price checker", input the dates and click search, sometimes get redirected to a new page before inputing dates.
maybe there is way to indentify which are the elements of the price checker, maybe by creating only 10 templates?
What do you suggest?
How would you do it?I wouldn't take this order
:DI have completed an order similar to this one, but with 3 sites. On the first site, I managed to get prices using technical queries, in the second by parsing the html page, in the third I do not remember what was already there. For each site, I wrote the logic myself, and if the site changed anything, then I had to change the logic of the script.
-
@Dasium said in выскабливание 1000 различных сайтов отелей ?:
@Fox i need to do it for myself
This raises the question of what you will spend more time on, creating a universal parser or creating accurate logic for each site. There are no simple solutions to this issue.
-
@Fox I guess it is not easy and price for universal parser could be higher than for 1000 websites.
-
@Antonio-Banderas said in выскабливание 1000 различных сайтов отелей ?:
@Fox I guess it is not easy and price for universal parser could be higher than for 1000 websites.
I have met entire services that parse different sites and allow you to compare prices. Do you understand?
If the sites used the same engine and only the site domain changed, then this could be done simply. -
@Fox said in выскабливание 1000 различных сайтов отелей ?:
@Antonio-Banderas said in выскабливание 1000 различных сайтов отелей ?:
@Fox I guess it is not easy and price for universal parser could be higher than for 1000 websites.
I have met entire services that parse different sites and allow you to compare prices. Do you understand?
If the sites used the same engine and only the site domain changed, then this could be done simply.What are these services?
-
@Dasium said in выскабливание 1000 различных сайтов отелей ?:
@Fox said in выскабливание 1000 различных сайтов отелей ?:
@Antonio-Banderas said in выскабливание 1000 различных сайтов отелей ?:
@Fox I guess it is not easy and price for universal parser could be higher than for 1000 websites.
I have met entire services that parse different sites and allow you to compare prices. Do you understand?
If the sites used the same engine and only the site domain changed, then this could be done simply.What are these services?
I have not worked with such a site for a long time, but I have met many such sites before. I think they are not difficult to find in Google.
