Bablosoft

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

concurrent threads for http requests

Support

2 Posts 2 Posters 981 Views

R Offline

R Offline
rekaa0251
wrote on last edited by rekaa0251

#1

I'm trying to get scrape for proxies, heres what im trying to do:
Connect to link
Get Proxy
Apply proxy

I just need to make sure only 10 is started at the same time and not more.

between connect to link and apply proxy i need to make sure the number of concurrent threads never gets higher than 10. How would i accomplish this?
1 Reply Last reply
0
F Offline

F Offline
Fox Bablosoft Team
wrote on last edited by

#2

@rekaa0251 Use the resource "LinesFromUrl" and set the number of threads to 10
1 Reply Last reply
0

T

automatically redirects http to https
Scheduled Pinned Locked Moved Support

0 Votes

4 Posts

636 Views

M

The problem occurs e.g. on http://ip-api.com/json
The site automatically redirects from http to https.
But the way how the OP posted it seems to work.
B

How to Wait Each Thread?
Scheduled Pinned Locked Moved Support

0 Votes

2 Posts

624 Views

E

@bennettjimmy63 its pretty simple just after Initialize just go on
Script statics - Thread number OK
then
Waiters - Sleep - [[THREAD_INDEX]]*(time to wait ms)
A

If script have an error 3 times than end the thread
Scheduled Pinned Locked Moved Support

0 Votes

5 Posts

1201 Views

A

@GaG said in If script have an error 3 times than end the thread:

Create a variable called "counter". Than use "is element exist" to check if element exist and update "counter" variable whenever element is missing. Check counter variable in the loop, and fail thread if "counter" hit 3

Got it. Thanks
T

How to keep track of Successfully executed threads
Scheduled Pinned Locked Moved Support

0 Votes

8 Posts

2231 Views

T

thanks at @Allister for the work around which helps me out to continue developing my script?
@Fox the success number action should be able to track number of successful threads irrespective of were the action is being used in the main function or when call function in several threads action is used.
A

HTTP POST getting stuck
Scheduled Pinned Locked Moved Support http http post http frozen http stuck

0 Votes

7 Posts

3308 Views

A

@support
face palm I feel like an idiot now. I had it setting the host because it was returning Method not Accepted error. I looked at the traffic again and figured it's the URL of the post/get's changing them, used the correct Host. Thank You, you rock.