@YounesGa To have each thread use only 1 line, set the value "max success usage: 1", "max number of simultaneous use: 1".
This is equivalent to the fact that after the flow finishes running with a result of Success, the already used proxy line will not be used again, whereas if there is an error, it will be reused 999999999 times and only one line. for each stream
290a12f6-98cf-4378-9d4c-72a246339adb-image.png
Dealing with huge text files in multithreads
-
im using multithreaded bot of around 200 threads, no issue at all, but the longer the script runs the bigger the text files become. eventually bas becomes unresponsive because 200 threads loads a huge text file of about 30k+ lines.
Each thread writes to this file as it needs to be updated by every threads and also read in every file. Right now I read the text file to a list, and checks if the list contains the same string.
How can I do this to offload the computation required? High amount of threads is required, each thread will write to it and each thread needs an updated resource/list of this.
I was looking for a "Global list" so I dont have to read/write every thread but no such options.
-
@0xSentinel you can use resources. access to file lines sharing.
