Bablosoft

Deleting the database while other threads are active

Support
  • P

    I use BAS (Browser Automation Studio) to develop a tool for scanning news articles on various online news websites. The tool runs 10 - 15 threads simultaneously, with each thread dedicated to a specific news website. During operation, I save the scanned links into a database to prevent re-scanning of old content.

    I plan to implement an additional function that automatically deletes the entire database at midnight to optimize its performance. However, I have the following concerns:

    1. Considering that the tool operates with multiple threads, if one thread attempts to delete the entire database while other threads are actively saving data into it, could the tool encounter errors or issues?

    2. How can I ensure that only one thread remains active at midnight to perform the database deletion process?

    0
  • I
    This post is deleted!
    0

  • junawanJ

    How do I delete the Line in the Element if it Errors and then repeat to create a new List?

    Support
    0 Votes
    1 Posts
    434 Views
    No one has replied
  • B

    how to parse list from database

    Support
    0 Votes
    1 Posts
    413 Views
    No one has replied
  • R

    concurrent threads for http requests

    Support
    0 Votes
    2 Posts
    917 Views
    FoxF

    @rekaa0251 Use the resource "LinesFromUrl" and set the number of threads to 10

  • O

    Threads and passwords

    Support
    0 Votes
    3 Posts
    1353 Views
    KiMoOK

    @omgusck47 are u parsing the string or just getting 'em from a file( i mean the username's and password's are 2 separated files's?

  • C

    Is this correct usage of linesfromfile, labels and threads?

    Support
    0 Votes
    3 Posts
    2072 Views
    supportS

    @caplaz

    Is that the correct method?

    Yes, this will work.

    Can I write to the csv file?

    Yes, there is action called Write File(which also has append switch).

    Can also use csv_generate api for proper escaping.

    Action "Custom" and

    [[CSV_LINE]] = csv_generate(["a","b","c"],",")

    Or should that be done in a seperate file?

    Better use database, not csv

    I want my threads to loop forever but no matter what I do they eventually end. Sometimes with success and sometimes with error.

    If you have any failure during thread run, for eaxmple failed to load with proxy error, the thread will end. And as long as you set "use each line one time" to resource, it won't be used again.

    Ending with success is strange, probably, because you are using labels inside loops, 20 version has good explanation about this:

    There are two types of goto: long and short. Short move is performed if goto and label are located inside same block (has one parent). This type of move preserves execution history and script continues afterward. In other cases long move is performed, which clears execution history. Long move case is perfect if you are jumping on script start, but if you move inside loop, you must use another move to leave it, otherwise thread will stop with success message.

    Anyway, if you have some code, that may return error, just wrap it inside ignore errors action.
    You can also wrap whole list of actions that you want to do with account inside ignore errors block.
    Like this

    0_1500075786806_listfromfile-loop.xml