Bablosoft

Extract parsed data to CSV file

Support

  • R

    Can't select load from file, user input, database (F7)

    Moved Support
    0 Votes
    9 Posts
    936 Views
    m4zuperM

    @romit
    I can't repeat it either. Maybe you could attach a project with such a problem?

  • D

    Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User

    Support
    -1 Votes
    8 Posts
    900 Views
    sergerdnS

    @dayyangee said in Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User:

    As you can see in this picture, I have added loop and also scrolled, but still, I am getting less data.

    I cannot see any logic in your picture that shows me that you scrolled before that loop to get the new data loaded.

    If you scrolled inside a loop while scraping data and assumed that you would obtain that data within the loop, this logic is incorrect because the HTML DOM has changed, and you need to restart the loop to retrieve the newly loaded data.

    You can not parse all data within one loop. You need to have at minimum 2 loops.

    While true(loop first) <==

    Scrape data with the Start Loop(loop second) from the last point or from the beginning if you are getting it for the first time. Scroll down or click to load new data.<==

    Alternatively, you can follow another approach:

    Scroll down to the end of the page and wait for all the data to load. Scrape the data with the Start Loop
  • hellomembershaH

    Parse fingerprint

    Support
    0 Votes
    1 Posts
    355 Views
    No one has replied
  • R

    Newbie Question: Correlated Data, Correlated Elements, Combined AddNewRow

    Support
    0 Votes
    2 Posts
    511 Views
    O

    About Ajax modal window - not sure how to do that.
    About other question (write all data to file or database).

    There are few functions made for that purpose, inside Foreach function there is special function called [[FOREACH_DATA]] (look in the description of the function) and, you can manipuliate it for Filesystem -> Write to File (https://prnt.sc/17z1wsu), you will need to set new resource at the start of the script and use that resource as the file you are writing to, then you can use this file and manipulate it as you wish with variables to save to Database.

    If you are using Multi-threaded script, you will need to use Global Variable so other threads won't override your current Thread.

  • nicckN

    Import csv in database not working

    Support
    1 Votes
    5 Posts
    2087 Views
    nicckN

    @andrwork Thanks a lot friend, it worked :)