Bablosoft

Reduce data usage

Support

  • T

    Stupid problem All data have been processed

    Support
    0 Votes
    7 Posts
    847 Views
    T

    @Huntenkill working thankyou for help

  • D

    Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User

    Support
    -1 Votes
    8 Posts
    1108 Views
    sergerdnS

    @dayyangee said in Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User:

    As you can see in this picture, I have added loop and also scrolled, but still, I am getting less data.

    I cannot see any logic in your picture that shows me that you scrolled before that loop to get the new data loaded.

    If you scrolled inside a loop while scraping data and assumed that you would obtain that data within the loop, this logic is incorrect because the HTML DOM has changed, and you need to restart the loop to retrieve the newly loaded data.

    You can not parse all data within one loop. You need to have at minimum 2 loops.

    While true(loop first) <==

    Scrape data with the Start Loop(loop second) from the last point or from the beginning if you are getting it for the first time. Scroll down or click to load new data.<==

    Alternatively, you can follow another approach:

    Scroll down to the end of the page and wait for all the data to load. Scrape the data with the Start Loop
  • R

    Newbie Question: Correlated Data, Correlated Elements, Combined AddNewRow

    Support
    0 Votes
    2 Posts
    593 Views
    O

    About Ajax modal window - not sure how to do that.
    About other question (write all data to file or database).

    There are few functions made for that purpose, inside Foreach function there is special function called [[FOREACH_DATA]] (look in the description of the function) and, you can manipuliate it for Filesystem -> Write to File (https://prnt.sc/17z1wsu), you will need to set new resource at the start of the script and use that resource as the file you are writing to, then you can use this file and manipulate it as you wish with variables to save to Database.

    If you are using Multi-threaded script, you will need to use Global Variable so other threads won't override your current Thread.

  • nicckN

    How can i get image data as base64 ?

    Support
    0 Votes
    6 Posts
    1650 Views
    B

    @Fox said in How can i get image data as base64 ?:

    @basmail said in How can i get image data as base64 ?:

    Its just empty for me, what am I doing wrong? The image parth is correct, checked it a few times.

    Best regards!

    What are you trying to do? If you need to read a file in base64, use the "Read File" action with the "Save In Base64 Format" option enabled

    6e63c432-b4d3-4451-b316-4fb1d2952b8d-ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅.png

    lol ok, I didn't know that.
    Thanks for the answer anyways, I have now solved it with an easy API ^^

    Best regards!

  • A

    Help - How to scrape data from Multiple New Email - from same sender address

    Support
    0 Votes
    1 Posts
    1111 Views
    No one has replied