Bablosoft

Scrape all links

Support

  • S

    want to ask if you can scrape data using html with this

    Support
    0 Votes
    4 Posts
    784 Views
    BAS Viet NamB

    @stephenperry18 Copy and paste into BAS. Try checking it, see if this is the data you want to get.

    BAS:[{"name":"","code":"/*Dat:eyJzIjoiaHR0cGNsaWVudGdldCIsInYiOjEsImYiOltdLCJ1dyI6IjAiLCJ1dCI6IjAiLCJ1dG8iOiIwIiwidW0iOiIwIiwiZCI6W3siaWQiOiJWYWx1ZSIsInR5cGUiOiJjb25zdHIiLCJkYXRhIjoiaHR0cHM6XC9cL2FwaS5zb2xzY2FuLmlvXC92MlwvYWNjb3VudFwvdHJhbnNhY3Rpb24/YWRkcmVzcz00Q3ltQVRROGE5cUpVbUNoNXlnTkZDZVBOUVZnaUtHa29idmtpNWk0NUJpQiZsaW1pdD0xMCIsImNsYXNzIjoic3RyaW5nIn0seyJpZCI6Ik1ldGhvZCIsInR5cGUiOiJjb25zdHIiLCJkYXRhIjoiR0VUIiwiY2xhc3MiOiJzdHJpbmcifSx7ImlkIjoiQ2hlY2siLCJ0eXBlIjoiY2hlY2siLCJkYXRhIjpmYWxzZX0seyJpZCI6IkhlYWRlcnMiLCJ0eXBlIjoiY29uc3RyIiwiZGF0YSI6ImFjY2VwdDogYXBwbGljYXRpb25cL2pzb24sIHRleHRcL3BsYWluLCAqXC8qXG5hY2NlcHQtZW5jb2Rpbmc6IGd6aXAsIGRlZmxhdGVcbmFjY2VwdC1sYW5ndWFnZTogZW4tVVMsZW47cT0wLjlcbmNvb2tpZTogY2ZfY2xlYXJhbmNlPVZyZGNDSDI3cFg4WHRYUDU0NUw1WEhQbl91UlF5UTFRVF8yX2owaUg4UGstMTcxODY0NTY2MS0xLjAuMS4xLW8xak9MMlVlYnBleDZ0NndyMlZMMmRIby5DcVpUOHRjOEZDTTZIQTBzLjVFR0ZacXRVcDROWXR1azQ4Llk4d1gwV0I3dWNXLnRVTjhUNndCdTV6bE5ROyBfZ2E9R0ExLjEuMTE1ODM3MzAzMC4xNzE4NjQ1NjYyOyBfZ2FfUFMzVjdCN0tWMD1HUzEuMS4xNzE4NjQ1NjYyLjEuMS4xNzE4NjQ1NjYzLjAuMC4wXG5vcmlnaW46IGh0dHBzOlwvXC9zb2xzY2FuLmlvXG5wcmlvcml0eTogdT0xLCBpXG5yZWZlcmVyOiBodHRwczpcL1wvc29sc2Nhbi5pb1wvXG5zZWMtY2gtdWE6IFwiQ2hyb21pdW1cIjt2PVwiMTI1XCIsIFwiTm90LkFcL0JyYW5kXCI7dj1cIjI0XCJcbnNlYy1jaC11YS1tb2JpbGU6ID8wXG5zZWMtY2gtdWEtcGxhdGZvcm06IFwiV2luZG93c1wiXG5zZWMtZmV0Y2gtZGVzdDogZW1wdHlcbnNlYy1mZXRjaC1tb2RlOiBjb3JzXG5zZWMtZmV0Y2gtc2l0ZTogc2FtZS1zaXRlXG5zb2wtYXV0OiBsSFI2MFlMQ05lZS1COWRsczBmS1pRPUhVSFBia2g3YmhPPUJwR2Y9XG51c2VyLWFnZW50OiBNb3ppbGxhXC81LjAgKFdpbmRvd3MgTlQgMTAuMDsgV2luNjQ7IHg2NCkgQXBwbGVXZWJLaXRcLzUzNy4zNiAoS0hUTUwsIGxpa2UgR2Vja28pIENocm9tZVwvMTI1LjAuMC4wIFNhZmFyaVwvNTM3LjM2IiwiY2xhc3MiOiJzdHJpbmcifV19*/\n_switch_http_client_main()\nhttp_client_get_no_redirect2(\"https:\\/\\/api.solscan.io\\/v2\\/account\\/transaction?address=4CymATQ8a9qJUmCh5ygNFCePNQVgiKGkobvki5i45BiB&limit=10\",{method:(\"GET\"), headers:(\"accept: application\\/json, text\\/plain, *\\/*\\naccept-encoding: gzip, deflate\\naccept-language: en-US,en;q=0.9\\ncookie: cf_clearance=VrdcCH27pX8XtXP545L5XHPn_uRQyQ1QT_2_j0iH8Pk-1718645661-1.0.1.1-o1jOL2Uebpex6t6wr2VL2dHo.CqZT8tc8FCM6HA0s.5EGFZqtUp4NYtuk48.Y8wX0WB7ucW.tUN8T6wBu5zlNQ; _ga=GA1.1.1158373030.1718645662; _ga_PS3V7B7KV0=GS1.1.1718645662.1.1.1718645663.0.0.0\\norigin: https:\\/\\/solscan.io\\npriority: u=1, i\\nreferer: https:\\/\\/solscan.io\\/\\nsec-ch-ua: \\\"Chromium\\\";v=\\\"125\\\", \\\"Not.A\\/Brand\\\";v=\\\"24\\\"\\nsec-ch-ua-mobile: ?0\\nsec-ch-ua-platform: \\\"Windows\\\"\\nsec-fetch-dest: empty\\nsec-fetch-mode: cors\\nsec-fetch-site: same-site\\nsol-aut: lHR60YLCNee-B9dls0fKZQ=HUHPbkh7bhO=BpGf=\\nuser-agent: Mozilla\\/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit\\/537.36 (KHTML, like Gecko) Chrome\\/125.0.0.0 Safari\\/537.36\")})!","internal_label_id":"","dat_precomputed":null,"search_precomputed":null,"code_precomputed":null,"parentid":0,"id":302529376,"donotexecuteduringrecord":false,"is_selected":false,"color":"","is_fold":false,"fd":""}]
  • D

    Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User

    Support
    -1 Votes
    8 Posts
    1032 Views
    sergerdnS

    @dayyangee said in Twitter Data Scraping Issue: Unable to Retrieve Likes Beyond the 21st User:

    As you can see in this picture, I have added loop and also scrolled, but still, I am getting less data.

    I cannot see any logic in your picture that shows me that you scrolled before that loop to get the new data loaded.

    If you scrolled inside a loop while scraping data and assumed that you would obtain that data within the loop, this logic is incorrect because the HTML DOM has changed, and you need to restart the loop to retrieve the newly loaded data.

    You can not parse all data within one loop. You need to have at minimum 2 loops.

    While true(loop first) <==

    Scrape data with the Start Loop(loop second) from the last point or from the beginning if you are getting it for the first time. Scroll down or click to load new data.<==

    Alternatively, you can follow another approach:

    Scroll down to the end of the page and wait for all the data to load. Scrape the data with the Start Loop
  • P

    Get all links on a website

    Support
    0 Votes
    47 Posts
    3851 Views
    Roy MustangR

    @World_Art

    Create a global variable (for example, [[COUNT_CLICKS]]) in the onapplicationstart function

    Create an “if” action. In the if action, enter: [[GLOBAL:Your variable]] <= 2
    In the if action itself, you need to call the “Increase global variable” action. You should call it at the very end, when your software has executed all the click logic

    In the if statement itself, you need to call the “Increase global variable” action. You should call it at the very end when your software has executed all the click logic

  • andreiemA

    Scrape Google

    Support
    0 Votes
    1 Posts
    483 Views
    No one has replied
  • S

    please help i want to remove " character from text link

    Support
    0 Votes
    5 Posts
    849 Views
    S

    @GhostZ Many many thanks Friend this solve the issue. Thanks again.