Bablosoft

Search the whole of database table for a string

Support

  • H

    How to delete CR in a string

    Support
    0 Votes
    2 Posts
    456 Views
    H

    Hello
    Sorry to waste your precious time.
    As i always said, im just an old retarded man.
    I just discovered now on "String" function that i can use the Clean to solve my problem.
    Thanks anyway

  • H

    How to ? database to delete the same records

    Support
    0 Votes
    2 Posts
    572 Views
    H

    @Fox @Administrator

  • Y

    syncing databases folder with cloud

    Support
    0 Votes
    1 Posts
    482 Views
    No one has replied
  • Y

    solution for massive database data check other than select db by criteria (high I/O)?

    Support
    0 Votes
    2 Posts
    1017 Views
    AllisterA

    @yourfriendkarol said in solution for massive database data check other than select db by criteria (high I/O)?:

    What I do is:

    get some data select by criteria db action, it gives u list if length of that list > 0 it means record is in db already - continue. If its not there, then it adds.

    its good way to do it but i think with many threads my I/O is on max and it gets kinda slow, but maybe im wrong and its something else slowing me.
    i basically have such thing as i described above running 24/7 and cant speed it up for some reason nomatter how many threads I add.

    CPU, memory, disk, is all ok on low usage, only I/O high

    This all depends, is the data within the table long/a lot? 1million + with a high character rate?
    Have you tried other Database actions and/or filters to minimize the search criteria?
    Would an external MongoDB you set-up & configure yourself might change the I/O bottleneck?
    External DB: http://wiki.bablosoft.com/doku.php?id=how_to_setup_mongodb_server

  • M

    How to Avoid Duplicates in Database?

    Support
    1 Votes
    7 Posts
    2344 Views
    BAS Viet NamB

    There are many ways to handle this issue. I'll show you one way.

    For a news website, it's almost impossible for recently added articles to have 100% identical content. Therefore, you just need to compare the latest data added to your database with the data you're checking. If they are 100% identical, then the data has already been added, so you can skip it and check the next piece of data using the same process.

    So, for your request, you can convert the database to a list format, then retrieve the last element corresponding to the latest data added (or you can retrieve the latest data directly from the database if you know how to work with databases). Use Parse CSV string to parse the string into article title and content.

    You can compare the title of the latest article with the title you're checking. If they are 100% identical, then it has already been added to the database. If you want to be more certain, you can also compare the content (although this may not be necessary).

    I hope you understand what I'm saying.