300x250 AD TOP

Search This Blog

Pages

Paling Dilihat

  • RISC-V Linux on ESP32
    RISC-V Linux on ESP32
    I've been playing with the idea of running linux on ESP32 since the first days I've met its more robust module, the WROVER-B, on pap...
  • LVGL ESP32 and Desktop Development Walkthrough
    LVGL ESP32 and Desktop Development Walkthrough
    UI for Embedded is always a hassle, find the right MCU, find the right Display, connect the right wires and that's even before writing t...
  • Embedding QuickJS in your Projects
    Embedding QuickJS in your Projects
    QuickJS is small and embeddable Javascript engine made by the famous Fabrice Bellard , it supports ES2020 specifications and made available...
  • Unit Testing with ESP32 and PlatformIO
    Unit Testing with ESP32 and PlatformIO
    Writing Quality Code and Tests usually goes hand in hand, some find it more productive to write code and then write tests for it and others,...
  • Using the ILI9488
    Using the ILI9488
    The ILITEK ILI9488 is one of the larger and cheaper SPI displays available to the maker community,, available in 3.5" and 4". How...
  • A Million Times
    A Million Times
    A while ago someone at work approached me with an idea to build a replica of  " A Million Times " by Humans Since 1982 , while the...
  • ESP32 SD Card Optimization
    ESP32 SD Card Optimization
     Reading and writing SD Cards with ESP32 should be simple, however, the amount of moving parts in esp-idf makes that a complicated task, fir...
  • ESP32 Performance Profiling
    ESP32 Performance Profiling
    The ESP32 is very capable but even the most capable of devices can get overwhelmed when using it extensively, so how can we find out what is...
  • PlatformIO Static Code Analysis
    PlatformIO Static Code Analysis
    Source Writing code and testing it with unit and integration tests can provide high quality executable, however, it does not indicate if its...
  • ESP32 as Professional Grade/Industry 4.0 Device
    ESP32 as Professional Grade/Industry 4.0 Device
    According to Forbes, IoT is a $264 Billion market while Industry 4.0 will be $152 billion by 2022 , these predictions can lead us to believ...
Powered by Blogger.
View Dror Gluska's LinkedIn profileView Dror Gluska's profile

Monday, August 2, 2010

Multiple Keyword Search

Some time ago I needed to do a huge data mining project, one of the tasks was getting keyword lists from multiple documents, my initial implementation was multiple IndexOf but my boss demanded near realtime and with the amount of data passing through the program, even a multi-core machine wasn't enough.


I've started digging and found this little algorithm called Aho-Corasick, its a nice algorithm that finds multiple keywords in a document.


Immediately after, I've found out that Tomas Petricek already implemented it in C# and the performance was better than the requirements, allowing for expansion.


So thanks Tomas!



Taken from CodeProject







Read More
Tags:
Dror Gluska August 02, 2010  No comment
Subscribe to: Posts (Atom)