fms string tokenizer / News: Recent posts

this is our first release, it is no where near complete, and it has some minor bugs. however, most of it works at this time. I currently believe that the benefits of working with a consistent string tokenizer across multiple languages out weigh the drawbacks of working with this project as it is at this time. In worst case, it will at least provide a building block upon which your own system may work.