Not sure how many languages have a class like this, but it's in java. A token is basically a chunk, or substring, of a string. Right now, it only handles single character delimiters. nextToken$() is an iterative function. So everytime you call it, it'll give the next token from the string.

This is one area that DBPro falls down. It really does need some of the basic string comands that virtually every other language has. There are some plugins around that do this sort of stuff but in my opinion they should be built-in.