tokens
tokens — returns the tokens of a character string.
Calling sequence
T=tokens(str [,delimiter])
Parameters
| str | : a character string. The string where to search the tokens. |
| delimiter | : (optional) a character or a vector of characters. The tokens delimeters. |
| T | : column vector of found tokens |
Description
T=tokens(str [,delimiter]) searches the tokens included in the
string str. The delimiter default value is [" ",<Tab>]
where <Tab> stands for ascii(9).
Examples
tokens('This is a character string')
tokens('SCI/demos/scicos','/')
tokens('y=a+b*2',['=','+','*'])
See also
strindex, tokenpos
