tokenize

Hi I'm trying to write a class that transfers some text into well defined tokens. The strings are somewhat similar to code like: (brown) "fox" 'c'; . What I would like to get is (either a token from Scanner or an array after slitting I think both would work just fine) ( , brown , ) , "fox" , 'c' , ; separately (as they are potential tokens) which include: quoted text with ' and " number with or without a decimal point parenthesis, braces , semicolon , equals, sharp, ||,<=,&& Currently I'm doing it with a Scanner, I've had some problems with the delimiter not being able to give me () etc.

I'm working on an end-of-semester project for a Programming languages course. The assignment is given below. I'm finishing writing it in Java and I'm having a lot of trouble writing in Prolog. I've been having a lot of trouble with Prolog so this question is as much looking for help with the assignment as it is trying to understand Prolog more. Any help that I can get would be GREATLY appreciated A sentence contains words, all occurring in a dictionary, that happen to be concatenated without white spaces as separators. Describe a solution that produces all possible answers, compatible with a

How can I insert a char acter into a string exactly after 1 character? I need to insert '|' into the string after every other character. In other words (C++): "Tokens all around!" Turns into: "T|o|k|e|n|s| |a|l|l| |a|r|o|u|n|d|!" (no thats not an array) Thanks std::string tokenize(const std::string& s) { if (!s.size()) { return ""; } std::stringstream ss; ss << s[0]; for (int i = 1; i < s.size(); i++) { ss << '|' << s[i]; } return ss.str(); } Jerry Coffin I think I'd use a standard algorithm and iterator: std::string add_seps(std::string const &input, std::string sep="|") { std::ostringstream

There are many places in my application where I need to generate links with unique tokens (foo.com/g6Ce7sDygw or whatever). Each link may be associated with some session data and would take the user to some specific controller/action. Does anyone know of a gem/plugin that does this? It's easy enough to implement, but would be cleaner without having to write it from scratch for each app. I needed the same think, you need and I implemented it by myself. I don't know about any plugin that does what you want. As you wrote, implementing it is not so difficult. Here is my solution: Since I didn't