Main Page | Namespace List | Class Hierarchy | Alphabetical List | Class List | Directories | File List | Class Members | File Members

tokenizer.cc File Reference

#include <locale>
#include <sstream>
#include <fstream>
#include <string>
#include "tokenizer.h"
#include "util.h"
#include "traces.h"

Include dependency graph for tokenizer.cc:


Defines

#define MOD_TRACENAME   "TOKENIZER"
#define MOD_TRACECODE   TOKEN_TRACE

Define Documentation

#define MOD_TRACECODE   TOKEN_TRACE
 

#define MOD_TRACENAME   "TOKENIZER"
 


Generated on Wed Apr 26 12:57:17 2006 for FreeLing by  doxygen 1.4.4