This is a Lexical Analyzer (Scanner) designed for a subset of a programming language, developed as part of a Compiler Project for Dr. Hokmi's course. Tokens File: Each token (lexeme) and its type are ...
A toolset for Amharic Language pre-processing. Includes an Amharic Stemmer, Transliterator, Stopword remover , Lexical analyzer, Corpus indexer and Term weighter.