Lexical

Generator of extremely fast lexical analysers. Sophisticated input/buffer management. Many character encodings (incl. ASCII, UTF8, UTF16, RUSCII, ...) are directly supported. Regular expressions are specified in the lex/flex style. Platforms: Windows, Mac, Solaris, Linux

B::LexInfo is a Perl module that shows information about subroutine lexical variables. SYNOPSIS use B::ShowLex (); my $lexi = B::ShowLex->new; Perl stores lexical variable names and values inside a padlist within the subroutine. Certain lexicals will maintain certain attributes after the... Platforms: *nix

A lexical analyzer is a program that transforms a stream of characters into a stream of 'atomic chunks of meaning', as shown in the figure below:As a result of the lexical analysis process the list of 'atomic chunks of meaning', so called 'tokens', prepare the interpretation on some higher level.... Platforms: Windows, Mac, *nix, C/C++, BSD Solaris

Hardware::Vhdl::Lexer is a Perl module that can split VHDL code into lexical tokens. SYNOPSIS use Hardware::Vhdl::Lexer; # Open the file to get the VHDL code from my $fh; open $fh, <, device_behav.vhd || die $! # Create the Lexer object my $lexer = Hardware::Vhdl::Lexer->new({... Platforms: *nix

JetPAG is full-LL(k) optimizing parser and lexical analyzer generator. It is focused on high usability, efficiency and readability of generated code. JetPAG performs full L(k) analysis and tails is with powerful optimizations resulting a grammatically powerfull, resource-efficient and fast... Platforms: *nix

Flex is a Fast Lexical Analyzer. Flex is a fast lexical analyzer generator. It is a tool for generating programs that perform pattern-matching on text. Flex is a non-GNU free implementation of the well known Lex program. Flex is a tool for generating scanners: programs which recognized... Platforms: *nix

IGETIT is a handy, agent-based situated language learning simulation designed to focus on lexical learning and grounding, featuring a unigram syntax structure and a CFG-based semantic grammar. Created as a MSc thesis project, using Python. for WindowsNT, 2K, XP, 2003, Vista, 7 Platforms: Windows, 2K, XP, 2003, Windows Vista, 7

JFlex is a lexical analyzer generator (also known as scanner generator) for Java(tm), written in Java(tm). JFlex is designed to work together with the LALR parser generator CUP. It can also be used together with other parser generators like ANTLR or as a standalone tool. Features: - Faster... Platforms: Windows, *nix, Java, BSD Solaris

Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition. Platforms: Windows, Mac, Linux

JetPAG is a recursive-descent parser and lexical analyzer generator.It generates optimized recursive-descent recognizers with multi-token lookahead. In short this means that parsers generated by JetPAG scan input stream left-to-right, and predict what to do next before taking actions.Features -... Platforms: Windows, *nix, C/C++,

Arabic MySQL Query can be used to build MySQL SQL query conditions to search for Arabic text considering Arabic lexical rules. It uses the MySQL REGEXP and LIKE functions to retrieve better results from queries for Arabic text. Platforms: PHP

Steel Bank Common Lisp is a development environment for Common Lisp, with excellent support for the ANSI standard: garbage collection, lexical closures, powerful macros, strong dynamic typing, incremental compilation, and the famous Common Lisp Object System (multimethods and all). Steel Bank... Platforms: *nix

Apolda, also known as Automated Processing of Ontologies with Lexical Denotations for Annotation was built as a plugin for GATE. The Apolda processing resource (PR) annotates a document like a gazetteer, but takes the terms from an (OWL) ontology rather than from a list. Apolda searches the... Platforms: Windows

This is a suite of several software agents to provide a complete architecture of lexical base as proposed in Didier Schwab's PhD. thesis. It will be used for automatic translation, information retrieval and other natural language processing tasks. Platforms: Windows, Mac, Linux

A port to C# of a lexical analyzer tool called JFlex. Produces Java or C# source code files for scanning an input stream and producing a sequence of tokens. Compatible with CUP (Constructor of Useful Parsers). Platforms: Windows, Mac, Linux

Provides a generic parser and lexical analysis interface with built in file I/O, regular expressions, globbing support, dynamically definable tokens, callbacks, and a variety of other features. Platforms: Windows, Mac, BSD, Linux

Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85. Platforms: Windows, Mac, Linux

Interpreter of the Pascal language, with lexical and syntactic analyzer's modules, written in Java. Platforms: Windows, Mac, Linux

Linear time, dynamic API for lexical analysis and parser generation. Allows for a text-based specification of formal languages with the well-known regular-expressions approach, and using Parsing Expression Grammars as the underlying engine. Platforms: Windows, Mac, Linux

A Python interface to the Wordnet database of word meanings and lexical relationships. allows the user to type expressions such as N['dog'], hyponyms(N['dog'][0]), and closure(ADJ['red'], SYNONYM) to query the database for lexical relationships. Platforms: Windows, Mac, Linux