Lexer

HOP::Lexer is a Perl module for "Higher Order Perl" Lexer. SYNOPSIS use HOP::Lexer string_lexer; my @input_tokens = ( [ VAR, qr/[[:alpha:]]+/ ], [ NUM, qr/d+/ ], [ OP, qr/[+=]/ ], [ SPACE, qr/s*/, sub { () } ], ); my $text = x = 3 + 4; my $lexer = string_lexer( $text, @input_tokens...

Hardware::Vhdl::Lexer is a Perl module that can split VHDL code into lexical tokens. SYNOPSIS use Hardware::Vhdl::Lexer; # Open the file to get the VHDL code from my $fh; open $fh, <, device_behav.vhd || die $! # Create the Lexer object my $lexer = Hardware::Vhdl::Lexer->new({...

Java Cobol Lexer take a cobol source program and return it as a list of lexical tokens. Library takes source code in fixed, free and mixed formats. It recognizes standard Cobol 85.


Platforms: Windows, Mac, Linux

C::Sharp is a parser and Lexer for C# Programming Language. SYNOPSIS use C::Sharp; use C::Sharp::Tokener; use C::Sharp::Parser; This module distribution contains (or will contain, when its finished) a tokeniser, parser and, hopefully, compiler for C#. C# is Microsofts new programming...


Platforms: *nix

A run-time configurable character stream tokenizer that allows the user to define token classes via regular expressions. The developer is not limited to predefined notions of whitespace, commenting, or word modalities.


Platforms: Windows, Mac, Linux

Annotation based lexer and parser generator suitable for processing wide range of languages, from small domain specific languages to big ones like Java. Actions may be written directly as annotated java methods. Examples of expression language and Java5.


Platforms: Windows, Mac, Linux

Generic Lexer which along with a language definition (.slx) file, constitutes Yacc/Bison compatible, custom lexical parser. It is ~1/3 the size of an equivalent Flex Lexer, resulting in a smaller compiler, and simpler yet more powerful lexical definition.


Platforms: Windows, Mac, Linux

Sometimes you want to work more with the form of an XML document than with the structural information it contains. For instance if you wanted to change a bunch of entity references or element names. Also, sometimes you have slightly incorrect XML that a traditional parser will choke on. In that...


Platforms: Windows, Mac, *nix, Python, BSD Solaris

AutoHyperlinks is a Cocoa framework that handles the detection of hyperlinks in normal language, leaving you, the developer, free to concentrate on the core functionality of your application. AutoHyperlinks is the framework used by Adium to scan for URLs in strings and other text containers. This...


Platforms: Mac

The Pytools package is like a big bag of things that are "missing" from the Python standard library. This is mainly a dependency of my other software packages, and is probably of little interest to you unless you use those. If you???*a*?re curious nonetheless, here???*a*?s what???*a*?s on offer:...


Platforms: *nix

Parser combinators are just higher-order functions that take parsers as their arguments and return them as result values. Parser combinators are: * First-class values * Extremely composable * Tend to make the code quite compact * Resemble the readable notation of xBNF grammars Parsers made...


Platforms: *nix

Inter-Thread Communication (ITC) aims to make it exceedingly easy to call functions in other threads. The lexer does all the work, so just run the lexer on your headers, then call the stub functions. In addition, it also provides a complete threading API, with the four threading primitives...


Platforms: *nix

Parse::Java is a Perl module that acts like a parser for Java code. SYNOPSIS use Parse::Java; my $ast = Parse::Java->parse_file(MyClass.java); Parse::Java parses Java code into an Abstract Syntax Tree which can be used for many things like writing compilers and stuff. As this module is...


Platforms: *nix

yagg::Tutorial is a Perl module that contains a tutorial for yagg. SYNOPSIS # To use the generator ./yagg -m nonterminals.yg terminals.lg ./output/progs/generate 5 This tutorial will show you how to use yagg, by way of two examples. In the first example, we create a simple logical...


Platforms: *nix

HTMLParser is a super-fast real-time parser for real-world HTML. What has attracted most developers to HTMLParser has been its simplicity in design, speed and ability to handle streaming real-world html. The two fundamental use-cases that are handled by the parser are extraction and...


Platforms: *nix

Class::Container is a Perl module with Glues object frameworks together transparently. SYNOPSIS package Car; use Class::Container; @ISA = qw(Class::Container); __PACKAGE__->valid_params ( paint => {default => burgundy}, style => {default => coupe}, windshield => {isa => Glass}, radio...


Platforms: *nix

Parse::Nibbler is Perl module to parse huge files using grammars written in pure perl. Create a parser object using the ->new method. This method is provided by the Parse::Nibbler module and should not be overridden. The main functionality of the Parse::Nibbler module is the Register...


Platforms: *nix

Tableutil is a utility for converting, aggregating and performing operations (currently unions, differences, complements and intersections) on lists of IP-addresses. Tableutils primary use is to convert files into a format pfctl(8) can read, but if you find another use for it Id really like to...


Platforms: *nix

Sometime in the early 90s a game existed on the Macintosh called Diamonds which was something like a cross between a puzzle and action game. The game play required for the player to use the ball on the screen to hit bricks and destroy them. However, rather than hitting the ball with a paddle...


Platforms: *nix

ccovinstrument package contains instruments C/C++ code for test coverage analysis. SYNOPSIS ccovinstrument code.c > covcode.c ccovinstrument code.c [-f] -o covcode.c [-e errs] -f instrument fatal code as well as normal code Scans C/C++ source (before cpp) and inserts trip-wires in each...


Platforms: *nix