NAME

Scheme::Tokenizer - The Scheme tokenizer

SYNOPSIS

  use Scheme:Tokenizer;

  my $tokenizer = Scheme::Tokenizer->new($file_name);

DESCRIPTION

The tokenizer takes a file and splits it into tokens.

AUTHOR

Jeffrey Goff, drforr@hargray.com

SEE ALSO

Scheme, Scheme::Parser, Scheme::Generator