perl-String-Tokenizer - A simple string tokenizer

Property Value
Distribution PCLinuxOS
Repository PCLinuxOS x86_64
Package filename perl-String-Tokenizer-0.05-10pclos2011.noarch.rpm
Package name perl-String-Tokenizer
Package version 0.05
Package release 10pclos2011
Package architecture noarch
Package type rpm
Homepage -
License -
Maintainer -
Download size 24.40 KB
Installed size 24.40 KB
A simple string tokenizer which takes a string and splits it on whitespace.
It also optionally takes a string of characters to use as delimiters, and
returns them with the token set as well. This allows for splitting the
string in many different ways.
This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs,
but it spans a gap between simple 'split / /, $string' and the other
options that involve much larger and complex modules.
Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its input
into specific chunks, a lexical analyzer classifies those chunks. Sometimes
these two steps are combined, but not here.


Package Version Architecture Repository
perl-String-Tokenizer - - -


Name Value
perl-base >= 5.12.3
rpmlib(CompressedFileNames) <= 3.0.4-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
rpmlib(PayloadIsLzma) <= 4.4.6-1
rpmlib(VersionedDependencies) <= 3.0.3-1


Name Value
perl(String::Tokenizer) = 0.50.0
perl(String::Tokenizer::Iterator) -
perl-String-Tokenizer = 0.05-10pclos2011


Type URL
Binary Package perl-String-Tokenizer-0.05-10pclos2011.noarch.rpm
Source Package perl-String-Tokenizer-0.05-10pclos2011.src.rpm

Install Howto

  1. Enable PCLinuxOS x86_64 repository in /etc/apt/sources.list:
    rpm pclinuxos/64bit x86_64
  2. Update the package index:
    # apt-get update
  3. Install perl-String-Tokenizer rpm package:
    # apt-get install perl-String-Tokenizer

See Also

Package Description
perl-String-Trim-0.005-1pclos2011.noarch.rpm Trim whitespace off your strings
perl-Sub-Exporter-0.982-10pclos2011.noarch.rpm A sophisticated exporter for custom-built routines
perl-Sub-Identify-0.04-10pclos2011.x86_64.rpm Retrieve names of code references
perl-Sub-Install-0.925-10pclos2011.noarch.rpm Install subroutines into packages easily
perl-Sub-Name-0.04-10pclos2011.x86_64.rpm Allows to (re)name a sub
perl-Sub-Override-0.08-10pclos2011.noarch.rpm Perl extension for easily overriding subroutines
perl-Sub-Uplevel-0.2002-10pclos2011.noarch.rpm apparently run a function in a higher stack frame
perl-Switch-2.14-10pclos2011.noarch.rpm A switch statement for Perl
perl-Syntax-Highlight-Perl6-0.73-10pclos2011.noarch.rpm Perl 6 Syntax Highlighter
perl-Sys-HostIP-1.3.1-10pclos2011.noarch.rpm Perl module to get ip address related info
perl-Sys-Hostname-Long-1.4-10pclos2011.noarch.rpm Try every conceivable way to get full hostname
perl-Sys-Load-0.2-10pclos2011.x86_64.rpm A perl5 module that indicate system load
perl-Sys-Mknod-0.02-10pclos2011.noarch.rpm Sys::Mknod - make special files
perl-Sys-Mmap-0.16-1pclos2011.x86_64.rpm Uses mmap to map in a file as a Perl variable
perl-Sys-Proctitle-0.03-10pclos2011.x86_64.rpm Sys::Proctitle - modify proctitle on Linux