DragonFly On-Line Manual Pages

Search: Section:  

BROWNFREQ(1)          User Contributed Perl Documentation         BROWNFREQ(1)


NAME

       brownFreq.pl - Compute Information Content from the Brown Corpus


SYNOPSIS

        brownFreq.pl [--outfile=OUTFILE [--stopfile=STOPFILE]
                [--wnpath=WNPATH] [--resnik] [--smooth=SCHEME] FILES
               | --help --version]


DESCRIPTION

       This program reads the Brown Corpus and computes the frequency counts
       for each synset in WordNet. These frequency counts are used by various
       measures of semantic relatedness to calculate the information content
       values of concepts. The output is generated in a format as required by
       the WordNet::Similarity modules for computing semantic relatedness.

       There are various forms of the Brown corpus available. The one we use
       for this program comes from the ICAME Collection of English Language
       Corpora,  Second Edition, 1999.  <http://www.hit.uib.no/icame/cd>

       A more detailed description of how information content is calculated
       can be found in rawtextFreq.pl. This program uses exactly the same
       techniques as described there.


OPTIONS

       --outfile=filename

           The name of a file to which output should be written

       --stopfile=filename

           A file containing a list of stop listed words that will not be
           considered in the frequency counts.  A sample file can be down-
           loaded from
           http://www.d.umn.edu/~tpederse/Group01/WordNet/words.txt

       --wnpath=path

           Location of the WordNet data files (e.g.,
           /usr/local/WordNet-3.0/dict)

       --resnik

           Use Resnik (1995) frequency counting

       --smooth=SCHEME

           Smoothing should used on the probabilities computed.  SCHEME can
           only be ADD1 at this time

       --help

           Show a help message

       --version

           Display version information

       FILES

           Files for the Brown Corpus (e.g., /home/sid/Brown/BROWN1/*.TXT).


BUGS

       Report to WordNet::Similarity mailing list :
        <http://groups.yahoo.com/group/wn-similarity>


SEE ALSO

       WordNet::Similarity

       ICAME Corpus :
        <http://www.hit.uib.no/icame/cd>

       WordNet home page :
        <http://wordnet.princeton.edu>

       WordNet::Similarity home page :
        <http://wn-similarity.sourceforge.net>


AUTHORS

        Ted Pedersen, University of Minnesota, Duluth
        tpederse at d.umn.edu

        Satanjeev Banerjee, Carnegie Mellon University, Pittsburgh
        banerjee+ at cs.cmu.edu

        Siddharth Patwardhan, University of Utah, Salt Lake City
        sidd at cs.utah.edu


COPYRIGHT

       Copyright (c) 2005-2008, Ted Pedersen, Satanjeev Banerjee, and
       Siddharth Patwardhan

       This program is free software; you can redistribute it and/or modify it
       under the terms of the GNU General Public License as published by the
       Free Software Foundation; either version 2 of the License, or (at your
       option) any later version.  This program is distributed in the hope
       that it will be useful, but WITHOUT ANY WARRANTY; without even the
       implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR
       PURPOSE.  See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along
       with this program; if not, write to the Free Software Foundation, Inc.,
       59 Temple Place - Suite 330, Boston, MA  02111-1307, USA.

perl v5.20.2                      2015-08-31                      BROWNFREQ(1)

Search: Section: