-
Notifications
You must be signed in to change notification settings - Fork 0
/
README.txt
125 lines (95 loc) · 4.63 KB
/
README.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
README for DiaColloDB
ABSTRACT
DiaColloDB - diachronic collocation database
REQUIREMENTS
Perl Modules
The following non-core perl modules are required, and should be
available from CPAN <http://www.cpan.org>.
DDC::Concordance (formerly ddc-perl)
Perl module for DDC client connections. Available from CPAN, or via
SVN from
<https://svn.code.sf.net/p/ddc-concordance/code/ddc-perl/trunk>
DDC::XS (formerly ddc-perl-xs)
XS wrappers for DDC query parsing. Available from CPAN, or via SVN
from
<https://svn.code.sf.net/p/ddc-concordance/code/ddc-perl-xs/trunk>
File::Map
File::Temp
JSON
IPC::Run
Log::Log4perl
LWP::UserAgent
For querying external servers via DiaColloDB::Client::http.
PDL (optional)
Perl Data Language for fast fixed-size numeric data structures, used
by the TDF (term-document frequency matrix) relation type. It should
still be possible to build, install, and run the DiaColloDB
distribution on a system without PDL installed, but use of the the
TDF (term x document) matrix relation type will be disabled.
PDL::CCS
(optional)
PDL module for sparse index-encoded matrices, used by the TDF
(term-document frequency matrix) relation type. See the caveats
under PDL.
Tie::File::Indexed
For handling large (temporary) arrays during index creation.
XML::LibXML
(optional)
Required for index compilation from TCF or TEI corpus sources.
Additional Requirements
In order to make use of this module, you will also need either a corpus
to index or an existing index to query. See "SUBCLASSES" in
DiaColloDB::Document for a list of supported corpus input formats.
DESCRIPTION
The DiaColloDB package provides a set of object-oriented Perl modules
and a command-line utility suite for constructing and querying native
diachronic collocation indices with optional inclusion of a DDC server
back-end for fine-grained queries.
INSTALLATION
Issue the following commands to the shell:
bash$ cd DiaColloDB-0.01 # (or wherever you unpacked this distribution)
bash$ perl Makefile.PL # check requirements, etc.
bash$ make # build the module
bash$ make test # (optional): test module before installing
bash$ make install # install the module on your system
See perlmodinstall for details.
USAGE
Assuming you have a raw text corpus you'd like to access via this
module, the following steps will be required:
Corpus Annotation and Conversion
Your corpus must be tokenized and annotated with whatever word-level
attributes and/or document-level metadata you wish to be able to query;
in particular document date is required. See "SUBCLASSES" in
DiaColloDB::Document for a list of currently supported corpus formats.
DiaCollo Index Creation
You will need to compile a DiaColloDB index for your corpus. This can be
accomplished using the dcdb-create.perl(1) script from this
distribution.
Command-Line Queries
Once you have compiled a local index, you can query it from the
command-line using the dcdb-query.perl(1) script from this distribution.
(Optional) WWW Wrappers
If you want online visualization of a local index, consider installing
the DiaColloDB::WWW distribution (available on CPAN) and following the
instructions in its README.txt file.
SEE ALSO
* The DiaColloDB module documentation describes the API of the
underlying perl module; when in doubt, look here.
* The dcdb-create.perl(1) script can be used to create a DiaColloDB
index for a corpus in one of the supported corpus formats.
* The dcdb-query.perl(1) script can execute runtime queries over a
local DiaColloDB index or a remote web-service via the
DiaColloDB::Client interface.
* <http://kaskade.dwds.de/dstar/dta/diacollo/> contains a live
web-service wrapper for a DiaCollo index over the *Deutsches
Textarchiv* corpus of historical German, including a user-oriented
help page (in English).
* The DiaColloDB::WWW distribution contains scripts and utilities for
creating HTTP-based web-services for local DiaCollo indices,
including various online visualizations.
* The CLARIN-D DiaCollo Showcase at
<http://clarin-d.de/de/kollokationsanalyse-in-diachroner-perspektive
> contains a brief example-driven tutorial on using the web-services
provided by the DiaColloDB::WWW distribution (in German).
AUTHOR
Bryan Jurish <[email protected]>