This is an old revision of the document!
Distributional Semantic Models (ESSLLI 2009)
Start page – Schedule – Downloads & Links – Bibliography
Schedule & handouts
Introduction
Foundations of DSMs (Mon, 27 July)
- general introduction & background
- DSMs in a nutshell
- the DSM parameter space: a taxonomy
Matrix algebra & vector spaces (Tue, 28 July)
- matrix representation, foundations of matrix algebra
- geometric analysis (norms, distances, similarity & angles)
- implementation: R as an interactive DSM laboratory
Slides, Handout – DSM lab (R script), bnc_vobj_filtered.txt.gz (15 MB) – Homework (R script), potter_tokens.txt.gz (8.9M)
DSMs in computational linguistics and cognitive science (Wed, 29 July)
- What can we do with DSM vectors?
- Do DSMs capture interesting aspects of word meaning?
Slides, Handout, Concrete nouns clustering, Concrete nouns MDS
Manipulating & understanding DSM spaces (Thu, 30 July)
- more advanced matrix algebra & implementation
- singular value decomposition (SVD)
- managing high-dimensional DSMs (SVD, random indexing)
- visualisation and intuitive interpretation
- mathematical properties of special DSMs
Challenges for DSMs & current research (Fri, 31 July)
- looking for a unified model
- connection to formal semantics: compositionality, inference, reference
- holographic memory, probabilistic approaches
