Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
data:start [2007/12/04 14:12]
schtepf 		data:start [2010/02/08 00:55]
schtepf
Line 1: Line 1:
-====== Data sets for the evaluation of word space models ======+====== Resources for the evaluation of word space models ======
  
-This page contains a developing list of tasks, sub-tasks and corresponding (sub-)data-sets. 
  
-Other tasks or sub-tasks might be added in the near future.+===== Ordered by events ===== 
 + 
 +  * [[:data:esslli2008:start|ESSLLI 2008 Shared Tasks]] (for the [[:workshop:esslli:start|Workshop on Distributional Lexical Semantics]]) 
  
  
Line 9: Line 10:
  
  
 +==== Semantic classification ====
  
 +  * Noun & verb categorization (ESSLLI 2008)
 +    * [[:data:esslli2008:Concrete Noun Categorization|semantic categories of concrete nouns]]
 +    * [[:data:esslli2008:Abstract/Concrete Nouns Discrimination|abstract vs. concrete nouns]]
 +    * [[:data:esslli2008:Verb Categorization|Levin-style verb classes]]
  
 +==== Free association ====
  
-==== Task 1: Categorization ==== +  * [[:data:esslli2008:Correlation with Free Association Norms|Correlation with free association norms]] (ESSLLI 2008) 
- +    * discrimination: strong association vs. non-associated 
-Categorization tasks play a prominent role in cognitive research on concepts. In this type of tasks, subjects +    * correlation: regression modelling of association strength 
-are typically asked to assign experimental items - objects, images, words - +    * prediction of most common responses (strongest associations)
-to a given category or to group together items belonging to the same category. +
-Since categorization presupposes an understanding of the relationship between the items in a category, it is regarded as a key source of evidence on the organization and structure of the human conceptual system. +
- +
-In the present task, computational models will be tested on their ability to properly group +
-words into semantic categories. The task is organized into three sub-tasks, focussing on different areas +
-of the lexicon and/or semantic dimensions: +
- +
-  * [[Concrete Nouns Categorization]] +
-  * [[Abstract/Concrete Nouns Discrimination]] +
-  * [[Verb Categorization]] +
- +
- +
-==== Task 2: Free Association ==== +
- +
-This task will be described in the near future. +
- +
-  * [[Correlation with Free Association Norms]]+
  
-==== Task 3: Property Generation ==== 
  
-The ability to describe a concept in terms of its salient properties is an important feature of human conceptual cognition. In this task, we compare human-generated //norms// collected by psychologists to the properties generated by computational models.+==== Property generation ====
  
-  * [[Comparison with Speaker-Generated Features]]+  * [[:data:esslli2008:Comparison with Speaker-Generated Features|Prediction of speaker-generated semantic features]]
  
  
  

You are here: start » data