Actions

Research: Difference between revisions

Computational Linguistics and Information Processing

No edit summary
(113 intermediate revisions by 10 users not shown)
Line 1: Line 1:
==Bayesian Modeling==
In the CLIP lab, we approach research on computational linguistics and information processing from a variety of angles. Some of our ongoing projects focus on the following challenges:


{| border="0" cellpadding="5" cellspacing="0" align="center"
* Computational psycholinguistics
|-
* Computational social science
| style="border-right: 1px solid grey; background:#ffefef" | <b>Faculty</b>
* Cross-language information retrieval
|
* Data science for finance / social good
{| border="0"
* Deep learning
| [http://www.umiacs.umd.edu/~jbg Jordan Boyd-Graber] ||
* E-discovery
|-
* Pattern discover in graphs / ranking and recommendation
| [http://www.umiacs.umd.edu/~jimmylin Jimmy Lin] ||
* Human-in-the-loop machine learning
|-
* Machine translation
| [http://umiacs.umd.edu/~hal Hal Daume III] ||
* Mental health
|-
* Privacy-aware information retrieval
| [http://www.umiacs.umd.edu/~resnik/ Philip Resnik] ||
* Speech retrieval
|-
* Urban computing / smart environments
|}
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Postdocs </b>
|
|-
| style="border-bottom: 3px solid grey; border-right: 1px solid grey; background:#ffefef" | <b>Graduate Students </b>
| style="border-bottom: 3px solid grey;" | Eric Hardisty, [http://umiacs.umd.edu/~ynhu/ Yuening Hu], Ke Zhai
|-
| colspan="3" align="left" |


Bayesian modeling is a rigorous mathematical formalism that allows us to build systems that reflect our uncertainty about the world.  Applied to language, they allow us to build models that reflect the "latent" aspects of communication such as topic, part of speech, syntax, or sentiment.  Using posterior inference, we can use the models to discover the latent features that best explain observed language.
CLIP research has been supported by the following organizations: NSF, DARPA, ARL, IARPA, OFR (Treasury), NIST, IMLS, Google, Yahoo and the World Bank.
 
In the CLIP lab, we are interested in
* building tools that make it easier for people to work with Bayesian models
* scaling inference for Bayesian models to the web scale
* understanding how humans interpret and understand the latent variables in Bayesian models
 
<b>Representative Publications and Project Pages:</b>
* [http://www.umiacs.umd.edu/~hal/HBC/ Hierarchical Bayes Compiler]
* [http://www.umiacs.umd.edu/~jbg/docs/nips2009-rtl.pdf Reading Tea Leaves: How Humans Interpret Topic Models]
* [http://drum.lib.umd.edu/handle/1903/10058 Gibbs Sampling for the Uninitiated]
|}
 
 
==Machine Translation and Paraphrasing==
 
{| border="0" cellpadding="5" cellspacing="0" align="center"
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Faculty</b>
|
{| border="0"
| [http://www.umiacs.umd.edu/~bonnie Bonnie Dorr] || interlingual and hybrid MT, semantically-informed syntactic MT
|-
| [http://umiacs.umd.edu/~mharper Mary Harper] || multilingual parsing, language modeling
|-
| [http://www.umiacs.umd.edu/~resnik/ Philip Resnik] || linguistically informed translation modeling, paraphrase, crowdsourcing and translation
|-
|}
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Postdocs </b>
|
|-
| style="border-bottom: 3px solid grey; border-right: 1px solid grey; background:#ffefef" | <b>Graduate Students </b>
| style="border-bottom: 3px solid grey;" | [http://www.cs.umd.edu/~vlad/ Vlad Eidelman]
|-
| colspan="3" align="left" |
 
The CLIP Laboratory's work in <b>machine translation</b> continues the lab's long tradition of research in translation.  Like most of the field, we work within the framework of statistical MT, but with an emphasis on taking appropriate advantage of knowledge driven or linguistically informed model structures, features, and priors.  Some current areas of research include syntactically informed language models, linguistically informed translation model features, the use of unsupervised methods in translation modeling, exploitation of large scale "cloud computing" methods, and human-machine collaborative translation via crowdsourcing. 
 
<b>Paraphrase</b>, the ability to express the same meaning in multiple ways, is an active area of research within the NLP community and here in the CLIP Laboratory.  Our work in paraphrase  includes the use of paraphrase in MT evaluation and parameter estimation, lattice and forest translation, and collaborative translation, as well as research on lexical and phrasal semantic similarity measures, meaning preservation in machine translation and summarization, and large-scale document similarity computation via cloud computing methods. 
 
<b>Representative Publications and Project Pages:</b>
* Greene and Resnik, NAACL 2009: [http://umiacs.umd.edu/~resnik/pubs/greene_resnik_naacl2009.pdf More Than Words: Syntactic Packaging and Implicit Sentiment]
|}
 
==Summarization ==
 
==Parsing and Tagging==
 
==Computational Social Science==
 
 
{| border="0" cellpadding="5" cellspacing="0" align="center"
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Faculty</b>
|
{| border="0"
| [http://www.umiacs.umd.edu/~jbg/ Jordan Boyd-Graber] || scientific literature analysis, persuasion
|-
| [http://www.umiacs.umd.edu/~bonnie Bonnie Dorr] || sentiment analysis, scientific literature analysis
|-
| [http://www.umiacs.umd.edu/~jimmylin/ Jimmy Lin] || social media
|-
|  [http://www.umiacs.umd.edu/~oard/ Doug Oard] || technological innovation
|-
| [http://www.umiacs.umd.edu/~louiqa/ Louiqa Raschid] || diffusion, prediction, event detection
|-
| [http://www.umiacs.umd.edu/~resnik/ Philip Resnik] || sentiment, persuasion
|-
| [http://www.umiacs.umd.edu/~weinberg Amy Weinberg] || sentiment, persuasion
|}
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Postdocs </b>
|
|-
| style="border-bottom: 3px solid grey; border-right: 1px solid grey; background:#ffefef" | <b>Graduate Students </b>
| style="border-bottom: 3px solid grey;" | [http://www.cs.umd.edu/~hardisty/ Eric Hardisty] [http://www.umiacs.umd.edu/~asayeed/ Asad Sayed] [http://www.cs.umd.edu/~sayyadi Hassan Sayyadi] [http://www.cs.umd.edu/~wsc Shanchan Wu]
|-
| colspan="3" align="left" |
 
<b>Computational social science</b> involves the use of computational methods and models to leverage [http://www.sciencemag.org/cgi/content/summary/323/5915/721 "the capacity to collect and analyze data at a scale that may reveal patterns of individual and group behaviors"].  Research in the CLIP Laboratory is at the forefront of this emerging area, and includes sentiment analysis (computational modeling and prediction of opinions, perspective, and other private states), automatic analysis and visualization of the scientific literature, modeling the diffusion of technological innovations, and modeling and prediction of social goals and actions such as persuasion. 
 
<b>Representative Publications and Project Pages:</b>
* Greene and Resnik, NAACL 2009: [http://umiacs.umd.edu/~resnik/pubs/greene_resnik_naacl2009.pdf More Than Words: Syntactic Packaging and Implicit Sentiment]
 
|}
 
==Information Retrieval ==
 
{| border="0" cellpadding="5" cellspacing="0" align="center"
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Faculty</b>
|
{| border="0"
| [http://www.umiacs.umd.edu/~jimmylin/ Jimmy Lin] ||
|-
|  [http://www.umiacs.umd.edu/~oard/ Doug Oard] ||
|}
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Postdocs </b>
|
{| border="0"
| [http://www.umiacs.umd.edu/~ewagner/ Earl Wagner] ||
|}
|-
| style="border-bottom: 3px solid grey; border-right: 1px solid grey; background:#ffefef" | <b>Graduate Students </b>
| style="border-bottom: 3px solid grey;" |
|-
|  colspan="3" align="left" |
 
The goal of information retrieval is to help people find what they are looking for.  Information retrieval research in the CLIP lab focuses principally on retrieval based on the language contained in text, in speech, and in document images.  We work across a broad range of content types, from tweets to tomes, from talking to texting, and from Cebuano to Chinese.  Three perspectives inform our work:
* we integrate a broad range of computational linguistics techniques,
* we focus on scalable techniques that can accommodate very large collections
* we sometimes draw the boundaries of our “systems” very broadly to include both the automated tools that we create and the process by which users can best employ those tools.
 
One example that illustrates these perspectives is our work with “cross-language information retrieval,” in which close coupling of machine translation and information retrieval techniques make it possible for people to find and use information written in languages that they can neither read nor write.  Another example is our work on the design and evaluation of “question answering” systems that can automatically find and present answers to complex questions, which serves as a bridge between our work on information retrieval and summarization.
 
<b>Representative Publications and Project Pages:</b>
* Douglas W. Oard, "[http://terpconnect.umd.edu/~oard/pdf/elis09.pdf | Multilingual Information Access]," in Encyclopedia of Library and Information Sciences, 3rd Ed., 2009.
 
 
|}
 
==Disambiguation==
 
{| border="0" cellpadding="5" cellspacing="0" align="center"
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Faculty</b>
|
{| border="0"
| [http://www.umiacs.umd.edu/~jbg Jordan Boyd-Graber] ||
|-
| Judith Klavans ||
|-
| [http://www.umiacs.umd.edu/~resnik/ Philip Resnik] ||
|-
|}
|-
| style="border-right: 1px solid grey; background:#ffefef" | <b>Postdocs </b>
|
|-
| style="border-bottom: 3px solid grey; border-right: 1px solid grey; background:#ffefef" | <b>Graduate Students </b>
| style="border-bottom: 3px solid grey;" |
|-
|  colspan="3" align="left" |
 
<b>Disambiguation </b> is the process of determining the meaning or senses of a word in its context;  disambiguation remains one of the most challenging NLP problems since discovering word senses involves syntactic, semantic and pragmatic contextual inferencing, along with a rich knowledge base to base selection upon. For example, the word "wing" in the theater differs from airplanes, yet another sense for furniture ("wing chair") applies to some usages.  Often disambiguation can be based on windows of two and three words, but usually involves larger computation.  Techniques for disambiguation range from the use of large scale thesaural resources (such as WordNet) to purely statistical methods.
 
<b>Representative Publications and Project Pages:</b>
* [http://www.umiacs.umd.edu/research/t3/index.shtml T3: Text, Tags, Trust]
* [http://www.umiacs.umd.edu/~jbg/docs/jbg-EMNLP07.pdf A Topic Model for Word Sense Disambiguation]
 
|}

Revision as of 01:51, 8 September 2017

In the CLIP lab, we approach research on computational linguistics and information processing from a variety of angles. Some of our ongoing projects focus on the following challenges:

  • Computational psycholinguistics
  • Computational social science
  • Cross-language information retrieval
  • Data science for finance / social good
  • Deep learning
  • E-discovery
  • Pattern discover in graphs / ranking and recommendation
  • Human-in-the-loop machine learning
  • Machine translation
  • Mental health
  • Privacy-aware information retrieval
  • Speech retrieval
  • Urban computing / smart environments

CLIP research has been supported by the following organizations: NSF, DARPA, ARL, IARPA, OFR (Treasury), NIST, IMLS, Google, Yahoo and the World Bank.