ISI 2016 Summer Internships in Natural Language Processing
University of Southern California

Summer 2016 Internships in Natural Language Processing
USC Information Sciences Institute
Natural Language Group

Projects   Past Interns   Intern publications   FAQ

View from ISI (credit: Pedro Szeleky)


Thank you for your application. The USC/ISI Natural Language Processing Internships Committee is reviewing all applications received on or before January 15, 2016.

We are looking for interested and qualified students (graduate and undergraduate) to spend the summer working with ongoing research projects at USC/ISI on natural language processing, machine learning, statistical modeling, machine translation, automata, and other areas.

These are paid internships. They will be available for a three month period during the summer of 2016.

Good programming skills are required, but prior experience in natural language processing is not necessarily required. We will provide tutorials on relevant topics at the beginning of the summer.

Important dates

2015 Dec 7 Internships and application instructions will be posted
2016 Jan 15 Applications due
2016 Feb 8 (approx.) First acceptance notifications
2016 Jun 01 Internships begin

How to apply

Please follow the instructions below. Applications that do not conform will be rejected without review.

Projects areas of interest include:

1. Semantics

We are developing methods for using both logical semantics and distributional semantics to improve machine translation systems and other natural-language-processing tasks.

2. Machine Reading

Scientists are overwhelmed with scientific literature. If we can build machines to read scientific papers, and understand them to some degree, then we can help science move faster.

3. Neural Machine Translation

We have built a powerful, efficient set of tools for machine translation with deep recurrent networks and are ready for experiments to extend its accuracy and capabilities.

4. Language and Vision

Young children process language and images simultaneously. They learn how to name objects, how to describe scenes, and how to imagine scenes that others describe. Can we design software to do this?

5. Language and Education

An increasingly larger number of skills, from writing to knowledge of a particular subject to mathematics, are assessed using software. Can we design generic software to automatically assess subject matter expertise?

6. Tools for All Languages

Today's automatic parsers, translators, and pronunciation dictionaries cover a tiny fraction of the world's languages. Can we use general knowledge of how language works to extend the reach of natural language tools?

7. Decipherment

Code-cracking and machine translation have an intimately tied history. The first job of proto-computers was to crack military codes, and the idea arose soon afterwards of treating foreign language as a code for English. We have several investigations planned, inspired by results we have recently reported: (1) cracking of the Copiale cipher (see also here and here), (2) discoveries concerning the Voynich manuscript, and (3) the training of a statistical machine translation system without the need for parallel data.

8. Creative Language

In the not-too-distant future, stories, poems, songs, and advertisements will be written by machines and human-machine collaborations. We are starting down this path now (for example, see here and here), and there are many research avenues to pursue.

Research Environment

Summer internship projects are supervised by Kevin Knight and Daniel Marcu, and interns also interact and collaborate closely with the rest of the Natural Language Group. Our group's research environment includes weekly seminars and reading groups, opportunities for teaching and advising, an active program for summer students, large quantities of linguistic resources, and a 2000-processor supercomputing cluster completely dedicated to natural language research at USC/ISI.

USC/ISI is an academic research institute that is part of USC's Viterbi School of Engineering; many USC/ISI scientists hold research faculty positions in the computer science department. The Natural Language Group is part of USC/ISI's Intelligent Systems Division which carries out a wide range of artificial intelligence research.

USC/ISI is located in Marina del Rey on the Southern California coast, an excellent location convenient to beaches, restaurants, boating, bike paths, and shopping. Note: we are not located on the main campus of USC, which is near downtown LA.

Past Interns

Our summer program is well established! Past students are listed below. People like this place -- several (marked with a *) interned twice, and several (marked with a ^) joined ISI eventually (as a PhD student, visiting PhD student, or research scientist).

2015: Callum O'Shaughnessy (Queens University), Sudha Rao (Maryland), Wenduan Xu (Cambridge), Barret Zoph (USC)

2014: Julian Schamper (Aachen), Eunsol Choi (Washington), Allen Schmaltz (Harvard), Matic Horvat (Cambridge)

2013: Daniel Bauer* (Columbia), Fabienne Braune (Stuttgart), Jackie Lee (MIT), Elliot Meyerson (Wesleyan), Arvind Neelakantan (Columbia/UMass), Malte Nuhn (Aachen)

2012: Jacob Andreas (Columbia), Daniel Bauer (Columbia), Karl Moritz Hermann (Oxford), Bevan Jones (Edinburgh/Macquarrie), Nathan Schneider (CMU), Ada Wan (CUNY).

2011: Licheng Fang (Rochester), Sravana Reddy* (Chicago), Xuchen Yao (JHU).

2010: Yoav Goldberg (Ben Gurion, Israel), Ann Irvine (Hopkins), Sravana Reddy (Chicago), Alexander "Sasha" Rush (MIT).

2009: Michael Auli (University of Edinburgh), Paramveer Dhillon (Penn), Erica Greene^ (Haverford), Adam Pauls (UC Berkeley)

2008: Amittai Axelrod (University of Washington), John DeNero (UC Berkeley), Kyle Gorman (Penn Linguistics), Catalin Tirnauca (Universitat Rovira i Virgili)

2007: Michael Bloodgood (Delaware), Jennifer Gillenwater (Rice University), Carmen Heger (Dresden), Wei Ho (Princeton).

2006: Joseph Turian (NYU), Chenhai Xi (Pitt), Victoria Fossum*^ (Michigan), Liang Huang*^ (Penn), Jason Riesa*^ (JHU), Oana-Diana Postolache^ (Saarland).

2005: Victoria Fossum (Michigan), Mark Hopkins* (UCLA), Liang Huang (Penn), Behrang Mohit (Pitt), Preslav Nakov (Berkeley), Jason Riesa (JHU), Hao Zhang (Rochester).

2004: Madhur Ambastha (Rochester), Michel Galley* (Columbia), David Kauchak (UCSD).

2003: Michel Galley (Columbia), Mark Hopkins (UCLA), Beata Klebanov (Hebrew University), Ana-Maria Popescu (University of Washington), Lara Taylor (UCSD).

2002: Chris Ackerman (USC), Emil Ettelaie (USC), Yuling Hsueh (USC), John Lee (Waterloo/MIT), Bo Pang (Cornell)

2001: Abdessamad Echihabi (USC), Hal Daume III^ (CMU), Michael Laszlo (Waterloo), Dragos Stefan Munteanu^ (Iowa), Rebecca Rees (BYU), Radu Soricut^ (Iowa)

1994-2000: Estibaliz Amorrortu, Vasileios Hatzivassiloglou (Columbia), Michael Jahr (Stanford), Larry Kite (USC), Magdalena Romera (USC), Maki Watanabe (USC).

Intern Publications

We always aim to solve interesting and novel scientific problems, and to publish the results in the best conferences. Sample papers that have come from past student internships:

"Cipher Type Detection" (Malte Nuhn and Kevin Knight), Proceedings of EMNLP 2014.

"Mapping between English Strings and Reentrant Semantic Graphs" (F. Braune, D. Bauer, and K. Knight), Proceedings of LREC 2014.

"Parsing Graphs with Hyperedge Replacement Grammars" (D. Chiang, J. Andreas, D. Bauer, K.-M. Hermann, B. Jones and K. Knight), Proceedings of ACL 2013.

"Learning Whom to Trust with MACE" (D. Hovy, T. Berg-Kirkpatrick, A. Vaswani, and E. Hovy), Proceedings of NAACL 2013.

"Semantics-Based Machine Translation with Hyperedge Replacement Grammars" (B. Jones, J. Andreas, D. Bauer, K.-M. Hermann, K. Knight), Proceedings of COLING 2012.

"Feature-Rich Language-Independent Syntax-Based Alignment for Statistical Machine Translation" (J. Riesa, A. Irvine, D. Marcu), Proceedings of EMNLP 2011.

"Language-independent parsing with empty elements" (S. Cai, D. Chiang, Y. Goldberg), Proceedings of ACL 2011.

"Automatic Analysis of Rhythmic Poetry with Applications to Generation and Translation" (E. Greene, T. Bodrumlu, K. Knight), Proceedings of EMNLP 2010.

"Efficient optimization of an MDL-inspired objective function for unsupervised part-of-speech tagging" (A. Vaswani, A. Pauls, D. Chiang), Proceedings of ACL 2010.

"Unsupervised Syntactic Alignment with Inversion Transduction Grammars" (A. Pauls, D. Klein, D. Chiang, K. Knight), Proceedings of NAACL 2010.

"Bayesian Inference for Finite-State Transducers" (D. Chiang, J. Graehl, K. Knight, A. Pauls, S. Ravi), Proceedings of NAACL 2010.

"Binarization of Synchronous Context-Free Grammars" (L. Huang, H. Zhang, D. Gildea, K. Knight), Computational Linguistics, 2009.

"Fast Consensus Decoding over Translation Forests" (J. DeNero, D. Chiang, and K. Knight). Proceedings of ACL 2009.

"Forest Rescoring: Faster Decoding with Integrated Language Models" (L. Huang and D. Chiang), Proceedings of ACL 2007.

"Scalable Inference and Training of Context-Rich Syntactic Models" (M. Galley, J. Graehl, K. Knight, D. Marcu, S. DeNeefe, W. Wang, and I. Thayer), Proceedings of ACL 2006, poster session.

"Synchronous Binarization for Machine Translation" (H. Zhang, L. Huang, D. Gildea, K. Knight), Proceedings of NAACL 2006.

"Statistical Syntax-Directed Translation with Extended Domain of Locality" (L. Huang, K. Knight, A. Joshi), Proceedings of the Conference of the Association for Machine Translation in the Americas (AMTA-06).

"Building an English-Iraqi Arabic Machine Translation System for Spoken Utterances with Limited Resources" (J. Riesa, B. Mohit, K. Knight, D. Marcu), Proceedings of Interspeech 2006.

"Text Simplification for Information Seeking Applications" (B. Beigman Klebanov, K. Knight, D. Marcu), In: On the Move to Meaningful Internet Systems, eds. R. Meersman and Z. Tari, Lecture Notes in Computer Science (3290), Springer-Verlag, 2004.

"What's in a Translation Rule?" (M. Galley, M. Hopkins, K. Knight, D. Marcu), Proceedings of NAACL 2004.

"Syntax-based Alignment of Multiple Translations: Extracting Paraphrases and Generating New Sentences" (B. Pang, K. Knight, and D. Marcu), Proceedings of NAACL 2003.

"Using a Large Monolingual Corpus to Improve Translation Accuracy" (R. Soricut, K. Knight, and D. Marcu), Proceedings of the 6th Association for Machine Translation in the Americas Conference (AMTA-2002).

"Processing Comparable Corpora With Bilingual Suffix Trees" (D. Munteanu and D. Marcu), Proceedings of EMNLP 2002.

"A Noisy-Channel Model for Document Compression" (H. Daume III and D. Marcu), Proceedings of ACL 2002.

"An Unsupervised Approach to Recognizing Discourse Relations" (D. Marcu and A. Echihabi), Proceedings of ACL 2002.

"Fast Decoding and Optimal Decoding for Machine Translation" (U. Germann, M. Jahr, K. Knight, D. Marcu, and K. Yamada), Proceedings of ACL 2001. ACL Best Paper award.

"An Empirical Study in Multilingual Natural Language Generation: What Should a Text Planner Do?" (D. Marcu, L. Carlson, and M. Watanabe), The 1st International Conference on Natural Language Generation INLG'2000, Mitzpe Ramon, Israel, 2000.

"Experiments in Constructing a Corpus of Discourse Trees" (D. Marcu, E. Amorrortu, and M. Romera), ACL'99 Workshop on Standards and Tools for Discourse Tagging, Univ. Maryland, 1999.

"Two-Level, Many-Paths Generation," (K. Knight and V. Hatzivassiloglou), Proceedings of ACL 1995.

Frequently Asked Questions

(Please read these before contacting us...)