Victoria Lin (林曦)

Research Scientist
Salesforce Research
575 High St, Palo Alto, California
xilin@salesforce.com

News

  • Feb. 2, 2018 Presenting NL2Bash (long talk) in NL4SE Workshop, co-located with AAAI 2018.
  • Dec. 13, 2017 Our dataset paper "NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System" is accepted to LREC 2018!
  • Oct. 16, 2017 Excited to join Salesforce AI Research (previously MetaMind) as a researcher on deep learning and natural language processing.
  • More ...

About Me

Hi! I am a research scientist at Salesforce Research. I develop novel machine learning solutions for natural language understanding in tasks such as intent prediction and question answering. I'm broadly interested in the topic of applying AI to help people become more productive in work and everyday life.

Previously I was a CS graduate student at the University of Washington, Seattle, working with Luke Zettlemoyer and Michael D. Ernst on data-driven natural language programming. We develop natural language based programming assistant tools for non-expert programmers by learning from experts and web materials.

Research Highlights

Tellina Logo

Tellina is an end-user scripting assistant that can be queried in natural language. It translates a natural language sentence typed by the user into a piece of short, executable script. The underlying machine learning models are neural encoder-decoders trained on text-script pairs. The current prototype is instantiated in the Bash domain.
The domain poses several challenges, including some shared by many practical semantic parsing problems, such as scalable data collection, online learning and personalization. [LREC'18, UW-CSE-TR'17]


Publications

Preprints

Program Synthesis from Natural Language Using Recurrent Neural Networks.
Xi Victoria Lin, Chenglong Wang, Deric Pang, Kevin Vu, Luke Zettlemoyer, Michael D. Ernst.
University of Washington Department of Computer Science and Engineering technical report UW-CSE-17-03-01.
Pdf Abstract Bibtex Tellina Tool
Even if a competent programmer knows what she wants to do and can describe it in English, it can still be difficult to write code to achieve the goal. Existing resources, such as question-and-answer websites, tabulate specific operations that someone has wanted to perform in the past, but they are not effective in generalizing to new tasks, to compound tasks that require combining previous questions, or sometimes even to variations of listed tasks.

Our goal is to make programming easier and more productive by letting programmers use their own words and concepts to express the intended operation, rather than forcing them to accommodate the machine by memorizing its grammar. We have built a system that lets a programmer describe a desired operation in natural language, then automatically translates it to a programming language for review and approval by the programmer. Our system, Tellina, does the translation using recurrent neural networks (RNNs), a state-of-the-art natural language processing technique that we augmented with slot (argument) filling and other enhancements.

We evaluated Tellina in the context of shell scripting. We trained Tellina's RNNs on textual descriptions of file system operations and bash one-liners, scraped from the web. Although recovering completely correct commands is challenging, Tellina achieves top-3 accuracy of 80% for producing the correct command structure. In a controlled study, programmers who had access to Tellina outperformed those who did not, even when Tellina's predictions were not completely correct, to a statistically significant degree.

Conference Proceedings

NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System.
Xi Victoria Lin, Chenglong Wang, Luke Zettlemoyer and Michael D. Ernst.
LREC 2018. To appear.
Pdf Abstract Bibtex Dataset & Code
We present new data and semantic parsing methods for the problem of mapping english sentences to Bash commands (NL2Bash). Our long-term goal is to enable any user to easily solve otherwise repetitive tasks (such as file manipulation, search, and application-specific scripting) by simply stating their intents in English. We take a first step in this domain, by providing a large new dataset of challenging but commonly used commands paired with their English descriptions, along with the baseline methods to establish performance levels on this task.
Compositional Learning of Embeddings for Relation Paths in Knowledge Bases and Text.
Kristina Toutanova, Xi Victoria Lin, Scott Wen-tau Yih, Hoifung Poon and Chris Quirk.
ACL 2016.
Pdf Abstract Bibtex
Modeling relation paths has offered significant gains in embedding models for knowledge base (KB) completion. However, enumerating paths between two entities is very expensive, and existing approaches typically resort to approximation with a sampled subset. This problem is particularly acute when text is jointly modeled with KB relations and used to provide direct evidence for facts mentioned in it. In this paper, we propose the first exact dynamic programming algorithm which enables efficient incorporation of all relation paths of bounded length, while modeling both relation types and intermediate nodes in the compositional path representations. We conduct a theoretical analysis of the efficiency gain from the approach. Experiments on two datasets show that it addresses representational limitations in prior approaches and improves accuracy in KB completion.

Workshop Proceedings & Technical Reports

Multi-label Learning with Posterior Regularization.
Xi Victoria Lin, Sameer Singh, Luheng He, Ben Taskar, and Luke Zettlemoyer.
NIPS Workshop on Modern Machine Learning and NLP, December 13, 2014, Montreal, Canada.
Pdf Abstract Bibtex
In many multi-label learning problems, especially as the number of labels grow, it is challenging to gather completely annotated data. This work presents a new approach for multi-label learning from incomplete annotations. The main assumption is that because of label correlation, the true label matrix as well as the soft predictions of classifiers shall be approximately low rank. We introduce a posterior regularization technique which enforces soft constraints on the classifiers, regularizing them to prefer sparse and low-rank predictions. Avoiding strict low-rank constraints results in classifiers which better fit the real data. The model can be trained efficiently using EM and stochastic gradient descent. Experiments in both the image and text domains demonstrate the contributions of each modeling assumption and show that the proposed approach achieves state-of-the-art performance on a number of challenging datasets..

Miscellaneous

  • I was a PhD student of the late Ben Taskar.
  • The Taskar Center for Accessible Technology (TCAT) was lauched by Anat Caspi in November, 2014. I am excited about its mission. Anat's unique perspective lead to innovative technology and products which would improve the quality of life for many.
  • I'm fascinated by different kinds of puzzles. At some point I tried to design a few: Sea Virus, Chocolate Crush.