Neeraj Varshney

Ph.D. Candidate
Natural Language Processing (NLP)
2019 ‐ Spring 2024 (Expected)
School of Computing & AI
Arizona State University
nvarshn2 at asu dot edu

I work in Natural Language Processing / Understanding, primarily towards addressing different Efficiency and Reliability aspects.

Specifically, I focus on problems such as Mitigating the Hallucinations of LLMs, Efficient LLM Decoding, Instruction Tuning, Question Answering, Inference Efficiency, Text Generation, LLM Defense Strategies, Selective Prediction, Training Sample Efficiency, Large Language Models, and Retrieval Augmented Inference.

I have published papers on these topics at premier AI and NLP conferences including ACL, EMNLP, EACL, NAACL, AAAI, and AAMAS.
My Research Wrok


May 15, 2024

My 3 papers have been accepted to ACL 2024.
1. On LLM Defense Strategies studying Safety and Over-Defensiveness
2. On sycophancy of LLMs
3. On Logical Reasoning Ability of LLMs

Will share the camera-ready versions soon.

May 6, 2024

I have joined Amazon as an Applied Scientist.

Apr 8, 2024

Awarded Outstanding CS PhD Graduating student for the 2023-2024 academic year, ASU.

Apr 3, 2024

Defended my PhD Thesis title "Addressing Efficiency and Reliability Challenges in Natural Language Processing"

Mar 14, 2024

My work on accelerating Large Language Models Inference (Accelerating LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with LITE) has been accepted to appear at NAACL 2024 Findings

Feb 8, 2024

SCAI doctoral fellowship award from School of Computing and AI, ASU.

Oct, 2023

GPSA Outstanding Research Award Fall 2023, ASU.

Oct 7, 2023

My paper On Developing Adversarial Attacks for Evaluating Logical Consistency of LLMs has been accepted to appear at EMNLP 2023.

July 8, 2023

My work on addressing the hallucination problem of Large Language Models (A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation) is available on arXiv.

June 16, 2022

Received Graduate College Travel Award Q1 for ACL 2023 from ASU.

May 22, 2023

Started NLP Research Internship at Tencent AI, Bellevue.

May 2, 2023

Selected as Outstanding Reviewer for EACL 2023 (Question Answering Track).

May 2, 2023

My two papers got accepted to ACL 2023. One paper is on improving the "reliability of QA systems" and the other one on "addressing novelties in an NLP task". Will share more details soon.

May, 2023

My paper got accepted to TrustNLP workshop @ ACL 2023.

Apr 17, 2023

Successfully completed my PhD Prospectus Defense and Comprehensive exam.

Mar 10, 2023

Reviewed for ACL 2023 (Question Answering Track).

Jan 30, 2023

SCAI doctoral fellowship award from School of Computing and AI, ASU.

Jan 21, 2023

My paper "John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility got accepted to EACL 2023.

Jan 3, 2023

My paper "Methods and Mechanisms for Interactive Novelty Handling in Adversarial Environments" has been accepted to appear at the 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023).

Dec 27, 2022

Received Graduate College Travel Award FY23 Q3 for AAAI from ASU.

Dec 22, 2022

Selected for AAAI 2023 Student Scholarship.

Dec 7-11, 2022

Presented my EMNLP 2022 papers in-person in Abu Dhabi.

Nov 26, 2022

Reviewed for EACL 2023 (Question Answering Track).

Nov 19, 2022

My paper "Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?" has been accepted to appear at the AAAI'23 Workshop on Knowledge Augmented Methods for NLP.

Oct 27, 2022

Received ASU GPSA Travel Award for EMNLP 2022.

Oct 6, 2022

Received SACI Conference Award for EMNLP from ASU.

Sep 26, 2022

Received Graduate College Travel Award FY23 Q2 for EMNLP from ASU.

July 25, 2022

Crossed 50K views on my medium articles.

June 21, 2022
May 23, 2022

Presented my papers at ACL 2022 in Ireland.

Summer 2022

Applied Scientist internship at Amazon Science under the mentorship of Alessandro Moschitti, Rik Koncel-Kedziorski, Siddhant Garg, Ivano Lauriola, Ankit Chadha.

Apr 15, 2022

Received Spring 2022 ASU GPSA Travel Award.

Apr 7, 2022

Received registration award from Repl4NLP workshop @ACL 2022.

Mar 30, 2022
Mar 8, 2022
Feb 26, 2022
Fall 2021

Mentered class projects for Natural Language Processing course at ASU.

Aug 2019

Started Computer Science Ph.D. program at Arizona State Univeristy.

July 2018

Joined Microsoft India as a Software Developer.

June 2018

Completed B.E. in Computer Science with Distinction (GPA: 9.11) at Birla Institute of Technology & Science, Pilani.

Fall 2018

Internship at Microsoft.

Summer 2017

Internship at Samsung R&D Institute.

Summer 2016

Internship at Valuefirst Digital Media.

Aug 2014

Started B.E. in Computer Science at Birla Institute of Technology & Science, Pilani.