CS 519, Applied Machine Learning, Spring 2020, Paper Review
Your Paper Review (min. 4 pages, max. 6 pages, 12 pt font, single-spaced, figs/tables at most 0.75 pages), due on Monday June 8 (submit a single PDF), must cover at least:
Use 12pt font, single space. Use LaTeX if possible.
non-technical background (3 pts):
- Who: Who are the authors? Which institutions are they from? Who are the PI and who are the students? Are there any interns?
- Where: Where and when was this paper published?
Note: it's possible that a paper is first published
in a conference and later expanded to a journal paper,
so check if this is the case.
Did this paper receive any recognition such as an award or nomination?
Does this paper have impact (number of citations)?
Is the impact increasing or decreasing (trend in the number of citations)?
Are there media reports about this paper?
Did the authors create and release any dataset?
If not, what the datasets did they use,
and are they freely available online?
Is there a clear train/dev/test split?
Did the authors release their code?
Are these datasets and code influential?
Is there a demo? Can you find slides or talk videos about this paper?
Overall, how reproducible is this paper?
core (the famous what-why-how-wow template for writing abstract/intro) (8 pts):
- What: What problem are the authors trying to solve? Is this a new problem?
If not, what are the notable previous approaches, and what are their limitations?
- Why: Why did they choose this problem? Is it hard? Is it important?
- How: What's the authors' approach to tackle this problem?
- Wow: Did this approach result in great results?
further: (3 pts)
- But: What flaws or limitations did you see in the authors' approach or results?
- More: If you were to follow up on this line of work, what topics/methods will you work on?
- All: What's your overall feeling of this paper? What's the single take-home message you learned from it?
relevance: (1 pt)
- Did materials covered in this course help you understand this paper?
How relevant is this paper to this course?
- What extra materials did you study in order to understand this paper?
Hint: Google Scholar is your friend. Use it to find freely-available PDFs for journal papers, citation counts and trends, bibtex files, etc.
List of Candidate Papers (you must choose a paper from this list)
bias, bias amplification, and fairness in machine learning (recommended)
- Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints (2017)
- Feature-Wise Bias Amplification
- Equality of Opportunity in Supervised Learning (2016)
large-scale machine learning
question answering and truly-blind competitions (recommended)
- SQuAD 1.0 (2016)
- SQuAD 2.0 (2018)
- CoQA (2018)
deep reinforcement learning
- Atari: journal version (non-technical); conference version (more technical) (2015)
- AlphaGo (2016)
- AlphaGoZero (2017)
- AlphaZero (2018--2019)
deep learning in language and vision
- show and tell: Show and Tell: A Neural Image Caption Generator, 2014--2015
- show, attend, and tell: Show, Attend, and Tell: Neural Image Caption Generation with Visual Attention, 2015--2016
- neural machine translation: Neural Machine Translation by Jointly Learning to Align and Translate 2014--2015
- sentence representation: Dependency-based Convolutional Neural Networks for Sentence Embeddings, 2015
- listen and tell: Audio Caption: Listen and Tell, 2019
deep learning in biology
- protein folding: Distance-based protein folding powered by deep learning, 2019
- protein folding: AlphaFold: Improved protein structure prediction using potentials from deep learning, 2020
- RNA folding: RNA Secondary Structure Prediction By Learning Unrolled Algorithms, 2020