Skip to content

Latest commit

 

History

History
261 lines (250 loc) · 7.1 KB

task-hierarchy.md

File metadata and controls

261 lines (250 loc) · 7.1 KB

Task Hierarchy

Guidelines / FAQs for Contributors:

  • Massaging the task hierarchy categories is somewhat encouraged.
  • src/auto_add_domain.py is helpful for adding domains for all tasks in any particular dataset

Task Categories

  • Translation
  • Question Answering
  • Program Execution
  • Question Generation
  • Sentiment Analysis
  • Text Categorization
  • Text Matching
  • Toxic Language Detection
  • Cause Effect Classification
  • Information Extraction
  • Textual Entailment
  • Wrong Candidate Generation
  • Named Entity Recognition
  • Commonsense Classification
  • Fill in The Blank
  • Text Completion
  • Sentence Composition
  • Title Generation
  • Language Identification
  • Question Understanding
  • Sentence Perturbation
  • Answerability Classification
  • Summarization
  • Coreference Resolution
  • Text Quality Evaluation
  • Text to Code
  • Paraphrasing
  • Dialogue Generation
  • Question Rewriting
  • Word Semantics
  • Pos Tagging
  • Linguistic Probing
  • Story Composition
  • Speaker Identification
  • Word Analogy
  • Data to Text
  • Stereotype Detection
  • Negotiation Strategy Detection
  • Dialogue Act Recognition
  • Gender Classification
  • Coherence Classification
  • Explanation
  • Ethics Classification
  • Word Relation Classification
  • Sentence Ordering
  • Answer Verification
  • Mathematics
  • Intent Identification
  • Keyword Tagging
  • Code to Text
  • Dialogue State Tracking
  • Text Simplification
  • Stance Detection
  • Fact Verification
  • Grammar Error Detection
  • Section Classification
  • Number Conversion
  • Style Transfer
  • Speaker Relation Classification
  • Irony Detection
  • Question Decomposition
  • Overlap Extraction
  • Grammar Error Correction
  • Spelling Error Detection
  • Entity Generation
  • Sentence Expansion
  • Discourse Connective Identification
  • Discourse Relation Classification
  • Poem Generation
  • Entity Relation Classification
  • Punctuation Error Detection
  • Spam Classification
  • Paper Review
  • Sentence Compression
  • Preposition Prediction
  • Misc.

Reasoning

  • Abductive Reasoning
  • Analogical Reasoning
  • Argument Reasoning
  • Causal Reasoning
  • Commonsense Reasoning: Tasks related to activities humans do in daily life e.g. eating breakfast in the morning, sleeping during night etc.
    • Commonsense Reasoning -> Numerical Commonsense Reasoning: Tasks which requires numerical commonsense knowledge e.g. a car has 4 wheels.
    • Commonsense Reasoning -> Physical Reasoning: Tasks involving physical interactions with objects e.g. a knife (and not a paper) is used to cut objects
    • Commonsense Reasoning -> Social Situations
    • Commonsense Reasoning -> Spatial Reasoning
  • Counterfactual Reasoning
  • Cross-document Reasoning
  • Deductive Reasoning
  • Discrete Reasoning
  • Ethical Judgement
  • Ethics
  • Grammatical Reasoning
  • Logical Reasoning
    • Logical Reasoning -> Reasoning with Symbols: Tasks where symbols represent various things e.g. if X is the number of apples in the fridge today morning and Y is the number remaining after I ate a few apples, X-Y is the number of apples I ate.
  • Mathematics
    • Mathematics -> Algebra
    • Mathematics -> Arithmetic
    • Mathematics -> Combinatorics
    • Mathematics -> Counting: Count an attribute of input e.g. a task to count number of vowels in a given word
    • Mathematics -> Geometry
    • Mathematics -> Statistics
  • Multihop Reasoning
  • Numerical Reasoning
    • Numerical Reasoning -> Numerical Commonsense Reasoning: Tasks which requires numerical commonsense knowledge e.g. a car has 4 wheels.
  • Planning: Tasks which need some sort of planning e.g. how to go to Hawaii?
  • Quantitative Reasoning
  • Reasoning on Actions
  • Reasoning on Numbers: When inputs are numbers, e.g. finding the maximum of a list
  • Reasoning on Objects
  • Reasoning on Social Interactions
  • Reasoning on Strings
  • Reasoning with Symbols
  • Relational Reasoning
  • Scientific Reasoning
  • Temporal Reasoning
  • Textual Entailment
    • Textual Entailment -> Abductive Reasoning
    • Textual Entailment -> Analogical Reasoning
    • Textual Entailment -> Deductive Reasoning
    • Textual Entailment -> Inductive Reasoning

Domain

  • Accounting
  • Animals
  • Anthropology
  • Architecture
  • Art
  • Astronomy
  • Biology
    • Biology -> Anatomy
    • Biology -> Bioinformatics
    • Biology -> Clinical Knowledge
    • Biology -> Human Biology
    • Biology -> Virology
  • Books
  • Business Ethics
  • Captions
    • Captions -> Image Captions
    • Captions -> Video Captions
  • Chemistry
  • Code
    • Code -> Language
      • Code -> Language -> Python
      • Code -> Language -> SQL
    • Code -> Repo
      • Code -> Repo -> Github
      • Code -> Repo -> Stack Overflow
  • Commonsense
    • Commonsense -> Concepts and Relations
      • Commonsense -> Concepts and Relations -> Physical Commonsense: a context involving two physical objects with contrasting properties, usage, locations, etc.
      • Commonsense -> Concepts and Relations -> Social Commonsense: a situation involving two people with contrasting attributes, emotions, social roles, etc.
      • Commonsense -> Concepts and Relations -> Spatial Commonsense
    • Commonsense -> Stories
  • Computer Science
    • Computer Science -> Computer Security
    • Computer Science -> Machine Learning
  • Conference
  • Countries
  • Debatepedia
  • Dialogue
  • Econometrics
  • Economics
    • Economics -> Macroeconomics
    • Economics -> Microeconomics
  • Electrical Engineering
  • English Exams
  • Fiction
  • Food
  • Formal Fallacy
  • Game
    • Game -> Card Game
  • Geography
  • Global Facts
  • Government and Politics
  • Healthcare
  • History
    • History -> 9/11 Reports
    • History -> European History
  • Human Race
  • Human Sexuality
  • International Law
  • Jurisprudence
  • Justice
  • Knowledge Base
    • Knowledge Base -> Freebase
    • Knowledge Base -> Wikidata
  • Law
  • Linguistics
  • Literature
  • Logic
    • Logic -> Formal logic
    • Logic -> Propositional Logic
  • Management
  • Marketing
  • Mathematics
  • Medical Genetics
  • Medicine
  • Miscellaneous
  • Moral Scenarios
  • Movies
  • Music
  • Narrative
    • Narrative -> Everyday Events
  • Natural Science
    • Natural Science -> School Science Textbooks
  • News
  • Nutrition
  • Personal Narratives
  • Philosophy
  • Physics
  • Pop Culture
  • Prehistory
  • Professions
  • Psychology
  • Public Places
    • Public Places -> Restaurants
  • Public Relations
  • Reviews
    • Reviews -> Books
    • Reviews -> Electronics and Grocery
    • Reviews -> Food
    • Reviews -> Movies
    • Reviews -> Music
    • Reviews -> Restaurants
    • Reviews -> TripAdvisor
  • Scientific Research Papers
  • Security: Environmental Security
  • Security: National Security
  • Social Media
    • Social Media -> Reddit
    • Social Media -> Text Message
    • Social Media -> Twitter
  • Sociology
  • Sports
    • Sports -> NFL
  • Statistics
  • Stereotypes
  • Story
  • TED Talks
  • US Foreign Policy
  • Web
  • Wikipedia
  • World Religions

Language