How do I annotate a paper?
It is recommended that you read the paper first in .pdf prior to annotating it sentence by sentence. When annotating the papers you should also have annotation guidelines handy.
At the SAPIENT Index page, click on the paper you want to annotate. This will re-direct you to a new page, where the paper is displayed sentence by sentence.
Annotation involves selecting for each sentence an option from EACH of the three drop-down menus below it. Please do not leave sentences with incomplete annotations.
a) The first drop-down corresponds to the types of CoreSC one can assign to a sentence. The CoreSCs are also visible at all times in the top menu bar.
b) Depending on the type of CoreSC you have chosen, you may also need to specify properties of the CoreSC, which corresponds to the second drop-down (subtypes). For most CoreSC types the only subtype option is <None>, which means that there are no properties to be chosen. <Object> , <Method> and <Motivation> (the latter in SAPIENTA but not SAPIENT) constitute exceptions. <Method> can have the properties <New>/<Old>, specifying whether the <Method> is <Old> or <New> (see the annotation guidelines). Or it can have the properties <Advantage>/<Disadvantage>. The latter properties can be chosen when there is already a sentence annotated as <Method> and the current sentence refers to the <Advantages> or <Disadvantage> of the particular method. Similarly, <Object> can have the properties <New> and <Advantages>/<Disadvantage>. <Motivation> can have the properties <New>/<Old>/<Future>
c) The third drop-down corresponds to concept identifiers (IDs). A concept may span over several sentences, so we cannot rely on using sentence IDs (the numbers to the left of each sentence) to keep track of different concepts. Concept IDs are contingent upon the type of CoreSC; Once you have selected the CoreSC type of a sentence, its concept ID can either correspond to an already annotated sentence of the same CoreSC type or it can be a new ID, for a new instance of this CoreSC type. To choose between the two possibilities, decide whether the sentence talks about the same CoreSC concept as a previous sentence or not.
Comments (0)