Skip to main content
SearchLogin or Signup

Chapter 2

Annotation is an informative literary practice. Glosses, rubrics, scholia, and labels provide information about the reader and the reader’s private or social reading practices, about the text, and about relevant scholarly, interest-driven, professional, and political contexts.

Published onJun 05, 2019
Chapter 2

2: Annotation Provides Information

The vitality of language lies in its ability to limn the actual, imagined and possible lives of its speakers, readers, writers.

—Toni Morrison, Nobel Lecture

Toni Morrison was awarded the Nobel Prize in Literature, in 1993, for “novels characterized by visionary force and poetic import.” In her Nobel Lecture, Morrison noted how language, whether spoken or written, can limn - or describe and detail - life. Limn is a distinctive verb; derived from the Latin illuminare, meaning to “make light” or “to illuminate,” the word has been used throughout literary history to generally describe - and, in some cases, to convey the literal illustration of - a manuscript. Can annotation limn, or help to describe? And if so, what does such annotation do? Let’s return to our annotated copy of Beloved.

Perhaps as a student you highlighted key passages of Beloved, jotted notes in the margins, or repeatedly scribbled stars and question marks, all to better illustrate your growing literary knowledge. Although your annotation of Beloved may be idiosyncratic, such activity extends a lineage of historic reading practices evident throughout the early modern period (approximately 1500-1800). Heidi Brayman Hackel’s study of that period’s book use among “less extraordinary readers” - and that would be everyday folks, like us - suggests people added various types of marks while reading their books.1

Marks of active reading, like underlining, indicated sustained engagement. Marks of ownership, like a signature, distinguished books as valued, physical objects. And marks of everyday recording, perhaps unrelated to the book’s content, added ancillary information. In Brayman Hackel’s assessment, with varied annotation practices “the book takes on a different role: as intellectual process, as valued object, and as available paper.”2 Perhaps your annotation of Beloved illustrated burgeoning intellectual acumen, or how much you valued the book, or perhaps it was just some paper to record the latest hallway gossip. It was George Steiner, the literary critic, who once suggested an intellectual was “quite simply, a human being who has a pencil in his or her hand when reading a book.”3 However you may have used that pencil while reading Morrison’s Beloved, your annotation provided information.

Annotation is an informative literary practice. Annotation, as with our example of Beloved, can signal different information to different readers. Notes of active reading may have better aided your future essay-writing and study, or have indicated to your teacher that you’re no dummy. Notes of ownership or recording may have also provided a stranger, who subsequently acquires this “used” copy from a bookstore, with insight about private noticing and musing. We know from those who have studied the history of books and reading practices that annotation was both ubiquitous and habitual by the 1500s, not long after the invention of the printing press and the growth of print culture. Such Medieval annotation also included drolleries, or small decorative images, drawn in the margins; what information might we glean from killer rabbits?4

Figure 7: Drollery/killer rabbit

By the 1600s, “graffiti” among the early modern book routinely provided information by adding detail, indicating references (particularly to scripture and classical literature), emphasizing importance, translating or clarifying terminology, and organizing the text.5

As with annotation today, notes can provide information about the reader and the reader’s private or social reading practices, about the text and relevant scholarly or political contexts, or maybe about a flower once pressed between the pages of a book.

Forms that Inform

As we will discuss throughout this chapter, what kind of information annotation provides, the contexts in which this information is written and received, and the modes through which this information is interpreted collectively influence how annotation is authored, understood, and trusted. To more easily examine the forms of annotation that provide information - as well as to foreground terminology used throughout the book - it’s useful at this point to distinguish among a few types of notes that, in both historic and contemporary contexts, have been added to texts.

In her oft-cited Marginalia: Readers Writing in Books, Heather Jackson, a professor of English at the University of Toronto, presents an extensive study of book annotation from 1700 into the twentieth century. Jackson focuses exclusively upon marginalia, or discursive and responsive notes written by hand anywhere in a book (and not only in the book’s margin). While non-verbal markings, including evidence of readers’ attention and engagement via asterisks or characters, are not marginalia according to Jackson, we do consider this repertoire of signs and symbols an important form of annotation (particularly among digital texts and contexts). Among book marginalia, however, Jackson categorizes three “basic particles:” the gloss, the rubric, and the scholium. Glosses, rubrics, and scholia each provide different types of information.

Remarking upon the complex relationships among readers, text, and annotation, the scholar James Nohrnberg once suggested: “Everything we read is thus a gloss upon, or a translation of, some original improvement upon silence.”6 While that may be true, in our book we appreciate Jackson’s suggestion that a gloss serves the explicit purposes of translation and explanation. Glosses, in her assessment, were often added to assist book readers with foreign and obscure words. The utility of glosses is underscored by the historian Anthony Grafton, who observed that “the margins of manuscripts and early printed texts in theology, law, and medicine swarm with glosses which, like the historian’s footnote, enable the reader to work backwards from the finished argument to the texts it rests on.”7 Glosses are literal and instructive. And in their more expansive and curated form, glosses comprise what we know of today as a glossary.

In addition to the gloss, book marginalia may also include a second form of annotation known as a rubric. The Latin rubrica translates as “red” and is the traditional color of rubrics found throughout medieval manuscript annotation. Jackson describes rubrication as the “scribal practice of writing or marking certain words in red,” with rubrics often corresponding to chapters, sections, or headings.8 The scholar of medieval literature Stephen Nichols suggests rubrics are an “extradiegetic intervention,” intentionally written in a color of ink different from the main text (hence red) so as to provide “metacritical perspective.”9 Rubricated manuscripts, like the thirteenth century French manuscript in Figure 8 (also further proof that doodling in the margins is a time-honored phenomenon), demonstrate how such medieval annotation predated forms of book marginalia by centuries. Together, and in a more contemporary print context, a group of rubrics becomes a book’s index.

Figure 8: French manuscript

A third form of marginalia that provides information is the scholium. Often referred to using the plural scholia, this type of annotation introduces to the text a new note, according to Jackson, “From outside the work that some scholar (usually) has judged relevant to it.”10 Scholia can elucidate an idea, share a useful example, provide a historical reference, or either affirm or contradict the author. Among famous instances of scholia are those added to the oldest copy of Homer’s Iliad, known as the Venetus A. This 645-page parchment book, written by Byzantine Greek scribes in the tenth century, includes both the full text of the Iliad and two sets of marginal scholia based upon the scholarship of Aristarchus.11 Scholia, when gathered together as complementary to a source text, established the literary genre of commentary.12

As discussed, our interest in annotation extends beyond book marginalia and print culture. Accordingly, our survey of annotation forms that inform should also include more than glosses, rubrics, and scholia (and drolleries of killer rabbits). Recall that we introduced annotation as multimodal notes in our previous introduction. Annotation, even when written, may be added to texts that communicate in multiple complementary modes. The history of cinema and the development of the motion picture industry relied upon text that was filmed and then manually edited into a movie. Silent era films featured intertitles, or text that shared characters’ dialogue or explained narrative elements. One of the most famous intertitles in movie history is still featured in films produced today: “A long time ago in a galaxy far, far away….”

Other types of annotation added to movies and television include subtitles that provide translation from one language to another. Textual and graphical information - picture the always-crawling news ticker - appear via annotation in the lower third of many broadcasts. Furthermore, multimodal annotation is critical for information accessibility. Closed captioning is a form of annotation that provides needed visual information, including the ability to read along when watching a public television at the gym or bar. And Twitter now allows users to add text descriptions to a tweet’s image that can be read aloud by assistive screen reading technology.

Forms of annotation - like subtitles and closed captions - provide information. This is why we previously suggested annotation is an everyday activity. Among scholarly traditions, forms of marginalia provide intellectual lineage to substantiate claims and offer the academic receipts relevant to skeptics and stalwart researchers. And annotation provides information privately or for self-interest. Whether doodling atop assigned course materials or adjusting a recipe, annotation can elevate a text from generic to personally sacred. As Edgar Allen Poe wrote, in 1844, “In the marginalia, too, we talk only to ourselves; we therefore talk freshly - boldly - originally - with abandonnement - without conceit.”13

Figure 9: Poe quote


Another form of annotation that informs are labels. Labels provide various kinds of information. When you’re at the grocery store, a label informs you that the red stuff in that jar is strawberry jam, rather than cherry. If you’re training a computer algorithm using image samples, a label will inform the program “this is a cat,” and not a cheeseburger - despite some visual similarity and the former perhaps having the latter.

Labels are like a gloss, literal and instructive. As a note added to a text, labels provide useful and contextual information. Texting a friend with your iPhone? Apple’s Messages app allows you to label a message with symbols - like a heart or a thumbs up - to add information.

Figure 10: text label

Writing computer code? The programming language Java includes a set of standard annotations, all of which begin with the @ symbol, to label code and provide additional information about how certain methods should be performed. You likely read labels as annotation added to graphs and other visualizations, as with the graph of global GDP featuring labeled historical events and geographic regions. These are just some examples of the plethora of labels appended to texts in everyday contexts.

Figure 11: GDP

When you text a friend, that message includes a time stamp, a confirmation that it was “delivered,” and - depending on whether your friend has the feature enabled - a confirmation that the recipient read the message. This addition of labeled information is increasingly automated. Similarly, when using social networks we often know when a message was sent, from what location, and even from what kind of device. This additional information is conveyed through words, numbers, and symbols - including emojis and GIFs - added as labels to the primary message. As discussed in our introduction, symbols like the “Like” buttons of Twitter and Facebook layer a label upon a text message. As everyday forms of annotation, these labels reflect the pervasiveness of notes attached to texts both automatically and also purposefully. This additional information imperceptibly shifts our relationship to texts and notes.

Let’s consider in more detail two important uses of annotation as labeling: machine learning and scientific research. Both cases underscore the ubiquity of annotation and the utility of labeling to make meaning and produce new knowledge.

Have you ridden in an autonomous vehicle? Maybe you only trust self-driving cars as far as you could throw one. Whatever the case, the inevitable growth in autonomous transportation - among ride-hailing services, long-haul trucking, and autopilot features in luxury cars - will be aided, in part, by annotation. How so?

Consider all the various road signs - and the myriad colors, shapes, lights, and electronic messages of those signs - that influence your ability to safely commute from home to work and back again. Then add to that all the other vehicles, unanticipated obstacles, cyclists, and pedestrians on the go. How do artificial intelligence (AI) systems that pilot an autonomous vehicle distinguish among these variables to make intelligent, safe, and accurate decisions? The AI needs to learn from lots and lots of data.14 And whether with AI that powers autonomous transportation, customer service bots, precision agriculture, product recommendations, or targeted advertising, that data need to be labeled.

In simplest terms, annotation in the area of machine learning is the process of labeling data. Data like text, images, or audio are routinely gathered from cameras, sensors, and social media. And these data are often unstructured. In order to train AI systems to make sense of and also make informed decisions based upon these data, it’s necessary for data to be identified. That’s were annotation plays a role. And so, too, many people whose jobs are primarily dedicated to labeling data. The manual labeling of data - that is, annotation by people - remains a preferred method, though it is time-intensive, not error-proof, and may be biased.15 Because automated annotation - annotation by AI - is much faster, much cheaper, and ever-more accurate, there is vigorous debate about the merits of manual versus automated data labeling. In some instances, people check samples of automatically labeled data to ensure AI accuracy, or people rely upon automated annotation suggestions to improve their labeling.16

There are now numerous data annotation companies specializing in all manner of services, technologies, and processes for labeling data. And business is booming, both in the United States and globally.17 Companies like Infolks and iMerit employ thousands of workers across India who manually label images using techniques like bounding box and contour annotation. The labeled images will train autonomous vehicle algorithms to better identify road obstacles and conditions.18 And techniques for semantically tagging data go beyond mere labeling to add new information so that AI can learn to establish links, filter, and make inferences or predictions. Billions of images, billions of text segments, and billions of social media data are now annotated each year to power the intelligent algorithms that many of us take for granted as we shop, work, commute, watch recommended movies, and listen to suggested playlists.

Just as labeling has helped advance business innovation, so too has data annotation fueled scientific research and discovery.

One of the most famous examples of data labeling is the Human Genome Project, the effort that successfully identified and mapped all the genes comprising human DNA. To do so, scientists used genome annotation processes that added information - such as the name, location, and function of genes - to labeled and sequenced genetic material.19 Techniques for the manual and automatic labeling of genetic information continue to improve the accuracy, speed, and scale of such annotation, as with RNA and proteins.20 Similar processes have established databases of annotated genomes for vertebrates like mice and chimpanzees,21 as well as for worms and Drosophilidae, the most commonly studied laboratory organism.22

As labeling methods improve, some scientists have advocated “democratizing genome annotation” through the use of open source technology.23 Genomic annotation - essentially the identification and labeling of genetic data - has contributed new scientific understanding of evolution and disease, guided improvements to medicine, and helped develop bioinformatics. Yet at the same time, critique about the role of automated annotation for AI suggests increased consideration of data ethics and the unintended consequences of human-machine automation24 – a concern we’ll revisit in Chapter 7.

For biologists, or those who have studied biology, another use of annotation-as-labeling can be found in the phylogenetic tree. Ever since Darwin published The Origin of the Species in 1859, the idea of an evolutionary “tree” - and the popular conception of the tree of life - has motivated visual depictions of the relationship among different species. A phylogenetic tree is, simply, is a branching diagram that displays the phylogeny, or the evolutionary relationships, among individuals or groups of organisms based upon their similarities and differences. Today, phylogenetic trees are a common tool in biological study and technologies assist scientists in creating interactive and annotated trees. One popular web-based technology for the annotation of phylogenetic trees is Interactive Tree of Life, a free tool that supports both manual and automated annotation, customizable visualization and labeling, and the ability to link annotations to related datasets.25

Recently, automated annotation of mammography records were found to quickly identify meaningful data about patient needs.26 Although the technology needs to improve before use, one day doctors might use these annotated clinical records to make more informed decisions about patient care. It is very encouraging that annotation as labeling plays a small role in potentially helping doctors to better identify and treat breast cancer.

To continue exploring how forms of annotation inform, the remainder of this chapter focuses on promising possibilities for democratizing annotation and information using digital tools and practices. But before we do so, it’s necessary that we recognize how the relationship between annotation and information is neither arbitrary nor incidental. Seldom are chemistry formulas annotated within Beloved, nor literary analysis inside a grandmother’s cookbook. The 6,106 annotations comprising “Your Biking Wisdom in 10 Words,” a series of interactive maps curated by The New York Times and annotated with advice and opinion, is - presumably - most useful for cyclists in a given city who desire information about a relaxing ride or a safe commute.27 Ideally, annotation provides information that is useful, relevant, and timely.

Information Needs Context

Whether with manuscript annotation from the Elizabethan era or human-assisted annotation of big data, annotation is dependent on context. Let’s revisit the early modern period to better appreciate how information needs context. Now considered required reading for English majors, John Dryden’s 1681 poem Absalom and Achitophel is satire that relies upon readers’ knowledge of seventeenth century English politics, like the Popish Plot, as well as the biblical story of Absalom and King David. Knowing that readers in his day would understand and appreciate the biting and satirical poem, Dryden offered an introductory explanation about the intent of his genre-specific writing: “The true end of satire is the amendment of vices by correction.”

Were you to read Absalom and Achitophel three-and-a-half centuries after publication, understanding the poem’s political and biblical context, as well as its satirical nature, might require additional information. Today, readers of the poem often turn to footnotes, explanatory essays, and even primers in biblical literature before coming to terms with the poem’s content and meaning. Whether for scholars or students cramming for an English exam, such annotation is particularly useful in adding information about the poem’s characters as Absalom and Achitophel is a veiled allegory about King Charles II. Readers, today, benefit from annotation providing contextual information about Absalom and Achitophel; and so, too, did Dryden’s contemporaries require annotation. Printed versions of the poem often featured an annotated “key,” as in Figure 12, handwritten by the manuscript owner associating biblical characters with corresponding members of English royalty.

Figure 12: A&A key

The “keys” added to Absalom and Achitophel demonstrate how annotation can assist with, in the words of English professor William Slights, “Transporting information across the borders of the printed page.”28 Both readers of the past and present require contextual information - provided by annotation - to more fully comprehend Absalom and Achitophel. And so, too, does this information help contextualize the poem’s purpose in a given period of time. When Dryden wrote the poem, it functioned as palace intrigue; today, the poem is regarded as quintessential satire and lauded for the use of heroic couplets.

Absalom and Achitophel is a useful example of how annotation provides information, as well as how that information needs context so readers can make sense of both text and note. As a poem with layered meaning and complex wordplay, Dryden’s work required - and, to this day, still requires - annotation for readers to make sense of overlapping historical, political, biblical, and aesthetic contexts. And with Absalom and Achitophel regarded as a valued contribution to English literature, contemporary readers rely upon annotation as contextual information to understand both the poem’s content and its scholarly significance in the literary landscape. The utility and relevance of annotation providing information implies that annotation is written, read, and informative within particular contexts - and so, too, particular communities.

Information among Knowledge Communities

When forms of annotation inform, and when annotation of a text provides information within and about a given context, the value and meaning of annotation may be pertinent to the interests of a group. We’ve mentioned various groups in this chapter, including medieval scribes, data annotators, and scientists. The activities of these groups are broadly concerned with the consumption, production, and dissemination of knowledge. In this respect, we might refer to a certain group - and whether among religious, professional, or scholarly settings, and often across networks and geography - as a knowledge community. And one important social practice among knowledge communities is the use of annotation to provide information.

In this final section of Chapter 2 we survey two cases of annotation providing information among knowledge communities. The first concerns a particular annotation technology primarily associated in name and function with a specific group, whereas the second describes how an emerging digital annotation infrastructure - and an exemplar technology - has assisted multiple communities to meet their diverse needs.

First, think of your favorite song. Maybe it’s a golden oldie from yesteryear, a hip-hop classic, or a recent earworm. No matter the case, there’s a very good chance that other people are fascinated by the song and its lyrics. The company Genius - formerly Rap Genius - maintains one of the most robust and lively communities for music fans to gather, discuss, and debate information about popular music.29 Genius uses annotation authored by their users, called “scholars,” to provide information about songs and increase the community’s “collective music IQ.” With over 25 million songs and two million contributors and editors, Genius is filled with interpretations, clarifications, and confirmations about song lyrics from all music genres.30

Genius annotation provides all manner of information, from highlighting historical facts within a song, to personal interpretation, to disagreement over the intended meaning of a lyric. A distinctive feature of Genius is “verified” annotation authored by artists and performers who provide their expert perspective and background knowledge. For example, the second studio album from Pulitzer Prize-winner Kendrick Lamar begins with the track “Sherane a.k.a Master Splinter’s Daughter.” On Genius, Lamar has contributed a number of verified annotations that provide information about the meaning of his song, as with the lyric: “The parade music we made had us all wearin’ shades now.” Lamar’s annotation informs his audience:

It is just basically talking about just the vibe and the atmosphere, more the party vibe. When I say ‘parade’ I am talking about the actual party and everybody having a good time, and making this feel like we have grown. We are feeling like we are adults, but really we don’t know shit. We are just faking it and living carefree.31

Genius is the twenty-first century version of the Great American Songbook, transformed into an interest-driven social network whose hive mind collaboratively annotates lyrics to inform and make meaning of songs and pop culture.

Whereas Genius refers to a specific technology and community whose annotation provides information, there is a long history of other digital and, now, web-based approaches to annotation that serve similar purposes for diverse knowledge communities.32 Web annotation is a means of annotating anything anywhere online, extending a layer of information and interactivity atop the entire web. According the World Wide Web Consortium (W3C), the standards body of the web, web annotation “can be linked, shared between services, tracked back to their origins, searched and discovered, and stored wherever the author wishes; the vision is for a decentralized and open annotation infrastructure.”33 Thanks to the W3C, this standards-based and interoperable approach to annotation,34 referred to as open web annotation, draws from a history of open-source software development, follows principles of the open web like accessibility and transparency, and advances digital annotation that provides information - and interaction - to any user of the web. And the technology that perhaps best exemplifies open web annotation is Hypothesis.35

Projects and research featuring Hypothesis open web annotation will appear throughout this book, as when we discuss journalism and fact-checking in Chapter 3, scholarly dialogues and peer review in Chapter 4, and various educational efforts in our chapter about learning (and full disclosure; we have collaborated with Hypothesis on various programs and research efforts). As an initial example of how Hypothesis provides information to knowledge communities, let’s consider how open web annotation can make research more accessible and transparent.

Annotation for Transparent Inquiry (ATI) is a collaboration among the Qualitative Data Repository (QDR) at Syracuse University, Hypothesis, and Cambridge University Press.36 ATI has been described as a “new approach to achieving transparency in qualitative research in the health and social sciences.”37 When conducting a study, researchers may collect all types of qualitative data to support their scholarly investigations and interpretations, such as text from archival documents, audio, video, or images. Some data may then be included as illustrative examples or aggregate summaries in an article, yet seldom can a colleague or curious reader trace a published assertion back to its supporting evidence. While maintaining ethical and legal protections, ATI uses Hypothesis to openly connect data with literature, thereby providing a transparent layer of publicly accessible information. Articles associated with ATI feature a public Hypothesis annotation layer curated by QDR. Individual annotations include citation information, extensive analytic notes, and a link to data housed within QDR databases. ATI, powered by Hypothesis, demonstrates how knowledge communities in the health and social sciences can make research accessible and transparent using open web annotation to provide information.

Whether with a rubricated thirteenth century French manuscript or an openly annotated research article, annotation propels the flow of information across texts and contexts. Notes enable readers to be more informed when engaging with the ideas and meanings of a text. Digital technologies, in particular, have created new opportunities for public, openly networked, and collaborative annotation, helping to democratize who can add a note to a text, how people access annotation, and how this information is shared across networks. Yet the participatory qualities of annotation providing information do not lack complexity or concern, especially when - as we discuss next - annotation blurs the line between information and comment.

christina King: There are various uses for Annotation. It not only an be used for jotting notes of important information. It is often times used to communicate a movie storyline when a person is hearing impaired. It is also used today currently through tweets. ENG3305Dagmar
christina King: Marginalia seemingly acts as a guide or narrator to the setting of a work. An the scholia gives an insight on a particular text within a work.ENG3305Dagmar
christina King: Rubrica is annotation marked in red for significance, meaning. An example of rubrics could be the parts in red found in the King James Bible that highlights Jesus speaking. ENG3305Dagmar
christina King: Annotations provide a window into a readers point of view about the subject matter they are reading. If the make a side note about a passage it is because it is important and has significant meaning about the passage being read. ENG3305Dagmar
christina King: Annotation has been around for a long. It presumptively was used as a means of make note of a extraordinary story or event that has happened. The use of this took account of important or unique details found in books.
Miranda Egger: Again, this may be beyond the scope, but have you checked out Audrey Watters? She is a tech journalist who seeks to hack education by examining its technologies and she is a prominent example of someone who has added script to her blog in order to consciously blocked both comments and annotations. Beyond blocking the hateful trolling and sexist comments that she gets, she makes clear that her choice is also about protesting extraction of “value from my work and shifting it to another company which then gets to control (and even monetize) the conversation” (Watters). I’m not sure where/how this fits, but hearing these voices of dissent might be important somewhere in this work (I could be missing it…I can’t read all chapters at this point).
Remi Kalir: Thanks Miranda. We’re very familiar with her work and address this explicitly in Chapter 5 when discussing power and the question “Can I annotate that?”
Miranda Egger: I wonder if you will talk about the ways these companies use (or don’t) the data entered by annotators? Isn’t there a big difference between Genius and in terms of how the data is used? Maybe that’s beyond the scope of this book (not sure), but the ethics of these companies does seem to matter.
Remi Kalir: Yup, we introduce this when discussing data labeling in this chapter and return, as well, in Chapter 7… though I suspect we’ll expand our discussion of data annotation and ethics as we revise this manuscript.
Miranda Egger: But I think of this quality as a product of crowd-sourcing knowledge. When we open spaces for genuine engagement, we get a diversity of ideas that makes it more timely and relevant and useful (owned and distributed by multiple people, not just one system of production). Right? It is the informal invitation to add to an original text that yields this results, right (going back to my earlier comment on how to distinguish between formal annotation examples and informal examples of readers/consumers annotations).
Miranda Egger: This may be my own pet project, but I’d go so far as to say possible “democratizing readership” and realizing civic participation in digital spaces. Too much? Maybe. :-)
Miranda Egger: Again, images might be really, really powerful here. I can see the parallels more clearly here (cause I’ve seen xrays, presumably), but visuals can do so much to draw the connections that I think you want readers to draw.
Miranda Egger: Is there a visual that could accompany this sort of annotation and make it accessible/relatable to folks like me who can’t see the parallels (beyond the term used to describe the act) between textual annotation and genome annotation?
Miranda Egger: I am wondering (maybe fruitlessly) where the distinction is drawn between the formal annotation of the producer (author and system of production, as indicated by the examples here) and the often-less-than-formal and certainly not often published (until digital social annotation happened) annotation of the reader/consumer of information. Is that distinction unnecessary here?
Miranda Egger: So maybe I’m thinking too narrowly in always wanting to ascribe the agency of marginalia to a ‘reader’ (marked by informality, typically unpublished or published beyond or outside the original producer of text) rather than extratextual elements used by the producers of text, right?
Miranda Egger: Maybe I’m just missing a key point here, but is this marginalia? Or an originally inscribed (even if copied from yet another version of original) element of text to highlight something important? A reader wouldn’t have changed a word to red, for example. Is this indeed a component of readerly marginalia?
Miranda Egger: This last item in the list, while interesting, seems to lack parallelism with the other items in the list. The other items are purposes for annotation, right? Or consequences of those annotation? While this is a specific object (not sure of purpose or consequence).
Miranda Egger: This is a really interesting parallel to draw (one draw between annotation and graffiti). Will this book take a more social justice/equity turn at some point to more fully realize all that an analogy of this sort conjures up?
Miranda Egger: It’s hard to tell from this image, but is this annotation doodling? Is there an image that shows more clearly how this is marginal? I didn’t get it at first glance.
Miranda Egger: My favorite part of a new book (which I always try for a used copy first) is seeing the words through previous readers’ eyes via annotation.
Jeffrey Pomerantz: Don't forget image Captchas, which ask everyday users to annotate images: "Which of these images contain a street sign," for example.
Jeffrey Pomerantz: I see that you discuss metadata below, but this might be a good place to introduce the concept. Seems to me that your machine learning example relies on 2 types of metadata, which perform different functions as annotations: Descriptive metadata is easily generated automatically, & is easier to trust as accurate, as with data from cameras, sensors, etc. Administrative metadata, specifically provenance metadata, which captures info about the sources of data, transformations its undergone, how to use it, etc., can be created automatically but is often still more reliable when created by humans.
Miranda Egger: I do wonder, in all honesty, if this is too minimal a goal or inquiry. For example, I might ask whether annotation has the power to make visible the process of making meaning? Not highlighting some meaning that presumably lives in the manuscript, but the early craftings of meaning itself. I know that’s a more ontological question (of what is and where lives this meaning), but should be asking even bigger, loftier questions of annotation?
Alan Reid: Maybe explain the format here - Genius is mainly hyperlinking, no? And, do you view hyperlinking as a different form of annotation, given that links lead us to the information but often in a disconnected and separate way.
Alan Reid: Wondering if we attribute more validity to labels, though. If annotation is opinion/reflection, then labels might be seen as fact.
Alan Reid: Maybe a self-aware comment here about the use of a footnote, and how the reader of this text might use it.
Alan Reid: Perhaps a brief mention here that annotation can occur digitally as well, though there’s nothing quite like manually notating a text.
Miranda Egger: I agree with Alan here. A brief mention of the modern-day equivalent to the pencil (a keyboard/mouse) might be warranted here. I feel like that brief mention acknowledges how the technologies change practice…all to avoid the elitism of naming the pencil/pen as the “real” way to read actively.
Chris Aldrich: This reminds me a bit of an interesting "annotated" version of the bible which presents the synoptic gospels of the New Testament in parallel which allows one to see where the four stories overlap, diverge, or are completely different. Throckmorton's version is a good example of this sort of presentation:
Chris Aldrich: Similarly mobile apps like Waze allow drivers to annotate road conditions in real-time distributed ways.
Chris Aldrich: An older example: In 1992, I was using chemical labels in the heart along with real-time 3D MRI images to identify cardiac anomalies at Johns Hopkins Hospital.
Chris Aldrich: This sort of genome annotation could also be said to have enabled police to find the serial killer known as the Golden State Killer. see also:
Chris Aldrich:
Chris Aldrich: This is the label you were hoping someone would put on this right? Image courtesy of icanhascheeseburger.
Remi Kalir: precisely
Chris Aldrich: These are known as a chyron.
Chris Aldrich: There was also the broader annotation example in television of the 1990's show Pop Up Video innovated by VH1.
Chris Aldrich: I can't help but gloss the word gloss, [a brief explanation (as in the margin or between the lines of a text) of a difficult or obscure word or expression]. It also seems a bit like the following paragraph actually glosses over a more concrete definition of the word?
Chris Aldrich: Now I'm wondering how to effectuate an asterisk more simply on digital platforms. * simply doesn't quite do it in an overlay system like though their highlight set up does quite well. Perhaps bookbook.pubpub's annotation indicator could act as an asterisk whether the note field is empty or not?
Chris Aldrich: Or underlining distractedly as if one were [punching the monkey](, a reference to the early days of the internet when one was encouraged to engage with internet ads in an active but often unmeaningful way.
Chris Aldrich: Here I can't help but wonder about people who wrote their notes or annotations into their own personal commonplace books rather than directly in the texts themselves. Perhaps somewhat tangential to the broader ideas here, but do the annotations necessarily need to be in the text themselves? What sorts of separate lives do unlinked annotations go on to have? What do annotations over the ages have from living within the text itself, separately in notebooks, notecards, or commonplace books, or even in the modern age with digital annotating tools that can be seen, read, and distributed to much larger audiences?
Troy Hicks: While I appreciate your continued focus on “democratizing annotation” as well as “using digital tools and practices,” your examples in this chapter (somewhat) undermine your point. That is, it is a famous literary scholar and the rapper who add valuable annotations to the documents you mention as examples, not the lay person adding his/her own comments. How do you plan to address issues of power and authority in knowledge communities/discursive spaces?
Troy Hicks: As you have begun to point out, it matters a great deal who makes the annotation, as well as the value that those annotations add depending on the purpose they serve. Not to add one more complication to your theoretical framing of annotation, but a little visit into the land of rhetoric with some attention to ethos, pathos, and logos could serve your argument well.
Troy Hicks: Having quickly read through the entire chapter and now planning to go back and annotate, I think that this is a critical point you need to make earlier in the text. A person can annotate for a variety of reasons — to ask a question, to offer one’s own insights, to simply doodle — yet to offer an annotation that is, indeed, informative for others… well, that requires some degree of skill as a reader/viewer of a text and as a writer. That is, I could go in and annotate a public version of “Absalom and Achitophel,” but poetry is not my area of expertise and I have no concept about the historical or cultural allusions that Dryden was trying to make. In a sense, my comments would be mostly for me, and I wouldn’t be adding value to the text with my annotations. As you think about your definition of “annotation,” and whether these annotations are meant to be public or private, I think that you can add additional nuance to your definition, especially as you build up to the ideas in this chapter about specific knowledge communities work working in different ways.
Heather Staines: The ATI layer on Cambridge was curated by QDR, but I’m not sure that is the intention moving forward. I believe the plan is that any author could add an “ATI” layer explaining their work. Best to check with them on this.
Remi Kalir: OK, thanks for the update, we’ll certainly check this out and revise accordingly so it’s accurate prior to final publication.
Heather Staines: Perhaps it would be useful to insert a note with a few sentence description of the events in this poem, even just where the title comes from? For those of us who are not familiar…
Remi Kalir: Can do!
Heather Staines: Would you consider metadata to be a form of annotation? Annotation for machines?
Remi Kalir: Yes, absolutely, metadata is a form of annotation. The MIT Press EKS volume “Metadata” is included in our Further Readings section. And the relationship between human-machine annotation, as well as automated annotation, is a topic we pick up in Chapter 7. Do you see additional opportunities for us to more explicitly discuss metadata as a form of annotation?
+ 1 more...
Nate Angell: Seems a little derogatory. Maybe: “you’re paying attention”?