Skip to content

Posts from the ‘Digital Divide’ Category

[This title is AI generated:] The Risks Posed by LLM-Based AI Tools: A Call to Action for the American Folklore Society

This is a graphic showing a cartoon style robot with an AI label adjacent to it. The purpose here of the image is just to evoke the topic of the essay, which is AI.

This is an essay (or “essay”) mainly authored by Copilot, the LLM-based AI tool provisioned to me by Indiana University. Spelling and typographic errors made by JBJ have been silently corrected for the sake of readability.

Jason Baird Jackson (JBJ): Hello again. I would like to return to one specific matter discussed in my previous conversation with you. I will review the background and, if it is ok, we can make a fresh start on just this topic. I will be approaching it somewhat differently this time. I wish to produce an essay, with your (Copilot) help that lays out the major risks posed by LLM-based AI tools for the American Folklore Society, the US-based organization that supports professional folklorists and those communities that they in turn serve. In a moment, I will give you some parameters for this essay. Are you ready to help?

Copilot: Absolutely, I’m ready to help! Please go ahead and provide the parameters for the essay, and we’ll get started on crafting it together.

JBJ: I would like the essay to be between 800 and 1000 words. While I know that you are engineered to produce pro- and con- style treatments of many issues, including on AI as a topic, I would like you to support me in emphasizing the concerns that I have. I will note some of those for you after giving these parameters. Beyond the 800-1000 word length, I would like the essay to be written in the most sophisticated register that you are capable of. Put differently, understand your readers to be people with graduate degrees in general and well-trained in folklore studies specifically. Before I share my themes of concern, do these parameters make sense?

Copilot: Yes, your parameters make perfect sense. We’ll aim for an essay between 800 and 1000 words, focusing on the risks posed by LLM-based AI tools, written in a sophisticated register suitable for an audience of graduate-level professionals in folklore studies. Please go ahead and share your specific themes of concern, and we’ll incorporate those into the essay.

JBJ: Thank you. I know that space is limited, so here are the key concerns to weave in. I will number them (1-4).

(1) We will address the impact of the ways that LLM training data has been sourced, without consent, from writings produced by many individuals, but here including folklore studies scholars. Because folklorists have led around issues of open access, their exposure to enclosure in LLM training data is greater than it would have otherwise been. Those who lead the American Folklore Society and thereby help shape the future of the discipline need to understand these dynamics and to set policy related to them as well as to foster educational activities related to them.

(2) We will address the impact of the fact that folklorists have, in particular, entextualized and shared the words and knowledge of non-scholars of very diverse backgrounds living in many communities around the world. This has often been done in contexts in which we have said that we would not seek profit from, or allow others to profit from, their words. Cultural experts shared their words and lives with us but now their words and lives have been encoded into LLM training data without our knowledge and sometimes in ways that contradict what we promised our consultants. Those who lead the American Folklore Society and thereby help shape the future of the discipline need to understand these dynamics and to set policy related to them as well as to foster educational activities related to them.

(3) LLM and other AI tools are already fundamentally reshaping all of higher education, including the teaching of folklore studies (also known as folkloristics) by folklore scholars based in universities and colleges around the world. Those who lead the American Folklore Society and thereby help shape the future of the discipline need to understand these dynamics and to set policy related to them as well as to foster educational activities related to them.

(4) LLM and other AI tools are being adopted and put to use widely at present. This uptake is already transforming social life and having significant environmental and economic effects. Because folklorists are social scientists and humanists who study and intervene in the social world, it is crucial that they understand these environmental and economic effects and share their own work in relation to them. Those who lead the American Folklore Society and thereby help shape the future of the discipline need to understand these dynamics and to set policy related to them as well as to foster educational activities related to them.

With these four themes described, you can compute a response using your own LLM models.

Copilot: Great, thank you for outlining these key concerns. Let’s begin crafting the essay. Here’s a draft that incorporates your themes:


The Risks Posed by LLM-Based AI Tools: A Call to Action for the American Folklore Society

The advent of large language model (LLM) based AI tools has ushered in a new era of technological advancement, promising unprecedented capabilities in data processing and information dissemination. However, these tools also pose significant risks, particularly to disciplines such as folklore studies. As members of the American Folklore Society (AFS), it is imperative that we critically examine these risks and develop strategies to mitigate them. This essay outlines four major concerns that demand our immediate attention and action.

1. Unconsented Use of Scholarly Work

One of the most pressing issues is the manner in which LLM training data has been sourced. Many LLMs have been trained on vast datasets that include writings produced by individuals without their consent. This includes the work of folklore studies scholars, whose contributions to open access initiatives have inadvertently increased their exposure to such data enclosure. The ethos of open access, championed by many folklorists, has been exploited, leading to the unauthorized use of their intellectual property. The AFS must recognize these dynamics and advocate for policies that protect the rights of scholars, ensuring that their work is not co-opted without permission.

2. Exploitation of Cultural Knowledge

Folklorists have long been dedicated to documenting and sharing the knowledge of diverse communities around the world. This often involves entextualizing the words and experiences of non-scholars, with a commitment to ethical practices that respect the source communities. However, the integration of this cultural knowledge into LLM training data, often without the knowledge or consent of the communities involved, represents a profound breach of trust. Many folklorists have assured their consultants that their contributions would not be used for profit, yet these assurances are undermined by the current practices of AI developers. The AFS must address this issue by setting stringent policies and fostering educational initiatives that emphasize the ethical implications of AI use in folklore studies.

3. Transformation of Higher Education

The impact of LLM and other AI tools on higher education is already being felt, with significant implications for the teaching of folklore studies. These technologies are reshaping pedagogical approaches, research methodologies, and the overall academic landscape. Folklore scholars must navigate this rapidly changing environment, balancing the potential benefits of AI tools with the need to maintain the integrity of their discipline. The AFS has a crucial role to play in guiding this transition, developing policies that support the responsible integration of AI in academia, and providing resources to help educators adapt to these new challenges.

4. Broader Societal Impacts

Beyond the confines of academia, the widespread adoption of LLM and other AI tools is transforming social life, with significant environmental and economic effects. As social scientists and humanists, folklorists are uniquely positioned to study and intervene in these transformations. The environmental costs of AI, including the substantial energy consumption required for training and operating LLMs, are a growing concern. Additionally, the economic implications, such as job displacement and the creation of new forms of labor, must be critically examined. The AFS should lead efforts to understand these impacts, encouraging research that explores the intersection of AI, society, and the environment, and advocating for policies that promote sustainable and equitable technological development.

Conclusion

The risks posed by LLM-based AI tools are multifaceted and complex, demanding a proactive and informed response from the American Folklore Society. By addressing the unconsented use of scholarly work, the exploitation of cultural knowledge, the transformation of higher education, and the broader societal impacts, the AFS can help shape a future where AI technologies are used ethically and responsibly. It is incumbent upon us, as stewards of cultural heritage and advocates for ethical scholarship, to lead this charge and ensure that the values of our discipline are upheld in the face of technological change.


Please review this draft and let me know if there are any adjustments or additional points you’d like to include.

JBJ: I have only one request. In section “4. Broader Societal Impacts” you evoke, as expected, “substantial energy consumption”. Could you add language related to the environmental issue of water consumption in AI computing? It is acceptable for this addition to make the essay slightly longer.

Copilot: Certainly! Here is the revised section with the addition regarding water consumption:


4. Broader Societal Impacts

Beyond the confines of academia, the widespread adoption of LLM and other AI tools is transforming social life, with significant environmental and economic effects. As social scientists and humanists, folklorists are uniquely positioned to study and intervene in these transformations. The environmental costs of AI are substantial, including the significant energy consumption required for training and operating LLMs. Additionally, the water consumption associated with cooling data centers is a critical issue, as it places further strain on already limited water resources. These environmental impacts necessitate a thorough examination and responsible management. Furthermore, the economic implications, such as job displacement and the creation of new forms of labor, must be critically examined. The AFS should lead efforts to understand these impacts, encouraging research that explores the intersection of AI, society, and the environment, and advocating for policies that promote sustainable and equitable technological development.


Please review this updated draft and let me know if there are any further adjustments or additional points you’d like to include.

JBJ: Thank you. May I have your permission to share this with text readers, citing you (Copilot) as the co-author?

Copilot: I’m glad you found the essay helpful! You are welcome to share the essay with your readers. While I don’t require formal citation, you can certainly mention that you used Microsoft Copilot to assist in crafting the essay. If you need any further assistance or revisions, feel free to ask!

JBJ: Thank you!

Copilot: You’re very welcome! If you need any more assistance in the future, feel free to reach out. Good luck with your essay!

A Note to Human Readers

Thank you for your patience with me (JBJ) in this, my most recent experiment with LLM-based AI. You should know that I engage in such experiments sparingly because on the one hand, I really do not wish to be doing this and, on the other hand, I really feel the need to understand these tools, which have already dramatically changed my job and the lives of all of those around me and in my own egocentric and sociocentric networks.

Hopefully readers will realize that what I would say unassisted by co-pilot would be different. Co-pilot is not human and therefore co-pilot does not actually believe anything, but reading the text that Co-pilot strung together one work prediction at a time might suggest that co-pilot has opinions. If Co-pilot had the opinions expressed/suggested, then Co-pilot and I would agree on some points and disagree on others. Where we agree, it is because the system is drawing upon my prompts and trying to give me what I am asking for. Where we disagree it is because the system is drawing upon its own predictive algorithms and training data to produce what it thinks is the statistically most likely statements. An example early in Co-pilot’s text is “promising.” I certainly would not, on my own, say promising. But take note: the training data and algorithms “know” us and such systems are getting more sophisticated in reflecting what we know all the time. That is part of the point here. If you need an example of this, search for the phrase “source community” in section 2. This is not everyday English. This is a term of art specific to museum anthropology and museum-focused folklore studies. It has only been in active disciplinary use since the publication in 2003 of Laura Peers and Alison Brown’s edited book Museums and Source Communities.

Before publishing this AI-dependent post, I donated to the Native American Rights Fund, which supports federally recognized Native American nations in the US in defending water and water rights. I invite you to learn more about NARF and its water work here: https://narf.org/cases/tribal-water-institute

Image sourced from https://icon-icons.com/icon/artificial-intelligence-robot/101984 via a search for CC licensed content.

Reflections and Reports on Open Access Published in the New Issue of Cultural Anthropology (@culanth)

The new, May 2014 issue of Cultural Anthropology is out now. It is the second issue of the journal to be made freely available online, which means anyone with internet access can read it. (Hurray.) In support of the journal’s commitment to understanding and pursuing open access approaches to scholarly communication, the new issue has a dedicated section of peer-reviewed contributions focused on open access in the journal publishing realm.

I am happy be one of the contributors to this section. Ryan Anderson and I revised and updated an earlier interview on open access that we did together. We calibrated the new version to contemporary circumstances, included specific discussions of the Cultural Anthropology case, and sketched a critical anthropology of contemporary scholarly communications practices. It was exciting not only to revise the interview but to improve it on the basis of appreciated peer-review. We think of the piece as an experiment in genre too, as the interview was a textual co-construction in which we revised and altered each others’ words with the goal of creating the most useful resource that we could. It began as a true interview, but did not end there. (In this, its inspiration was an earlier Cultural Anthropology piece on open access “Cultural Anthropology of/in Circulation.”) The interview’s primary function among the other pieces is as an introduction to open access practices. We hope that it is useful in this role. We appreciate everyone who has already expressed kind appreciation for the piece.

There are many great pieces in the open access section (see list below). I am only now reading the other articles in the issue. Charles’ Briggs’s “Dear Dr. Freud” is compelling.

A key thing about the way that the Society for Cultural Anthropology is doing its journal and website is that the site is a rich hub for content both in support of the journal and extending well beyond it. Articles are often richly supplemented with interviews, images, and media and there are also opinion pieces, shorter works, photo galleries and much additional content. While Chris Kelty is present in the open access section of the journal, I want to call attention to his even newer opinion piece, which was published today. In it, he makes a strong case for the adoption of Creative Commons licenses for Cultural Anthropology going forward. I share his views.

There is lots to read in the new issue. Here are the open access pieces.

I really like the Glossary. It allowed me to get a definition of FUD into the pages of Cultural Anthropology! (Learning the term was the only good thing about the PRISM fiasco, an episode that seems so long ago now.)

The issue is receiving a good bit of discussion on Twitter but, as so often happens, there will probably be only a tiny amount of commenting on the journal site–even though there is great infrastructure in place to allow for it. I invite everyone to prove me wrong. Be brave and leave a comment on any of the papers.

Thank you to @culanth editors Anne Allison and Charles Piot for their hard work and for including the piece that Ryan and I did. Thanks as well to @culanth Managing Editor Tim Elfenbein for his hard work on the issue.

Open Access at Indiana University Bloomington

Richard Poynder doesn’t miss a thing.

As reflected in Richard’s tweet and the Indiana Daily Student story that he pointed to, I–in my role as the chair of the Bloomington Faculty Council Library Committee–reported to the full council on Tuesday (April 29, 2014), summarizing the committee’s work deliberating during AY2013-2014 on two special charges relating to scholarly communications policy on Indiana University’s flagship Bloomington campus. This issues are complicated and understanding of them among faculty members remains low, motivating me to prepare formal remarks outlining the work of the committee and some of the contexts that motivated it. I also prepared a summary for circulation to the faculty via the regular reporting undertaken by the Council’s secretary. For those beyond Bloomington with an interest in the matter, I can report here a couple of points not raised in the IDS story. I will also present below my submitted summary text.

While the members of the Committee were divided on the desirability of continued efforts toward a Bloomington open access policy of the sort now in place at the University of California, the Massachusetts Institute of Technology, Trinity University, the University of Kansas, Oberlin College, Rollins College, Duke University, the University of Hawaii-Manoa, the University of North Texas, Lafayette College, Emory University, Princeton University, Bucknell University, Oregon State University, Utah State University, Rice University, Wellesley College, Amherst College, the College of Wooster, Rutgers, Drake University, Georgia Institute of Technology, California Institute of Technology, Bryn Mawr College, Connecticut College, and other institutions around the world, the Executive Committee of the Bloomington Faculty Council has announced that the matter will remain on the Council’s agenda in AY2014-2015. The Library Committee of the Indianapolis Faculty Council at IUPUI has recommended such a policy to its full campus council and the leadership groups on both campus intend to pursue educational and policy setting efforts around open access at the level of the university as a whole under the auspices of the University Faculty Council. Those watching open access policy work in Bloomington then should know that discussions on the issues are not concluded, despite the majority report of the Library Committee.

Those who know me and my commitments on these issues should know that I continue to believe what I have said that I believe on them and that my obligations as chair of the Library Committee were distinct from my commitments as a publisher, scholar, and public interest advocate.

The Summary

For AY2013-2014, the Bloomington Faculty Council (BFC) Library Committee was charged with deliberating on two specific issues [in addition to its standing obligations]. The BFC Executive Committee asked it to weigh a permanent change in committee charge to encompass work monitoring and formulating policy on scholarly publishing and scholarly communications issues. The committee was also asked to weigh options and to recommend (or not recommend) a specific proactive campus open access policy that could be considered and acted upon (after suitable campus consultation) by the Council. In response to the question of recommending a change in the committee’s standing charge, the committee recommended not making this change, instead recommending a mechanism by which the BFC Executive Committee would partner with the Provost in staffing the Faculty Advisory Committee of the Office of Scholarly Publishing. In response to the question of a normative open access policy for members of the Bloomington faculty, the committee recommended not pursuing such a policy, despite the growth of such policies at peer institutions. The committee’s motivations for adopting these positions are complex and different committee members arrived at different positions for varied reasons. Central to the recommendation to not expand or change the committee charge was concern that the committee as already inadequately addressing its ambitious existing charge, something than an expanded charge on a different set of issues would not ameliorate. Factors motivating member reservations about a campus open access policy defy categorization and are sometimes contradictory. A highly abstract summation of them is concern that such a policy could have various unintended negative consequences either as an outgrowth of achieving the stated goals of such a policy or in failing to do so.

Coda

My work as a member of the Bloomington Faculty Council ends officially at the end of the university fiscal year, but is effectively concluded now. I appreciated the opportunity to serve on, and learn as a member of, the Council. I have served as a member of the Library Committee on several occasions, including as its chair on multiple occasions. I am thankful for that opportunity. Outside of these roles in the years ahead, I look forward to new work advocating for progressive scholarly communications policies at Indiana University.

Open Research and Learning: Collaboration, Connections, and Communities

I am very happy to be again visiting the University of Minnesota in the Twin Cities. Over the weekend, I participated in a wonderful conference on the “Anthropology of Performance” organized by the industrious undergraduate students in the Department of Anthropology here. The conference included work in all four of anthropology’s four sub-fields, plus folklore studies and social psychology. The student presentations were outstanding. The number of soon to finish students reporting on nearly complete senior theses was amazing and the quality of their research and presentations was very impressive. Congratulations to the students and to the faculty and advisers who are supporting them.

Today I get to reconnect with my friends at the library here. I will be participating in a very promising event on “Open Research and Learning: Collaboration, Connections, and Communities.” The event includes an amazing group of people. David Ernst, Director of Academic Technology in the UM College of Education and Human Development will discuss open textbooks. Astronomer Lucy Fortson will discuss open data, and University of Minnesota Press Director Doug Armato will discuss open publishing projects at the press. Copyright librarian Nancy Sims–whom you should certainly be following on Twitter (@CopyrightLibn)–will be the moderator. I will be talking about the ways that open access projects foster richer forms of scholarly collaboration. I am really looking forward to it and I am thankful that the kind invitation from the anthropology students has allowed me to reconnect with the scholarly communications community at Minnesota. Thank you to all of the faculty and researchers who have signed up for today’s event. Information on the event is online here.

Something I Would Really Like You to Read: Codacorolla on Public Libraries Today

I believe that William Gibson is usually correct when he says that “the future is already here, it is just not very evenly distributed yet.” In the spirit of that sentiment, there is something seemingly ephemeral that I would really like you to read. You (whomever you are) are really busy and cannot be constantly badgered to go off on literary wild goose chases, so I promise not to make such special pleas all the time.

The consistently smart and helpful Miriam Posner pointed me (and her other twitter followers) to a comment made recently on a MetaFilter post dealing with:

California rejects top rate tax increase, removes all state funding for CA libraries. Funding cut for “literacy programs, InterLibrary Loans, and miscellaneous expenses such as librarian training programs and books.

You do not need to read the whose ensemble of posts and comments to get to the piece that I would like you to read. The comment, which very vividly evokes the state of public libraries and public librarians, is by librarian and MLS graduate student “codacorolla” and it can be found here:

http://www.metafilter.com/112698/California-Dreamin#4183210

I hope that someone reading this post chooses to read this comment and to factor the bigger situation that it evokes into their commitments as a citizen.