Journal:Why do we need food systems informatics? Introduction to this special collection on smart and connected regional food systems

From LIMSWiki
Jump to navigationJump to search
Full article title Why do we need food systems informatics? Introduction to this special collection on smart and connected regional food systems
Journal Sustainability
Author(s) Tomich, Thomas P.; Hoy, Casey; Dimock, Michael R.; Hollander, Allan D.; Huber, Patrick R.; Hyder, Ayaz; Lange, Matthew C.; Riggle, Courtney M.; Roberts, Michael, T.; Quinn, James F.
Author affiliation(s) University of California; Ohio State University; Public Health Institute; International Center for Food Ontology Operability Data and Semantics; University of California, Los Angeles
Primary contact tptomich at ucdavis dot edu
Editors Brewster, Christopher
Year published 2023
Volume and issue 15(8)
Article # 6556
DOI 10.3390/su15086556
ISSN 2071-1050
Distribution license Creative Commons Attribution 4.0 International
Website https://www.mdpi.com/2071-1050/15/8/6556
Download https://www.mdpi.com/2071-1050/15/8/6556/pdf?version=1681698750 (PDF)

Abstract

Public interest in where food comes from and how it is produced, processed, and distributed has increased over the last few decades, with even greater focus emerging during the COVID-19 pandemic. Mounting evidence and experience point to disturbing weaknesses in our food systems’ abilities to support human livelihoods and wellbeing, and alarming long-term trends regarding both the environmental footprint of food systems and mounting vulnerabilities to shocks and stressors. How can we tackle the “wicked problems” embedded in a food system? More specifically, how can convergent research programs be designed and resulting knowledge implemented to increase inclusion, sustainability, and resilience within these complex systems, support widespread contributions to and acceptance of solutions to these challenges, and provide concrete benchmarks to measure progress and understand tradeoffs among strategies along multiple dimensions?

This article introduces and defines food systems informatics (FSI) as a tool to enhance equity, sustainability, and resilience of food systems through collaborative, user-driven interaction, negotiation, experimentation, and innovation within food systems. Specific benefits we foresee in further development of FSI platforms include the creation of capacity-enabling verifiable claims of sustainability, food safety, and human health benefits relevant to particular locations and products; the creation of better incentives for the adoption of more sustainable land use practices and for the creation of more diverse agro-ecosystems; the widespread use of improved and verifiable metrics of sustainability, resilience, and health benefits; and improved human health through better diets.

Keywords: assessment workflow, informatics, ontology, knowledge graph, Semantic Web of Food (SWoF), internet of food (IoF), food justice, resilience, democratization, sustainability

Introduction

We begin by providing a conceptual framing of food systems and associated challenges within rapidly changing global conditions and politically contested food systems policy issues. The daunting list of challenges and pressures that have exposed shocking vulnerabilities in our food systems include Putin’s invasion of Ukraine; the COVID-19 pandemic; climate change and associated fires, floods, and droughts; racial and economic inequality; and profound polarization along several axes across scales, from among global hemispheres to localized rural-vs-urban divides. In concert, these pressures threaten human health and wellbeing and the sustainability of the natural resources upon which we rely for our food. These realizations have spawned a burgeoning scientific literature on the alarming long-term trends relative to food system environmental footprints, shortcomings in outcomes for people, and mounting systemic vulnerabilities to shocks and stressors (and many others).[1][2][3][4][5][6] This is further highlighted by the work of Steffen et al.[7] and their discussion on the societal importance of a planetary boundary framework, and Campbell et al.[8], who report that more than two dozen food system publications have appeared in the past two years.

An important theme emerging in this recent literature is what Turnhout et al.[9] refer to as "knowledge controversies"—deficiencies in access to information and not "simply controversies over competing values or interests"—in their call for new, pluralistic "knowledge–policy" interfaces for food systems. Similarly, Campbell et al.[8] call for "greater efforts in collecting, collating, and curating the data needed for decision making." There has been significant progress in generating relevant data on food and on agricultural production, particularly precision agriculture.[10][11][12] However, integration across data stores in ways that make useful information widely accessible to diverse food system stakeholders remains elusive.[4][13]

Before going on, we must define what "food systems" means within the context of this work. Our point of departure in this review is one of the earliest published definitions of a food system: “the set of activities and relationships that interact to determine what, how much, by what method, and for whom food is produced and distributed”[14], with emphasis added for reasons explored in greater depth below. Tangentially, the work of the Organisation for Economic Cooperation and Development (OECD) concludes that “the growing demand for a more holistic ‘food systems approach’ to policy making is based on the realization that there are potential synergies and trade-offs between food security and nutrition, livelihoods, and environmental sustainability.”[4] The OECD adds that "this complexity makes it hard to generalize, and highlights the importance of evidence: while it is easy to speculate about possible synergies or trade-offs, it is imperative for policy makers to scrutinize those hypotheses before using them as a basis for policy decisions."[4] More generally, it also is necessary to ground our conceptual framing to encompass a deeper “systems approach to address underlying structural problems and system dynamics that affect production, people, and the planet (i.e., sustainability)."[15]

The goal of positively transforming food systems comes with a variety of challenges in linking knowledge with action. First, through the food systems "activities" lens, there are particular conceptual framing challenges regarding food system boundaries, especially as these relate to drivers and disruptors arising outside the food and agriculture system. Nexus framing may be a way to a depict this, e.g., "food x water x climate x energy" or "food x poverty x hunger x disease." "Syndromes" also may be a way to make these "nexus" ideas more dynamic. Either way, these linkages become a strong element of our rationale for a convergence approach harnessing informatics to enhance effectiveness in participation, inclusion, and engagement.

There are further correlated challenges when viewed through the food systems "relationships" lens. Consensus on causal mechanisms and public policy goals in food systems has been elusive (in part) because[16]:

  • these multiple links involve systems of numerous components, in which major interactions can be non-linear, complex, and interdependent;
  • interventions aimed at affecting components and outcomes also are numerous, complex, and interdependent;
  • implementation of interventions requires partnership and concerted cooperation across multifarious organizations and scales;
  • key phenomena (e.g., both socioeconomic and ecological processes) display emergent properties, meaning that there may be no clear “line of sight” linking intervention points (say in fields, farms, or firms) with desired impacts (viz., poverty reduction); and
  • prospects for desired impacts are context-dependent.

Given the nature of their many challenges, food system transformation for greater resilience, sustainability, and equity means tackling what Rittel and Webber call "wicked problems"[17], requiring multiple sources of expertise and information spanning many disciplines and involving multiple individuals and organizations with a stake in outcomes, often with conflicting interests and values and even disagreeing on what the problem actually is or whether there is a problem at all. Schuler[18] applies pattern language (introduced by Alexander et al. in 1977[19]) to refute the assertion of Rittel and Webber[17] that "every wicked problem is essentially unique." Clark et al.[20] demonstrate the need for investment to build negotiation support capacity when multiple knowledge sources are essential and when multiple divergent stakeholder interests must be engaged. Anderies et al.[21] draw a similar distinction between what we call the "textbook" natural resource management problem—singular welfare goal and optimal allocation by a social planner with considerable certainty about cause and effect—with a "real world" policy problem involving multiple interrelated and contested goals, complexity of actors and social dilemmas, poorly understood (or missing) institutional capabilities, and considerable uncertainty in a complex dynamic system with multiple interactions, feedbacks, and somewhat chaotic patterns produced by external drivers.

Discussion of these challenges and related topics on informatics approaches to them is paramount, and a special collection, Smart & Connected Regional Food Systems, has been created for the journal Sustainability. The focus of this special collection is a growing wave of innovations that hold potential to address underlying deficiencies in data and analytical capabilities so that innovation and sustainable transformation of our food systems can be accelerated in the face of growing threats. The scope of the collection spans informatics and data science innovations in network engagement, analytics, and translation to enable equitable access to better data and assessment capabilities for use by any and all food system actors and advocates, facilitating information discovery for evidence-based negotiation support and co-creation of innovative solutions. Much of what is presented was developed through application, from use cases focused on food system challenges and opportunities. Topics include new conceptualizations related to informatics, innovative information exchange standards, such as ontologies and controlled vocabularies, knowledge graphs, generalized workflows, and data governance standards, as components of a smart and connected food system platform. The overarching purpose is to enhance equity, sustainability, and resilience through collaborative, user-driven experimentation within complex food systems toward a set of guideposts: diverse agro-ecosystems, circular economies, and equity-based cultural norms.

Within the existing literature, many studies take a partial approach to food system sustainability and resilience, covering some aspects (e.g., economic, environmental, or social) but missing others, thereby failing to provide a comprehensive framework. Among these, some use top-down, static approaches. Other innovations in data science that can be monetized tend to be proprietary, and hence exclusive (and unpublished). In comparison, this collection's articles emphasize an open approach to data and research, seek interoperability among linked data and tools, and strive for holistic, comprehensive, and dynamic approaches to challenges and opportunities to support food system sustainability. This encompasses tools for systems analysis as well as community engagement, incubation of entrepreneurship, and legal aspects of data sharing (e.g., IP, privacy, and data ethics). The articles in this collection span a wide range of the food system domain, although they are not exhaustive, as there are other relevant topics, such as food waste[22], that are not well-represented. These articles, and others in the emerging body of literature, do not yet constitute a comprehensive "food systems informatics" approach (discussed further in the next section). Rather, many take the form of use cases and thus show how information technology can address a wide range of food systems questions and challenges, and, therefore, collectively and cumulatively point toward a complete approach (Figure 1).


Fig1 Tomich Sustain23 15-8.png

Figure 1. Use cases in this collection of the journal Sustainability situated within a food systems schematic. Figure adapted from Tomich et al.[16] Citations to articles in this collection: Thompson et al.[23], Medici et al.[24], Hollander et al.[25], Chicoine et al.[26], Huber et al.[27], and Hyder et al.[28]

In addition to this introductory article, other articles in the collection include:

1. Thompson et al.'s "Early Ethical Assessment: An Application to the Sustainability of Swine Body Scanners"[23]
2. Medici et al.'s "PestOn: An Ontology to Make Pesticides Information Easily Accessible and Interoperable"[24]
3. Hollander et al.'s "Workflows for knowledge co-production: Meat and dairy processing in Ohio and Northern California"[25]
4. Chicoine et al.'s "Exploring Social Media Data to Understand How Stakeholders Value Local Food: A Canadian Study Using Twitter"[26]
5. Huber et al.'s "Using systematic planning to link biodiversity conservation and human health outcomes: A stakeholder-driven approach"[27], and
6. Hyder et al.'s "Design and Implementation of a Workshop for Evaluation of the Role of Power in Shaping and Solving Challenges in a Smart Foodshed"[28]

Many new technologies are addressed in the scope of food systems and food systems informatics (FSI). These new technologies, which require, interface with, or build upon informatics frameworks, are opportunities to extend capabilities in either of the two generalized application domains discussed below in the section on FSI applications. For example, the ethics of using swine monitors delves into both the activities involved with pork production and factors that influence the relationships between producers and consumers.[23] Work to create interoperability among pesticide datasets is meant to improve the collaboration between producers and regulators and ultimately improve the safety and sustainability of pesticide use in agriculture.[24] Additionally, social media may be an untapped source of data and insights into the varying attitudes, interests, and values surrounding local food both within and across communities.[26]

So far, this introduction has delineated conceptual and operational challenges intrinsic to food systems and motivates both this review and the articles in the special collection. Building on the operational definition of "food systems" and contextualization within our introduction of contemporary issues, we now move on to our motivating methodological question that unites all the articles in this collection: Why do we need FSI? The next section introduces key concepts, methods, and definitions, including our definition of FSI, and links them to relevant informatics methods. The subsequent section on FSI applications discusses promising applications to regional food systems, continuing development and improvements in methods and approaches, and their potential impacts for systemic sustainability and resilience, for which social justice and equity are requisites. Then we discuss promising potential outcomes and impacts of the development of FSI platforms. Finally, we conclude with observations on next steps and policy implications, including some significant caveats about application of these informatics platforms for our food systems.

To sum up our purpose, this paper is intended both as an introduction to this special collection and to the new field of FSI, which is defined in the next section. Taken together, this collection also serves the bigger purpose of introducing the new field. The other articles in the collection illustrate examples of the application of these tools to specific parts of food systems. The present paper is intended to show how these components, ongoing work, and future use cases can create a comprehensive FSI platform incrementally and cumulatively. One insight from years of work is that a top-down approach to food systems as a whole is not feasible. Thus, this bottom-up approach is necessary to make progress while producing use cases as practical intermediate outputs. At the same time, we feel the overall context and framing of this review article is necessary for those incremental, partial use cases to cumulatively create a more comprehensive FSI platform. The articles we cite in this review span many very broad literatures; they were selected by our diverse author team to represent the literature we have found most useful in the development of this new field. Taken together with the other articles in this collection, the work reviewed here is motivated by two overarching research questions:

  1. How can the complexity intrinsic to food systems be managed more effectively by public policymakers, food system advocates, and private enterprises, including farmers and processors?
  2. How can quantitative benchmarks be developed and updated dynamically to understand tradeoffs across objectives and facilitate negotiation, mediation, and innovation among interest groups in searching for solutions and monitoring progress?

Methods: Definition and data science tools

FSI is an emerging transdisciplinary field that is distinguished by the following characteristics:

  • Development and application of data science and information and communication technologies (ICT) to food, agriculture, and human wellbeing from a holistic, systems perspective;
  • Use of data science and ICT to include and engage the full range of diverse food systems stakeholders and their knowledge, expertise, and epistemologies;
  • User-driven and science-informed portrayal of food system activities and human relationships that interact to determine what, how much, by what method, and by whom food is produced, processed, distributed, and consumed and the associated human health outcomes; and
  • An overall goal of building knowledge infrastructure necessary to reveal, understand, and influence food system structure and function spanning scales from molecular to planetary, and nanoseconds to centuries.

FSI applies data science and informatics with the engagement of diverse stakeholders and forms of knowledge to portray activities and human relationships that determine what, how much, by what method, and by whom food is produced, processed, distributed, and consumed, and the associated health outcomes, socioeconomic consequences, and environmental impacts and vulnerabilities. FSI has broad applications in building diverse partnerships and innovative programs, stimulating innovation and entrepreneurship, and shaping public policies and other initiatives to influence food systems across multiple scales, while balancing tradeoffs across issues and objectives, and benchmarking and monitoring progress toward greater equity, sustainability, and resilience.

This definition was developed collaboratively by the coauthors in the course of our collaborative work; it was workshopped and refined in a workshop at the Center for Environmental Policy and Behavior of the University of California, Davis in October 2021. We feel this multi-dimensional definition is necessary to fit our purposes of engaging food systems stakeholders inclusively and to address food systems’ complexity in a practical way. FSI is distinguished from the related and complimentary concept of food informatics[29] in its focus on the entire complex, coupled social-ecological system—from sources to consumption, from health and environmental outcomes to impacts and interactions—as opposed to the complex and widely varying composition and preparation of what people eat.

In focusing jointly on human wellbeing and environment health, and the interactions between them, endeavoring to provide negotiation support to multiple interests and to link multiple knowledge sources with collective action spanning many conflicting interest groups, our approach to FSI has its intellectual roots in sustainability science[30] and is informed by the literature on coupled systems[31][32][33], knowledge systems[21][34], and inclusive wealth.[35][36]

But why do we need FSI? Food systems informatics addresses the underlying information deficiencies described in our introduction, which inhibit the innovation and transformation of the food system. Specifically, FSI focuses on data science innovations in engagement, information discovery, analytics, and translation to enable equitable access to better data and assessment capabilities for use by food system actors and advocates and to facilitate co-creation of innovative solutions. As highlighted in Figure 2, FSI approaches food system transformation as a set of information problems, including information needed to convene representative stakeholders and for understanding conditions, trends, and tradeoffs among key issues. FSI platforms thus play central roles in enabling the convening of stakeholders and negotiation and collaboration among them, as well as bringing relevant data to bear in the search for solutions.


Fig2 Tomich Sustain23 15-8.png

Figure 2. A theory of change for food systems transformation, as presented by the authors.

FSI is represented by an amalgam of data science tools, products, and associated research and development questions. Relevant informatics tools include information exchange standards (e.g., ontologies, controlled vocabularies, and data schemas) and information discovery tools that allow users to apply those standards to identify existing data or knowledge on particular entities or processes, and perhaps to accurately classify unincorporated prior work, knowledge graphs derived from use cases of food system challenges and opportunities, generalized workflows, legal frameworks and data governance standards, and development of application programming interfaces (APIs, or other standardized machine-to-machine interfaces), as well as human interfaces (user interfaces/user experiences [UI/UX]). Analytical tools include descriptive, predictive, and explanatory analytical methods for networks, relationships among food system actors (e.g., social network analysis), activities, and structures. Food system structures include both patterns of organization in the many elements of the food system (e.g., facilities, transportation routes, natural resources), and more specific to FSI, the many ways in which data describing the food system is collected, stored, and used (e.g., linked open data, FAIR [findable, accessible, interoperable, and reusable][37] data, distributed ledger systems, blockchains).

Community-based use cases identify and, ideally, connect interested and affected individuals and organizations, enabling more effective partnerships and networks, data sharing, and integrated assessment of challenges and opportunities identified by and with community members. Entire communities can contribute to identifying data and knowledge gaps that need to be addressed. For example, a “food access for healthy families” use case could identify the full range and optimal combination of services available to food-insecure people, while a "food supply chain" use case could explore options for the reconfiguration of supply chain flows and critical infrastructure needs for providing more stable flows of food products despite disruptions, such as the labor shortages caused by COVID-19.

There are a number of different types of workflows that have been developed and derived from use cases. A scientific workflow is the most widely-used type and has been defined narrowly by Ludascher et al. as "the description of a process for accomplishing a scientific objective, usually expressed in terms of tasks and their dependencies."[38] Another more generic definition we have found useful, originating from Wikipedia[39]:

A workflow consists of an orchestrated and repeatable pattern of activity, enabled by the systematic organization of resources into processes that transform materials, provide services, or process information. It can be depicted as a sequence of operations, the work of a person or group, the work of an organization of staff, or one or more simple or complex mechanisms. From a more abstract or higher-level perspective, workflow may be considered a view or representation of real work.

Workflows differ in terms of context and use. For example:

  • Scientific workflow: data curation in a research setting
  • Business workflow: commercial processes in a private enterprise
  • Policy design and implementation workflow: policy impact analysis in a public agency or an advocacy organization
  • Stakeholder workflow: power analysis in political science or public administration
  • Assessment workflow: negotiation support in sustainability science

An important element in the generalizability of FSI is for others to be able to replicate the assessment and analysis of similar food system issues. Generalized workflows that are built up from experience with partners can be used to accelerate the development of new use cases as needs arise in response to changing opportunities and circumstances, thereby enhancing the adaptive capacity, agility regarding shocks, and overall resilience of the food system. For example, a workflow may consist of performing a set of structured interviews of a wide range of community members with varying interests in and perspectives on a given problem or opportunity, tagging interview materials using consistent terminologies linked to existing ontologies, visualizing the linkages between stakeholders, issues, and resources, and cataloging resources present in the use case such as actors, institutions, and datasets. Cumulatively, specific use case experiences provide a platform to further develop a generalized workflow for responding to food system community needs. Other examples include workflows for annotating a corpus of documents, such as organizational websites describing relationships among stakeholders and strategic plans. Such a corpus could facilitate later research on machine learning and natural language processing for inferring these relationships from readily available documents.

Standards for integrated information exchange, including food systems ontologies, could further develop functional data resources across a number of domains ranging from food science to conservation planning. The most widely cited definition of an ontology in computer science comes from Gruber[40], who states that “an ontology is an explicit specification of a conceptualization.” An evolving operational definition we have found useful is:

"In computer science and information science, an ontology encompasses a representation, formal naming, and definition of the categories, properties, and relations between the concepts, data, and entities that substantiate one, many, or all domains of discourse”[41], especially controlled vocabularies (e.g., AGROVOC[42]) and data schemas, and open data networks (e.g., Global Open Data for Agriculture and Nutrition[43]).

Building replicable tools and applications depends on development of standards at many levels, including but not limited to standards for ontology development and reuse, minimum amounts of information (i.e., data shapes), and metadata. One example application is improving the information transfer between food producers and distributors and food banks and pantries. Food producers and distributors may have excess food they cannot sell commercially but instead wish to transfer it to food banks. The exchange can be facilitated by developing a data schema describing food transfer logistics, but stakeholders should have a great deal of input into the design of the data schema to ensure that the correct fields and interrelationships are captured. Developing this data schema would provide a standard that could be used widely. Open questions remain, however, such as how to best work with communities to co-create such standards, and what tools or approaches for engagement will facilitate translation of community data needs into a formally defined exchange standard.

Ontology-based food system knowledge graphs are needed to capture and visualize the complex networks of concepts, relationships, and data across large, heterogeneous, yet convergent domains that comprise the food system. A set of modular and integrated ontologies that conform to standards and underpin food system knowledge graphs building on existing research on ontologies of food system actors—including a people, projects, organizations, and data ontology (“PPOD”)[44] and an issues-and-indicators ontology of food system impacts and vulnerabilities[45][46]—could be deepened and enriched with sectoral detail (e.g., for food access or meat processing), linkages with related ontologies, such as health[47] and environment and resources[48], and lead to novel food systems ontologies (food systems power, policies, transformation strategies, and project implementation). Extensions of food systems thinking to the humanities—including philosophy, aesthetics, and culture—are particularly exciting in terms of the central roles of dynamic food preferences, choices, and experiences, and interactions and feedbacks with values, tastes, and preferences[49][50], and likewise in documentation of “tangible and intangible aspects of a cultural object”[51], such as a recipe, a meal, or a harvest festival.

At the same time, ontologies also could enable the development of further applications, such as creating catalogs of food system actors and resources for information sharing, testing prototype artificial intelligence (AI) tools for search and query (such as Natural Language Processing (NLP) systems for automatically finding and indexing food system resources) and providing a formal structure for characterizing linkages in the food system, which may help analyses such as identifying food system vulnerabilities. Yet, moving forward with building such knowledge graphs leads to a number of challenges. To begin with, are there scalable approaches for gathering information across a regional food system to create a knowledge graph that is comprehensive and yet accessible enough to be useful to the community? Second, how does one build knowledge graphs that respect privacy where needed? Is there a middle road for information sharing in knowledge graphs that falls between the full openness of the linked open data model and the inaccessibility of closed proprietary information sets?

We take it as axiomatic that it is not feasible to create a comprehensive FSI platform as a top-down exercise. Activities and outputs based on these tools must be interoperable to build cumulatively across use cases and crosscutting research themes. FSI platforms will exist at both the level of cyberinfrastructure and at the level of social engagement. At the cyber level, there are three major components: data infrastructure, human interaction elements, and documentation and repositories. The data infrastructure will host knowledge graphs, tool suites, and computational engines for analytics, and machine-readable APIs for data access. Human interaction will center on websites providing front ends to the knowledge graphs, query, update, visualization, and analysis tools, and mechanisms for social interaction that support planning, negotiation of tradeoffs, policy development, and coordinated action for system change.

User interfaces that fully support a simultaneous top-down and bottom-up, community-engaged approach to food system transformation remain poorly developed for any of the necessary functions, including data contribution, query, display, curation, and analytics. Prototype UI/UX development could proceed along various lines, including information about relationships between food system actors; retrieval of information and visualization tools of the network of relationships between actors; individual and shared ownership of content; web mapping tools that elucidate spatial relationships; and ultimately a collection of multiple, federated, interoperable knowledge graphs describing the food system in depth. For example, linking spatial information to semantic web databases has been an ongoing research concern (e.g., the work of Battle and Kolas[52]), and exposing provenance information that can be stored in a knowledge graph (e.g., historical information about food processing facilities) in a web mapping interface may lead to increased user engagement. Current work on more advanced UI/UX interfaces includes democratizing access to AI (e.g., ICICLE[53]). Ultimately, such interfaces must achieve the aforementioned qualities of sustainable and resilient food systems: inclusion, equity, and balancing power differentials in access to data and their use to answer questions. More generally, Schuler[54] has argued “the primary aim of technology in the service of democracy is not merely to make it easier or more convenient but to improve society’s civic intelligence, its ability to address the problems it faces effectively and equitably” (emphasis in the original).

FSI applications to enhance sustainability, resilience, and equity of regional food systems

The emerging FSI field is envisioned as the information platform for “smart and connected” regional food systems. By using “smart and connected” here and in the title of this collection, we mean the application of data science tools to address the information failures highlighted in our theory of change for food systems transformation (Figure 2). The rationale for a regional focus draws on discussion concerning the physical and social infrastructure necessary to provision major cities and how these investments and differential capabilities affect inequalities of outcomes in the US.[32][33][36][55][56]

Our approach to convergent research and negotiation support at the regional scale is iterative and embraces two interacting opportunities for collaborative community engagement:

  1. Engagement and inclusion for participation and partnership across the food system: Engaged, inclusive, and diverse participation to build the social capital necessary for co-creation of solutions, including building necessary networks and partnerships for data access, sharing, and analysis.
  2. User-driven research on food system problems and opportunities: This research includes collaborative development of ontologies, indicators, data analytics, and model technology needed to co-create and act on data-informed experimentation, while leveraging indicators and measures of progress to influence change.

These two interlinked applications share a number of important attributes. Each is an important aspect of a food system as both a set of human relationships and as a set of activities, including the impacts and vulnerabilities associated with those activities.[14] Each has at its core an information problem; in other words, better data and information is a necessary (but not sufficient) condition for better outcomes in terms of equity, prosperity, sustainability, and resilience. These collaborative opportunities are mutually dependent: prospects for better outcomes depend on parallel and articulated work on both human engagement and the assessment of activities, impacts, and vulnerabilities.

To accommodate the duality of food systems described above—as both systems of human relationships and of activities for the production, processing, marketing, and consumption of food—we introduce here the concept of “assessment workflows” (Figure 2), which combines familiar notions of scientific workflows (discussed in the prior section) with “stakeholder workflows.” The workflows summarized in Figure 3 were derived from our experience with participatory development of specific use cases, with particular reference to several reported in this special collection, in which engagement with diverse food system stakeholders was the basis for (and interacted with) scientific activities in support of those efforts. This responds directly to calls for a new “knowledge–policy interface” for the food system[9] and not just another “science–policy interface.”[57]


Fig3 Tomich Sustain23 15-8.png

Figure 3. Assessment workflows combine scientific and stakeholder workflows. Created by the authors based on experience collaborating with numerous stakeholders.

Of necessity, Figure 3 is a simplification of these complex processes. In particular, since the concept already will be familiar to many, the schematic depiction of scientific workflows in Figure 3 is highly streamlined into “research analysis cycle” activities (indicated in green in Figure 3). Based on the authors’ experiences with the development of use cases, a bit more detail on the greater process is elaborated for the “stakeholder workflow” activities (indicated in peach color in Figure 3). Of course, each application will differ in its details, but there are some common elements. For example, reflecting best practices in integrated ecosystem assessments[58], a mandate from a coalition of stakeholders initiates the assessment workflow and parallel development and interaction of the scientific and stakeholder activities. This is rooted in theories of policy processes[59] and particularly “advocacy coalition theory.”[60] Thus, rather than the curiosity-inspired impetus typical of a detached, scientific workflow, the impetus for an assessment workflow arises from a mandate from a specific advocacy coalition. Note also the central role for a dedicated “boundary spanner”[20], who facilitates communication and interaction between the stakeholders and scientists contributing to the overall process. In turn, as shown in Figure 3, this process creates the groundwork both for business workflows and policy formulation and implementation workflows, while also extending ontologies and instantiating knowledge graphs that contribute to the development of the "internet of food" (IoF). While this generic workflow is presented for heuristic purposes, a more realistic depiction of the creation of an actual use case likely would be presented as a series of adaptive management cycles, revisited over an extended period spanning many months, if not years. In the same vein, reports and other documentation are provisional, rather than “final,” informing further engagement, action by private sector businesses, public sector agencies, and civil society, and knowledge creation that is readily accessible and widely useful across sectors.

User-defined use cases have been important vehicles to pursue the two interlinked collaborative opportunities described above. They have guided the development of digital technology that can harness and generate social capital for prioritizing issues, indicators, data, data sharing, ontologies, management strategies, and co-created pilot projects aimed at systemic solutions through socio-technological convergence. We can characterize the contributions to this special collection as a set of use cases, which typically have been specified and prioritized by a set of community partners to address key food system challenges in a network-of-networks approach (Figure 1).

Using rapidly expanding linked open data resources and the burgeoning Semantic Web of Food (SWoF) within IoF, we believe it will be possible to connect and facilitate the use of fragmented and hidden data by social actors at multiple scales. The next step is creating a food system knowledge graph (KG) on easy-to-use, pluggable platforms capable of integrating and “cross-walking” (also called “ontology negotiation”) existing ontologies and datasets, thereby facilitating open access to extensive food system knowledge stores. Innovative IP and privacy standards must be co-created in tandem to assure equitable outcomes. Real-time connectivity and sharing of data will help enable networks of innovators who currently work in isolation and drive innovation in agricultural practices, food products, and social institutions based on social and environmental effects that largely are omitted in current market prices. Ultimately, the process will accelerate as community social actors share and learn from each other, scaling and replicating sustainable, resilient, and just food systems in their communities.

FSI use case examples

The following examples illustrate a range of use cases that are in development, or which could be developed as modular components of FSI platforms (see Figure 1).

(A) Food supply chain diversification: Almost everywhere in the US, critical processing infrastructure is missing that, if created, would result in system-wide shifts (spanning production, processing, distribution, and consumption) that would contribute to inclusive economic development in both rural and urban areas, while increasing food system resilience in the face of disruptive events, such as the COVID-19 pandemic.[25][61][62] One entry point for this work has been meat processing supply chains that were disrupted as a result of COVID-19, and which are highly concentrated at processing stages.[63] Ongoing work has broadened to encompass regional supply chains. Examples of successful outcomes include knowledge graphs with appropriate intellectual property protections to match producers, processors, distributors, and consumers, as well as bypass chokepoints caused by over-concentration or poor awareness of alternative options. Indeed, successful outcomes may be less knowledge graphs per se than the unleashing of knowledge-graph connections to enable commercial transactions and ameliorate food inequities.

(B) Food access for hungry people: Currently, access to available food security services falls far below need because the services are poorly communicated and coordinated, such that conventional targeting omits specific needy consumer groups and disadvantaged populations within particular neighborhoods. An initial focus to better serve omitted populations pivots on existing food preparation infrastructure (e.g., schools, restaurants, hospitals, religious institutions, food banks, etc.), which can help planners and other food system actors to address hunger emergencies. Consider one example of a successful outcome: a publicly available knowledge graph for each region that links information on food production, processing capabilities (especially in public and non-profit institutions), and marginalized groups without sufficient access to healthy, affordable food, as well as philanthropists and programs seeking to underwrite food access.

(C) Food for better health: Combining dietary prescriptions with existing in-patient nutritional and pharmaceutical options significantly improves health outcomes for underserved populations.[64][65] We anticipate that linking prescriptive diets and health information systems to food provider information systems will increase the likelihood for providers to offer dietary treatment, whilst also increasing consumer acceptance and adherence to the prescriptions. One example of successful outcomes could be knowledge graphs with appropriate privacy protections to match patient nutritional needs with local sources of food.

(D) Working landscapes for regional resilience: Stakeholders’ efforts are hampered by administrative “siloing” of data and information, which inhibits identification, assessment, and action to better manage critical resources and food system tradeoffs within the specific contexts of each of these contrasting agro-ecosystems.[58][66][67] (See also Elahi et al.[68] for a useful comparative case in an international context.) In Columbus, Ohio, both farmer-led collaborators and urban planners behind the Local Food Action Plan hypothesize that solutions to local shortages and access deficiencies are feasible from such shifts in production within the region, resulting in more of what is needed, particularly fresh crop and livestock products, being produced and delivered within the region, and that such shifts will also improve economic outcomes. In California, Huber et al.[27] address regional vulnerability and options to increase resilience in the face of fire, drought, and flood risks and other likely climate and environmental shocks through better-informed regional planning processes, including planning and public investments in critical infrastructure. The work builds on previous assessments of the region’s natural resource and public health characteristics conducted by the team.[69][70][71] Examples of successful outcomes includes a publicly available knowledge graph for each region that links information on a wide range of natural resource and environmental issues, including ecosystem services, climate change mitigation, and adaptation, as well as tools enabling new connections between suppliers and consuming organizations.

(E) Food system governance: Power dynamics are an expected feature of coupled social–ecological systems as comprehensive and complex as the food system. Power differentials and imbalances—along with varied priorities, values, and interests—contribute substantially to the classification of food system issues as "wicked problems." Classifying and relating the nature of these power dynamics on the social side of food systems resulted in a power ontology that has extended the PPOD ontology that had been developed earlier as a joint effort of a wide range of food system actors. Hyder et al.[28] provide an example of the potential for engagement and inclusion through a generalized application of FSI.

Challenges of scale, scope, and system boundaries

Food systems are embedded within an environment characterized by other systems, each of which interacts to drive the dynamics of the whole. Drivers and disruptors arising outside the food and agriculture system, therefore, are both expected and difficult to incorporate within FSI. Regardless, these linkages among systems become a strong element of our rationale for a convergence approach harnessing informatics to enhance effectiveness in participation, inclusion, and stakeholder engagement. As Helfgott[55] argues persuasively, “rigorous framing of resilience necessarily involves participatory systemic boundary critique and both theoretical and methodological pluralism.” Building on this, we feel systematic, intentional stakeholder engagement is the most promising method for tackling the challenges of scope and scale for a specific food system and in determining workable system boundaries that have practical significance (see also Ash et al.[58]).

Discussion: Potential outcomes and impacts of creating FSI platforms

FSI platforms hold promise to enable the co-creation of transformative changes in food systems and their associated agro-ecosystems. FSI building blocks for transformation paths to greater food system sustainability and resilience include:

  • replicable prototypes of food system knowledge graphs spanning many communities, enabling a holistic, inclusive treatment of the food system;
  • appropriate, workable balance between openness and privacy in knowledge graphs, encouraging decentralized information nodes, an important step towards data democratization; and
  • diversity, equity, and inclusion increases as foodshed distribution patterns serve a wider range of producers, processors, and consumers, creating greater economic opportunities and enabling consumers to attain healthier diets.

With these FSI tools, communities could develop new mechanisms that support a combination of food access, health prescription, supply chain regionalization, and planning; in turn, these enable overall improvements in human wellbeing through preventive health measures and dietary improvements integrated within healthcare systems, particularly for populations that formerly experienced poor access to both food and healthcare. In parallel, policy coalitions spanning the food system can actively use information technology to engage and empower crosscutting stakeholder interests in food access, food for health, food supply chain business opportunities, and ecosystems services provided by working landscapes. Enabled by FSI tools, powerful networks can emerge of food system innovators, entrepreneurs, advocates, and leaders in the public, private, and non-profit sectors.

Ultimately, successful development of FSI platforms is envisioned to provide supporting cyberinfrastructure for improved resilience, sustainability, and equity of food systems. These broader impacts can be measured through tracking key system vulnerability indicators, and direct impacts through tracking uptake indicators; each of these indicators can be integral to an FSI platform. Expected direct, practical impacts include:

  1. Creation of a rigorous, data-informed consensus on scope, benchmarks, and practical tradeoffs regarding inclusion, sustainability, and resilience in food systems that can be applied anywhere (rather than reinventing);
  2. Institutional and legal innovations to enhance intellectual property and incentivize innovation;
  3. Expansion, interlinkage, and empowerment of networks of food system innovators and entrepreneurs;
  4. Entrepreneurs and innovators capturing value by advancing equity, sustainability, and resilience;
  5. Farmers, ranchers, and processors branding products and services that add value through enhanced inclusion, sustainability, and resilience;
  6. Data science tools that streamline and reduce costs of compliance for food safety, labor regulations, and environmental standards; and, as discussed below,
  7. FSI ontologies and information-discovery tools built upon them that can enable more effective and evidence-based negotiations among food system actors, and enhance local producers’ and processors’ markets and incomes, for example, by enabling supply chain alternatives to concentrated and lowest-common-denominator systems controlled by a few huge companies.

Each of the FSI use cases discussed prior exemplifies user-driven transdisciplinary research. Either engagement without analysis or analysis without engagement perpetuates the disappointing “state of the art,” summarized in Table 1. In particular, expert-driven analysis without engagement is a formula for irrelevant or even harmful misguided top-down actions. Thus, while each of the collaborative opportunities described above is independently poised for an “information revolution,” transformational advances depend crucially on an integrated approach, as mapped in the assessment workflows depicted in Figure 3, and a corresponding vision for the practical implications of FSI innovations, as sketched in Table 1, which was developed by the co-authors. Thus, FSI platforms provide novel means to overcome barriers to well-informed collective action.

Table 1. Vision for innovations enabled by FSI, as identified by the authors.
Collaborative opportunity State of the art Vision for game-changing innovations
Engagement and inclusion for participation and partnership across the food system * Static “Rolodex” of established contacts; tends to involve the same familiar cast of characters.
* Tools: Personal networks and electronic contact lists based on past interactions and chance encounters.
* Pitfalls: Marginalized groups remain invisible or are engaged haphazardly. Important voices are omitted from assessment, creation, and implementation of “solutions”. Temporally dynamic engagement in collaborations is not accounted for. Interventions are misguided or unusable. Inequities and injustices are reproduced. Innovation is constrained and creative opportunities are missed.
* Dynamic social network analysis opens avenues for active partnership, data discovery and access, and discovery by key stakeholders.
Tools: PPOD ontologies of diverse food system actors and resources; knowledge graphs enhancing purposeful social networking for each region.
* Advances: Intersectional data on complex, multidimensional identities of people, programs, organizations, and data enables fresh, focused, and effective inclusion and data-informed interaction. The clearing house includes more diverse people and incubates more creative ideas. Participants can discover partners whom they otherwise would not meet at all. Shifting composition of collaborative groups can be accommodated without losing opportunities to engage and re-engage partners over time.
User-driven research on food system problems and opportunities * Ad hoc workshops with little access to data that do exist and limited capacity to fill data gaps. More holistic, data-informed assessments are prohibitively time consuming and rapidly obsolete.
* Tools: “Sticky notes,” flip charts for visual recording, logic models, and conceptual maps.
* Pitfalls: Repeated “reinventing of the wheel” with little or no cumulative understanding of dynamic, complex problems. Keyhole vision focuses too narrowly and misses both threats and opportunities. Time bounded “seat of the pants” brainstorming with little opportunity to test consistency of assumptions or to consider more than one (or a few) issues or approaches at a time. Expert-driven processes squelch community innovation and creativity. Missed opportunities, rigid strategies, failure to learn from experience (positive and negative) slow progress and lead to repeated costly mistakes.
* Computer science and information technology is harnessed to break down data silos, open up public access to information, inspire data sharing, and facilitate curation to ensure data quality and fill data gaps.
* Tools: Use cases and workflows to pivot assessment activities in response to shocks and other changes in circumstances; relational, system, and meta ontologies for linked, open food system data flows; knowledge graphs to supply data for relevant scales within spatial context and (increasingly) in real time.
* Advances: More holistic, community-driven, data-informed assessment of problems and opportunities becomes feasible because time and effort required to pose questions and seek answers is dramatically reduced. Clearing house links concerns and insights from community experience with analytical capabilities and curated, contextual, timely data. Scientific foundations set for authentic co-creation and implementation of transformative solutions employing state of the art tools, for example visualization, scenarios, and foresight; real time “dashboards” to benchmark progress.

Conclusions and policy implications

Building on over a decade of work, including five years of implementation of an NSF-funded Research Coordination Network on “Smart and Connected Regional Food Systems,” we have introduced food systems informatics (FSI) as a tool to enhance equity, sustainability, and resilience of food systems through collaborative, user-driven interaction, negotiation, experimentation, and innovation within food systems. Specific benefits we foresee in further development of FSI platforms include:

  • Capacity to create verifiable claims of sustainability, food safety, and human health benefits relevant to particular locations and products;
  • Better incentives for the adoption of more sustainable land use practices and for the creation and stewardship of more diverse agro-ecosystems;
  • Widespread adoption and practical use of improved and verifiable metrics of sustainability, resilience, and health benefits arising from practices affecting how our food is produced, processed, marketed, and consumed; and
  • Overall, improved human health through better diets.

Together, these FSI tools and platforms promise to be highly relevant in efforts to address major food policy challenges by policymakers, food system advocates, and private enterprises, including farmers and processors. In particular, they offer important tools for the development and curation of quantitative benchmarks to understand tradeoffs across policy objectives and facilitate negotiation, mediation, and innovation across stakeholder groups (often with conflicting perspectives, beliefs, and interests) in collaborative efforts to search for solutions and to monitor progress that drives improvement, further refinement, and innovation. In addition to further technological developments and significant effort to create informatics tools and to instantiate knowledge graphs, priorities for further steps to realize this vision include the following investments and innovations:

1. Investment to build social capital: Socio-technological investment is key to overcoming barriers to effective collaboration on food system challenges and opportunities. Co-creation of solutions to these "wicked problems" that are feasible technically, economically, socially, and politically requires investment in social capital. The social networking and informatics tools that have been developed[44] can dramatically improve efficiency (lowering search, transaction, and negotiation costs) and effectiveness in spanning boundaries to co-create innovative solutions.[20][44] Together with partners, we have designed ontological underpinnings for an SWoF[72][73] that lay the knowledgebase foundation for a connected Smart Food Shed.

2. Community engagement, diversity, and inclusion: Democratization of food system data through open access is necessary so that communities can share information and inspirational solutions and advocate for data-informed policies and programs supporting sustainable, resilient food systems and healthy communities. Ultimately, our vision is to link and expand a powerful, inclusive network of advocates, innovators, and entrepreneurs, creating local innovations shared through global networks for practical action for food system sustainability, resilience, and justice, buttressed by validated metrics. Food system challenges disproportionately affect vulnerable communities within each region; however, novel, practical solutions often come from community-level innovators to co-create and scale out practices, tools, and strategies to enhance food system sustainability, resilience, and justice. This also carries an obligation to indigenous peoples and other marginalized groups to “ensure that due recognition, acceptance, and prominence are given to traditional knowledge.”[74]

3. Local innovation and entrepreneurship: Resilience, particularly adaptive capacity in the face of unknown and unpredictable challenges (COVID-19 being a current example, but climate change also providing many others), requires diversity across many dimensions of food systems as the building blocks of adaptation. How can programs of engagement and convergent research best support the co-creation of resilient and entrepreneurial agricultural and business ecosystems that can readily respond and adapt to food system challenges? Our hypothesis is that social and cultural diversity and inclusion spur food system innovation and entrepreneurship. Our ongoing work includes a design of means of combining diversity in multiple forms, including inclusive community engagement, with technological advances in data science to address the issues of concern in our communities by connecting these diverse voices with relevant but currently disconnected data.[44] Further socio-technological innovations are needed to support self-organizing social and economic activities in diverse agricultural ecosystems, working landscapes, and inclusive food systems. We further hypothesize that convergent research can best provide concrete benchmarks to measure progress and understand tradeoffs among strategies along multiple dimensions, and thereby spur the transformation to smart foodsheds with greater resilience and enhanced human wellbeing.[67][71]

4. Transparency: Innovative IP and privacy standards must be co-created in tandem to assure equitable outcomes. Real-time connectivity and sharing of data will create a network of innovators who currently work in isolation and also drive innovation in agricultural practices, food products, and social institutions based on social and environmental effects that largely are omitted in current market prices. Creation of an SWoF is the entry point for this complex opportunity to connect open data streams and co-create useful knowledge graphs in response to pressing needs across our complex food systems. Ultimately, the process will accelerate as community social actors share and learn from each other, scaling and replicating sustainable, resilient, and just food systems in their communities.

5. Data democratization: We believe that open access to information, tools, and other technical infrastructure can lead to the democratization of knowledge. This requires embedded mechanisms for transparency, inclusiveness, engagement, collaboration, and data-informed community co-creation. “Crowdsourcing” is one superficial term for this, although more radical is the idea of open validation; this process determines whether the problems identified and solutions co-created are viewed as legitimate (in the sense of a fair and open process) by the communities concerned. FSI tools—generalized workflows, ontologies, knowledge graphs, and ultimately community-identified and creatively generated solutions—highlight the need for decentralized data curation and maintenance, since we hypothesize that they enable a more transparent, accountable, and, hence, democratic food system. Specific questions in these new lines of FSI research and development include how to strike an effective balance between centralized and federated information architectures when dealing with the complexity and dynamics of food systems. Perhaps different information architectures suit different use cases? How does a community-based, user-driven approach affect the answers to these questions?

The ontologies underpinning the Semantic Web of Food link could also make data more FAIR[37] through the integration of labor, environmental, governance, and other concerns at the heart of inclusive growth. “Data democratization” underpins this work, which means FAIR data access while respecting individual data privacy. Co-creation of practical IP and privacy standards and shared data ethics norms are prerequisites to data democratization. Current institutional weaknesses undermine incentives for innovation and entrepreneurship and disadvantage those outside mainstream food supply chains. Antidotes include shared best practices for environmental-social-governance (ESG) reporting and the exchange of data, support for co-creation of informatics tools, and interfaces based on innovative metadata standards. This will reduce costs of collaboration, helping to level the accountability “playing field” underpinning traceability, transparency, and (ultimately) trust. In turn, these are essential to data-informed advocacy and collective action by social actors to create sustainable, resilient food systems and healthier communities. Complementary to FAIR data are the CARE principles (collective benefit, authority to control, responsibility, and ethics).[75] Originating in discussion around indigenous data sovereignty, the CARE perspective emphasizes governance of data for the collective benefit of marginalized communities.[75] The CARE principles might resonate with many communities in the food system.

6. Distributed infrastructure for data and analytics: A further necessary requirement for these advances is to explore how legal and institutional safeguards for privacy and intellectual property (and other civil and human rights) also are necessary to spark the local and regional creativity, innovation, and entrepreneurship needed for transformation of the food system. We believe that moving towards decentralized data infrastructures is important for democratization of systems, especially including food systems. However, it is not clear what sort of social or technological mechanisms will lead to a move towards decentralization. We need to identify and assess specific classes of information, such as geographically localized materials and cultural practices, that lend themselves most naturally to be deployed through a decentralized infrastructure. Furthermore, data democratization requires attention to the social and political economy in which the FSI infrastructure is maintained and developed. It is not sufficient merely to open standards for FSI protocols. One needs funding for actual hardware and systems administrators to run it and maintain it. This is by no means assured; possible models for the funding and organization of data infrastructure range across extremes from globalized “surveillance capitalism”[76] to extremely decentralized cooperative economies. At the same time, one must recognize that decentralization poses challenges for authentication, privacy, and ease of use, among other issues. Legal expertise is essential to provide specific recommendations and policy insights for multiple aspects, including transparency, data protection, licensing, data ownership, data sharing, cyberlaw, and other relevant intellectual property issues.

Caveats

The digitization of food systems and study of FSI introduces risks, as well as social and economic benefits. Resolving issues of inclusion in problem definition and the creation of solutions, equity of outcomes and access, data privacy, intellectual property, and managing political and economic power differentials are essential for desirable (indeed, essential) advances toward food system sustainability, resilience, equity, and justice, including data democratization. Yet, patent trolling, perversely designed licensing and privacy agreements, greenwashing, and disinformation campaigns each hold potential to exacerbate information, access, and ownership asymmetries and thereby to concentrate wealth and power. Knowledge is power, and digital technologies carry risks of increasing power elites’ capabilities to gather and hoard knowledge in order to hold onto and enhance their power. Digital technologies also hold potential to lay bare food system “attack surfaces” to bad actors. Therefore, looking forward, FSI also must expand its scope to include food systems security, privacy, and intellectual property considerations within its disciplinary purview. In turn, food systems security itself will necessarily and increasingly include food systems cybersecurity in an ever more digital world.

Abbreviations, acronyms, and initialisms

  • AI: artificial intelligence
  • CARE: collective benefit, authority to control, responsibility, and ethics
  • FAIR: findable, accessible, interoperable, and reusable
  • FSI: food systems informatics
  • ICT: information and communication technologies
  • IoF: internet of food
  • OECD: Organisation for Economic Cooperation and Development
  • PPOD: people, projects, organizations, and data
  • SWoF: semantic web of food
  • UI/UX: user interface/user experience

Acknowledgements

Author contributions

Conceptualization, T.P.T., C.H. and J.F.Q.; methodology, T.P.T., C.H., A.D.H., P.R.H., A.H., J.F.Q. and M.C.L.; resources, T.P.T., C.H., C.M.R. and M.C.L.; conceptualization, T.P.T., C.H., J.F.Q. and M.C.L.; methodology, everyone; software, A.D.H., P.R.H. and M.C.L.; writing—original draft preparation, T.P.T., C.H., M.R.D., A.D.H., P.R.H., C.M.R., M.T.R. and M.C.L.; writing—review and editing, T.P.T., C.H., C.M.R. and J.F.Q.; visualization, A.D.H., A.H., M.C.L., T.P.T. and C.H.; data curation, A.D.H.; supervision, T.P.T., C.H. and C.M.R.; funding acquisition, T.P.T., C.H. and C.M.R. All authors have read and agreed to the published version of the manuscript.

Funding

We are grateful to the US National Science Foundation, NSF Award 1737573, for funding this research and the conceptualization and editing of this Special Collection, both of which were underpinned by our NSF-funded Research Coordination Network, “Developing Informational Infrastructure for Building Smart Regional Foodsheds”. T.P.T. and the UC Davis Food Systems Lab team also appreciate additional funding from the TomKat Foundation and USDA Hatch Program that also contributed to this project. We are grateful for helpful comments and suggestions from two anonymous reviewers.

Conflicts of interest

The authors declare no conflict of interest.

References

  1. Godfray, H. Charles J.; Beddington, John R.; Crute, Ian R.; Haddad, Lawrence; Lawrence, David; Muir, James F.; Pretty, Jules; Robinson, Sherman et al. (12 February 2010). "Food Security: The Challenge of Feeding 9 Billion People" (in en). Science 327 (5967): 812–818. doi:10.1126/science.1185383. ISSN 0036-8075. https://www.science.org/doi/10.1126/science.1185383. 
  2. Foley, Jonathan A.; Ramankutty, Navin; Brauman, Kate A.; Cassidy, Emily S.; Gerber, James S.; Johnston, Matt; Mueller, Nathaniel D.; O’Connell, Christine et al. (1 October 2011). "Solutions for a cultivated planet" (in en). Nature 478 (7369): 337–342. doi:10.1038/nature10452. ISSN 0028-0836. https://www.nature.com/articles/nature10452. 
  3. Willett, Walter; Rockström, Johan; Loken, Brent; Springmann, Marco; Lang, Tim; Vermeulen, Sonja; Garnett, Tara; Tilman, David et al. (1 February 2019). "Food in the Anthropocene: the EAT–Lancet Commission on healthy diets from sustainable food systems" (in en). The Lancet 393 (10170): 447–492. doi:10.1016/S0140-6736(18)31788-4. https://linkinghub.elsevier.com/retrieve/pii/S0140673618317884. 
  4. 4.0 4.1 4.2 4.3 OECD (11 January 2021) (in en). Making Better Policies for Food Systems. OECD. doi:10.1787/ddfba4de-en. ISBN 978-92-64-90619-8. https://www.oecd-ilibrary.org/agriculture-and-food/making-better-policies-for-food-systems_ddfba4de-en. 
  5. Fan, Shenggen; Cho, Emily EunYoung; Meng, Ting; Rue, Christopher (18 October 2021). "How to Prevent and Cope with Coincidence of Risks to the Global Food System" (in en). Annual Review of Environment and Resources 46 (1): 601–623. doi:10.1146/annurev-environ-012220-020844. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-012220-020844. 
  6. Zurek, Monika; Ingram, John; Sanderson Bellamy, Angelina; Goold, Conor; Lyon, Christopher; Alexander, Peter; Barnes, Andrew; Bebber, Daniel P. et al. (17 October 2022). "Food System Resilience: Concepts, Issues, and Challenges" (in en). Annual Review of Environment and Resources 47 (1): 511–534. doi:10.1146/annurev-environ-112320-050744. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-112320-050744. 
  7. Steffen, Will; Richardson, Katherine; Rockström, Johan; Cornell, Sarah E.; Fetzer, Ingo; Bennett, Elena M.; Biggs, Reinette; Carpenter, Stephen R. et al. (13 February 2015). "Planetary boundaries: Guiding human development on a changing planet" (in en). Science 347 (6223): 1259855. doi:10.1126/science.1259855. ISSN 0036-8075. https://www.science.org/doi/10.1126/science.1259855. 
  8. 8.0 8.1 Campbell, Bruce M.; Thornton, Philip K.; Nelson, Gerald C. (24 November 2022). "Upping our ambition for food system adaptation" (in en). Nature Food 3 (12): 970–971. doi:10.1038/s43016-022-00656-y. ISSN 2662-1355. https://www.nature.com/articles/s43016-022-00656-y. 
  9. 9.0 9.1 Turnhout, Esther; Duncan, Jessica; Candel, Jeroen; Maas, Timo Y.; Roodhof, Anna M.; DeClerck, Fabrice; Watson, Robert T. (3 September 2021). "Do we need a new science-policy interface for food systems?" (in en). Science 373 (6559): 1093–1095. doi:10.1126/science.abj5263. ISSN 0036-8075. https://www.science.org/doi/10.1126/science.abj5263. 
  10. McFadden, J. et al. (2022). "The digitalisation of agriculture: A literature review and emerging policy issues" (in en). OECD Food, Agriculture and Fisheries Papers 176. doi:10.1787/285cc27d-en. https://www.oecd-ilibrary.org/agriculture-and-food/the-digitalisation-of-agriculture_285cc27d-en. 
  11. Deconinck, K.; Hobeika, M. (2022). "Improving environmental outcomes along food supply chains: A review of initiatives and their effectiveness" (in en). OECD Food, Agriculture and Fisheries Papers 186. doi:10.1787/d549eb43-en. https://www.oecd-ilibrary.org/agriculture-and-food/improving-environmental-outcomes-along-food-supply-chains_d549eb43-en. 
  12. Data Foundation; AGree Initiative; Glauber, J. et al. (3 May 2022). "Modernizing Agriculture Data Infrastructure to Improve Economic and Ecological Outcomes". Data Foundation. p. 19. https://www.datafoundation.org/modernizing-agriculture-data-infrastructure-to-improve-economic-and-ecological-outcomes-2022. 
  13. McGreevy, Steven R.; Rupprecht, Christoph D. D.; Niles, Daniel; Wiek, Arnim; Carolan, Michael; Kallis, Giorgos; Kantamaturapoj, Kanang; Mangnus, Astrid et al. (4 August 2022). "Sustainable agrifood systems for a post-growth world" (in en). Nature Sustainability 5 (12): 1011–1017. doi:10.1038/s41893-022-00933-5. ISSN 2398-9629. https://www.nature.com/articles/s41893-022-00933-5. 
  14. 14.0 14.1 OECD Council (30 July 1981). "Food Policy" (PDF). OECD. https://www.oecd.org/agriculture/documents/oecd-food-policy-report-1981.pdf. Retrieved 15 March 2023. 
  15. Lang, Tim; Heasman, Michael (2016). Food wars: the global battle for mouths, minds and markets (Second edition ed.). London ; New York: Routledge, Taylor & Franics Group. ISBN 978-1-138-80258-2. 
  16. 16.0 16.1 Tomich, Thomas P.; Lidder, Preetmoninder; Coley, Mariah; Gollin, Douglas; Meinzen-Dick, Ruth; Webb, Patrick; Carberry, Peter (1 June 2019). "Food and agricultural innovation pathways for prosperity" (in en). Agricultural Systems 172: 1–15. doi:10.1016/j.agsy.2018.01.002. https://linkinghub.elsevier.com/retrieve/pii/S0308521X17305383. 
  17. 17.0 17.1 Rittel, Horst W. J.; Webber, Melvin M. (1 June 1973). "Dilemmas in a general theory of planning" (in en). Policy Sciences 4 (2): 155–169. doi:10.1007/BF01405730. ISSN 0032-2687. http://link.springer.com/10.1007/BF01405730. 
  18. Schuler, Douglas (2008). Liberating voices: a pattern language for communication revolution. Cambridge, Mass: MIT Press. ISBN 978-0-262-19579-9. OCLC 173748411. https://www.worldcat.org/title/mediawiki/oclc/173748411. 
  19. Alexander, Christopher; Ishikawa, Sara; Silverstein, Murray (1977). A pattern language: towns, buildings, construction. New York: Oxford University Press. ISBN 978-0-19-501919-3. 
  20. 20.0 20.1 20.2 Clark, William C.; Tomich, Thomas P.; van Noordwijk, Meine; Guston, David; Catacutan, Delia; Dickson, Nancy M.; McNie, Elizabeth (26 April 2016). "Boundary work for sustainable development: Natural resource management at the Consultative Group on International Agricultural Research (CGIAR)" (in en). Proceedings of the National Academy of Sciences 113 (17): 4615–4622. doi:10.1073/pnas.0900231108. ISSN 0027-8424. PMC PMC4855572. PMID 21844351. https://pnas.org/doi/full/10.1073/pnas.0900231108. 
  21. 21.0 21.1 Anderies, John M.; Mathias, Jean-Denis; Janssen, Marco A. (19 March 2019). "Knowledge infrastructure and safe operating spaces in social–ecological systems" (in en). Proceedings of the National Academy of Sciences 116 (12): 5277–5284. doi:10.1073/pnas.1802885115. ISSN 0027-8424. PMC PMC6431179. PMID 30111542. https://pnas.org/doi/full/10.1073/pnas.1802885115. 
  22. Spang, Edward S.; Moreno, Laura C.; Pace, Sara A.; Achmon, Yigal; Donis-Gonzalez, Irwin; Gosliner, Wendi A.; Jablonski-Sheffield, Madison P.; Momin, Md Abdul et al. (17 October 2019). "Food Loss and Waste: Measurement, Drivers, and Solutions" (in en). Annual Review of Environment and Resources 44 (1): 117–156. doi:10.1146/annurev-environ-101718-033228. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-101718-033228. 
  23. 23.0 23.1 23.2 Thompson, Paul B.; Thorp, Laurie; Ginsburg, Blake L.; Zivku, Tabitha Maria; Benjamin, Madonna (18 December 2021). "Early Ethical Assessment: An Application to the Sustainability of Swine Body Scanners" (in en). Sustainability 13 (24): 14003. doi:10.3390/su132414003. ISSN 2071-1050. https://www.mdpi.com/2071-1050/13/24/14003. 
  24. 24.0 24.1 24.2 Medici, Marco; Dooley, Damion; Canavari, Maurizio (30 May 2022). "PestOn: An Ontology to Make Pesticides Information Easily Accessible and Interoperable" (in en). Sustainability 14 (11): 6673. doi:10.3390/su14116673. ISSN 2071-1050. https://www.mdpi.com/2071-1050/14/11/6673. 
  25. 25.0 25.1 25.2 Hollander, Allan D.; Hoy, Casey W.; Armstrong, Kevin S.; Dimock, Michael R.; Huber, Patrick R.; Jackson-Smith, Douglas; Quinn, James F.; Riggle, Courtney M. et al. (23 June 2023). "Workflows for Knowledge Co-Production—Meat and Dairy Processing in Ohio and Northern California" (in en). Sustainability 15 (13): 9991. doi:10.3390/su15139991. ISSN 2071-1050. https://www.mdpi.com/2071-1050/15/13/9991. 
  26. 26.0 26.1 26.2 Chicoine, Marilyne; Rodier, Francine; Durif, Fabien; Schillo, Sandra; Dubé, Laurette (16 December 2021). "Exploring Social Media Data to Understand How Stakeholders Value Local Food: A Canadian Study Using Twitter" (in en). Sustainability 13 (24): 13920. doi:10.3390/su132413920. ISSN 2071-1050. https://www.mdpi.com/2071-1050/13/24/13920. 
  27. 27.0 27.1 27.2 Huber, Patrick R.; Baker, Matthew; Hollander, Allan D.; Lange, Matthew; Miller, Daphne; Quinn, James F.; Riggle, Courtney; Tomich, Thomas P. (21 June 2023). "Linking Biodiversity and Human Wellbeing in Systematic Conservation Assessments of Working Landscapes" (in en). Sustainability 15 (13): 9912. doi:10.3390/su15139912. ISSN 2071-1050. https://www.mdpi.com/2071-1050/15/13/9912. 
  28. 28.0 28.1 28.2 Hyder, Ayaz; Blatt, Angela; Hollander, Allan D.; Hoy, Casey; Huber, Patrick R.; Lange, Matthew C.; Quinn, James F.; Riggle, Courtney M. et al. (24 February 2022). "Design and Implementation of a Workshop for Evaluation of the Role of Power in Shaping and Solving Challenges in a Smart Foodshed" (in en). Sustainability 14 (5): 2642. doi:10.3390/su14052642. ISSN 2071-1050. https://www.mdpi.com/2071-1050/14/5/2642. 
  29. Krupitzer, Christian; Stein, Anthony (22 November 2021). "Food Informatics—Review of the Current State-of-the-Art, Revised Definition, and Classification into the Research Landscape" (in en). Foods 10 (11): 2889. doi:10.3390/foods10112889. ISSN 2304-8158. PMC PMC8620004. PMID 34829170. https://www.mdpi.com/2304-8158/10/11/2889. 
  30. Clark, William C.; Harley, Alicia G. (17 October 2020). "Sustainability Science: Toward a Synthesis" (in en). Annual Review of Environment and Resources 45 (1): 331–386. doi:10.1146/annurev-environ-012420-043621. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-012420-043621. 
  31. Ostrom, Elinor (24 July 2009). "A General Framework for Analyzing Sustainability of Social-Ecological Systems" (in en). Science 325 (5939): 419–422. doi:10.1126/science.1172133. ISSN 0036-8075. https://www.science.org/doi/10.1126/science.1172133. 
  32. 32.0 32.1 Markolf, Samuel A.; Chester, Mikhail V.; Eisenberg, Daniel A.; Iwaniec, David M.; Davidson, Cliff I.; Zimmerman, Rae; Miller, Thaddeus R.; Ruddell, Benjamin L. et al. (1 December 2018). "Interdependent Infrastructure as Linked Social, Ecological, and Technological Systems (SETSs) to Address Lock‐in and Enhance Resilience" (in en). Earth's Future 6 (12): 1638–1659. doi:10.1029/2018EF000926. ISSN 2328-4277. https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2018EF000926. 
  33. 33.0 33.1 Advisory Committee for Environmental Research and Education (2018). "Sustainable Urban Systems: Articulating a Long-Term Convergence Research Agenda. A Report from the NSF Advisory Committee for Environmental Research and Education" (PDF). https://nsf-gov-resources.nsf.gov/2022-12/Sustainable-urban-systems-508c.pdf?VersionId=M0OsHkQd7DX2Il8lBgKKYKJcx7p8Ldxt. Retrieved 25 January 2023. 
  34. Cash, David W.; Clark, William C.; Alcock, Frank; Dickson, Nancy M.; Eckley, Noelle; Guston, David H.; Jäger, Jill; Mitchell, Ronald B. (8 July 2003). "Knowledge systems for sustainable development" (in en). Proceedings of the National Academy of Sciences 100 (14): 8086–8091. doi:10.1073/pnas.1231332100. ISSN 0027-8424. PMC PMC166186. PMID 12777623. https://pnas.org/doi/full/10.1073/pnas.1231332100. 
  35. Polasky, Stephen; Bryant, Benjamin; Hawthorne, Peter; Johnson, Justin; Keeler, Bonnie; Pennington, Derric (4 November 2015). "Inclusive Wealth as a Metric of Sustainable Development" (in en). Annual Review of Environment and Resources 40 (1): 445–466. doi:10.1146/annurev-environ-101813-013253. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-101813-013253. 
  36. 36.0 36.1 Irwin, Elena G.; Gopalakrishnan, Sathya; Randall, Alan (5 October 2016). "Welfare, Wealth, and Sustainability" (in en). Annual Review of Resource Economics 8 (1): 77–98. doi:10.1146/annurev-resource-100815-095351. ISSN 1941-1340. https://www.annualreviews.org/doi/10.1146/annurev-resource-100815-095351. 
  37. 37.0 37.1 Wilkinson, Mark D.; Dumontier, Michel; Aalbersberg, IJsbrand Jan; Appleton, Gabrielle; Axton, Myles; Baak, Arie; Blomberg, Niklas; Boiten, Jan-Willem et al. (15 March 2016). "The FAIR Guiding Principles for scientific data management and stewardship" (in en). Scientific Data 3 (1): 160018. doi:10.1038/sdata.2016.18. ISSN 2052-4463. PMC PMC4792175. PMID 26978244. https://www.nature.com/articles/sdata201618. 
  38. Ludäscher, Bertram; Bowers, Shawn; McPhillips, Timothy (2009), Liu, Ling; Özsu, M. Tamer, eds., "Scientific Workflows" (in en), Encyclopedia of Database Systems (Boston, MA: Springer US): 2507–2511, doi:10.1007/978-0-387-39940-9_1471, ISBN 978-0-387-35544-3, http://link.springer.com/10.1007/978-0-387-39940-9_1471. Retrieved 2024-02-06 
  39. "Workflow". Wikipedia. Wikimedia Foundation, Inc. https://en.wikipedia.org/wiki/Workflow. Retrieved 15 March 2023. 
  40. Gruber, Thomas R. (1 November 1995). "Toward principles for the design of ontologies used for knowledge sharing?" (in en). International Journal of Human-Computer Studies 43 (5-6): 907–928. doi:10.1006/ijhc.1995.1081. https://linkinghub.elsevier.com/retrieve/pii/S1071581985710816. 
  41. "Ontology (information science)". Wikipedia. Wikimedia Foundation, Inc. https://en.wikipedia.org/wiki/Ontology_(information_science). Retrieved 15 March 2023. 
  42. "AGROVOC Multilingual Thesaurus". Food and Agriculture Organization of the United Nations. 2023. https://agrovoc.fao.org/browse/agrovoc/en/. Retrieved 15 March 2023. 
  43. "GODAN, Global Open Data for Agriculture & Nutrition". GODAN Secretariat. 2023. https://godan.info/. Retrieved 15 March 2023. 
  44. 44.0 44.1 44.2 44.3 Hollander, Allan D.; Hoy, Casey; Huber, Patrick R.; Hyder, Ayaz; Lange, Matthew C.; Latham, Angela; Quinn, James F.; Riggle, Courtney M. et al. (3 March 2020). "Toward Smart Foodsheds: Using Stakeholder Engagement to Improve Informatics Frameworks for Regional Food Systems" (in en). Annals of the American Association of Geographers 110 (2): 535–546. doi:10.1080/24694452.2019.1662764. ISSN 2469-4452. https://www.tandfonline.com/doi/full/10.1080/24694452.2019.1662764. 
  45. Springer, Nathaniel P.; Garbach, Kelly; Guillozet, Kathleen; Haden, Van R.; Hedao, Prashant; Hollander, Allan D.; Huber, Patrick R.; Ingersoll, Christina et al. (11 June 2015). Cheng, Zhihui. ed. "Sustainable Sourcing of Global Agricultural Raw Materials: Assessing Gaps in Key Impact and Vulnerability Issues and Indicators" (in en). PLOS ONE 10 (6): e0128752. doi:10.1371/journal.pone.0128752. ISSN 1932-6203. PMC PMC4465747. PMID 26065899. https://dx.plos.org/10.1371/journal.pone.0128752. 
  46. Springer, Nathaniel P.; Hollander, Allan D.; Huber, Patrick R.; Riggle, Courtney; Tomich, Thomas P. (15 August 2022). "A malleable workflow for identifying the issues and indicators that define and measure sustainability in food systems". Frontiers in Sustainable Food Systems 6: 684831. doi:10.3389/fsufs.2022.684831. ISSN 2571-581X. https://www.frontiersin.org/articles/10.3389/fsufs.2022.684831/full. 
  47. Lange, Matthew C; Lemay, Danielle G; German, J Bruce (1 June 2007). "A multi‐ontology framework to guide agriculture and food towards diet and health" (in en). Journal of the Science of Food and Agriculture 87 (8): 1427–1434. doi:10.1002/jsfa.2832. ISSN 0022-5142. https://onlinelibrary.wiley.com/doi/10.1002/jsfa.2832. 
  48. Gordon, Sean N.; Murphy, Philip J.; Gallo, John A.; Huber, Patrick; Hollander, Allan; Edwards, Ann; Jankowski, Piotr (6 December 2021). "People, Projects, Organizations, and Products: Designing a Knowledge Graph to Support Multi-Stakeholder Environmental Planning and Design" (in en). ISPRS International Journal of Geo-Information 10 (12): 823. doi:10.3390/ijgi10120823. ISSN 2220-9964. https://www.mdpi.com/2220-9964/10/12/823. 
  49. Borghini, A.; Piras, N.; Serini, B. (2021). "From Philosophy to Ontology: Rethinking Food Concepts". CEUR Workshop Proceedings. https://air.unimi.it/handle/2434/897444. 
  50. Blanchard, Emmanuel G.; Allard, Danièle, eds. (2011). Handbook of Research on Culturally-Aware Information Technology: Perspectives and Models. IGI Global. doi:10.4018/978-1-61520-883-8.ch009. ISBN 978-1-61520-883-8. http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/978-1-61520-883-8. 
  51. Carboni, Nicola; de Luca, Livio (2016). "Towards a conceptual foundation for documenting tangible and intangible elements of a cultural object" (in en). Digital Applications in Archaeology and Cultural Heritage 3 (4): 108–116. doi:10.1016/j.daach.2016.11.001. https://linkinghub.elsevier.com/retrieve/pii/S2212054816300467. 
  52. Battle, Robert; Kolas, Dave (2012). "Enabling the geospatial Semantic Web with Parliament and GeoSPARQL". Semantic Web 3 (4): 355–370. doi:10.3233/SW-2012-0065. https://www.medra.org/servlet/aliasResolver?alias=iospress&doi=10.3233/SW-2012-0065. 
  53. "ICICLE: Intelligent CI with Computational Learning in the Environment". Ohio State University. 2023. https://icicle.osu.edu/. Retrieved 15 March 2023. 
  54. Schuler, Douglas (31 January 2020). "Can Technology Support Democracy?" (in en). Digital Government: Research and Practice 1 (1): 1–14. doi:10.1145/3352462. ISSN 2691-199X. https://dl.acm.org/doi/10.1145/3352462. 
  55. 55.0 55.1 Helfgott, Ariella (1 August 2018). "Operationalising systemic resilience" (in en). European Journal of Operational Research 268 (3): 852–864. doi:10.1016/j.ejor.2017.11.056. https://linkinghub.elsevier.com/retrieve/pii/S0377221717310676. 
  56. Deener, Andrew (2020). The problem with feeding cities: the social transformation of infrastructure, abundance, and inequality in America. Chicago: University of Chicago Press. ISBN 978-0-226-70291-9. 
  57. Singh, Brajesh K.; Arnold, Tom; Biermayr-Jenzano, Patricia; Broerse, Jacqueline; Brunori, Gianluca; Caron, Patrick; De Schutter, Olivier; Fan, Shenggen et al. (3 November 2021). "Enhancing science–policy interfaces for food systems transformation" (in en). Nature Food 2 (11): 838–842. doi:10.1038/s43016-021-00406-6. ISSN 2662-1355. https://www.nature.com/articles/s43016-021-00406-6. 
  58. 58.0 58.1 58.2 Ash, Neville, ed. (2010). Ecosystems and human well-being: a manual for assessment practitioners. Washington, DC: Island Press. ISBN 978-1-59726-711-3. 
  59. Sabatier, Paul A., ed. (2007). Theories of the policy process (2nd ed ed.). Boulder, Colo: Westview Press. ISBN 978-0-8133-4359-4. 
  60. Sabatier, P.A.; Weible, C.M. (2007). "The Advocacy Coalition Framework: Innovations and Clarifications". In Sabatier, P.. Theories of the Policy Process (2nd ed.). Routledge. pp. 189–220. doi:10.4324/9780367274689-7. ISBN 9780367274689. https://www.taylorfrancis.com/chapters/edit/10.4324/9780367274689-7/advocacy-coalition-framework-paul-sabatier-christopher-weible. 
  61. Family Farm Action (November 2020). "Build Back Better: Our Call to Action and Roadmap for Rural America" (PDF). https://farmactionfund.us/wp-content/uploads/2020/11/Family-Farm-Action-Roadmap-for-Rural-America-Biden-Harris-min_compressed.pdf. Retrieved 25 January 2023. 
  62. Dimock, M.R.; Riggle, C.; Hollander, A. et al. (2021). "A New Era for Meat Processing in California? Challenges and Opportunities to Enhance Resilience". UC Davis: Food Systems Lab. University of California. https://escholarship.org/uc/item/4r723374. Retrieved 25 January 2023. 
  63. Hendrickson, M.K.; Howard, P.J.; Miller, E.M. et al. (6 May 2021). "The Food System: Concentration and Its Impacts". Family Farm Action Alliance. https://farmaction.us/concentrationreport/. Retrieved 04 April 2023. 
  64. Ridberg, Ronit A.; Bell, Janice F.; Merritt, Kathryn E.; Harris, Diane M.; Young, Heather M.; Tancredi, Daniel J. (13 June 2019). "Effect of a Fruit and Vegetable Prescription Program on Children’s Fruit and Vegetable Consumption". Preventing Chronic Disease 16: 180555. doi:10.5888/pcd16.180555. ISSN 1545-1151. PMC PMC6583818. PMID 31198165. http://www.cdc.gov/pcd/issues/2019/18_0555.htm. 
  65. Ridberg, Ronit A.; Bell, Janice F.; Merritt, Kathryn E.; Harris, Diane M.; Young, Heather M.; Tancredi, Daniel J. (1 February 2019). "A Pediatric Fruit and Vegetable Prescription Program Increases Food Security in Low-Income Households" (in en). Journal of Nutrition Education and Behavior 51 (2): 224–230.e1. doi:10.1016/j.jneb.2018.08.003. https://linkinghub.elsevier.com/retrieve/pii/S1499404618307115. 
  66. Tomich, Thomas P.; Brodt, Sonja; Ferris, Howard; Galt, Ryan; Horwath, William R.; Kebreab, Ermias; Leveau, Johan H.J.; Liptzin, Daniel et al. (21 November 2011). "Agroecology: A Review from a Global-Change Perspective" (in en). Annual Review of Environment and Resources 36 (1): 193–222. doi:10.1146/annurev-environ-012110-121302. ISSN 1543-5938. https://www.annualreviews.org/doi/10.1146/annurev-environ-012110-121302. 
  67. 67.0 67.1 Hoy, Casey W. (1 December 2015). "Agroecosystem health, agroecosystem resilience, and food security" (in en). Journal of Environmental Studies and Sciences 5 (4): 623–635. doi:10.1007/s13412-015-0322-0. ISSN 2190-6483. http://link.springer.com/10.1007/s13412-015-0322-0. 
  68. Elahi, Ehsan; Khalid, Zainab; Tauni, Muhammad Zubair; Zhang, Hongxia; Lirong, Xing (1 September 2022). "Extreme weather events risk to crop-production and the adaptation of innovative management strategies to mitigate the risk: A retrospective survey of rural Punjab, Pakistan" (in en). Technovation 117: 102255. doi:10.1016/j.technovation.2021.102255. https://linkinghub.elsevier.com/retrieve/pii/S0166497221000365. 
  69. Vadrevu, Krishna Prasad; Cardina, John; Hitzhusen, Fred; Bayoh, Isaac; Moore, Richard; Parker, Jason; Stinner, Ben; Stinner, Deb et al. (1 March 2008). "Case Study of an Integrated Framework for Quantifying Agroecosystem Health" (in en). Ecosystems 11 (2): 283–306. doi:10.1007/s10021-007-9122-z. ISSN 1432-9840. http://link.springer.com/10.1007/s10021-007-9122-z. 
  70. Huber, Patrick R.; Springer, Nathaniel P.; Hollander, Allan D.; Haden, V. Ryan; Brodt, Sonja; Tomich, Thomas P.; Quinn, James F. (1 April 2015). "Indicators of global sustainable sourcing as a set covering problem: an integrated approach to sustainability" (in en). Ecosystem Health and Sustainability 1 (2): 1–8. doi:10.1890/EHS14-0008.1. ISSN 2096-4129. https://spj.science.org/doi/10.1890/EHS14-0008.1. 
  71. 71.0 71.1 Hahn, Intaek; Dyson, Brian; Neale, Anne; Gould, Rachelle; Huber, Patrick; Biedenweg, Kelly; Hochard, Jacob; Geller, Andrew (1 January 2021). "Review of ESA 2019 SYMP 8: Integrating Human Health with Ecosystem Services—Research to Provide Practical Tools for Healthier and More Resilient Communities" (in en). The Bulletin of the Ecological Society of America 102 (1): e01786. doi:10.1002/bes2.1786. ISSN 0012-9623. PMC PMC8715912. PMID 34970000. https://esajournals.onlinelibrary.wiley.com/doi/10.1002/bes2.1786. 
  72. Dooley, Damion M.; Griffiths, Emma J.; Gosal, Gurinder S.; Buttigieg, Pier L.; Hoehndorf, Robert; Lange, Matthew C.; Schriml, Lynn M.; Brinkman, Fiona S. L. et al. (18 December 2018). "FoodOn: a harmonized food ontology to increase global food traceability, quality control and data integration" (in en). npj Science of Food 2 (1): 23. doi:10.1038/s41538-018-0032-6. ISSN 2396-8370. PMC PMC6550238. PMID 31304272. https://www.nature.com/articles/s41538-018-0032-6. 
  73. Holden, Nicholas M.; White, Eoin P.; Lange, Matthew. C.; Oldfield, Thomas L. (9 October 2018). "Review of the sustainability of food systems and transition using the Internet of Food" (in en). npj Science of Food 2 (1): 18. doi:10.1038/s41538-018-0027-3. ISSN 2396-8370. PMC PMC6550226. PMID 31304268. https://www.nature.com/articles/s41538-018-0027-3. 
  74. The Global-Hub on Indigenous Peoples’ Food Systems; Milbank, Charlotte; Burlingame, Barbara; Hunter, Danny; Brunel, Anne; de Larrinoa, Yon Fernandez; Eulalia Martinez-Cruz, Tania; Katic, Pamela et al. (17 November 2021). "Rethinking hierarchies of evidence for sustainable food systems" (in en). Nature Food 2 (11): 843–845. doi:10.1038/s43016-021-00388-5. ISSN 2662-1355. https://www.nature.com/articles/s43016-021-00388-5. 
  75. 75.0 75.1 Carroll, Stephanie Russo; Herczog, Edit; Hudson, Maui; Russell, Keith; Stall, Shelley (16 April 2021). "Operationalizing the CARE and FAIR Principles for Indigenous data futures" (in en). Scientific Data 8 (1): 108. doi:10.1038/s41597-021-00892-0. ISSN 2052-4463. PMC PMC8052430. PMID 33863927. https://www.nature.com/articles/s41597-021-00892-0. 
  76. Zuboff, Shoshana (2019). The age of surveillance capitalism: the fight for a human future at the new frontier of power (First edition ed.). New York: PublicAffairs. ISBN 978-1-61039-569-4. 

Notes

This presentation is faithful to the original, with only a few minor changes to presentation and updates to spelling and grammar. In some cases important information was missing from the references, and that information was added. No citation was given for Wilkinson et al.'s FAIR principles in the original; a citation was added for this version. Note that after the original paper was published, the Huber et al. paper[1] was ultimately published under a different title and never put in the special collection mentioned in this paper.

  1. Cite error: Invalid <ref> tag; no text was provided for refs named :13