Showing posts with label cultural-evolution. Show all posts
Showing posts with label cultural-evolution. Show all posts

February 5, 2026

G:P:C (Genotype:Phenotype:Culturtype) Maps

For Darwin Day 2026, I will introduce a method and theory for multiple types of inheritance called Genotype:Phenotype:Culturtype (G:P:C) Maps. While dubious attempts at understanding culture in Darwinian terms were advanced in the 19th century, it wasn't until the 20th century that evolutionary approaches to culture matured [1]. These approaches, advanced by Boyd and Richerson [2] and Cavalli-Sforza and Feldman [3] identified cultural evolution as units of inheritance subject to mutation and recombination. These approaches are influenced by biological evolution, while also serving as a metaphor that brings cultural change in line with biological evolutionary change. What goes on inside of a population of organisms ultimately ties together culture and biology, there are additional factors and types of explanation necessary that allow us to map from biology (both genotypic and phenotypic aspects) to culture [4].


The approach sketched out here expands on the concept of Genotype: Phenotype (G:P) maps which provide a means to characterize a mapping of the genotype to a phenotype [5]. Let us take a very small G:P example (Figures 1 and 2). We might think that the simplest relationship would be a 1:1 mapping, with the genome collectively serving as a blueprint for the phenotype. But this simplistic mapping scheme results in a linear, low-resolution phenotype. In such cases, mutations or recombination in each gene have direct effects in the phenotype. The resulting linearity also works against evolvability of the G-P map [6], as every new trait would require a new gene. Simply duplicating genes might appear to solve the problem, but this ultimately results in an extremely large genome.


Figure 1. Five examples of relationships between Genotype (G), Phenotype (P), and Culturtype (C) featuring the convergence and divergence of braided structures and 1:1 mappings. From left: 1) 1:1 mapping between G and P, divergence between P and G; 2) divergence between G and P, convergence between P and C; 3) terminal effects at P; 4) convergence between G and P, divergence between P and C; and 5) convergence between G and P, 1:1 mapping between P and C.  


Another issue is the information content of a 1:1 mapping. Mapping one gene to one phenotypic trait results in a blocky, 1 bit representation. While we can specify as much detail as we would like in a single gene, it can only be turned on or off in a switchlike fashion. This is a common feature across the tree of life, and basic regulatory mechanisms exhibit common ancestry among bacteria (start sites and modulation) and in the Last Universal Common Ancestor (LUCA; an RNAP that predates DNA replication) [7, 8].


A much more realistic scenario is a G-P map where multiple genes contribute to a single trait, and each trait is the product of epistatic interactions between genes [9]. This not only provides compensatory routes to a partial phenotype in case of functional loss yet also provides a source of regulation resulting in phenotypic variation. Such a nonlinear approach moves us away from the “genes as blueprint” view, and towards a different view of G-P maps. This alternative view enables an emergent approach to gene regulation, where different versions of a phenotype can arise from the same set of genes. The G-P map is thus defined by pleiotropic interactions, which can be mapped out as the translation from one gene to many phenotypes.


G-P maps are defined by convergence as well as emergence. Convergence can be characterized by phenocopying or buffering, or where a single phenotype can result from multiple genotypic interactions. Genotype networks possess a small-world network architecture with assortativity [10].  



Figure 2. An example of a G:P:C mapping. Each dot is a unit that corresponds with its level: red dots (G, or genotype) are equivalent to alleles, blue dots (P, or phenotype) are equivalent to affordances, and green dots (C, or culturtype) are equivalent to cultural variants.


In Figure 2, we can see that a G-P map (and by extension the G-P-C map) is constructable as a set of topological braids: branching and convergence patterns between two 1-D physical maps of the genotype (bottom) and phenotype (top). We are interested in a level above the phenotype, however, and this is where our third physical map (culturtype, Figure 2B) comes into play. A culturtype is the culture in which a phenotype operates. Each culturtype is a distinct form of practices and behaviors that shares attributes with other culturtypes. Culturtypes also have a connection to both the genotype and phenotype, offering a means to adapt to environmental conditions when genotypes cannot. From an embodied perspective, collective behaviors can be shaped by the phenotype, which should then map to the culturtype. The mapping between the phenotype and culturtype is similar in nature to the genotype-phenotype mapping. In particular, the relation between phenotypes composed of affordances and culturtypes composed of variants allows us to understand embodied, embedded, and extended cognition in the context of biological diversity [11]. The equivalent of epistasis is a more generic one-to-many mapping, typified by differences in cultural practice. This is typified by branching patterns. By contrast, convergence is defined by functional buffering and similar cultural practices derived from different phenotypes.  


Topological braids [12] consist of strands that represent single pathways that map between different sets. In our example, each genotype:phenotype path is defined by a subset of braids, each braid being assigned a braid word as a means of credit assignment. Likewise, each phenotypic component has a subset of braids leading to a culturtype. The G:P:C map is an open braid system in which the number of braids nor number of units at each level remain constant, connecting the open nature of genotype, phenotype, and cultural diversity.  Future work might incorporate a phylogenetic approach where braids are mapped to a reticulating phylogenetic tree, where temporal relationships can also be addressed.


References:

[1] Lewens, T. and Buskell, A. (2013). Cultural evolution. Stanford Encyclopedia of Philosophy, https://plato.stanford.edu/entries/evolution-cultural/


[2] Boyd, R. and Richerson, P.J. (1985). Culture and the Evolutionary Process. University of Chicago Press.


[3] Cavalli-Sforza, L.L. and Feldman, M. (1981). Cultural Transmission and Evolution: a quantitative approach. Princeton University Press.


[4] Claidière, N., Scott-Phillips, T.C., and Sperber, D. (2014). How Darwinian Is Cultural Evolution? Royal Society B, 369(1642), 20130368.


[5] Alberch, P. (1991). From genes to phenotype: dynamical systems and evolvability. Genetica, 84, 5–11.


[6] Wagner, G.P. and Zhang, J. (2011). The pleiotropic structure of the genotype-phenotype map: the evolvability of complex organisms. Nature Reviews Genetics, 12(3), 204-213.


[7] Kuo, S-T., Chang, J.K., Chang, C., Shen, W-Y., Hsu, C., Lai, S-W., and Chou, H-H.D. (2025). Unraveling the start element and regulatory divergence of core promoters across the domain bacteria.  Nucleic Acids Research, 53, gkaf1310.


[8] Koonin, E.V., Krupovic, M., Ishino, S., and Ishino, Y. (2020). The replication machinery of LUCA: common origin of DNA replication and transcription.  BMC Biology, 18, 61. 


[9] Pigliucci, M. (2010). Genotype–phenotype mapping and the end of the ‘genes as blueprint’ metaphor. Royal Society London B: Biological Sciences, 365(1540), 557–566.


[10] Aguilar‐Rodríguez, J., Peel, L., Stella, M., Wagner, A., and Payne, J.L. (2018). The architecture of an empirical genotype‐phenotype map. Evolution, 72(6), 1242–1260.


[11] Alicea, B., Gordon, R., and Parent, J. (2023). Embodied Cognitive Morphogenesis as a Route to Intelligent Systems. Royal Society Interface Focus, 13(3), 20220067.


[12] Weisstein, E.W. (2025). Braid. Wolfram MathWorld. https://mathworld.wolfram.com/ Braid.html AND Artin, E. (1950). The Theory of Braids. American Scientist, 38, 112-119, 1950.

November 27, 2020

Open-source Community-building Discussions

As part of my role as Community Manager at the Rokwire Initiative, I have been maintaining content on a personal blog. I am highlighting some of the systems-oriented posts here on Synthetic Daises. The first re-post summarizes the functional aspects of open-source communities, while in the second re-post I propose that open-source communities are actually form of collective intelligence. The third re-post is of particular interest to this blog's audience, which is a revisitation of wicked problems.


Striving for Issue 0 (why do we have a community)

Why do we want to build a community in the first place? This question may seem self-obvious on its surface, even in the open-source context. But it is good to state the reasons why we might want to create a community. More importantly, it is good to think about communities as having explicitly stated benefits. Communities allow us to tap into a heterogeneous pool of expertise, build upon a network of contributors, recruit collaborators for future projects, and serve to facilitate education.

What direction does the action flow? A countdown to the essential issue, or enumeration of the issues?

The first benefit of an open-source community is to allow for a single contributor to interact quickly with many other contributors with a wide range of skills and expertise. For example, if you are a technical writer and have a question about a new programming language, you can post a message to the Slack channel with your inquiry and receive a helpful answer much more quickly than making a blanket inquiry or searching for the answer yourself. This actually sounds like the guiding principle of a University, but with a much more decentralized and informal structure.

Unlike a University, open-source communities are inherently interconnected [1], and as such serve to form a social network of contributors. Our hypothetical Slack channel is part of a Slack team (with many channels), and the Slack team is in turn a part of the entire community. As with a traditional workplace or school, this involves the interactions of many people, often with different roles and interests. A community allows for people who might not otherwise interact to cross paths, and mutually benefit from this serendipity [2].

Example of network structure in an open source community. Map of openrpg bug report interactions. From [3].

By their nature, open-source community networks are broad and loosely integrated. This is necessary by design; many open-source contributors have other commitments and contribute erratically to the project. But this is a good thing! One benefit of this structure is to enable people who would otherwise not make the time commitment. Related to this is the existence of a talent pool that is poised to build out an existing initiative, or engage in a new initiative. This alleviates the need to recruit and incentivize people using conventional hiring mechanisms.

But these relationships should not designed to be exploitative. In fact, one contributor to a healthy and stable open-source community is the feeling that contributors are able to benefit from their participation. Short of financial compensation, there are many other ways that contributors can benefit. One of these is becoming educated about the software platform itself. Educational incentives such as badging systems (microcredentials) serve as small-scale incentives. Being a contributor also allows one to learn about the latest features, and even have a hand in developing them. Another way open-source communities can reinforce education is through outreach, particularly in the form of an Ambassadors program [4]. A focus on learning opportunities centered on a specific software platform, in addition to learning and promoting associated skills, builds participation incentives into the community.

In these ways, we can take a step back from issues and builds and think about how we can leverage the community as a benefit of the platform. Then we can work towards addressing Issue 0: building and maintaining a community.

NOTES:

[1] Teixeira, J., Robles, G., and Gonzalez-Barahona, J.M. (2015). Lessons learned from applying social network analysis on an industrial Free/Libre/Open Source Software ecosystem. Journal of Internet Services and Applications, 6, 14.

[2] Achakulvisut, T., Ruangrong, T., Acuna, D.E., Wyble, B., Goodman, D., and Kording, K. (2020). neuromatch: Algorithms to match scientists. eLife Labs, May 18.

[3] Crowston, K. And Howison, J. (2005). The social structure of free and open source software development. First Monday, 10(2).

[4] Starke, L. (2016). Building an Online Community Ambassador Program. Higher Logic blog, July 28.

The Role of Collective Intelligence in Open-source

What do ants have to do with open-source?

Ants (and social insect more generally) are capable of building structures that feature great complexity and labor specialization. These complicated structures result from the small contribution of individual ants, each of which have a specialized job in their community [1]. In this sense, ant colonies exhibit parallels with open-source collaboration. Both types of organization (ant societies and open-source communities) rely upon collective intelligence, or the wisdom and power of crowds to create an artifact of great complexity shaped by design principles that emerge from these interactions.

Collective intelligence can be defined as intentional behaviors based on a coordinated set of goals among multiple individuals, and emerges from various forms of collaboration, competition, and group effort. For systems ranging from insect colonies to human societies [2], collective intelligence is a prime enabler of coordinated social behaviors and movements [3]. Being aware of how this process works is important for making the most of an open-source effort.

Traditional crowdsourcing can be understood as cooperation between two groups of people: requesters and contributors [4]. Requesters can be thought of as people who want a functional artifact, but may not be able to implement the solution. Contributors are people with technical know-how who realize the initial specification. I have discussed the open-source ethos and related contributor motivations in other posts on this blog. In this post, the focus will be on how requesters and contributors work together to produce a coherent outcome.

The find-fix-verify (FFV) workflow [5] has been identified as a facilitator or collective intelligence in open-source projects. FFV involved three steps: 1) finding room for improvement, such as a new feature or correcting an error, 2) proposing specific solutions to said improvements, and 3) verify that such changes are acceptable solutions. FFV allows for a division of labor in open-source communities based on expertise and technical skill. Yet each step is not executed by a dedicated employee reporting to a supervisor. Rather, each step is performed by groups of contributors who make their own contributions based on personal experiences and context.

In terms of organization, there are three ways in which open-source communities can be organized [4]. These are demonstrated graphically using Paul Baran’s networking diagram. The first is through direct leadership (centralized, A), which typically involves a single coordinator. This is most typically found in traditional corporate or academic organizations, and are often the least effective at harnessing the power of open-source.

Open-source communities can also be organized through collaboratives (decentralized, B), which involves the coming-together of people with a common interest. This form of organization is usually maintained over the long-term through expedient subgroups that form and dissolve given the immediate imperative. Finally, the passive mode of organization (distributed, C) is perhaps the most effective mode for facilitating open-source. In this type of organization, members of the crowd work independently, and in fact may never collaborate directly. This mode resembles so-called leaderless movements [6]. While collaborative and passive organizational modes have their advantages for facilitating open-source, there is no one-size-fits-all solution. The optimal organizational structure is often project- and goal-dependent.

Paul Baran’s Networking Diagram

A great majority of open-source contributors are transient [7]. Generally, these people contribute to a single project, and within that project only contribute to a small portion of the codebase. Most open-source projects have a few key leaders (occasionally not dissimilar to queen ants) who coordinate and facilitate project management [8]. But this is only a coordination tactic; across hundreds or event thousands of contributors, great things can happen.

NOTES:

[1] Bonabeau, E., Dorigo, M., and Theraulaz, G. (1999). Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, New York.

[2] O’Bryan, L., Beier, M., and Salas, E. (2020). How Approaches to Animal Swarm Intelligence Can Improve the Study of Collective Intelligence in Human Teams. Journal of Intelligence, 8(1), 9.

[3] Sasaki, T. And Biro, D. (2017). Cumulative culture can emerge from collective intelligence in animal groups. Nature Communications, 15049.

[4] Bigham, J.P., Bernstein, M.S., and Adar, E. (2014). Human-Computer Interaction and Collective Intelligence. Chapter 2, Collective Intelligence Handbook.

[5] Bernstein, M.S., Little, G., Miller, R.C., Hartmann, B., Ackerman, M.S., Karger, D.R., Crowell, D., and Panovich, K. (2015). Soylent: A Word Processor with a Crowd Inside. Communications of the ACM, 58(8), 85-94. doi:10.1145/ 2791285.

[6] Alicea, B. (2012). Leaderless control: understanding unguided order. Synthetic Daisies, April 9.

[7] Cui, X. And Stiles, E. (2010). Workings of Collective Intelligence within Open Source Communities. Third International Conference on Social Computing, Behavioral Modeling, and Prediction, Bethesda, MD.

[8] Alicea, B. (2020). Building a Distributed Virtual Laboratory Adjacent to Academia. MetaArXiv, doi:10.31222/osf.io/4k3z6. 


Infinite Issues (issue infinity): how to break down a wicked problem

In this blog post, I want to discuss how to break down a big problem into a set of smaller issues that are addressable in a short-term timescale. Previously, I discussed how to break a complex problem down into addressable action items. Now I want to do this in the context of wicked problems, or problems that are highly complex, hard to predict, and have multiple unintended or unforeseen outcomes.

Solving a basic problem requires you to take its most salient and/or interesting features, and then establish the outlines of a solution. This might involve breaking the problem up into  more easily solved parts, or asking additional questions about the nature and context of the problem. Next is a consideration of what resources you might need. In an open-source project, many of these projects revolve around the time constraints of contributors. Therefore, one key to creating issues is to break down the problem into small pieces that are both relatively easy to solve and require a low time commitment. Individually, these might seem too small to matter. Taken together, however, they allow you to build large-scale applications.

Of course, this procedure works well for normal complex problems, such as “let’s build a smart watch”! But suppose we want to work on a problem that interacts strongly with social systems, such as how to mitigate a pandemic. Then we have to think about the problem in terms of so-called wicked problems.

Wicked problems have a very high degree of computational complexity, which translates into a system with many more moving parts than cannot be analyzed in a way that provides an exact answer.

1) ill-defined problems reign supreme: it is hard to define the problem or even a set of issues at least initially.

2) all solutions to a given problem are at best a guess. This includes the ability to break down a problem into salient issues. Most issues in wicked problems will require the approximation of the salient issues, as well as forms of rapid prototyping to refine issues as the problem domain becomes more familiar.


Wicked Problems from a design perspective. Image is from Figure 1 in [1].

3) no natural end-point, where a system does not have a clearly defined stopping points.

4) so-called messes interactions between subdomains, problems of which cannot be easily broken up into discrete parts [for more, see 2]. This might be because your problem domain has porous boundaries/categories or that the problem itself is highly variable over time.

One example of a wicked problem is an institutional response to COVID. The University of Illinois has done this fairly effectively, but has involved innovations on multiple fronts. Part of this has involved Safer Illinois, which is a normal complex problem. But Safer is necessary but not sufficient to solving this problem. The real success has been seen through multiple institutional components such as testing regimens and building ambassadors. While an app designed to manage one part of the pandemic response is a basic problem, the response as a while is a wicked problem. This is something to consider when we think about how our contributions fit into larger issues.

NOTES:

[1] Jobst, B. And Meinel, C. (2013). How Prototyping Helps to Solve Wicked Problems. Design Thinking Research, 105-113.

[2] Yeh, R.T. (1991). System Development as a Wicked Problem. International Journal of Software Engineering and Knowledge Engineering, 1(2), 117-130.

August 27, 2018

Final Google Summer of Code presentations are live!

The final presentation for Google Summer of Code students in the Representational Brains and Phenotypes (Sam and Jim) and DevoWorm (Arnab) groups are now available! The summer went quite well: skills were taught, lessons were imparted, and computing projects were advanced. Here are the links to each project submission and summary video.


Sam's final talk (YouTube) and project repository (Github).


Arnab's final talk (YouTube) and project repository (Github).


Cheng-Hsun (Jim)'s final talk (YouTube) and project repo (Github).

Sam and Jim worked to advance the Contextual Geometric Structures framework (link 1, link 2) using different approaches. Both projects involved a mix of evolutionary algorithms, computational linguistics, hybrid modeling, and representational AI. The Google n-gram database was used to provide a source of training data.

Arnab worked on an XML framework for organizing embryo data at the cellular level. This not only provides the DevoWorm group with a link to more specific XML and simulation frameworks, but also moves us towards network-based representational models of the embryo.

February 12, 2018

Darwin as a Universal Principle

Background Diagram: Mountian-Sky-Astronomy-Big-Bang blog.

For this year's Darwin Day post, I would like to introduce the concept of Universal Darwinism. To understand what is meant by universal Darwinism, we need to explore the meaning of the term as well as the many instances Darwinian ideas have been applied to. The most straightforward definition of Universal Darwinism is a Darwinian processes that can be extended to any adaptive system, regardless of their suitability. Darwinian processes can be boiled down to three essential features:
1) production of random diversity/variation (or stochastic process).  
2) replication and heredity (reproduction, historical contingency). 
3) natural selection (selective mechanism based on some criterion). 
A fourth feature, one that underlies all three of these points, is the production and maintenance of populations (e.g. population dynamics). These features are a starting point for many applications of universal Darwinism. Depending on the context of the application,these four features may be emphasized in different ways or additional features may be added.

Taken collectively, these three features constitute many different types of process, encompassing evolutionary epistemology [1] to cultural systems [2], neural systems [3, 4], physical systems [5, 6], and informational/cybernetic systems [7, 8]. Many of these universal applications are explicitly selectionist, and do not have uniform fitness criteria. In fact, fitness is assumed in the adaptive mechanism. This provides a very loose analogy to organismal evolution indeed.

Universal computational model shaped by Darwinian processes. COURTESY: Dana Edwards, Universal Darwinism and Cyberspace.

Of these, the application to cybernetic systems is the most general. Taking inspiration from both cybernetics theory and the selectionist aspects of Darwinian models, Universal Selection Theory [7, 8] has four basic claims that can be paraphrased in the following three statements:
1) "operate on blindly-generated variation with selective retention". 
2) "process itself reveals information about the environment". 
3) "processes built atop selection also operate on variation with selective retention".
The key notions are that evolution acts to randomly generate variation, retains only the most fit solutions, then builds upon this in a modular and hierarchical manner. In this way, universal Darwinian processes act to build complexity. As with the initial list of features, the formation and maintenance of populations is an important bootstrapping and feedback mechanism. Populations and heredity underlie all Darwinian processes, even if they are not defined in the same manner as biological populations. Therefore, all applications of Darwinian principles must at least provide an analogue to dynamic populations, even at a superficial level.

There is an additional advantage of using universal Darwinian models: capturing the essence of Darwinian processes in a statistical model. Commonalities between Darwinian processes and Bayesian inference [3, 5] can be proposed as a mechanism for change in models of cosmic evolution. In the Darwinian-Bayesian comparison, heredity and selection are approximated using the relationship between statistical priors and empirical observation. The theoretical and conceptual connections between phylogeny, populations, and Bayesian priors is a post-worthy topic in and of itself.

At this point, we can step out a bit and discuss the origins of universal Darwinian systems. The origin of a Darwinian (or evolutionary) system can take a number of forms [9]. There are two forms of "being from nothingness" in [9] that could be proposed as origin points for Darwinian systems. The first is an origin in the lowest possible energetic (or in our case also fitness) state, and the other is what exists when you remove the governance of natural laws. While the former is easily modeled using variations of the NK model (which can be generalized across different types of systems), the latter is more interesting and is potentially even more universal.

An iconic diagram of Cosmic Evolution. COURTESY: Inflation Theory by Dr. Alan Guth.


An iconic diagram of Biological Evolution. COURTESY: Palaeontological Scientific Trust (PAST).

So did Darwin essentially construct a "theory of everything" over 200 years ago? Did he find "42" in the Galapagos while observing finches and tortoises? There are a number of features from complexity theory that might also fit into the schema of Darwinian models. These include concepts from self-organization not explicitly part of the Darwinian formulation: scaling and complexity, dependence on initial condition, tradeoffs between exploitation and exploration, and  order arising from local interactions in a disordered system. More explicitly, contributions from chaos theory might provide a bridge between nonlinear adaptive mechanisms and natural selection.

The final relationship I would like to touch on here is a comparison between Darwinian processes and Universality in complex systems. The simplest definition of Universality states that the properties of a system are independent of the dynamical details and behavior of the system. Universal properties such as scale-free behavior [10] and conformation to a power law [11] occur in a wide range of systems, from biological to physical and from behavioral to social systems. Much like applications of Universal Darwinism, Universality allows us to observe commonalities among entities as diverse as human cultures, organismal orders/genera, and galaxies/universes. The link to Universality also provides a basis for the abstraction of a system's Darwinian properties. This is the key to developing more representationally-complete computational models.

8-bit Darwin. COURTESY: Diego Sanches.


Darwin viewed his theory development of evolution by natural selection as an exercise in inductive empiricism [12]. Ironically, people are now using his purely observational exercise as inspiration for theoretical mechanisms for systems from the natural world and beyond.


NOTES:
[1] Radnitzky, G.,‎ Bartley, W.W., and Popper, K. (1993). Evolutionary Epistemology, Rationality, and the Sociology of Knowledge. Open Court Publishing, Chicago. AND Dennett, D. (1995). Darwin's Dangerous Idea. Simon and Schuster, New York.

[2] Claidiere, N., Scott-Phillips, T.C., and Sperber, D. (2014). How Darwinian is cultural evolution? Philosophical Transactions of the Royal Society B, 36(9), 20130368.

[3] Friston, K. (2007). Free Energy and the Brain. Synthese, 159, 417-458.

[4] Edelman, G.M. (1987). Neural Darwinism: the theory of neuronal group selection. Oxford University Press, Oxford, UK.

[5] Campbell, J. (2011). Universal Darwinism: the path to knowledge. CreateSpace Independent Publishing.

[6] Smolin, L. (1992). Did the universe evolve? Classical and Quantum Gravity, 9, 173-191.

[7] Campbell, D.T. (1974). Unjustified Variation and Selective Retention in Scientific Discovery. In "Studies in the Philosophy of Biology", F.J. Ayala and T. Dobzhansky eds., pgs. 139-161. Palgrave, London.

[8] Cziko, G.A. (2001). Universal Selection Theory and the complementarity of different types of blind variation and selective retention. In "Selection Theory and Social Construction", C. Hayes and D. Hull eds. Chapter 2. SUNY Press, Albany, NY.

[9] Siegal, E. (2018). The Four Scientific Meanings Of ‘Nothing’. Starts with a Bang! blog, February 7.

[10] Barabási, A-L. (2009). Scale-Free Networks: a decade and beyond. Science, 325, 412-413.

[11] Lorimer, T., Gomez, F., and Stoop, R. (2015). Two universal physical principles shape the power-law statistics of real-world networks. Scientific Reports, 5, 12353.

[12] Ayala, F.J. (2009). Darwin and the Scientific Method. PNAS, 106(1), 10033–10039.

July 2, 2017

Excellence vs. Relevance

Impetus for this blog post. Twitter h/t to Alex Lancaster (@LancasterSci).

In academia, the term excellence is often used in the context of scarcity and competitive dynamics (e.g. publications, career promotion), and as a result can be used quite arbitrarily [1]. In [1], a distinction is made between excellence and soundness. Excellence is seen as a subjective concept, while soundness (enabled through completeness, thoroughness, and an emphasis on reproducibility) is the adherence to clearly defined and practiced research standards. While it may also be true that the concept of soundness can suffer from the same subjective limitations, it is probably an improvement over the current discussions surrounding excellence.

Another term we rarely refer to, but may be of even greater importance, is the relevance of scientific research. In a previous post, I brought relevance theory to bear on potential biases in scientific selectivity. One way to think of relevance is as the collective attentional focus of a given research group, community, or field. Collective attention (and thus relevance) can change with time: papers, methods, and influences rise and fall as research ideas are executed and new information is encountered [2]. As such, relevance defines the scope of scientific research that defines a particular field or community of researchers. Given a particular focus, what is relevant defines what is excellent. In this case, we return to the biases inherent in excellence, but this time with a framework for understanding what it means in a given context.

There is also an interesting relationship between soundness and relevance. For example, the stated goal of venues like PLoS One and Scientific Reports is to evaluate manuscripts based on methodological soundness rather than merely on field-specific relevance. To some extent this has eliminated issues of arbitrary selectivity, yet reviewers and editors from various fields may still surruptitiously impose their own field-specific conventions to the review process. Interestingly, soundness itself can be a matter of relevance, as the use of specific methodologies and modes of investigation can be highly field-specific.

Sometimes relevance is a matching problem between an individual researcher and the conventions of a specific field. Relevance can be represented as a formalized conceptual problem using skillset geometries [3]. In the example below, I have shown how the relevance of a specific individual overlaps with what is considered relevant in a specific field. In this case, the researcher has expertise in multiple areas of expertise, while the field is deeply rooted in a single domain of knowledge. The area of overlap, or Area of Mutual Relevance, describes the degree of shared relevance between individual and community (sometimes called "fit").


How relevant is a single person's skillset in the context of a research community, and how do we leverage this expertise in an inclusive manner? The mutual relevance criterion might provide opportunities in cases where there seems to be a "lack of fit". Understanding the role of collective attention within research communities might allow us to consider how this affects both the flow of new ideas between fields and the successful practice of interdisciplinarity.


NOTES:
[1] Moore, S., Neylon, C., Eve, M.P., O'Donnell, D.P., and Pattinson, D. (2016). Excellence R Us: university research and the fetishisation of excellence. Palgrave Communications, 3, 16105. doi:10.1057/palcomms.2016.105.

[2] Wu, F. and Huberman, B.A. (2007). Novelty and collective attention. PNAS, 104(45), 17599-17601. doi: 10.1073/pnas.0704916104.

[3] First introduced in: Alicea, B. (2017). A peripheral Darwin Day post, but centrality in his collaboration graph. Synthetic Daisies blog, February 16.

July 24, 2016

Catching up on Free Alife

Here are three Alife-related resources to catch up on, some new and some not yet posted to this blog:


Alife XV just concluded, and was hosted in Cancun by Carlos Gershenson and the Self-organizing Systems Lab at UNAM. The proceedings are available here.


Here are the Proceedings from the previous Alife conference (XIV), held in NYC during the Summer of 2014.


And here is the Spring 2016 issue of Artificial Life journal, which features selected papers from the Alife XIV conference (held in NYC in 2014). Be sure to check out the paper "An Informational Study of the Evolution of Codes and of Emerging Concepts in Populations of Agents", which I reviewed.

April 25, 2015

Reading Carnival, April Edition

A new feature here on Synthetic Daisies, which features a variety of readings from blogs, the popular press, and journals of both immediate and long-term interest. This edition features six pieces ranging topically from intellectual property and data analysis to evolutionary biology and complexity theory.


Haydari, S. and Smead, R.   Does Longer Copyright Protection Help of Hurt Scientific Knowledge Creation? JASSS, 18(2), 23 (2015).

An agent-based modeling approach (featuring a type of spatial lattice called an epistemic plane) is used to better understand how copyright protections can both enable and hinder knowledge creation. The model represents knowledge creation in two ways: knowledge can either either "discovered" by agents or remain "undiscovered". Discovered knowledge can be disseminated in either a high-access (proprietary) or open-access (freely-distributable) fashion. This distributed model of scholar behavior has revealed that extended periods of intellectual property protection can act to hinder innovation. While open-access can serve the public good, there is also a role for individual incentives which are served by limited periods of proprietary protection. Whether these returns are served through monetary compensation or social capital accumulation go unexplored.


Lind, P.A., Farr, A.D., and Rainey, P.B.   Experimental evolution reveals hidden diversity in evolutionary pathways. eLife, 10.7554/eLife.07074 (2015).

By examining 28 morphs of the wrinkly spreader phenotype in Pseudomonas fluorescens (a gram-negative bacterium), the authors were able to discover a number of new pathways through which diversity is generated. These unique pathways involved unique, uncharacterized mutations that provided variation to the existing taxonomic group. As instances of parallel evolution, they provided a means to suggest a set of principles that involve changing the regulation of genes followed by a change of function for those genes.



Kiers, E.T. and West, S.A.   Evolving new organisms via symbiosis. Science, 348(6233), 392-394 (2015).

A mini-review on the evolution of symbiont species and how it may account for major transitions in the tree of life.


Dennett, D. and Roy, D.   Our Transparent Future: No secret is safe in the digital age. Scientific American, 312(3), 32-27 (2015).

This essay compares the rise of information transparency, enabled through internet technologies, to the explosion of life's complexity as it occurred during the Cambrian explosion. As a result, the practice of information-handling by individuals and organizations will change due to key innovations. These innovations are analogous to the camera-like retinas, claws, jaws, and shells that emerged amongst animals during the Cambrian. A very Rodney Brooks-esque style argument for internet-enabled (or -forced, depending on your point of view) cultural evolution.


Ellenburg, J.   The Amazing, Autotuning Sandpile. Nautil.us, 23(1) (2015).

A popular science take on the Abelian Sandpile model and its role in pattern formation. The beginning of the article presents a neccessary contrast with the domino model of causality. Unlike a linear model of system dynamics (one event leads to another with a predictable timing), the sanpile model produces nonlinear dynamics with unpredictable timing. While both models involve a simplistic physical structure, but only one produces a highly complex output. Latter portions of the article focus on geometric abstractions (cellular automata) which produce self-organizing and "life-like" behavior.



Brown, C.T.   Cultural confusions about data - the intertidal zone between two styles of biology. Living in an Ivory Basement blog, April 2 (2015).

An interesting blog post (with links and comments) on the cultural meaning of data and what constitutes useful datasets when comparing both academic fields (e.g. computational biology vs. molecular biology) and research outputs (e.g. genome sequences vs. experimental outcomes).

March 9, 2015

Review of "Arrival of the Fittest"

"Arrival of the Fittest" is the latest book by Andreas Wagner, a professor at the University of Zurich in Switzerland. The book [1] tackles a subtly complicated topic: the evolution and evolvability of innovations using a biochemical and computational perspective. For the most part, Wagner succeeds at presenting an elegant case for how the ability to naturally evolve innovations lies at the heart of the evolutionary process. To get there, however, Wagner must introduce us to a number of semi-obscure concepts (at least to the layman). The book can be summarized in four parts: survival of the most novel (I), the concept of innovability (II), the safe and the risky (III), and multiple origins, multiple solutions (IV). I will give a technical review of the book by highlighting these four interrelated themes.



I. Survival of the most novel.
To understand the propagation of innovative solutions throughout the tree of life, it is important to understand the difference between the force of evolution versus the role of selection. Wagner proposes that, rather than creating innovations, the role of natural selection is to preserve them. Innovations themselves are the result mutation, recombination and historical contingencies. The first two mechanisms are capable of randomly generating either very simple innovations or the components of more complex innovations. But to achieve the "tinkering" that seems to be prevalent in complex genetic pathways and phenotypes, we need to have standard meta-components that can lock in previous changes. This allows for the limited exploration of a fitness space without incurring the cost of losing previous advances.


Wagner teases historical contingencies this into two classes: building blocks and standards. In the case of building blocks, the working components that result from previous innovation are modularized into larger units. This allows for increasing complexity to be had from a stochastic process (evolution) as well as accelerating the process of finding and retaining novelties (innovation). The coordination of building blocks often leads to standards, which are much more flexible than hyper-specialized systems but are much more able to deal with hyper-complexity.

Building blocks assembled into a complex structure.

Wagner illustrates this by comparing metabolic engines (a high-tolerance biological engine) with the internal combustion engine (a high-precision mechanical innovation). While metabolic engines can use an interchangeable set of fuels and reactants, internal combustion engines require specific specifications to operate. While one might argue that this implies mechanical engines will be "optimized" and metabolic engines will be made "good enough", this is indeed the point. Rather than survival of the fittest, we observe a survival of the fit enough, with selection acting strongest on functional novelties that augment fitness.

A high-tolerance but highly-specific engine (internal combustion) type.

II. Concept of innovability.
In the case of complex metabolic networks, the basic function has not changed throughout evolutionary history. What has changed is the number of reactions, which scales with evolutionary complexity. This scaling requires very general standards. But to make these standards interoperable across divergent evolution, a diversity of building blocks regulatory mechanisms are also required. This leads us to a set of principles which can explain general trends in innovation rather than on a case-by-case basis. Another such principle involves the number of parts and identity of a specific innovation. The number of interacting parts and their configuration provides a means to compare specific innovations in a hypothetical manner. Wagner proposes that this be done using a high-dimensional structure such as a hypercube [2] or a neutral network [3].

In a hypercube representation, each node represents a specific genotype, while the edges represent pathways (or the accumulation of mutations) between genotypes. In short, the shortest paths are the most probable. In a highly-connected space, a long distance can be traveled across the space in a short number of mutations (or edges).

III. The safe and the risky.
How can the structure of a biological system make things safe for innovation? Certainly, blindly changing key components of a metabolic network or developmental scaffolding without regard for essential function can result in lethality. The presence of the building blocks and standards principles provides a failsafe means to tinker or change without lethal disruption. But there are two other principles at work: redundancy and connectivity. These principles are arguably more important in acting as gatekeepers for the fitness benefits reaped by innovations.

A machine finding its way through a maze. One way to search for novel solutions in a de novo fashion.

Redundancy involves the presence of multiple parts that play a similar or interchangeable role in the functioning of a system. For example, both genetic and metabolic networks can be robust to the removal of single components. When components get removed without having a consequence on function [4], we can say that such a component is redundant. Gene duplications can play a similar role: single copies can be knocked out without a large detriment to fitness. Related to redundant function is, of course, robustness. Robustness can be thought of as how much redundancy exists in a specific system. Wagner gives the example of phenocopying as a way in which developmental robustness can lead to redundant phenotypic configurations.

Connectivity is a less appreciated aspect of evolution. Yet in terms of functional and conceptual unity, connectivity is an essential component of evolving systems that produce innovation. Three aspects of connectivity are most important here: interaction type, density, and connection order. There are a number of interaction types in biological networks that can give rise to innovation. For example, we can look to genetic networks (interaction between genes), breeding networks (interactions between conspecifics), or even the aforementioned neutral networks (interactions between evolutionary configurations) for ways in which connectivity can yield pathways that lead to innovations of high fitness.

An example of a genetic (gene interaction) network. Sometimes this approach is called "hairball science". COURTESY: Figure 1 in [5].

Network density (or the number of interconnections between nodes) allows for a greater number of potential innovative solutions to be explored in a shorter number of steps. This can increase the number of potential solutions, which can be reached in a shorter number of evolutionary steps and/or time (depending on your perspective). In the neutral network, a number of "safe" pathways of equivalent fitness are created for the innovating pathway or organism to explore. While the network density is important in facilitating innovation, the connection order of the network is also important. In networks with a short connection order (e.g. small-world networks), even random paths through the network can yield large-scale, non-deleterious change.

An example of constituent genotypes in a neutral network with reference to robustness. COURTESY: Ricardo Azevedo, Wikipedia.

IV. Multiple origins, multiple solutions.
The final point of Wagner's book is to remind us that innovations can be achieved through multiple unique solutions, and that existing innovations may have had multiple origin points. While evolution also has no unique solution, innovation is particularly subject to parallel evolution. Since this book does not shy away from computational representations, Wagner applies the idea of evolution strategies [6] to illustrate how innovations can be modeled as a five-part process. Specifically, innovation involves trial-and-error, population-based exploration, solutions with multiple origins, a combinatorial structure, and a stochastic process with a mutation-selection structure. While these factors also define the evolutionary process, we might say that innovation is inseparable from evolution by natural selection. Thinking more broadly and considering social systems, cultural innovation might also be best characterized as an evolutionary process. Wagner's approach to innovation as evolvability is a useful and accessible introduction to the topic, and places this new set of concepts and terminology directly into the context of evolution by natural selection.

NOTES:
[1] For other, briefer reviews, please see: Hoppe, R.B.   Andreas Wagner: Arrival of the Fittest: Solving Evolution’s Greatest Puzzle. Panda's Thumb blog, November 4 (2014) AND Pagel, M.   The Neighborly Nature of Evolution. Nature, 514, 34 (2014).

[2] For an example, please see: Gavrilets, S. and Gravner, J.   Percolation on the Fitness Hypercube and the Evolution of Reproductive Isolation. Journal of Theoretical Biology, 184(1), 51–64 (1997).

[3] For an example, please see: Wagner, A.   Robustness and Evolvability in Living Systems. Princeton University Press (2005).

[4] Li, J., Yuan, Z., and Zhang, Z.   The Cellular Robustness by Genetic Redundancy in Budding Yeast. PLoS Genetics, 6(11), e1001187 (2010).

[5] Magtanong, L. et.al   Dosage suppression genetic interaction networks enhance functional wiring diagrams of the cell. Nature Biotechnology, 29, 505-511 (2011).

[6] Evolution strategies assumes that evolution is an optimizing process that results from the iterative application of a mutation-selection model. For more, please see: Schwefel, H-P.   Numerical optimazaion of computer models. Wiley Press, Chichester (1981) AND Beyer, H-G. and Schwefel, H-P.   Evolution Strategies: A Comprehensive Introduction. Journal of Natural Computing, 1(1), 3–52 (2002).

Printfriendly