Showing posts with label cultural-representation. Show all posts
Showing posts with label cultural-representation. Show all posts

February 5, 2026

G:P:C (Genotype:Phenotype:Culturtype) Maps

For Darwin Day 2026, I will introduce a method and theory for multiple types of inheritance called Genotype:Phenotype:Culturtype (G:P:C) Maps. While dubious attempts at understanding culture in Darwinian terms were advanced in the 19th century, it wasn't until the 20th century that evolutionary approaches to culture matured [1]. These approaches, advanced by Boyd and Richerson [2] and Cavalli-Sforza and Feldman [3] identified cultural evolution as units of inheritance subject to mutation and recombination. These approaches are influenced by biological evolution, while also serving as a metaphor that brings cultural change in line with biological evolutionary change. What goes on inside of a population of organisms ultimately ties together culture and biology, there are additional factors and types of explanation necessary that allow us to map from biology (both genotypic and phenotypic aspects) to culture [4].


The approach sketched out here expands on the concept of Genotype: Phenotype (G:P) maps which provide a means to characterize a mapping of the genotype to a phenotype [5]. Let us take a very small G:P example (Figures 1 and 2). We might think that the simplest relationship would be a 1:1 mapping, with the genome collectively serving as a blueprint for the phenotype. But this simplistic mapping scheme results in a linear, low-resolution phenotype. In such cases, mutations or recombination in each gene have direct effects in the phenotype. The resulting linearity also works against evolvability of the G-P map [6], as every new trait would require a new gene. Simply duplicating genes might appear to solve the problem, but this ultimately results in an extremely large genome.


Figure 1. Five examples of relationships between Genotype (G), Phenotype (P), and Culturtype (C) featuring the convergence and divergence of braided structures and 1:1 mappings. From left: 1) 1:1 mapping between G and P, divergence between P and G; 2) divergence between G and P, convergence between P and C; 3) terminal effects at P; 4) convergence between G and P, divergence between P and C; and 5) convergence between G and P, 1:1 mapping between P and C.  


Another issue is the information content of a 1:1 mapping. Mapping one gene to one phenotypic trait results in a blocky, 1 bit representation. While we can specify as much detail as we would like in a single gene, it can only be turned on or off in a switchlike fashion. This is a common feature across the tree of life, and basic regulatory mechanisms exhibit common ancestry among bacteria (start sites and modulation) and in the Last Universal Common Ancestor (LUCA; an RNAP that predates DNA replication) [7, 8].


A much more realistic scenario is a G-P map where multiple genes contribute to a single trait, and each trait is the product of epistatic interactions between genes [9]. This not only provides compensatory routes to a partial phenotype in case of functional loss yet also provides a source of regulation resulting in phenotypic variation. Such a nonlinear approach moves us away from the “genes as blueprint” view, and towards a different view of G-P maps. This alternative view enables an emergent approach to gene regulation, where different versions of a phenotype can arise from the same set of genes. The G-P map is thus defined by pleiotropic interactions, which can be mapped out as the translation from one gene to many phenotypes.


G-P maps are defined by convergence as well as emergence. Convergence can be characterized by phenocopying or buffering, or where a single phenotype can result from multiple genotypic interactions. Genotype networks possess a small-world network architecture with assortativity [10].  



Figure 2. An example of a G:P:C mapping. Each dot is a unit that corresponds with its level: red dots (G, or genotype) are equivalent to alleles, blue dots (P, or phenotype) are equivalent to affordances, and green dots (C, or culturtype) are equivalent to cultural variants.


In Figure 2, we can see that a G-P map (and by extension the G-P-C map) is constructable as a set of topological braids: branching and convergence patterns between two 1-D physical maps of the genotype (bottom) and phenotype (top). We are interested in a level above the phenotype, however, and this is where our third physical map (culturtype, Figure 2B) comes into play. A culturtype is the culture in which a phenotype operates. Each culturtype is a distinct form of practices and behaviors that shares attributes with other culturtypes. Culturtypes also have a connection to both the genotype and phenotype, offering a means to adapt to environmental conditions when genotypes cannot. From an embodied perspective, collective behaviors can be shaped by the phenotype, which should then map to the culturtype. The mapping between the phenotype and culturtype is similar in nature to the genotype-phenotype mapping. In particular, the relation between phenotypes composed of affordances and culturtypes composed of variants allows us to understand embodied, embedded, and extended cognition in the context of biological diversity [11]. The equivalent of epistasis is a more generic one-to-many mapping, typified by differences in cultural practice. This is typified by branching patterns. By contrast, convergence is defined by functional buffering and similar cultural practices derived from different phenotypes.  


Topological braids [12] consist of strands that represent single pathways that map between different sets. In our example, each genotype:phenotype path is defined by a subset of braids, each braid being assigned a braid word as a means of credit assignment. Likewise, each phenotypic component has a subset of braids leading to a culturtype. The G:P:C map is an open braid system in which the number of braids nor number of units at each level remain constant, connecting the open nature of genotype, phenotype, and cultural diversity.  Future work might incorporate a phylogenetic approach where braids are mapped to a reticulating phylogenetic tree, where temporal relationships can also be addressed.


References:

[1] Lewens, T. and Buskell, A. (2013). Cultural evolution. Stanford Encyclopedia of Philosophy, https://plato.stanford.edu/entries/evolution-cultural/


[2] Boyd, R. and Richerson, P.J. (1985). Culture and the Evolutionary Process. University of Chicago Press.


[3] Cavalli-Sforza, L.L. and Feldman, M. (1981). Cultural Transmission and Evolution: a quantitative approach. Princeton University Press.


[4] Claidière, N., Scott-Phillips, T.C., and Sperber, D. (2014). How Darwinian Is Cultural Evolution? Royal Society B, 369(1642), 20130368.


[5] Alberch, P. (1991). From genes to phenotype: dynamical systems and evolvability. Genetica, 84, 5–11.


[6] Wagner, G.P. and Zhang, J. (2011). The pleiotropic structure of the genotype-phenotype map: the evolvability of complex organisms. Nature Reviews Genetics, 12(3), 204-213.


[7] Kuo, S-T., Chang, J.K., Chang, C., Shen, W-Y., Hsu, C., Lai, S-W., and Chou, H-H.D. (2025). Unraveling the start element and regulatory divergence of core promoters across the domain bacteria.  Nucleic Acids Research, 53, gkaf1310.


[8] Koonin, E.V., Krupovic, M., Ishino, S., and Ishino, Y. (2020). The replication machinery of LUCA: common origin of DNA replication and transcription.  BMC Biology, 18, 61. 


[9] Pigliucci, M. (2010). Genotype–phenotype mapping and the end of the ‘genes as blueprint’ metaphor. Royal Society London B: Biological Sciences, 365(1540), 557–566.


[10] Aguilar‐Rodríguez, J., Peel, L., Stella, M., Wagner, A., and Payne, J.L. (2018). The architecture of an empirical genotype‐phenotype map. Evolution, 72(6), 1242–1260.


[11] Alicea, B., Gordon, R., and Parent, J. (2023). Embodied Cognitive Morphogenesis as a Route to Intelligent Systems. Royal Society Interface Focus, 13(3), 20220067.


[12] Weisstein, E.W. (2025). Braid. Wolfram MathWorld. https://mathworld.wolfram.com/ Braid.html AND Artin, E. (1950). The Theory of Braids. American Scientist, 38, 112-119, 1950.

January 18, 2025

Orthogonal Lab Annual Report for 2024

Another year of the Orthogonal Research and Education Laboratory (2024). We have had a great year! I posted a summary video on YouTube that covers activities related to Saturday Morning NeuroSim, our Open Science/Open-source interest group, the Computational Developmental Systems interest group, the Representational Brains and Phenotypes interest group, and the Cybernetics interest group. I also discuss our educational initiatives and conference/publication activities.

The seminal activity of the lab is the Saturday Morning NeuroSim meeting, which happens on Saturdays at 10AM ET (North America). This is based on the Saturday Morning Physics educational events, which originated in Germany and are popular in Physics departments and US National Labs. We had 45 meetings in 2024, and covered all manner of intersections between computational, neuroscience, social science, molecular biology, and complexity theory. 

The Computational Developmental Systems interest group can best be described as Neuro-Devo-Psych. This combines our work on Computational Critical Periods and Computational Developmental Biology (DevoWorm-associated). This also intersects with work in the Representational Brains and Phenotypes interest group and the Developmental Neurosimulation approach. 


Our Open Science/Open-source interest group sponsors Google Summer of Code participation in addition to assorted activities in the research practice and open-source project management spheres. The rejuvenation of our Cybernetics interest group features a reading group and other academic activities. 

December 3, 2021

MAIN and Neuromatch Conference Presentations


The Orthogonal Research and Education Lab is on the virtual move! We have been featured at two conferences this week. The first conference is MAIN (Montreal Artificial Intelligence-Neuroscience) conference, a hybrid conference that focused on cutting-edge research in Neuro-AI. Our submission (Developmental Embodied NeuroSimulation) is a group effort and summarizes our work in this area over the past few years. The graphical abstract can be found below.



We also had a presence at Neuromatch 4, with four flash talk presentations on four different topics. Neuromatch 4 was a great time, with two days of keynote talks, short talks, flash talks, and debate panels. 


Each flash talk was 7.5 minutes long, which requires an efficiency of words and ideas not typical of a longer format. The first talk is "The Universal Theory of Switching", which focuses on transitory "switching" phenomena. Switching behavior is ubiquitous across biological, physical, and algorithmic systems, and is controlled by sudden, first-order phase transition-like behavior we characterize as zeroth-order cybernetic regulation. 

Another talk is on "Allostatic Kinds". Allostatic Kinds are a way to regulate the boundaries of meaning and regulation of internal emotional and conscious states. This talk is presented by Jesse Parent, and features a mix of complex systems regulation, philosophy of mind, and consciousness studies. This talk was in conjunction with CEEALAR (Center for Enabling EA Learning and Research), an academic hostel located in Blackpool, UK.

Daniela Cialfi has built upon the lab's work on Meta-brain Models to develop "Economic Meta-brains", which are bio-economic agents that behave according to the free energy principle. Meta-brains are layered computational models that enable different levels of representation in the same agent. These model layers can be configured in geometrically specific ways, which in turn affects their function. The free energy principle enriches the meta-brains approach by adding a mathematically rigorous energetic component to a meta-brain agent. 

Finally, our presentation on "Gibsonian Information" comes with a preprint. Gibsonian Information is the information content of direct perceptual processing (sensu J.J. Gibson). We draw parallels between Shannon and Gibsonian Information, in addition to the role of such information in the dynamic interactions between agents and their environments. See our graphical abstract below, which simplifies the mathematics in the preprint. The talk also features a number of naturalistic settings in which Gibsonian Information can be demonstrated.



Graphical abstract for the Gibsonian Information paper/presentation (direct perception as information content).


December 18, 2020

Observer-dependent Models @ the Philosopher's Web Cafe

 


I gave a talk called "Observer-dependent Models" to the Philosopher's Web Cafe on December 11. I have made the slides available here, and the recording is here. Thanks to Jesse Parent (Orthogonal Lab Manager) and Charlotte Guo (series host) for hosting. It will be almost like being there (almost). 

The talk involved reviewing and redefining the role of observers in empirical and simulated systems. "Observer" refers mostly to computational agents (agent-based simulation and AI), although many of the ideas introduced here may apply to the analysis of empirical observations (experiments). Here is the abstract:

In many areas of science and philosophy, observers are seen as an integral part of understanding the natural world. Aside from a pedagogical role, observers are seen as less important in computational forms of inquiry. In this talk, I will reconsider a role for the observer in computational models as fully integrated with the agent. perhaps more fundamentally, causal outcomes and system dynamics are seen to be contingent on observers, while empirical observations themselves are dependent upon the actions of observers. As this is an article of faith in some interpretations of quantum mechanics, we extend this to algorithmic systems with a combinatorial solution space. The role for observers in computational and empirical investigations is established superficially using a number of concepts, including cybernetics, embodiment, and perceptual information processing. Then we will be introduced to more concrete examples of observer-oriented computational agents, such as observer-emitter systems and viewpoint networks. Finally, we will discuss how this approach goes beyond constructivism to consider multiple observers, multiple perspectives (relativism), and how they affect the interpretation of results.

There is a lot to follow up on from this talk, including a number of themes to explore within the topic of agent-based observers, with more to come in the new year. 



July 31, 2020

Hybrid Models and Representations, latest developments

Our research group Representational Brains and Phenotypes has recently been doing a lot of work in the area of embodied nervous systems simulation. Our go-to model over the past year and a half [1] has been the Braitenberg Vehicle (BV), which makes explicit the relationships between interactions with the environment, a neuronal network, and behavior. In the recently open-sourced Meta-Brain Models initiative, we are looking beyond the highly-limited representational framework of the BV by creating hybrid models that combine Vehicles with a representation-rich model (one that specifies symbolic and semantic properties).  

Representational Brains and Phenotypes website. Click to enlarge.

A few weeks ago, members of our research group presented on this topic at the DevoNN (virtual) workshop. Our paper and presentation "Developmental Embodied Agents as Meta-brain Models" introduced the Meta-brain concept to a wider audience, which in this case coupled a developmental Braitenberg Vehicles (dBV) and Contextual Geometric Sturctures (CGS) [2,3]. dBV and CGS are coupled as layers that interact in ways that resemble central nervous systems [4]. Other model combinations are possible, but must conform to the representation-free/representation-rich layering.

 
DevoNN logo and the layered representations approach. Click to enlarge.

This has the potential to leverage not only embodied aspects of intelligent behavior, but its symbolic aspects of as well. There are also opportunities to expand our layered representations in the direction of growth, form, and analogues of biological plasticity [5]. DevoNN was part of Artificial Life 2020, which was in itself a great virtual conference experience. Everything from digital evolution to robotics, and from computational social science to adaptive systems. 


While our extended abstract is not in the Proceedings, I was also able to given a lightning talk on the OpenWorm approach to virtual organisms. 

OpenWorm lightning talk. Click to enlarge.


NOTES:
[1] Check out our Saturday Morning NeuroSim research meetings on YouTube. Contact the Orthogonal Research and Education Lab if you would like to join in!

[2] Dvoretskii, S., Gong, Z., Gupta, A., Parent, J., and Alicea, B. Braitenberg Vehicles as Developmental Neurosimulation. arXiv, 2003.07689. doi:10.13140/RG.2.2.31149.23526.

[3] Alicea, B. Contextual Geometric Structures: modeling the fundamental components of cultural behavior. Proceedings of Artificial Life, 13, 147-154.

[4] examples include the relationship between the Thalamus and Neocortex of Mammals. For functional and evolutionary context, see: Karten H.J. (2015). Vertebrate brains and evolutionary connectomics: on the origins of the mammalian "neocortex". Philosophical Transactions of the Royal Society B, 370, 20150060

[5] this recent paper is the subject of a presentation at the Dynamics Days Digital conference, but is providing some inspiration for further development towards AI innateness: Alicea, B. (2020). Developmental Incongruity as a Dynamical Representation of Heterochrony. ResearchGate, doi:10. 13140/RG.2.2.17401.08807/1

August 27, 2018

Final Google Summer of Code presentations are live!

The final presentation for Google Summer of Code students in the Representational Brains and Phenotypes (Sam and Jim) and DevoWorm (Arnab) groups are now available! The summer went quite well: skills were taught, lessons were imparted, and computing projects were advanced. Here are the links to each project submission and summary video.


Sam's final talk (YouTube) and project repository (Github).


Arnab's final talk (YouTube) and project repository (Github).


Cheng-Hsun (Jim)'s final talk (YouTube) and project repo (Github).

Sam and Jim worked to advance the Contextual Geometric Structures framework (link 1, link 2) using different approaches. Both projects involved a mix of evolutionary algorithms, computational linguistics, hybrid modeling, and representational AI. The Google n-gram database was used to provide a source of training data.

Arnab worked on an XML framework for organizing embryo data at the cellular level. This not only provides the DevoWorm group with a link to more specific XML and simulation frameworks, but also moves us towards network-based representational models of the embryo.

April 29, 2018

Ready to Start to Google Summer of Code 2018!

Currently at the red roadhouse on the left-hand side of the road.

On your mark, get set, go! We are quickly traveling down the Google Summer of Code (GSoC) road! First, a welcome to the three students I will be mentoring: Arnab Banerjee (Pune University), Sam Felder (University of Illinois Urbana-Champaign), and Cheng-Hsun Hsueh (National Yang-Ming University).

Arnab will be working within the OpenWorm Foundation on "Physics-based XML Model-building for the Mosaic Embryo", while Sam and Cheng-Hsun will be working on "Contextual Geometric Structures of Cultural Behavior ".

This tweet says it all. Check in on the DevoWorm and Representational Brains and Phenotypes group activities throughout the Summer for updates.

We are currently in the Community Period, which lasts until the coding period begins (May 14). Towards the end of Community Period, each student will present a 15-20 minute presentation on their accepted proposal, including additional insights on what will make their project successful. Stay tuned! 

February 12, 2018

Darwin as a Universal Principle

Background Diagram: Mountian-Sky-Astronomy-Big-Bang blog.

For this year's Darwin Day post, I would like to introduce the concept of Universal Darwinism. To understand what is meant by universal Darwinism, we need to explore the meaning of the term as well as the many instances Darwinian ideas have been applied to. The most straightforward definition of Universal Darwinism is a Darwinian processes that can be extended to any adaptive system, regardless of their suitability. Darwinian processes can be boiled down to three essential features:
1) production of random diversity/variation (or stochastic process).  
2) replication and heredity (reproduction, historical contingency). 
3) natural selection (selective mechanism based on some criterion). 
A fourth feature, one that underlies all three of these points, is the production and maintenance of populations (e.g. population dynamics). These features are a starting point for many applications of universal Darwinism. Depending on the context of the application,these four features may be emphasized in different ways or additional features may be added.

Taken collectively, these three features constitute many different types of process, encompassing evolutionary epistemology [1] to cultural systems [2], neural systems [3, 4], physical systems [5, 6], and informational/cybernetic systems [7, 8]. Many of these universal applications are explicitly selectionist, and do not have uniform fitness criteria. In fact, fitness is assumed in the adaptive mechanism. This provides a very loose analogy to organismal evolution indeed.

Universal computational model shaped by Darwinian processes. COURTESY: Dana Edwards, Universal Darwinism and Cyberspace.

Of these, the application to cybernetic systems is the most general. Taking inspiration from both cybernetics theory and the selectionist aspects of Darwinian models, Universal Selection Theory [7, 8] has four basic claims that can be paraphrased in the following three statements:
1) "operate on blindly-generated variation with selective retention". 
2) "process itself reveals information about the environment". 
3) "processes built atop selection also operate on variation with selective retention".
The key notions are that evolution acts to randomly generate variation, retains only the most fit solutions, then builds upon this in a modular and hierarchical manner. In this way, universal Darwinian processes act to build complexity. As with the initial list of features, the formation and maintenance of populations is an important bootstrapping and feedback mechanism. Populations and heredity underlie all Darwinian processes, even if they are not defined in the same manner as biological populations. Therefore, all applications of Darwinian principles must at least provide an analogue to dynamic populations, even at a superficial level.

There is an additional advantage of using universal Darwinian models: capturing the essence of Darwinian processes in a statistical model. Commonalities between Darwinian processes and Bayesian inference [3, 5] can be proposed as a mechanism for change in models of cosmic evolution. In the Darwinian-Bayesian comparison, heredity and selection are approximated using the relationship between statistical priors and empirical observation. The theoretical and conceptual connections between phylogeny, populations, and Bayesian priors is a post-worthy topic in and of itself.

At this point, we can step out a bit and discuss the origins of universal Darwinian systems. The origin of a Darwinian (or evolutionary) system can take a number of forms [9]. There are two forms of "being from nothingness" in [9] that could be proposed as origin points for Darwinian systems. The first is an origin in the lowest possible energetic (or in our case also fitness) state, and the other is what exists when you remove the governance of natural laws. While the former is easily modeled using variations of the NK model (which can be generalized across different types of systems), the latter is more interesting and is potentially even more universal.

An iconic diagram of Cosmic Evolution. COURTESY: Inflation Theory by Dr. Alan Guth.


An iconic diagram of Biological Evolution. COURTESY: Palaeontological Scientific Trust (PAST).

So did Darwin essentially construct a "theory of everything" over 200 years ago? Did he find "42" in the Galapagos while observing finches and tortoises? There are a number of features from complexity theory that might also fit into the schema of Darwinian models. These include concepts from self-organization not explicitly part of the Darwinian formulation: scaling and complexity, dependence on initial condition, tradeoffs between exploitation and exploration, and  order arising from local interactions in a disordered system. More explicitly, contributions from chaos theory might provide a bridge between nonlinear adaptive mechanisms and natural selection.

The final relationship I would like to touch on here is a comparison between Darwinian processes and Universality in complex systems. The simplest definition of Universality states that the properties of a system are independent of the dynamical details and behavior of the system. Universal properties such as scale-free behavior [10] and conformation to a power law [11] occur in a wide range of systems, from biological to physical and from behavioral to social systems. Much like applications of Universal Darwinism, Universality allows us to observe commonalities among entities as diverse as human cultures, organismal orders/genera, and galaxies/universes. The link to Universality also provides a basis for the abstraction of a system's Darwinian properties. This is the key to developing more representationally-complete computational models.

8-bit Darwin. COURTESY: Diego Sanches.


Darwin viewed his theory development of evolution by natural selection as an exercise in inductive empiricism [12]. Ironically, people are now using his purely observational exercise as inspiration for theoretical mechanisms for systems from the natural world and beyond.


NOTES:
[1] Radnitzky, G.,‎ Bartley, W.W., and Popper, K. (1993). Evolutionary Epistemology, Rationality, and the Sociology of Knowledge. Open Court Publishing, Chicago. AND Dennett, D. (1995). Darwin's Dangerous Idea. Simon and Schuster, New York.

[2] Claidiere, N., Scott-Phillips, T.C., and Sperber, D. (2014). How Darwinian is cultural evolution? Philosophical Transactions of the Royal Society B, 36(9), 20130368.

[3] Friston, K. (2007). Free Energy and the Brain. Synthese, 159, 417-458.

[4] Edelman, G.M. (1987). Neural Darwinism: the theory of neuronal group selection. Oxford University Press, Oxford, UK.

[5] Campbell, J. (2011). Universal Darwinism: the path to knowledge. CreateSpace Independent Publishing.

[6] Smolin, L. (1992). Did the universe evolve? Classical and Quantum Gravity, 9, 173-191.

[7] Campbell, D.T. (1974). Unjustified Variation and Selective Retention in Scientific Discovery. In "Studies in the Philosophy of Biology", F.J. Ayala and T. Dobzhansky eds., pgs. 139-161. Palgrave, London.

[8] Cziko, G.A. (2001). Universal Selection Theory and the complementarity of different types of blind variation and selective retention. In "Selection Theory and Social Construction", C. Hayes and D. Hull eds. Chapter 2. SUNY Press, Albany, NY.

[9] Siegal, E. (2018). The Four Scientific Meanings Of ‘Nothing’. Starts with a Bang! blog, February 7.

[10] Barabási, A-L. (2009). Scale-Free Networks: a decade and beyond. Science, 325, 412-413.

[11] Lorimer, T., Gomez, F., and Stoop, R. (2015). Two universal physical principles shape the power-law statistics of real-world networks. Scientific Reports, 5, 12353.

[12] Ayala, F.J. (2009). Darwin and the Scientific Method. PNAS, 106(1), 10033–10039.

December 1, 2017

Coherence and Relevance in Scientific Communities

          During the past year, Synthetic Daisies featured a series of posts on relevance theory and intellectual coherence within research communities [1]. In this post, I would like to use a set of small datasets to demonstrate how relevance plays a role in shaping scientific practice [2]. We are using a syntactic approach (or word frequency) to infer changes over time in specific scientific fields. 


          This is done using a list of words extracted from titles of accepted papers at the NIPS (Neural Information Processing Systems) conference from various years past. The NIPS conference (annual) represents a set of fields (Neural Modeling, Artificial Intelligence, Machine Learning) that has experienced rapid innovation and vast methodological change over the past 20 years [3]. To get a handle on patterns that represent a more stable field, data from GECCO (Genetic and Evolutionary Computation Conference). While there is plenty of innovation in this area of CS research, the short-term wholesale turnover of methods is much less prominent.

          Our approach involves ranking words used in paper titles in terms of frequency, and then comparing these rankings between different time intervals. Title words are in many ways more precise than keywords in that titles tend to be descriptive of specific methods and approaches. Each list has the top 15 results for each year listed. Changes in rank are represented by lines between their location in each pairwise list, and words that newly appear or disappear from the list project to a black dot underneath the ranked lists. 

          The working hypothesis is that periods of rapid change are characterized by very little carry-over between two neighboring time-points. Basic descriptive terms specific to the field should remain, but all other terms in the earlier list will be replaced a new set of terms. 

NIPS Conference Accepted Papers for 10-year intervals.

          The first graph shows the change in top terms (relevance) across 10-year intervals. As expected for such a fast-moving field, the terms exhibit an almost complete turnover for each interval (4/15 terms are continuous between 1994 and 2007, and 5/15 terms are continuous between 2007 and 2016). The only three terms that are present in both 1994 and 2016 are "learning", "model", and "neural". These are consistent with the basic descriptive terms in our working hypothesis.

NIPS Conference Accepted Papers for 3-year intervals.

          The second graph demonstrates changes in top terms (relevance) between 2010 and 2016, using intervals of three years. As expected, there is more continuity between terms (8/15 terms are continuous between 2010 and 2013, and 11/15 terms are continuous between 2013 and 2016). The 2013-2016 interval is interesting in that two of the terms new to the 2016 list ("optimal" and "gradient") are descriptors of a word that was lost from the 2013 list ("algorithm"). This suggests that there was much coherence in research topics within this interval as compared the 2010-2013 intervals.

GECCO Conference Accepted Papers for 1-year intervals.

          For both one-year intervals, 11/15 terms are preserved from one interval to the next. The terms that exhibit this continuity are consistent with the idea of basic descriptive terms. This might be seen as the signature of stability within communities, as it matches what is observed between 2013 and 2016 for the NIPS data.

          In keeping with the idea of scientific revolutions [4], we might adjust our view of paradigm shifts as revolutions in relevance. This serves as an alternative to the "big person" view of history, where luminaries such as Newton or Einstein singularly make big discoveries that change the course of their field and upend prevailing views. In this case, revolutions occur when communities shift their discourse, sometimes quite rapidly, to new sets of topics. This seems to be the case with various samplings of the NIPS data.

          For papers presented at NIPS and GECCO, what is relevant in a particular year is made salient to the audience of people who attend the conference. Whether or not this results in a closed feedback loop (people perpetually revisiting a focused set of topics) is dependent on other social dynamics.


UPDATE (12/7):
A preprint is now available! Check it out here: How to find a scientific revolution: intellectual field formation and the analysis of terms. Psyarxiv, doi:10.17605/OSF.IO/RHS9G (2017).


NOTES:
[1] For more information, please see the following posts: Excellence vs. Relevance. July 2 AND Breaking Out From the Tyranny of the PPT, April 17 AND Loose Ends Tied, Interdisciplinarity, and Consilience. June 18.

[2] Lenoir, R. (2006). Scientific Habitus: Pierre Bourdieu and the Collective Individual. Theory, Culture, and Society, 23(6), 25-43.

[3] For more about the experience and history of NIPS, please see: Surmenok, P. (2017). NIPS 2016 Reviews. Medium.

[4] Kuhn, T.S. (1962). The Structure of Scientific Revolutions. University of Chicago Press, Chicago, IL.

November 15, 2017

Deep Reading Brings New Things to Life (Science)

Here is an interesting Twitter thread from Jacquelyn Gill on 'deep reading':


The basic idea is that exploring older literature can lead to new insights, which in turn lead to new research directions. The new research of our era tends to focus on the most relevant and cutting-edge literature [1]. This recency bias excludes many similarly relevant articles, including articles that perhaps inspired the more recent citations to begin with [2]. 

I have my own list of deep reads that have influenced some of my research in a similar fashion. These references can be either foundational or so-called "sleeping beauties" [3]. Regardless, I am doing my part to maintain connectivity [4] amongst academic citation networks:


1) Woodger, J.H. The Axiomatic Method in Biology. 1937.

An argument for biological rules, an influence on cladistics (developed in the 1960s), and a natural bridge to geometric approaches to data analysis and modeling. While there is a strong argument to be made against the axiomatic approach [5], this directly inspired much of my thinking in the biological modeling area. 


2) Davis R.L., Weintraub H., and Lassar A.B. Expression of a single transfected cDNA converts fibroblasts to myoblasts. Cell 51, 987–1000. 1987.

This was the first proof-of-concept for direct cellular reprogramming, and predates the late 2000's Nobel-winning work in stem cells by decades. In this case, a single transcription factor (MyoD) was used to convert a cell from one phenotype to another without a strict regard for function. More generally, this paper helped inspired my thinking in the area of cellular reprogramming to go beyond a biological optimization or algorithmic approach [6].


3) Ashby, W.R. Design for a Brain. 1960.

"Design for a Brain" serves as a stand-in for the entirely of Ashby's bibliography, but this is the best example of how Ashby successfully merged explanations of adaptive behavior [7] with systems models (cybernetics). In fact, Ashby originally coined the phrase "Intelligence Augmentation" [8]. I first discovered Ashby's work while working in the area of Augmented Cognition, and has been more generally useful as inspiration for complex systems thinking.



Not so much a couple of sleeping beauty as easy reading technical reference guides for all things complexity theory.


5) Bourdieu, P. Outline of a Theory of Practice. Cambridge University Press. 1977 AND Alexander, C., Ishikawa, S., and Silverstein, M. A Pattern Language: towns, buildings, construction. Oxford
University Press. 1977.

This is a bonus, not because the references are particularly obscure or even from the same academic field, but because they partially influenced my own view of cultural evolution. This is yet another piece of advice to young researchers: take things that appear to be disparate on their surface and incorporate them into your mental model. If nothing else, you will gain valuable skills in intellectual synthesis.

UPDATE (11/17):
Here is another example of old (classic, not outdated) work influencing new scholarship.



NOTES:
[1] Evans, J.A. (2008). Electronic Publication and the Narrowing of Science and Scholarship. Science, 321(5887), 395-399 AND Scheffer, M. (2014). The forgotten half of scientific thinking. PNAS, 111(17), 6119.

[2] related topics discussed on this blog include distributions of citation ages and most-cited papers.

[3] van Raan, A.F.J. (2004). Sleeping Beauties in Science. Scientometrics, 59(3), 467–472.

[4] Editors (2010). On citing well. Nature Chemical Biology, 6, 79.

[5] For the semantic approach (which had been influential to my more recent work), please see: Lloyd, E.A. (1994). The Structure and Confirmation of Evolutionary Theory. Princeton University Press, Princeton, NJ.

[6] Ronquist, S. et.al (2017). Algorithm for cellular reprogramming. PNAS, 114(45), 11832–11837.

[7] Sterling, P. and Eyer, J. (1988). Allostasis: A new paradigm to explain arousal pathology. In "Handbook of life stress, cognition, and health". Fisher, S. and Reason, J.T. eds. Wiley, New York. 

[8] Ashby, W.R. (1956). An Introduction to Cybernetics. Springer, Berlin.

April 17, 2017

Breaking Out From the Tyranny of the PPT

Player 1 vs. Powerpoint (with a screenshot of the game Breakout). The image itself was made in PowerPoint, but I promise this post will not be recursive nonsense.


By now, you have probably chosen a side in the PowerPoint debate: namely, does it enhance or hinder scholarly communication? I will present both sides of this argument, but not argue to moderation. Rather, I will show that PowerPoint is good (or good to get rid of) only if you define your own style of presentation. In either case, you will need to "break out" of the box containing typical advice for creating PowerPoint presentations.


A number of people have argued (both rhetorically and in practice) that PowerPoint represents an enforced tyrrany on presented information. It forces big ideas into small compartments, defined by slide optimization and bullet points. What follows are a few examples of PowerPoint tyranny, or cases in which the default style of organization imposes constraints on communication and the exchange of ideas. 


A few years ago, Franck Frommer wrote a book on how PowerPoint makes us stupid [1]. Frommer's definition of stupid refers to impovrishing our ability to communicated logical flow, contextual detail, and the confusion of opinion and fact. Supprting this position is Peter Norvig's Gettysburg Address analysis, which suggests that the cognitive style of PowerPoint and its visual gimmickry often obscure rather than enhance the logical flow of a larger idea.


Example slide from the Gettysburg Address as a PowerPoint presentation.


Education might also benefit from breaking away from PowerPoint tradition. In fact, there is an argument to be made that the use of PowerPoint in education reduces course content to an overly-simplified, pre-packaged learning experience [2]. Dr. Chris Waters at Michigan State University has moved to eliminate PowerPoint lectures altogether in his undergraduate Microbiology course. He is instead adapting the existing presentations into a series of chalk talks which are more conducing to communicating scientific ideas. 


Perhaps the failures of PowerPoint are not about varied styles of communication across different domains of knowledge (scientific, business, legal), but more about the relevance of ideas and their overall structure. Relevance theory (Dan Sperber and Deidre Wilson) suggests that are biased according to what seems relevant [3]. Some of this is mediated by the cognition of attentional resources, but there is also an underappreciated role of cultural preferences and constraints. In the realm of science communication, the narrowly-defined relevance of typical PowerPoint design practice might encourage some aspects of scientific practice (science as memorization of facts, still images, simple graphs) at the expense of others (experimentation, data exploration, theory-building). 


The tyrrany of representational orthodoxy, PowerPoint style. On the other hand, this is actually pretty good in terms of available clip art. While perfectly suitable for business-oriented communication (e.g. team-building, simple storytelling), this may or may not be suitable for other domains of knowledge.


So how does one break out from the restrictions of PowerPoint? One way forward is shown by the artistic community's use of PowerPoint as an expressive medium. Like the latter-day explosion of animated .gif art on Tumblr [4], artists have been using PowerPoint to create animations and short videos. Interestingly, the limitations of PowerPoint for representing alternate forms of argumentation does not seem to limit artistic innovation [5]. Perhaps this has to do with the use of symbols rather than the ambiguity of linguistic syntax. 

A more argumentative-based way to approach PowerPoint is to adopt the Lessig Method of presentation [6], which presents ideas in only a few words in a large font. One example of this is Larry Lessig's "Free Culture" lecture, which connects a sequence of court cases and landmark ideas in sparse blocks of text. Whether this solves the ambiguity issue is not clear to me, but does provide a way to simplify without losing information.


The last several talks I have given include a final "Thanks for your Attention" Acknowledgements slide which features a graphic that has something to do with attention (visual illusion and/or obscure reference). This is one such example featuring Marshall McLuhan (e.g. breaking the message out of the medium).

UPDATED (4/23): Here is a presentation to the Association of Computational Heresy by Tom Wildenhain on how to construct a Turing Machine with PowerPoint. While it is a lot of fun, it does bring to mind some more creative uses of PowerPoint.


NOTES:
[1] Frommer, F. (2012). How PowerPoint Makes You Stupid: The Faulty Causality, Sloppy Logic, Decontextualized Data, and Seductive Showmanship That Have Taken Over Our Thinking. New Press, New York.

[2] Ralph, P. (2015). Why universities should get rid of PowerPoint and why they won’t. The Conversation, June 23.

[3] Sperber, D. and Wilson, D. (1995). Relevance: Communication and Cognition. Blackwell Publishers, Oxford, UK.

[4] Alicea, B. (2012). Moving the Still, courtesy of the .gifted. Synthetic Daisies blog, October 19.

[5] Greenberg, A. (2010). The Underground Art of PowerPoint. Forbes, May 11. Some examples of PowerPoint art (converted to YouTube videos) include:

a) "Infiltration" by Jeremiah Lee.

b) "Joiners" by blastoons.


[6] Reynolds, G. (2005). The "Lessig Method of Presentation". Presentation Zen blog, October 7.

Printfriendly