Ingress: Part Game | Part Reality

Pseudo-Abstract:

A new Google game, Ingress, is discussed along with some of its implications for the narrowing divide between various domains of human experience.

Key Links:

Rachel Metz's post on Ingress.

A recent post by Rachel Metz of MIT Technology Review discusses a fascinating new Google app: Ingress. Ingress puts the player in an epic battle for a newly discovered resource, exotic matter, which is distributed throughout the world. Naturally, the nodes that spill this matter into the world, key tactical positions for either team in the game, are conveniently placed on landmarks and other useful locations. Thus, by playing the game, people flood Google with an endless wealth of location-based information. Genius.

By integrating game and application, Google successfully takes an excellent step into the realm of augmented reality. As I have mentioned previously (1, 2), this domain is ripe for exploration and Ingress is certainly at the forefront of this work.

What is central to this exploration is a fusion in the divide between domains we normally consider separate like game and application. This fusion is possible because the divide, though once very real, is becoming increasingly illusory. The human-machine distinction is becoming all but absurd. 'Real life' is so artificial that most people 'play' themselves while living in fictional realities that they find more meaningful. The result is a convergence of sorts towards something like a singularity: a world in which humanity 'plays' the game of life, the good and the bad, purely for the sake of enjoyment and the base needs of all are met merely as a byproduct of this game.

Pictures courtesy of:

http://www.t3.com/news/google-ingress-app-uses-augmented-reality

http://www.district78.com/tag/game-on/

Softwired: Extending VR to Sensation Post Oculus Rift

Pseudo-Abstract:
I discuss how the new virtual reality headset, Oculus Rift, is indicative of a growing shift away from materiality: the 'real,' 'physical' world we all supposedly know and love (1, 2). By highlighting three other phenomena that are similarly indicative--unboxing, phantom limbs, and lucid dreams--I attempt to forecast a method to extend this visual work in VR into the realm of 'physical' sensation. This new method, however, attempts to push the boundaries of our technological conceptions by abandoning the contemporary bias of physicality. That is, we no longer live in a world where you need wires and cables to be 'plugged in.' This is what it means to be 'Softwired.'

The solution, then, is to harness this state and use it to trick the mind into 'feeling' VR. That is, with the powerful symbolic gratification demonstrated by the unboxing phenomena; the easy plasticity and extension of the mind outside of itself indicated in Ramachandran's work with mirrors and phantom limbs; and, the interface provided through the body's natural associations with dream states and awakening, one gets an interesting 'softwire' implementation. It may be possible to displace one's sense of self onto the virtual representation, and hence trick the mind to feel what the representation is feeling, by imitating the 'waking up' experience upon entering VR. Sensory deprivation tank not included.

Important Links:
Oculus Rift
Ramachandran and phantom limbs
Unboxing

Given that the Oculus Rift is only a few days old, a marvel in itself considering the endorsement it has already received, it is probably strange to be hearing "post" already. However, this is the case. The ever accelerating expansion in tech and VR can only forecast future states, almost by definition. And, immediately after reading about this incredible technology, it was inevitable to start thinking about how one could extend this to physical sensation (i.e., touch). With technology like Microsoft's Kinect 2 and Leap fast approaching, this may be the last piece to a nearly unlimited virtual experience. Yet, the traditional way to work with and think about technology may be the wrong way to approach this problem. By binding theory to physicality, one limits many potential innovative solutions. Unfortunately, this seems to be the 'natural' way of thinking.

When one pictures 'technology,' the inclination is to think of wires or some form of hardware. A Google images search for "technology" corroborates this to a certain degree. Even the dystopian anticipations of 'possible futures' are often trapped in this kind of view, as Neo's awakening out of the Matrix--a giant, material machine--illustrates. But, this vision is no longer indicative of the current or probable future state of affairs. Humanity's predictive capacity in the West is backlogged circa 1950. Hence, it is not surprising that the contemporary technological space has largely passed us by. We are still waiting for the wires. In the mean time, the entire world has been swallowed by a diffuse matrix of invisible information and it is already so pervasive that its identification is extremely difficult. Like a fish in water, humanity breathes technology without even realizing it.

An excellent illustration of this was performed by Timo Arnall, Jorn Knutsen, and Einar Sneve Martinussen in a brilliant art-slash-data-visualization piece entitled Light painting WiFi. The authors basically created an abstract 'measuring stick' for WiFi signal strength and then marched around urban areas with some artistic stuff thrown in (e.g., camera tricks, etc.). What was created as a result is a pseudo-materialization of an "immaterial" as Matt Jones likes to call it. That is, the piece offers a very simple material conceptualization qua visualization of the digital immersion of the Western world. Yet, the fact that this visualization is not an intimate part of the global awareness, hence its relevance at this time, is only a further indicator of the degree of the problem. WiFi is, realistically, a 'low hanging fruit.'  It rides the cusp of our technological immersion: the signals are diffuse and invisible but still very intimately related to hardware. The "filter bubble," in contrast, is much more subtle and far more indirectly related to materiality. The fact that the entire world is currently driven by a stock market, 70% of which is run by machines (1, 2) whose actions are incomprehensible, is of a similar caliber (see Kevin Slavin's Ted talk or my previous post for a more detailed discussion of this topic).

In fact, it is the opposite of Jones' description: immateriality is shaping materiality. The high frequency trading that is running the stock market right now is already terraforming the planet (1, 2, 3). The effort to make this 'immaterial' reality more material a la Jones is outdated. What is needed is an entirely new way of framing humanity's relation to the 'world,' a world that is increasingly incomprehensible in older forms of knowing. Without this, the uncritical assimilation of fascinating tools like the Oculus Rift is likely to cause serious downstream problems. At minimum, the characterization of phenomena like unboxing is very challenging in common frameworks.

Unboxing is a fascinating phenomena where marketing, capitalism, or perhaps Christmas is taken to pornographic proportions. People film themselves opening new, usually technological, items so that others might participate in the pleasure of that first moment. Despite the apparent absurdity of indulging in another individual's new toy, unboxing has gone viral. Youtube, by way of example, has some unboxing videos with over a million hits and there are websites dedicated specifically to the topic. Yet, to frame this assemblage of behaviours as pornography or some form of ritualized, symbolic gratification does not lend itself to an explanation of the phenomena. At best it just describes what is currently happening: a non-material 'thing' invokes a similar response to the thing itself due to some previous association. At worst it misses the point entirely: it requires reference to the previous material relation in order to have any effect or comprehension of the situation; it lacks a direct means of approach. And, let us be honest, pornography, of any kind, does not require an initial experience of the phenomena in question in order to be utilized. Hence, this material dependency is not useful. Instead, what is needed is various methods to approach a variety of experiences directly. Ramachandran's work with mirrors is one such method for this highly 'symbolic' space.

Ramachandran either discovered or popularized the idea of using mirrors to treat the symptoms many people experience after amputation, the phantom limb. In essence, these individuals still feel various sensations, often unpleasant, where their arm, leg, or other body part was once present. Upon exposure to a mirror in such a way that the mind can mistakenly perceive the remaining limb as the one that is missing, and then 'moving' both the phantom and 'real' limb in sync, these symptoms rapidly disappear. That is, the patient stops feeling a pain with no physical basis through a method with no physical basis.

Now, many people will challenge this last claim as untenable given the current evidence. They will make claims for a physical basis in the arm that was amputated, the brain, or the light particles that make up the image. I agree, but that is not the point. The existence of materialism as a tenable philosophical or conceptual position is evidence enough that any set of circumstances can be described materially. Idealism, pragmatism, and any number of other positions might just as well be argued; though, materialism is certainly dominant in Western Science--reification intentional. The question is whether or not any or all of these differentiations are conducive to discovering direct methods that lead to solutions like the mirror for phantom limbs. What I was trying to illustrate, to put into question, was the materiality of the solutions used by Ramachandran. The idea of "opening your missing hand" is very strange if viewed materially and far less direct (e.g., when using the brain). More importantly, the very idea of using a mirror in this fashion seems highly unlikely in many of these contexts. The fact that Ramachandran's culture of origin does not have the same material biases that are prominent in the West cannot be ignored. Thus, I propose we abandon all such limiting factors. In their place, I propose unadulterated, conceptual expansion. The new motto: try everything. By definition, you will only keep the 'things' and follow the paths that work. Success is inevitable until humanity is extinct. Accepting this, even tentatively, it is possible to follow the greater implications of both unboxing and the mirror.

The implication of both of these phenomena is a new characterization of the world. I choose to illustrate this world through the idea of lucid dreaming: the experience of being 'awake' while maintaining the dreaming state. It is not lucid dreaming nor is it just a dream. Lucid dreaming merely characterizes some of the aspects of this new world that are relevant to the current discussion. Specifically, it has a quality of concreteness and experiential validity while simultaneously having an extreme degree of flexibility. Most importantly, it is very close to a simulated world like VR and I can feel in it. Thus, for these reasons it offers an elegant approximation or metaphor whose implications are likely worth exploring. I say "likely" because ultimate success is unknowable and absurd, while local success is guaranteed given that I was motivated enough to put 'pen to paper.'

The implication I want to emphasize is the experience of waking up. When one is lucid dreaming, or dreaming more generally, what will often occur is a "false awakening," where the individual feels as though they have resumed a regular, waking state when they are in fact still dreaming. What is fascinating about this occurrence is that the process of 'waking up' is powerful enough to annihilate the flexibility of a dreaming state and resume a vivid sense of concreteness: the person truly believes they have awoken. Oddly, this is a sort of half-way point between lucid dreaming and dreaming proper. Thus, the implication is as follows. If, by some means, one could emulate this experience--perhaps by actually falling asleep and arising in VR--it may be possible to trick the mind as Ramachandran did and extend one's perception of sensation into the virtual form. In fact, it is possible that, given the circumstances of this shift, the mind might even enhance the virtual image in order to accommodate the increase in concreteness and validity. That is, if I believe its 'real,' it must be more 'real.'

Welcome to the softwire. Please enjoy your stay.

Pictures courtesy of:
http://www.youcanluciddream.com/learn/lucid-dreams
http://boyo1989.blogspot.ca/2009/11/thre-return-to-union.html
http://www.nearfield.org/2011/02/wifi-light-painting
http://www.engadget.com/2008/01/31/macbook-air-gets-the-unboxing-treatment/
http://endthepainproject.org/donations.html
http://gretachristina.typepad.com/.a/6a00d8341bf68b53ef0154323b315e970c-popup
http://www.in5d.com/how-to-have-lucid-dreams.html
http://www.lifeevolver.com/inception-turning-false-awakenings-dreams-dreams-lucid-dreams/

Machinic: An illustration through Bausola's Weavr

Inspired by a podcast of the CBC radio show Spark, especially given my previous post, I have decided to expand the idea of machinic organization as it relates to David Bausola's weavr: a social bot. 

Nora of Spark starts her discussion with the observation that traffic on the internet is shifting from a predominantly user-based environment to one that is dominated by bots and their ilk. That is correct. Humans are no longer central in the framework of the internet. In some sense, we have been replaced by bots and not with a resulting decrease in quality. In fact, given that these bots aid in the creation of networks that support things like Google's search engine, one could argue that things have improved. A great deal of these bots are also maliciously related (e.g., spam bots) so one could argue in the other direction as well. It is a moot point whether this is for better or worse as it is happening regardless. The point is that not only was the persistence and functioning of the internet not tied to any particular individual, but it was not even tied to any particular system--where 'system' is used very abstractly to represent any organized assemblage of parts including humans and bots. Thus, the shift emphasizes or highlights what some have described as a decentration and one in which both humanity and individualism must be replaced by a framework of broader scope. In this ever changing landscape, the weavr comes to the fore.

The weavr is a strange bot that operates in social networks of various kinds. It defaults to having a blog and can be interfaced with Twitter. It dialogues, wanders around with Google maps, and draws associations between its 'interests,' 'emotions,' and various other associations (e.g., its position on Google maps and the position people are posting various materials from). On the broad side, it even dreams.

I simply adore this little creature and Bausola's emphasis on the idea of emergence is certainly invigorating. However, I recently had a shift that changes my relation to this idea as it relates to AI. The shift occurred with a thought that was similar to the following:

If a 'truly' novel intelligence on par with humanity were to be created, what benefit would come to humanity?

The thought stemmed from the work of Mark Bickhard. I briefly commented on a similar element of Bickhard's work in the latter part of this post. Briefly, Bickhard's critique of representation in the Encodingist framework results in the following dilemma: any construction qua representation that I overlay over this hypothetical 'super' AI must necessarily be separate from the functioning of that AI.

It is worth noting that I am neither being a phenomenologist nor an epiphenomenalist when I make the previous claim. It is an entirely different framework. To emphasize this, I will switch my use of the Encodingist 'representation' to the Interactivist 'anticipation' while relying, somewhat, on the common sense view of anticipation to get me through the analogy. The result follows: my anticipations of the AI are separate from the functioning of the AI much like my anticipations of other people are separate from the functioning of other people. The key point here is that my anticipations can be wrong and hence have to be separate. This "have to" is crude, but a more sophisticated discussion is beyond the scope of this post. I urge anyone who is interested to read Bickard's text for a much more detailed and eloquent rendition of the problem, especially Chapter 7, p. 55 and onward.

Given this framework, the 'super' AI, at the moment of its attaining this level of sophistication, becomes inherently 'Other' to me. But, this degree is just the beginning as even other humans can be 'Other.' There is also the difference of species: my framework of anticipations was built in interaction with other humans. And, though my association between the AI and humanity was originally justified in the construction of the 'AI as tool,' the 'AI as self-organizing/maintaining system' is outside of this domain. Thus, it warrants the description as 'truly alien.'


One could argue that we have at least elementary forms of such self-organizing systems and, as such, the transformation would not warrant the degree of 'Otherness' that I am proposing. However, I would argue that this is false. At most we have more sophisticated forms of 'AI as tool' that allow for modest degrees of self-organization in respect to a specific task. Simultaneously, then, I can push the requirements for this purely hypothetical 'super' AI further out by requiring that they posses the ability to be "recursively self-maintaining" a la Bickhard (p. 21).

Regardless, my point is that this transition of the AI from a tool to a functioning entity is not useful. First, the very idea that there could be a transformation is Encodingist: it is the magical transformation that takes a material substrate, 'AI as tool,' into the efficacious realm of a symbol manipulator, 'AI as individual or recursively self-organizing system.' In Interactivism, there is no such transformation. If anything is problematic, in the Interactivist context, it is systems that are more than locally self-organizing, which are more likely to be unwieldy. Thus, and to my second point,  I can only imagine how problematic it would be if I had to convince my calculator  to crunch numbers for me.

To return to the discussion of weavrs but in this new context, we can work towards a better conceptualization that does not have the Encodingist overtones of Bausola's infomorph while maintaining its machinic qualities. Weavrs are a new type of social tool. They emphasize the growing shift on the internet away from users and towards pseudo-autonomous functions by invading into a domain that previously excluded bots by definition: the social sphere. They also give us insight into some elements of how we as humans work, but not by possessing the individualistic properties of humans (e.g., intention). Rather, it is by showing that humans do not have those properties either.

This is the decentration. This is why it is called "machinic" organization. This is also probably why Jon Ronson got so upset about the weavr of the same name: not only does the weavr partially delegitimate the particular individual, it delegitimates all individuals even if just potentially (i.e., even if some future update may take it to this degree entirely but the current one is still too limited). Thus, I believe I can answer both Olivia Solon of Wired's question, "what do you think of weavrs?" and Bausola's question about what weavrs are in a single comment:

Weavrs are simply a tool for social exploration. But, by being such, they anticipate a time when all such exploration is relegated to their ilk. Through this anticipation they mark the end of humanity as organism... as 'system' par excellence and in place they speak of a time when a human-function is no more valuable than an AI-function and no less replaceable. This is of the utmost significance to both the study of AI and humanity as it relates to itself.



Pictures courtesy of:
http://www.goldrootherbs.com/2010/10/11/the-systemic-theory-of-living-systems-and-relevance-to-cam/
http://twitter.com/#!/PixelNinjWeavr
http://www.myjewishlearning.com/blog/rabbis-without-borders/2012/02/14/the-singularity-vs-the-gift-of-death/
http://www.evolo.us/architecture/architecture-designed-to-simulate-self-organizing-biological-systems/
http://www.flickr.com/photos/philterphactory/6829175342/

Augmented reality 2.0

It seems that I was previously mistaken. There are a number of groups that are implementing preliminary hardware and software for mobile and otherwise that is beginning to collapse the divide between our cyber and material worlds.

It's hard to comment on all of this stuff as I am a tad overwhelmed. Nevertheless, here are some preliminary thoughts.

For the games, I would like to see some gaming classics like PacMan get reinterpreted. It would also be nice to see someone explore the current limitations of our hardware so that we have an idea of where the boundary is in this domain. I think the explosion of excitement in this industry, though wonderful, had best be reined in. The domain is potentially infinite, but currently has some solid limitations in our hardware and software design. Rather than see programs and apps that really push the limits, I would like to see some slightly more modest but functional attempts. Take one facet of the infinite potential and develop it until it has some obvious practical usefulness. And, though I love these ideas (1 2), wearing a giant suit or helmet is... not feasible.

In this vein, I think I am following other thinkers. The importance of finding ways in which augmented reality, given its current limitations, can legitimately reinforce or support our current existence in our environments is pertinent. That is, given a camera, gps, a small screen or primitive glasses (1 2), an accelerometer and/or gyroscope, a live feed to the internet and the cloud, audio input/output, and a touch screen, what can be implemented?

The cloud offers the ability to extend our memory capacity if we can find a seamless way to 'recall' the information or begin to implement triggers (e.g., visual, auditory, etc.). If someone could find a way to integrate this with multilingualism (i.e., by having a list of common phrases, etc.), I think traveling would become much simpler.

The accelerometer and gyroscope offer an alternative to touch screens. Just hold your phone and swipe it around like a computer mouse. In fact, I'm surprised I have not seen any software implementing smartphones as UI for standard computers. Though, I have heard of other countries using it for UI more generically. And, actually, the idea of being able to graphically scan anything and have my smartphone find where I can buy it, virtually or otherwise, is certainly worth exploring.

This software has some interesting uses socially. I can see a time when people have clothing that encodes their 'avatar' (i.e., appearance) in cyberspace so that they are seen as such through AR. Subcultures, I'm sure, will be able to integrate this as an interesting form of identification. There are possible consequences here for gangs, etc.  as well as the police. On the extreme end, machines could be seen in a more anthropomorphic frame, which might have interesting repercussions for our relationships with them and we may be able to project our avatars to new places in order to send cues, or even interact with the world. Imagine your phone's 'ring tone' was the person appearing in your peripheral vision and waving at you. Interesting implications for the research I have heard on less invasive forms of human-computer interaction.

Actually, this would be an interesting way to implement some of the ideas I discussed previously. I could have it such that messages or social cues, interests, etc. are encoded right on my person (e.g., approachable, busy, single, etc.). If people start doing this with tattoos, that would certainly be fascinating. And, to forecast a future post, the ability to tag others given a particular network or context would be fascinating, too, especially with ratings.

Images courtesy of:
http://www.guardian.co.uk/technology/2010/mar/21/augmented-reality-iphone-advertising
https://t.co/5jjnouAY
http://strangehorizons.blogspot.ca/2011_06_01_archive.html

Y!kes: Implications for augmented reality

The current take on mobile applications demonstrated through the upcoming software Y!kes is an inspiration for us all. Too long have we lived in Descartes' rendition of cyberspace--a fact that is all the stranger given the ever increasingly pervasive smartphone. How is it that so few people are capitalizing on the capacity for this conveniently sized, networked, computer to augment our day-to-day reality? The answer eludes me. Nevertheless, I think the move Y!kes is taking is a big one, and not just for Hotels.
What Y!kes seeks to do is transform your mobile phone into a networked passport for your evenings away from home. Elevators pick your floor; doors unlock and lock themselves; your bed and breakfast is prepped on arrival at the airport. Surely, this is just the beginning.

I personally see this idea expanding into life in general and, especially, social networking. When you walk into your local store, relevant advertising and specials will pop-up on your phone (e.g., Google, Facebook, Cloudmade). Hotels will start registering you upon entering their establishment. Restaurants will start seating you, give you the menu, and begin ordering your food. Your mobile will create a seamless flow of relation without all the standard wait times and administrative hiccups. And this is just via position. Start scanning audio and this ever expands the framework of anticipation. Add visual scan and augmentation and you are really rolling. Perhaps this may all seem far away, but at the current rate of technological advancement how long, really, is 'far away?'

In the social sphere, I can see networking sites starting to really utilize the presence of the smartphone as Y!kes has. People will be able to scan for live profiles in their immediate vicinity, which will or won't be visible depending on the networks you are associated with. Social interaction will be augmented as individuals will already know each others likes and dislikes, favourite topics of conversation, and more. They will be able to ping one another to invite conversation or be in an 'open' status where meetings are always welcome. They will be notified when friends are close by, assuming they are 'live.' Social reality will be augmented.

So what are you waiting for Developers? Let the technological race begin!