Semester 2 Begins 2018

I’ve visited two papers that I am taking this semester, Studio and Research Practicum.

Let’s start with studio

My final academic work on Conv-O has arrived and now I can commit my full attention to it. The first half of 2018 has been the construction period of Conv-O and it is progressing magically. It is in a stage that it is almost complete and now it is in the stage of working on the logic behind how the entire thing works.

For this semester, I am asking the identity of Conv-O. Why does it need to exist, do a SWOT analysis on it, who is it for and what am I going to learn what is the core or heart of Conv-O? All of the previous questions is something I am in the middle of answering.

I really believe that if I can answer these question Conv-O can really transform and take shape as something I believe in and grow into something magnificent.

Something I would call the edge

Secondly, the Research Practicum is expanding from what I did last semester to something more to do.

The hypothesis is:  “If Neural Network functions more accurately compared to HMM (Hidden Markov Model).

Both uses AI deep learning system but with differences.



Photoshop to 11 Pt. 1

Resurrecting myself from my lack of post, I come with new vigour and new inspiration to blog again and wondering if I remember what I made.


This is my final variation for my Screen. The major note will be is that the title is my placeholder and the background should change either each time the game reaches the main menu (think Overwatch) or just a slideshow (think windows background ).

The highlight of this is my masterful photoshopping skills giving life to the main menu. I like the highlight of the menu turquoise like colour with the orange/gold highlight colour. feel like it works well.


Deaf Sight HUD

This is my first vision for the HUD. The bottom left contains the dpad control scheme, if required. Kept it minimal and didn’t add anything that I deemed not important. No hp, no or map. The two sticks are surrogate arms because I cant model hands if we are going to have hands.

New UI Country A.pngThis is my second version with more changes and with a real screenshot of our game. Moved the objective to the top left for less clutter. Used the 2D Assets as more of the game is developed. The top right is the symbol for the amount of charge the robot has. A lightning bolt is a place is a place to charge, reseources. The box around the target is a pickup symbol.

the text with # are colours so we can ignore them for the purpose of this image.

Message Across

hud-blind (1).gif

NOTE: Due to compression issue, the green text is hard to read. It says signal lost. This occurs during the sense swapping.

This is a gif of the basic transition of sense when losing your vision. The screen gets static followed by the text saying signal lost and the echo-location kicks in that’s why we can see the other player, the grey image that shows.

The changes we made is to not have a static snow on the screen all the time because it creates a nauseating experience and an epileptic nightmare.

It is a basic transition because there is a need to explain whats happening quickly and intuitively.

Now the grey image of the other player allows both players to be aware of each other’s position regardless of what sense they have. Potentially the blind character can only detect the other player when they move because they make noises when it walks.

Overall this is a rough draft of what Xavier and I have been discussing happens during the sense swapping. We also agreed that when people want to swap senses they both have to mutually agree to swap sense instead of “stealing” sense off one another, but this can change depending what the rest of the team says, we think this is just the best way to get around it as it might cause an unfavourable experience for one person.


Seeing and Hearing Clearly 1

One of the main importance of the game we are creating focusses on the sense swapping involving hearing and sight. Below  are the early iteration of the screen the players will see the first being able to hear  but not see well/at all and the second being able to see but not hear well/at all

Hear well but not see well

hud blind
This is the design teams first iteration of no/minimal vision and good hearing. Top left contains the indicator that the other person wants to swap senses, the two sticks indicate the hands, hands,  bottom left is the radar that shows where the ping coming from, the red image is the other person and their location and the screen is covered with a form of static that makes it hard to see.

One concern that was raised is that for a visual effect, that static is good, but if you are playing a game with this filter over a long period of time, this filter can make the game extremely unplayable or nauseating and should be changed to something more simple and less sensory overload experience.

See well but not Hear well

Hud Sight

A lot of the features found above will be here as well with few major changes. Immediately the vission is a lot more clear but there is a mute button on the top right and the minimap is inturn not working and on the top left, there is still the icon for the indication to swap senses.

The reason for the mute noise is to give the player a visual indication of what they are lacking this includes the radar.

Overall these serves as the first few iterations of the HUD.

The missing piece

There has been a rising concern within the group regarding the concept around the game so we decided to write down all that we considered is guaranteed, at least unchanging from our idea.

The mechanic of the game

Sense Swapping – Sight + sound

This is the core mechanic of the game use to explore the balance of power or the change in balance of power

With the focus of team work.

It will by a stylised aesthetic because of constraints.


It will be set up as a multiplayer game as a lan, to split the screen.


Rovers/robot are injured in the beginning. Have to work together or it wont work.

The aliens come into pair that’s why the players have to work together most of the time for it to work.

The explorers are AI that learns Self preservation thats why they swap eyes, hearing modules.

Exploring for future habitation.
Not mars. Planet surface is hot thats why they live underground. Big Eyes if they live underground.

Colour scheme from blue to purple to red

\Thats it so far.



Sight beyond Sight

The design of the sense is something I’m researching as it is one of the more integral parts of the game, how the user feels the surrounding.

taking from current existing projects, the Mars Science Laboratory, more coliqualy called Curiosity Rover, is a recent space project that traveled from Earth to Mars for scientific exploration and analysis. It is designed to be fully automated, (remotely controlled) and a mobile lab to test what is already on Mars.


As long as it isn’t damaged, the power source of the Curiosity rover will run for a long time. It uses a reactor to keep it going which at current estimates and if everything goes according to plan, it will last about 14 years.


It has many instruments to analyse its surrounding.

Mast Camera

It can capture video at a high rate. Is also can produce video stereo multispectral images which allows scientific studies of landscape physiology, rocks and ice. This also allows unprecedented observations of the atmosphere and meteorological events.

Marse hand Lens Imager

Another camera but designed for close up inspections of rocks and minerals and soil

Chemistry & Mineralogy X-Ray Diffraction

It is used to analyse the rocks and crystal with X-Ray energy and detect the way it refracts on the mineral to determine the type and nature of the encounted mineral because elements and mineral refract in specific ways

Chem Cam

Capable of high-resolution images from five to ten times as sharp compared to Mast Camera

Sample Analysis at Mars  Instrument Suite

This is the instrument that looks for the signs of life, looking for compounds of the element carbon including methane which is associated with life and how they were generated and destroyed in the Martian ecosphere. It includes a mass spectrometer, gas chronograph, tunable laser spectrometer. It also looks for light elements such as Hydrogen, Oxygen and Nitrogen, again associated with signs of life.

Radiation Assessment Detector

An instrument specifically to prepare for future human exploration. It detects the surface and its radiation levels, including galactic cosmic rays (which are important because Mars doesn’t have any atmosphere or poles to deflect EMR), solar energetic particles, secondary neutrons and other particles both in the atmosphere and in the soil. Before we go to Mars, we have to know what are the radiations on where we stand

Dynamic Albedo of Neutrons

This provides the first surface means of detecting neutron that escape as cosmic rays from space and hit the surface of Mars. A way of detecting hydrogen and therefore the possible presence of water. Previously, this was only onboard spacecraft flying by Mars and this time it’s on the ground.

Rover Environmental Monitoring Station

This provides the atmospheric weather conditions on Mars, this includes pressure, humidity, UV radiation from the sun, wind speed and direction, ground temperature. All the measurements performed and gathered here is key to finding ideal habitat location near the surface.

Alpha Particle X-Ray Spectrometer

This measures the chemical elements in the rocks and soul. It comes into contact with the samples and blasting them with alpha particles and x_rays. This allows the scientist to determine the rock-forming elements from sodium to heavier elements.

And that is all the sensory capability of Curiosity and no sound detection. Then again the sound is a form of a wave and all these senses just go up and beyond to know what it holds.

It is interesting in what it can do and we can add and remove sense that we think that can drown the player with sensory overload because if it had all these things to experience, it wont be a fun time.


Physical Test 2 Electric boogaloo & Phsical Test 3 return of the Tree

Same two people from the orinal run, see part 1, but the blindness is reversed

This time the voice is moving leading the blind and still communicating using words.


  • as the voice leads the blind, the blind turns in the direction of the voice which make sense because the voice that leads will be in a place that wont have obstacles
  • the misinterpretation of the commands is still present, but to avoid multiple words and actions, drove the blind person over obstacles instead of going around it.

From the test subjects

  • trust is still a big point
  • Is considered fun
  • didnt question the voice/believed it absolute there thought the obstacles were more hazardous than it actually is

From the movement of the voice which allowed the blind to turn to the direction of the speaker

Test 3

Switched one of the players

No voice, the person who can make a sound (talk) can only make pinging noise (think submarine).
There were more obstacles and more chaotic


  • The voice created a system to mean single beep is to follow and two beeps mean there is an obstacle to go over.
  • the voice is struggling to stop or slow the blind from their movements

Stressful both for blind and deaf but everyone had fun.

This can be a real-life version of a point and click game. sounds being the point where to move to. It is hard to move while blind as it is one of the sense we depend very heavily upon, at the very least it doesn’t feel like an equivalent to losing eyesight, but this is my opinion.

But according to the group, it’s harder to choose what sense between eyesight or hearing.


First Day; Final year

Life is fleeting and unexpected. Time moves fast when we have fun and slowly if in misery. And I can say with utter certainty that this one is in the bag.

Wait that isn’t right.

I can say with certainty that the time in COLAB and AUT is one of the best experience of my life. Learning that learning doesn’t stop at the classroom. It is one of the greatest philosophy I have learned here because University doesn’t give you the answer to working, it gives you a foundation and the learning stays with you forever if you don’t want to get run over by the changing technology.

I always try to attend the first day of the first years because it is a form of self-check. It allows me to compare myself with the uncertainty that I felt when I was in my first Year and now and where I am in my relation to my journey as a creative technologist.

All in all, I think it is going according to plan, which can be a bit scary as something bad can happen around the corner. But even still I think I matured enough to handle this problem when it comes my way.


We are almost done.

Extending my knowlege


One of the thing I am doing to better myself is learn more about AI and a great place is in IBM for the Great AI Debate.


Here is the panel. Starting from the left
Igor Portugal
Catalyst IT

David Bloch

Isuru Fernando

Peter Harrison

Priti Ambani
The next billion

Richard Wilde

Sonya Crosby

Stu Christie
Ai Forum

and moderated by Guy Burgess
Clendon Lawyers

Personally, I take a positive outlook when it comes to AI. People who like AI gave positive answers and not apocalyptic improving us and looking at the history through the industrial revolution, the life of horses after the cars came. For horses, it wasn’t good, but England had a 30% of farmlands dedicated to feeding horses and that 30 % was opened up.

Again I am biased to this question but none of the other people convinced me to be afraid. All they were saying is that we should fear the unknown and one person was talking about that we are only a little bit better than the rest of the animal and should fear something better than us. One said that if we created an AI smarter than us then are they smarter than us?

The point is people are looking at the worst of humanity that we cant teach it to be good. Is it inadequacy that makes you look at the flaws of humanity and not the marvel we have created?

We have constructed beast of steel that breaths steam and exhale black fogs that travels much faster than we have ever before.

We have constructed weapons of mass destruction that were truly feared to ignite the atmosphere if it goes off.

At the end the day it is intent. It is so far off from a realised self-aware AI.

Fear of the unknown is something that stagnates us.

people who take risk are the ones who are remembered

the one who challenges


Signing off

Shigenobu Kobayashi’s Colour Theory

As my work is heavily depending on the colour of the particular topic and relating it to emotions, it can be daunting. Especially one of the main focus of many psychologists is to make their environment to be as neutral as possible. Following the advice of my lecturer, I have looked at Shigenobu’s Kobayashi’s Colour theory.

Above is what Kobayashi considered colours that work well and in a particular genre or type. I am trying to achieve to visually convey emotions using shapes and colours and using the colours to convey positive and negative emotions. Do I though?

There are 5 areas that I want to convey are:

  • Cognitive Behaviour
  • Dialectal behaviour
  • Interpersonal
  • Psychodynamic and Psychoanalysis
  • Acceptance and Commitment

with the following meanings:

  • Cognitive behavioral therapy (CBT), which helps you identify unhealthy, negative beliefs and behaviors and replace them with healthy, positive ones
  • Dialectical behavior therapy, a type of CBT that teaches behavioral skills to help you handle stress, manage your emotions and improve your relationships with others
  • Acceptance and commitment therapy, which helps you become aware of and accept your thoughts and feelings and commit to making changes, increasing your ability to cope with and adjust to situations
  • Psychodynamic and psychoanalysis therapies, which focus on increasing your awareness of unconscious thoughts and behaviors, developing new insights into your motivations, and resolving conflicts
  • Interpersonal psychotherapy, which focuses on addressing problems with your current relationships with other people to improve your interpersonal skills — how you relate to others, such as family, friends and colleagues
  • Supportive psychotherapy, which reinforces your ability to cope with stress and difficult situations

In terms of colours, the background should be romantic and sits in dreamy.

The topic names should be divided into two categories,  positive and negative and it shifts between these two types of colour to show the type of emotions.

Clear, neat and clean are good starting points for the positive emotions,

Dandy, dapper and chic, stylish are good for the negative emotions

Staff, M. C. (2016, March). Psychotherapy. Retrieved from