Designing Data Science - Conversation with Shruti Shetty

I met Shruti Shetty, Art Director at Adrenalin Media at conference in Sydney few months ago. Shruti kindly agreed to answer some of my questions in regards to Design and Data Science. Answers below.

Shruti Shetty - Art Director & Data Science enthusiast

Mauricio: Why your passion for Design and Data Science?

Shruti: Design has gone through quite a silent transformation over the years. The canvas, the technology, the aesthetics have all evolved significantly. Now more so than ever I think, design plays a very central role in tying all these changing features and packaging them for experience. Moving into the new age of the Data Economy, made me look and explore this new and next avenue that will impact design in the coming few years. This lead me to Data Science.

M: Data Science brings insights from analysing data sets. Design can then help present those insights on ways they are easily understood but also engaging and interactive. As a result, those new insights or findings from data sets can highly resonate with audiences...is that correct?

S: That's correct. Traditionally data analysis and handling has taken place in the development or mathematical sense of the world. With the help of design, we translate those complex models, from texts and numbers to patterns, which we can see and understand, and in context to a collateral situation or problem. As said, an image might be as powerful as thousand words.

M : Analysis of data is just one part of a story; in some cases investigative journalism, historical context, current market, political, economic and social dynamics have also a great influence on helping shape data into powerful insights. How do you see the future of Data Science with other disciplines and how Design can play a key role?

S: Patterns are everywhere. They are the very fabric of human behaviour, which has now translated to our online lives. With the power of technology and our need to be switched-on 24/7, we are contributing continuously to this massive data pool. This also means data is being continuously altered and influenced by all and/or more factors, than the ones mentioned above. Hence, before we even begin processing the dataset, we try to understand the circumstances in which the data has been collected. Sometimes this can help fill in the blanks, with the bigger picture. The purpose of data science is to help tell our story, with the events & features of our data. As the scene setting changes so does the climax of the story.
It can be quite hard to identify these influencers in the process of crunching numbers, and this is where visualisation comes into play, within the process itself. Visual tools also help determine the influencing features and charter an appropriate course for the story.We use tools like graphs, charts, plots etc. that display the workings of the data sets in a visual form. As mentioned before, design is a key interpretation of this story into a visual language, which everyone can understand.

M: How important is for Designers (who help Data Scientists) to be involved from the early stages of data analysis? so they can fully understand final insights and create solutions that matches what Data Science want to convey...

S: Designing or visualizing isn't an end mean or a final output stage. Many designers would agree, that design and creation is a journey and a process by itself. Such as data, design goes through it's own transformations, gradually. Hence for a desired optimised solution, collaboration between the two fields, is key. The key is to compliment and co-relate.

M: Is it the role of Designers to just help Data Science better visualise data insights? or the Design role goes far beyond that?... Can Design also help companies better collect data or help companies to find better ways to engage people to contribute to data? or even more, can design engage audiences to analyse data sets?

S: I began the studying data science, my intention was to implement this within our service pool, for our clients. The data we collect can help impact the strategy with which we can constantly improve our products or technology, given the patterns that our users or consumers display. Which in turn, gives them a better experience.

This evolution needs to be refuelled by new and more precise data, which can again be facilitated by design. In short, we use design to translate the given said data, and help grow and alter the data set, to maybe evolve into a new pattern. According to me, this agile approach would best suit this relationship, between data and design.

M: There might be plenty of data visualisation tools these days. What tools have you worked with and found them great to use?

S: Open source softwares such as R Project , and Python, provide a suite of visual tools to crunch and model the data, during the process. The output results can be visualised using a suite of other tools. There are a lot of javascript libraries out there, to help with this. For eg: My team has used, Raphael.js in the past, for a real-time RFID visualisation project. At the same time, there are many other public toolkits to help with this. The one I have found useful is the Tableau toolset.

The Method Case: The project uses digital practices and processes to blur the lines between photography, data visualization, textile design, and computer science.

M: Organisations with no access to Designers or Data Scientists have a big challenge when analysing and presenting insights from data? Any tips for them?

S: Ideally, gathering of that knowledge and datasets would be the first step, moving into this direction. Maintaining records and collecting them in a consistent and efficient manner. I guess with any given field, you need to have access to expertise on that subject matter. If you don't have those skill sets in-house, you would seek those services elsewhere. Traditionally, companies have been gathering the knowledge for the datasets, but haven't been able to implement it's full potential, back into their businesses. For businesses that want to explore this area, there are plenty of options out there. There are independent Data Science organisations who can then collaborate and partner with other agencies, to help make use of their data. But at the same time, companies like ours - Adrenalin Media, are upscaling their skill sets to include this as part of their services, even for Small / Medium sized companies to big scale corporations.

M: Do you favour tools that automate the discoveries of regularities in data? meaning less work for data crunching and possibly just more work for finding compelling ways to present those discovered regularities?

S: I have learnt the hard way, there is no easy formula to help clean up datasets. Again, softwares like R and Python are quite versatile and can handle this process quite well. Personally I like the Google Refine programme, as it has some really nifty features such as a log of all the changes you have made to the dataset, which helps reverse back any mistakes you might have made.

M: As cloud services become more popular and affordable, companies now have the opportunity to collect massive amount of data. However the reality is most of that data gets untapped and/or un-used? Apart from using Data Scientists to help companies find better ways to achieve their key objectives/goals by effective analysis and presentation of Data turned into insights; is there anything else companies should be using their data for?

S: My answer would be similar to the above.

M: There is a lot of talk about how to use big data on organisations and companies but what about individuals, citizens using data for everyday life activities or local community based activities? Any examples or insights on this front?

S: Definitely! Why should all the big companies have all the fun? Sites like vizify.com help visualize your personal data into a cluster of visual graphics, aggregating all your stories online, from LinkedIn, Facebook, Twitter etc. Companies and services alike, have realised the power of visualization and there are a lot of them out there empowering us to take charge of our own data footprints to chart and describe the journey, in a visual form. It also helps keep things fun and interesting for the users.

M: Powerful visualisation of data is key but what about user interaction with data. Any user data driven projects and at what point can interactivity be a nuance for users to fully engage with stories and insights?

S: Interaction is such a powerful engaging tool. Data science wouldn't exist without user interaction. It's the basis of the records that we use. At the same time, the benefits of our insights are then used to display that information for the user to 'interact' with, in terms of engaging with and modifying a visual art piece or using a said service or product. The User interaction is central to the validation of the predictions that we as Data Scientists make. And design can then present this case for the user to accept or reject. In either cases, that would be fed back into the cycle, for the whole process to flow again. It's such a powerful concept, if one thinks about it.

M: What are possibly the top three projects you believe have implemented great design for their data driven projects?

S: Design can be assessed aesthetically or functionally. A good design follows a balance of both. Amazon, Netflix are a few of the companies that continuously update their design based on the data and user patterns that they record. While they aren't aesthetically prominent, they are studied to be one of the most effective use of Information Architectures. Similarly, you see startups such as Triptease, Evr.st etc. who hire data scientists, terming them as 'Growth Hackers' to bust and crunch the numbers and deliver visually stunning outputs for their users. The recurring themes with all these projects is the agile collaborative way that the data and the design teams work together to keep their services and their presence fresh and valuable.

Triptease - For finding lust worthy destinations curated by users 

 About Shruti Shetty ( Twitter - LinkedIn)

Shruti has a design background and been working in the digital space for the past 8 years now.  After graduating from BillyBlue College in Sydney, with a degree in Communication Design, over the years she has specialised in User Experience and Information Architecture. In her current role as Art Director at Adrenalin Media in Sydney, her team produce online solutions, ranging from websites, campaigns to integrating new technologies into their services for eg: RFID.

Infographic explaining Big Data, made by James West and published by New Scientist. It starts with the most fundamental concept which drives big data 3 Vs of Big Data and then moves on to talk about trends, features and challenges of Big Data.

NEXT

• Need Design support for your data sets? Call eDigital on +61481 367 711
• Check Mauricio Escobar Mármol LinkedIn profile.
• Follow us on Facebook, Tumblr, Twitter or Google+

Simplexity

The world as a whole is complex, but it is also a unity. It is “simplex”, founded on simple principles. Poets, painters, scientists and mathematicians are all searching for simplexity in their own way. Aesthetic pleasure is very largely the delight we feel in seeing order, meaning and relationship – the beauty that Coleridge called unity in variety. But it has to be an order unforced, seemingly spontaneous, rather than brutally imposed upon the material. The world as a whole is beautiful in just this sense.

Modern science describes the world as to a large extent “self-organizing”, because sophisticated and unpredictable patterns are now thought to emerge spontaneously from the indefinite repetition of simple algorithms. Furthermore they do so without violating the law of entropy. Evolution is then held to account for the refinement of those patterns through the process of selection. None of this - if true - is incompatible with theism (although it makes Intelligent Design look a bit foolish). The Christian God is the principle of existence itself, the creator without whom there would be nothing either simple or complex to admire. (For the compatibility of theistic faith with an up-to-date cosmology see Stephen Barr’s Modern Physics and Ancient Faith, reviewed here.)  If with complexity emerges unpredictability, this merely highlights the possibility of a higher-level order we call providence, governing coincidence and chance. God is the principle of order, and thus the ever-present source of unity as well as diversity.

If science interests you, take this awesome trip through the known universe. (The image above, by the way, is a fractal from Wikimedia Commons. For more on fractals see this clip on fractals in Africa.)

Regenerate science

Sitting in a meeting recently with a group of people each of whom was staring down into one or other electronic gadget, the following quotation came to mind:

“In our contemporary world it may be said that the more a man becomes dependent on the gadgets whose smooth functioning assures him of a tolerable life at the material level, the more estranged he becomes from an awareness of his inner reality. I should be tempted to say that the centre of gravity of such a man and his balancing point tend to become external to himself: that he projects himself more and more into objects, into the various pieces of apparatus on which he depends for his existence. It would be no exaggeration to say that the more progress ‘humanity’ as an abstraction makes towards the mastery of nature, the more actual individual men tend to become slaves of this very conquest.” – Gabriel Marcel, Men against Humanity (London: Harvill Press, 1952)

Technology is far from neutral, as it is frequently assumed to be in both popular and scholarly writings on this subject. “The medium is the message” (McLuhan), and a technology is not simply a technique that may be employed for good or ill. It bears within itself a value system and a worldview - perhaps even a metaphysics and a theology. Telephone, television and the internet, for example, change our sense of space and time, and have a variety of effects on the relationships within the family and the wider social community. Some of these effects will be humanly beneficial, others less so, but an assessment of the technology is not possible without paying attention to the overall pattern of these effects, and to the purpose or function of the technology in relation to the purpose of human life itself. In what respect is a given tool actually serving the true end of man?

As a matter of fact, I think the portable computers we all use now are a great boon, and I could hardly do without mine. But this does not stop me noticing that this very dependence is a kind of warning sign. We are addicted to technological change in a much more serious way than simply psychologically. This makes “technology assessment” impractical, to say the least. We are running too fast to stop and assess anything – if we are not to stumble over our own feet and be left behind in the race, we have to assume we are running in the right direction.

In his classic work, The Abolition of Man, C.S. Lewis compares the Baconian scientist with Goethe’s Faustus. “For the wise men of old the cardinal problem had been how to conform the soul to reality, and the solution had been knowledge, self-discipline, and virtue. For magic and applied science alike the problem is how to subdue reality to the wishes of men: the solution is a technique; and both, in the practice of this technique, are ready to do things hitherto regarded as disgusting and impious - such as digging up and mutilating the dead.”

But Lewis is no Luddite. He thinks another kind of science and technology is possible. He goes on, “The regenerate science I have in mind would not do even to minerals and vegetables what modern science threatens to do to man himself.” Goethe and the Romantics were on to something. My book is trying to point in that direction, to encourage us to reflect on the elimination of formal and final causes from science, and the disconnectedness of our lives, and to begin to imagine another way of doing business, another way of making scientific progress – a “regenerate” science, perhaps.

Image by Giovanni Sades from FreeDigitalPhotos.net