Guest blog post by Ajit Jaokar
According to Deloitte: by the “end of 2016 more than 80 of the world’s 100 largest enterprise software companies by revenues will have integrated cognitive technologies into their products”. Gartner also predicts that 40 percent of the new investment made by enterprises will be in predictive analytics by 2020. AI is moving fast into the Enterprise and AI developments can create value for the Enterprise. This value can be captured/visualized by considering an ‘Enterprise AI layer’. This AI layer is focussed on solving relatively mundane problems which are domain specific. While this is not as ‘sexy’ as the original vision of AI, it provides tangible benefits to companies.
In this brief article, we proposed a logical concept called the AI layer for the Enterprise. We could see such a layer as an extension to the Data Warehouse or the ERP system. This has tangible and practical benefits for the Enterprise with a clear business model. The AI layer could also incorporate the IoT datasets and unite the disparate ecosystem. The Enterprise AI layer theme is a key part of the Data Science for Internet of Things course. Only a last few places remain for this course!.
Enterprise AI – an Intelligent Data Warehouse/ERP system?
AI enables computers to do some things better than humans especially when it comes to finding insights from large amounts of Unstructured or semi-structured data. Technologies like Machine learning , Natural language processing (NLP) , Speech recognition, and computer vision drive the AI layer. More specifically, AI applies to an algorithm which is learning on its own.
To understand this, we have to ask ourselves: How do we train a Big Data algorithm?
There are two ways:
- Start with the Rules and apply them to Data (Top down) OR
- Start with the data and find the rules from the Data (Bottom up)
The Top-down approach involved writing enough rules for all possible circumstances. But this approach is obviously limited by the number of rules and by its finite rules base. The Bottom-up approach applies for two cases. Firstly, when rules can be derived from instances of positive and negative examples(SPAM /NO SPAN). This is traditional machine learning when the Algorithm can be trained. But, the more extreme case is : Where there are no examples to train the algorithm.
What do we mean by ‘no examples’?
a) There is no schema
b) Linearity(sequence) and hierarchy is not known
c) The output is not known(non-deterministic)
d) Problem domain is not finite
Hence, this is not an easy problem to solve. However, there is a payoff in the enterprise if AI algorithms can be created to learn and self-train manual, repetitive tasks – especially when the tasks involve both structured and unstructured data.
How can we visualize the AI layer?
One simple way is to think of it as an ‘Intelligent Data warehouse’ i.e. an extension to either the Data warehouse or the ERP system
For instance, an organization would transcribe call centre agents’ interactions with customers create a more intelligent workflow, bot etc using Deep learning algorithms.
Enterprise AI layer – What it mean to the Enterprise
So, if we imagine such a conceptual AI layer for the enterprise, what does it mean in terms of new services that can be offered? Here are some examples
- Bots : Bots are a great example of the use of AI to automate repetitive tasks like scheduling meetings. Bots are often the starting point of engagement for AI especially in Retail and Financial services
- Inferring from textual/voice narrative: Security applications to detect suspicious behaviour, Algorithms that can draw connections between how patients describe their symptoms etc
- Detecting patterns from vast amounts of data: Using log files to predict future failures, predicting cyberseurity attacks etc
- Creating a knowledge base from large datasets: for example an AI program that can read all of Wikipedia or Github.
- Creating content on scale: Using Robots to replace Writers or even to compose Pop songs
- Predicting future workflows: Using existing patterns to predict future workflows
- Mass personalization: in advertising
- Video and image analytics: Collision Avoidance for Drones, Autonomous vehicles, Agricultural Crop Health Analysis etc
These applications provide competitive advantage, Differentiation, Customer loyalty and mass personalization. They have simple business models (such as deployed as premium features /new products /cost reduction )
The Enterprise AI layer and IoT
So, the final question is: What does the Enterprise layer mean for IoT?
IoT has tremendous potential but faces an inherent problem. Currently, IoT is implemented in verticals/ silos and these silos do not talk to each other. To realize the full potential of IoT, an over-arching layer above individual verticals could ‘connect the dots’. Coming from the Telco industry, these ideas are not new i.e. the winners of the mobile/Telco ecosystem were iPhone and Android – which succeeded in doing exactly that.
Firstly, the AI layer could help in deriving actionable insights from billions of data points which come from IoT devices across verticals. This is the obvious benefit as IoT data from various verticals can act as an input to the AI layer. Deep learning algorithms play an important role in IoT analytics because Machine data is sparse and / or has a temporal element to it. Devices may behave differently at different conditions. Hence, capturing all scenarios for data pre-processing/training stage of an algorithm is difficult. Deep learning algorithms can help to mitigate these risks by enabling algorithms to learn on their own. This concept of machines learning on their own can be extended to ‘machines teaching other machines’. This idea is not so far-fetched and is already happening, A Fanuc robot teaches itself to perform a task overnight by observation and through reinforcement learning. Fanuc’s robot uses reinforcement learning to train itself. After eight hours or so it gets to 90 percent accuracy or above, which is almost the same as if an expert were to program it. The process can be accelerated if several robots work in parallel and then share what they have learned. This form of distributed learning is called cloud robotics
We can extend the idea of ‘machines teaching other machines’ more generically within the Enterprise. Any entity in an enterprise can train other ‘peer’ entities in the Enterprise. That could be buildings learning from other buildings – or planes or oil rigs. We see early examples of this approach in Salesforce.com and Einstein. Longer term, Reinforcement learning is the key technology that drives IoT and AI layer for the Enterprise – but initially any technologies that implement self learning algorithms would help for this task
In this brief article, we proposed a logical concept called the AI layer for the Enterprise. We could see such a layer as an extension to the Data Warehouse or the ERP system. This has tangible and practical benefits for the Enterprise with a clear business model. The AI layer could also incorporate the IoT datasets and unite the disparate ecosystem. This will not be easy. But it is worth it because the payoffs for creating such an AI layer around the Enterprise are huge! The Enterprise AI layer theme is a key part of the Data Science for Internet of Things course. Only a last few places remain for this course!.