Enterprise AI – an Intelligent Data Warehouse/ERP system?
AI enables computers to do some things better than humans especially when it comes to finding insights from large amounts of Unstructured or semi-structured data. Technologies like Machine learning , Natural language processing (NLP) , Speech recognition, and computer vision drive the AI layer. More specifically, AI applies to an algorithm which is learning on its own.
To understand this, we have to ask ourselves: How do we train a Big Data algorithm?
There are two ways:
- Start with the Rules and apply them to Data (Top down) OR
- Start with the data and find the rules from the Data (Bottom up)
The above Rules can be implemented / Executed using Oracle Policy Modeling and Oracle Policy Automation (OPA)
The Top-down approach involved writing enough rules for all possible circumstances. But this approach is obviously limited by the number of rules and by its finite rules base. The Bottom-up approach applies for two cases. Firstly, when rules can be derived from instances of positive and negative examples(SPAM /NO SPAN). This is traditional machine learning when the Algorithm can be trained. But, the more extreme case is : Where there are no examples to train the algorithm.
What do we mean by ‘no examples’?
a) There is no schema
b) Linearity(sequence) and hierarchy is not known
c) The output is not known(non-deterministic)
d) Problem domain is not finite
Hence, this is not an easy problem to solve. However, there is a payoff in the enterprise if AI algorithms can be created to learn and self-train manual, repetitive tasks – especially when the tasks involve both structured and unstructured data.
One simple way is to think of it as an ‘Intelligent Data warehouse’ i.e. an extension to either the Data warehouse or the ERP system
For instance, an organization would transcribe call centre agents’ interactions with customers create a more intelligent workflow, bot etc using Deep learning algorithms.
Enterprise AI layer – What it mean to the Enterprise
So, if we imagine such a conceptual AI layer for the enterprise, what does it mean in terms of new services that can be offered? Here are some examples
Bots : Bots are a great example of the use of AI to automate repetitive tasks like scheduling meetings. Bots are often the starting point of engagement for AI especially in Retail and Financial services
Inferring from textual/voice narrative: Security applications to detect suspicious behaviour, Algorithms that can draw connections between how patients describe their symptoms etc
Detecting patterns from vast amounts of data: Using log files to predict future failures, predicting cyberseurity attacks etc
Creating a knowledge base from large datasets: for example an AI program that can read all of Wikipedia or Github.
Creating content on scale: Using Robots to replace Writers or even to compose Pop songs
Predicting future workflows: Using existing patterns to predict future workflows
Mass personalization: in advertising
Video and image analytics: Collision Avoidance for Drones, Autonomous vehicles, Agricultural Crop Health Analysis etc
These applications provide competitive advantage, Differentiation, Customer loyalty and mass personalization. They have simple business models (such as deployed as premium features /new products /cost reduction )
The Enterprise AI layer and IoT
So, the final question is: What does the Enterprise layer mean for IoT?
IoT has tremendous potential but faces an inherent problem. Currently, IoT is implemented in verticals/ silos and these silos do not talk to each other. To realize the full potential of IoT, an over-arching layer above individual verticals could ‘connect the dots’. Coming from the Telco industry, these ideas are not new i.e. the winners of the mobile/Telco ecosystem were iPhone and Android – which succeeded in doing exactly that.
Firstly, the AI layer could help in deriving actionable insights from billions of data points which come from IoT devices across verticals. This is the obvious benefit as IoT data from various verticals can act as an input to the AI layer. Deep learning algorithms play an important role in IoT analytics because Machine data is sparse and / or has a temporal element to it. Devices may behave differently at different conditions. Hence, capturing all scenarios for data pre-processing/training stage of an algorithm is difficult. Deep learning algorithms can help to mitigate these risks by enabling algorithms to learn on their own. This concept of machines learning on their own can be extended to ‘machines teaching other machines’. This idea is not so far-fetched and is already happening, A Fanuc robot teaches itself to perform a task overnight by observation and through reinforcement learning. Fanuc’s robot uses reinforcement learning to train itself. After eight hours or so it gets to 90 percent accuracy or above, which is almost the same as if an expert were to program it. The process can be accelerated if several robots work in parallel and then share what they have learned. This form of distributed learning is called cloud robotics
We can extend the idea of ‘machines teaching other machines’ more generically within the Enterprise. Any entity in an enterprise can train other ‘peer’ entities in the Enterprise. That could be buildings learning from other buildings – or planes or oil rigs. We see early examples of this approach in Salesforce.com and Einstein. Longer term, Reinforcement learning is the key technology that drives IoT and AI layer for the Enterprise – but initially any technologies that implement self learning algorithms would help for this task
In this brief article, we proposed a logical concept called the AI layer for the Enterprise. We could see such a layer as an extension to the Data Warehouse or the ERP system. This has tangible and practical benefits for the Enterprise with a clear business model. The AI layer could also incorporate the IoT datasets and unite the disparate ecosystem. This will not be easy. But it is worth it because the payoffs for creating such an AI layer around the Enterprise are huge! The Enterprise AI layer theme is a key part of the Data Science for Internet of Things.
Note : this article was reprinted in The OPA Hub Website with the kind permission of the author. You can find him on LinkedIn and the original article can be found here.