Pursuing a decision tree down a rat hole

Fair Isaac’s recent press release touts the “key differentiator” of Blaze Advisor 7.0 as:

the innovative Decision Graph visual metaphor, a decision tree management solution that makes even the most complex rule sets easier to manage and explain

Of course, a decision tree is really more like a root system (i.e., the tree is upside down).  So, what this capability is particularly good for explaining how some pretty structured logic gets wherever it lands up, which FICO touts:

The new capability is especially valuable to businesses that need to be able to explain their decision logic to external auditors and regulators, or to internal parties such as senior management.

Unfortunately, this capability is only good for business logic that has been heavily analyzed and transformed from more natural forms of knowledge that stakeholders and regulators understand or communicate about.

FICO’s suggestion is that after operational guidelines and regulations have been laboriously translated (literally and, hopefully, appropriately) into if-then-else logic (i.e., decision trees) that viewing the path through the “code” will be informative to stakeholders and suitable for regulators.  That seems like quite a stretch given the immediately following sentence, which indicates the complexity of using the metaphor in the first place:

Decision Graph gives business analysts a more intuitive way to view and navigate decision trees, which can reach 10,000 nodes or more.

Lots of people are attracted to such “visual programming” metaphors, but they are extremely limited in their logical expressiveness and, therefore, in their utility.  Still, if you are using induction technology (such as FICO’s)  to produce very large decision trees (independent of governing policies or regulations) such a tool can be useful, if only to understand what the machine “discovered” or to explain “how” it reached a decision, albeit post facto, which may or may not be compliant with governing doctrine.

The press release also talks about using this structure to experiment or optimize certain decisions by simulation, which is good stuff.  FICO has long led in this area, especially in the markets it focuses on (i.e., B2C financial).  This would have been a better central point, imo.

Overall, I agree with the following quote embedded within the release:

“Business rules management provides a shared platform for CIOs and business managers to help their enterprises stay competitive, and making business logic clearer to all parties is an essential part of that collaboration,” said Jim Sinur, a vice president at Gartner Research specializing in business rules management systems. “Better visualization of business logic can provide a huge uplift for companies that are looking for ways to improve business decisions.”

Showing thousands of nodes in a tree or cells in a table does not accomplish the appropriate goal (i.e., effective collaboration) of the first clause, however.  And Jim did not say that decision trees provide effective visualization.

My take: the best approach is to guarantee that the statements of business policy and regulation are unambiguously understood by machine intelligence that automatically translates them into completely reliable systems.

That is, the best visualization for general purposes may be plain English.

Rules vs. applications of knowledge

I was just asked for some background on business rules and the major players, preferably in the form of videos. The request came in by email, so I didn’t have the opportunity to immediately ask “why”.   Below I give some specific and direct responses, but first a few thoughts about clarifying objectives.

I don’t know of any video that is particularly good from an executive overview standpoint concerning “business rules” or even “decision management” let alone “management of active knowledge”.    My recommendation is to clarify the objective before drilling into “business rules”, which is a technical perspective.  What is it that you are trying to accomplish?  Most abstractly, it could be to manage and improve performance of an activity or an organization.  That kind of answer or focus is the right place to start and then work backwards to the technical approach rather than start with an inadequately conceived technical need.  This is one of the major problems with business rules as an independent market or product line.

Learning from Enterprise Decision Management

While at Fair Isaac, James Taylor saw this clearly.  He articulated the enterprise decision management (EDM) and positioned the business rules capability Fair Isaac acquired with Blaze Software in that space.  That is, more as a strategic objective than as a tool or technology.  This is an example of the proper way to think about business rules.

The decision management perspective was also narrowly focused on point decision making (e.g., using rules) but James and others (e.g., John Lucker of Deloitte) have appropriately expanded the strategy of decision management to include analytics, which produce and inform decision making (i.e., business rules), into a continuous process not of point decision making, but more closed-loop, continuous process improvement.  Over recent years, this has evolved into the broader market of performance management, which also includes performance optimization.

The key thing to consider when considering inquiries about “the applications and market for business rules” is the applications of knowledge.  The “knowledge engineering” community is often too focused on the sources of knowledge.  Focusing on sources rather than opportunities and benefits is a big part of why the business rules market has been subsumed into the business process management market, which is small in comparison to the business intelligence market, the fastest growing segment of which is performance management.

Semantic enterprise performance optimization checklist:

Here’s a checklist to consider when framing your considerations of strategies and tactics that might involve business rules technology:

  1. What knowledge (including policies, regulations, objectives, goals) is involved?
  2. What knowledge is superficial (i.e., derived from or approximations of) versus deeper knowledge?
  3. Will you capture the motivation for a decision rather than how that decision is made using rules?
  4. How will the performance  of your decision management or governance system be evaluated?
  5. Is the knowledge involved in evaluating such performance part of the knowledge that you will capture and management?
  6. How does the manner of evaluation relate to goals and objectives and over what time frames?
  7. Is the knowledge about goals and objectives time frames part of the knowledge to be managed?
  8. Are your decisions rigidly governed in every aspect or do you need the business process to include experimentation and optimization?

Most business rules efforts are focused on contexts so narrow that they are reduced to technical buying criteria without much or any consideration of the above.  That is, most business rule efforts do not even cover point 1 above.  Few reach bullet 2 and only strategic thinkers get to the third.

Specific recommendations for the naive question:

So I went off looking for videos…  You can find some on technical matters involving IBM/Ilog but I didn’t find any good videos from IBM at the business strategy level which concerned knowledge-based process/decision management/governance, which surprised.

A video from the vendors of Visual Rules touches on many of the traditional buying points that IT people typically formulate before evaluating vendors (here).

Although it did not respond to the inquiry, I sent along this video of James’ since it touches on so many of the aspects beyond business rules that are increasingly in vogue, even if it does not go far enough towards things like the business motivation model and the market for performance management, imo.

And for a very thorough background in the form of an analyst presentation that is consistent with all of the above, John Rymer of Forrester is most thorough in the two longer presentations that are here and there.

Please send me any other content that you would recommend!

Paul

IBM Ilog JRules for business modeling and rule authoring

If you are considering the use of any of the following business rules management systems (BRMS):

  • IBM Ilog JRules
  • Red Hat JBoss Rules
  • Fair Isaac Blaze Advisor
  • Oracle Policy Automation (i.e., Haley in Siebel, PeopleSoft, etc.)
  • Oracle Business Rules (i.e., a derivative of JESS in Fusion)

you can learn a lot by carefully examining this video on decisions using scoring in Ilog.  (The video is also worth considering with respect to Corticon since it authors and renders conditions, actions, and if-then rules within a table format.)

This article is a detailed walk through that stands completely independently of the video (I recommend skipping the first 50 seconds and watching for 3 minutes or so).  You will find detailed commentary and insights here, sometimes fairly critical but in places complimentary.  JRules is a mature and successful product.  (This is not to say to a CIO that it is an appropriate or low risk alternative, however. I would hold on that assessment pending an understanding of strategy.)

The video starts by creating a decision table using this dialog:

Note that the decision reached by the resulting table is labeled but not defined, nor is the information needed to consult the table specified.  As it turns out, this table will take an action rather than make a decision.  As we will see it will “set the score of result to a number”. As we will also see, it references an application.  Given an application, it follows references to related concepts, such as borrowers (which it errantly considers synonomous with applicants), concerning which it further pursues employment information.

Continue reading “IBM Ilog JRules for business modeling and rule authoring”

What could be more strategic than process or decision management?

The folks from Knowledge Partners have a post that I found thanks to Sandy Kemsley, whose blog often provides good pointers.  This article talks about the decision perspective on business rules.  It makes some good points, on which I would like to elaborate albeit at a more semantic or knowledge-level.

Every language has three kinds of statements: questions, statements, and commands.   There are also some peripheral types, such as exclamations (Yikes!), but in business processes and decisions only declarative and imperative sentences matter.

From a process- or decision-oriented perspective, decisions are always phrased as imperative sentences.  Otherwise, the statements reflected in any business process, whether you are using BPMN or a BRMS, are declarative sentences.

Decisions are imperative sentences because they state an action to be taken.  For example, decline a loan or offer a discount.  It’s really pretty simple.  A decision is an action.  Rules that don’t take actions are statements of truth.  Such declarative statements of truth are perfect for formal logic, logic programming, and semantic technologies.  It’s the action that requires the production rule technology that dominates the market for and applications of rules.

The authors of the aforementioned article use the following diagram to explain the benefits of the decision-oriented approach in simplifying business processes:

The impact of rules on business process complexity

The impact is very simple.  If you eliminate how you reach decisions from the flow that you diagram in BPMN things get simpler.  It’s really as simple as realizing that you have removed all the “if” parts (i.e., the antecedents) of the rule logic from the flow chart.

So who in their right mind would use a business process tool to express any business logic? Continue reading “What could be more strategic than process or decision management?”

Accenture, Public Policy and Governance at Oracle

Some time ago I spoke with public sector leadership at Oracle and Accenture about  applications in Health and Human Services.   Oracle was already my client with what was then Haley Authority (now Oracle Policy Automation) integrated within Siebel CRM.  Lagan was also one of my clients who competed with Oracle and others, such as Curam Software, for public sector case management applications.  It was obvious then that then market-leading approach of Curam Software, which largely relied on IBM Global Services to codify the policies that determine eligibility and levels of benefit for various programs would not be viable for much longer.  Oracle and Lagan were going to change the playing field with a more accessible and knowledge-centric approach based in Haley’s natural language business rules management system. 

There was a current battle going on in one state (Kansas, as I recall) among these three companies which went Oracle’s way thanks to Accenture and support from Haley.  We were also working with them on a larger opportunity in Ontario.  Continue reading “Accenture, Public Policy and Governance at Oracle”

$50/hr for Ilog work?

I can hardly believe posts like this one in Charlotte requiring 6 years or more of IT.   Two weeks ago I talked with a recruiter looking for consulting-to-hire people with significant Ilog experience at under $100 / hr in the DC area.  Is this what happens when you cross the chasm?  I guess it never hurts to ask!

How is a process an event?

Today, I came upon some commentary by a business rule colleague, Carlos Serranos-Morales, of Fair Isaac concerning a presentation I made at the Business Rules Forum.  During the presentation I showed some sentences that are beyond the current state of the art in the business rules industry.  Generally speaking, these were logical statements that did not use the word “if”.  (Note, however, that many of the them could be expressed in SBVR, OMG’s semantics of business vocabulary and rules standard).  Carlos argued that such statements should be more precisely articulated within the specific context of a business process. 

Here is the slide that triggered the controversy:

AI beyond Fair Isaac

Continue reading “How is a process an event?”

Time for the next generation of knowledge automation

In preparing for my workshop at the Business Rules Forum in Las Vegas on November 5th, I have focused on the following needs in reasoning about processes, about events, and about or over time:

  1. Reasoning at a point within a [business] process
  2. Reasoning about events that occur over time.
  3. Reasoning about a [business] process (as in deciding what comes next)
  4. Reasoning about and across different states (as in planning)

Enterprise decision management (EDM) addresses the first.  Complex event processing (CEP) is concerned with the second.  In theory, EDM could address the third but it does not in practice.  This third item includes  the issue of governing and defining workflow or event-driven business processes rather than point decisions within such business processes. 

Business applications of rules have not advanced to include the fourth item.  That is to say, business has yet to significantly leverage reasoning or problem solving techniques that are common in artificial intelligence.  For example, artificially intelligent question and answer systems, which are being developed for  the semantic web,  can do more than retrieve data – they perform inference.  Commercial database and business intelligence queries are typically much less intelligent, which presents a number of opportunities that I don’t want to go into here but would happy to discuss with interested parties.  The point here is that business does not use reasoning much at all, let alone to search across the potential ramifications of alternative decisions or courses of action before making or taking one.  Think of playing chess or a soccer-playing robot planning how to advance the ball on goal.  Why shouldn’t business strategies or tactical business decisions benefit from a little simulated look-ahead along with a lot of inference and evaluation?

Even though I have recently become more interested in the fourth of these areas, I expect the audience at the business rules forum to be most interested in the first two points above.  There will also be some who have enough experience with complex business processes, which are common in larger enterprises.  These folks will be interested in the third item.  Only the most advanced applications, such as in biochemical process planning, will be interested in the fourth.  I don’t expect many of them to attend!

The notion of enterprise decision management (EDM) is focused on point decision making within a business process.  For enterprises that are concerned with governing business processes, a model of the process itself must be available to the business rules that govern its operation.  I’ve written elsewhere about the need for an ontology of events and processes in order to effectively integrate business process management (BPM) with business rules.  Here, and in the workshop, I intend to get a little more specific about the requirements, what is lacking in current standards and offerings, and what we’re trying to do about it. Continue reading “Time for the next generation of knowledge automation”

Ron Ross’ Business Rule Concepts

Ron Ross was kind enough to send me a copy of his recently publishd 3rd edition of his book, Business Rule Concepts.  Ron has been at the forefront of mainstreaming business rule capture for decades.  Personally, I am most fond of his leadership in establishing the Object Management Group’s Semantics of Business Vocabulary and Rules standard (OMG’s SBVR).  This book is an indispensible backgrounder and introduction to the concepts necessary to effectively manage business rules using this standard.

Continue reading “Ron Ross’ Business Rule Concepts”

Adaptive Decision Management

hr-dashboard.jpg

In this article I hope you learn the future of predictive analytics in decision management and how tighter integration between rules and learning are being developed that will  adaptively improve diagnostic capabilities, especially in maximizing profitability and detecting adversarial conduct, such as fraud, money laundering and terrorism.

Business Intelligence

Visualizing business performance is obviously important, but improving business performance is even more important.  A good view of operations, such as this nice dashboard[1], helps management see the forest (and, with good drill-down, some interesting trees). 

With good visualization, management can gain insights into how to improve business processes, but if the view does include a focus on outcomes, improvement in operational decision making will be relatively slow in coming.

Whether or not you use business intelligence software to produce your reports or present dashboards, however, you can improve your operational decision management by applying statistics and other predictive analytic techniques to discover hidden correlations between what you know before a decision and what you learn afterwards to improve your decision making over time.  Continue reading “Adaptive Decision Management”