Defining and Analysing Resource-Aware Process Performance Indicators
Abstract
A key aspect to identify improvement points of the business processes (BP) of an organisation is to conduct performance management, which involves defining appropriate PPIs (Process Performance Indicators). Up to date, existing approaches to define and analyse PPIs usually focus on time and control flow aspects, leaving disregarded the organisational perspective. in this paper we extend PPINOT, a PPI metamodel, to support the definition of resource-aware PPIs in BPs enriched with resource information. Furthermore, leveraging the formal foundation of PPINOT, we introduce automated operations that relate PPIs to the people that may have an influence on them.
Full text
Defining and Analysing Resource-Aware Process Performance Indicators? Adela del–Río–Ortega, Manuel Resinas, Cristina Cabanillas, and Antonio Ruiz–Cortés Universidad de Sevilla, Spain {adeladelrio,resinas,cristinacabanillas,aruiz}@us.es Abstract. A key aspect to identify improvement points of the business processes (BP) of an organisation is to conduct performance management, which involves defining appropriate PPIs (Process Performance Indicators). Up to date, existing approaches to define and analyse PPIs usually focus on time and control flow aspects, leaving disregarded the organisational perspective. In this paper we extend PPINOT, a PPI metamodel, to support the definition of resource-aware PPIs in BPs enriched with resource information. Furthermore, leveraging the formal foundation of PPINOT, we introduce automated operations that relate PPIs to the people that may have an influence on them. Keywords: Performance Management, Key Performance Indicator, Process Performance Indicator, Resource Aware Business Process. 1 Introduction Companies today spend effort, money and time improving and optimising their BPs. Process performance measurement tools and techniques applied to enterprise environments are essential for this continuous improvement. A key part of performance measurement is the definition of PPIs, which are quantifiable metrics that can be measured directly by data generated within the process flow and are aimed at the process controlling and continuous optimisation [1,2]. Existing approaches to manage PPIs tend to focus on control flow or time aspects such as the number of times certain activity is executed, while they stray their attention from the organisational perspective. However, the participation of people in BPs is of utmost importance, both to supervise the execution of automatic activities and to carry out software-aided and/or manual activities. Therefore, their influence in BP performance should be considered by means of resource-aware PPIs. They are PPIs that measure aspects related to the resources1involved in activities of a BP like the time certain resource spends on a given activity or the resources involved in its execution. ?This work has been partially supported by the European Commission (FEDER), Spanish Government under the CICYT projects SETI (TIN2009–07366) and TAPAS (TIN2012-32273); and projects THEOS (TIC–5906) and ISABEL (P07–TIC–2533) funded by the Andalusian local Government. 1From now on, we will use resource to refer to human resources uniquely.
2 Hacienda Process IAAP IAAP Create a resolution proposal draft Si g n , s t o r e and notify resolution Revi ew resolution proposal Analyse reports Internal Reso lu t io n Req uest report to Consultative Boar d Req uest report to Legal Department Ex t e r n al resolution required? Receive external resolution Ex t e r n al Reso lu t io n Data warehouse Tech. LD [Position] Tech. IAAP [Position] Tech. CB [Position] Tech. IAAP [Position] Secr et ar y [Position] Reso lu t io n Pr o p o s al Reso lu t io n Pr o p o s al Reso lu t io n Pr o p o s al Req uest external resolution Secr et ar y [Position] Rep o rt CB Rep o rt LD CONSULTATIVE BOARD LEGAL DEPARTMENT EXT ERN A L CO M M IT T EE No Yes CRISTINA CABANILLAS MACÍAS 1 of 1 01.10.2011 Fig. 1: Excerpt of the process to create and process a resource resolution proposal Unfortunately, to the best of our knowledge, no proposal is able to define them, probably because the organisational perspective in BPs has been much less addressed in literature than others like, for instance, control flow. In this paper, we address this issue as follows. On the one hand, we extend PPINOT, a metamodel to define PPIs described in [3] (cf. Section 3), to allow the definition of resource-aware PPIs (Cf. Section 4) in BPs enriched with resource information modelled with RAL (Resource Assignment Language) [4]. On the other hand, we leverage the formal foundation of both PPINOT and RAL to introduce two automated operations that relate PPIs to the people that may have an influence on them (Cf. Section 5). The final result is a holistic approach that provides insight, not only on the control-flow performance or the resources, but the combinations and interrelations between them. 2 Use Case The process depicted in Figure 1 takes place in the Andalusian Institute of Public Administration (IAAP) and represents the procedure to create and process a resource resolution proposal (RRP) for hiring people. Since we focus on resource-aware PPIs, the BP must also contain information regarding the resource assignments to its activities. Note that assigning several resources to an activity means any of them can execute it, e.g. activity Review resolution proposal can be done by a Technician of the IAAP, a Technician of the Consultative Board or a Technician of the Legal Department. These
3 Hacienda OM IAAP Legal Department Consultative Bo ar d Technician of the IAAP Technician of the Legal Department Technician of the Consultative Board Sec r et ar y Assistant of the Legal Department Assistant of the IAAP Assistant of the Consultative Board Alex Lydia Carol Sam u el Anna DanielChris Diana Lucas David Bu si n ess Manager Mario Dr. CRISTINA CABANILLAS 1 of 1 28.04.2013 ! Position Role Business Manager Accountable Process responsible Technician of the IAAP Technician Analyst Technician of the Legal Department Technician of the Consultative Board ! ! ROLES! Document!Signer!2!Secretary! Technical!assistant!2!Assistants! Document!writer!2!Assistants! Technician!2!Technicians! Analyst!2!Technicians! Accountable!–!Business!Manager! ! Position Position Assistant of the IAAP Technical assistant Document writer Assistant of the Legal Department Assistant of the Consultative Board Secretary Document signer Fig. 2: Excerpt of the organizational model of the IAAP. Orange rectangles are organisational units, yellow rectangles are positions, and dashed-line rectangles are resources positions are defined in the organisational model of the IAAP regarding Administrative Resource Management depicted in Figure 2. To evaluate the performance of this process, the following PPIs can be defined: –PPI1: Average time of report analysis –PPI2: RRPs that required external resolution out of resolved RRPs –PPI3: Number of RRPs under review –PPI4: Number of RRPs created per technician –PPI5: Resources that review an RRP –PPI6: Average lifetime of an RRP Note that PPI4 and PPI5 are resource-aware PPIs since they are related to the resources involved in activities Create a resolution proposal draft and Review resolution proposal, respectively. 3 Background on RAL and PPINOT As detailed in the introduction, the approach we follow to define resource-aware PPIs and to relate PPIs with the people that may have an influence on them are supported by a language to define resource assignments and a PPIs metamodel called RAL and PPINOT, respectively. RAL is an expressive DSL that allows defining the conditions that the members of the organisation must fulfill in order to be assigned to the BP activities [4]. Specifically, RAL expressions use the following concepts: –The organisational model of the company, which in the case of RAL is based on the organisational metamodel described in [5]. This involves selecting people with a certain capability (HAS CAPABILITY Degree); belonging to a given group resource2(HAS POSITION Secretary); having a group resource in common with 2The term group resource refers to concepts that represent group of persons, i.e., positions, roles or organisational units.
4 another person (SHARES SOME ROLE WITH Samuel); or people that report or can delegate work to a given position (REPORTS TO Technician of the IAAP). –The data and resource BP perspectives, e.g. to select the person responsible for another activity (IS RESPONSIBLE FOR ACTIVITY Analyse Reports) or someone specified in a data object (IS PERSON IN DATA FIELD RP.Analyser). Furthermore, RAL is aware of the different duties that may be involved in a single activity. In particular, it considers the five so-called RASCI roles [6], namely: responsible, i.e., the person who performs the work; accountable, i.e., the person who approves the work; support, i.e., the people who may assist in completing the activity; consulted, i.e., the people whose opinion is sought while performing the work; and informed, i.e., the people that are kept up-to-date about the results of the work. RAL expressions can be composed (AND/OR) and negated (NOT). For instance, according to Figure 1, which only represents assignments for task duty responsible, the RAL expression for activity Review resolution proposal is ((HAS POSITION Tech. IAAP) OR (HAS POSITION Tech. CB.)) OR (HAS POSITION Tech. LD). PPINOT is a metamodel that has been created to allow the modelling of PPIs in a way that is unambiguous and complete, understandable by technical and non-technical users, traceable with the BP elements and amenable to automated analysis [3]. Figure 3 depicts an excerpt of PPINOT showing the main elements of a PPI definition and the types of measure that can be used to define a PPI. These types are: Base, Derived and Aggregated. A Base Measure is obtained directly from a single process instance and does not require any other measure to be computed. It can be subdivided into four classes: Time Measure, for the time duration between two time instants; Count Measure, for the number of times something happens; Condition Measure, for the fulfillment of certain condition referred to either a BPElement state (StateConditionMeasure) or a DataObject restriction(DataPropertyConditionMeasure), in both running or finished process instances; and Data Measure for the value of a certain part of a DataObject. A Derived Measure is defined as a mathematical function over one or more measure definitions, that can be single- (DerivedSingleInstanceMeasure) or multi-instance measures (DerivedMultiInstanceMeasure). An Aggregated Measure aggregates one single-instance measure in several process instances using an aggregation function (e.g. sum or average). They can also be grouped by the content of a DataObject. For further detail, we refer the reader to [3]. 4 Definition of Resource-Aware PPIs There are two different types of resource-aware PPIs. Next, we describe how the PPINOT metamodel can be extended to support them (cf. Figure 3). Resource Measure. It measures the resources that perform certain task duty associated to an activity. For instance: PPI5: Resources that review an RRP. This is modelled by means of attribute measuresResource that selects the resource that is performer of a task duty (attribute taskDuty) associated to an activity. As established above, five
5 MeasureDefinition - scale: String - unitOfMeasure: String PPI - identifier: String - name: String - goals: String [0..*] - responsible: HumanResource - accountable: HumanResource - informed: HumanResource [0..*] - comments: String [0..1] BaseMeasure AggregatedMeasure - samplingFrequency: int DerivedMeasure - function: String DerivedSingleInstanceMeasure DerivedMultiInstanceMeasure TimeMeasure CountMeasure ConditionMeasure DataMeasure LinearTimeMeasure CyclicTimeMeasure Condition TimeInstantCondition - changesTostate: RuntimeState ProcessInstanceCondition DataPropertyCondition - restriction: String - statesConsidered: RuntimeState StateCondition - state: RuntimeState BPElement Variable - name: String DataContentSelection «enumeration» AggregationFunction Maximum Minimum Average Sum DataObject ElementToGroup ResourceSelection - TaskDuty: String [0..1] Activity ResourceMeasure RAL_Expression Process ProcessInstanceFilter Target Extension Legend * aplliesTo 1 1..* definition 1 * when 1 * aggregationFunction 1 * aggregationFunction 1 * taskDutyInActivity 1 * activityPrecondition 1 * measuresResource 1 resourcePrecondition * data 1 * from 1 * measuresData 1 * to 1 * precondition 1 1 refersTo 1 * uses1..* * aggregates 1 * meets 1 * isGroupedBy 1 * relatedTo 1 1..* scope 1 1 target 1 Fig. 3: Excerpt of PPINOT Metamodel (extended to take into account human resources)
6 Measure type BP elements involved Time (1) The elements that are executed between the start and the end of the time measure and (2) the elements at the start or at the end if some of the time of their execution is included in the time measure. Count (1) The element that is being counted and (2) the XOR gateways that have taken the execution path to that element. Condition (1) The element used in the condition and (2) if the condition involves a data object, the activities that can write in it. Data (1) The data object whose value is measured and (2) the activities that can modify the data object. Resource The activity referred by the resource selection associated to the measure. Aggregated (1) The elements involved in the measure that it aggregates and (2) if it groups results by some value, the data object that provides it. Derived The elements involved in the measures used by the mathematical function that calculates the value of the measure. Table 1: Elements involved in a PPI as defined in [3] extended with resource measures possible task duties can be assigned: responsible, accountable, supported, consulted and informed. In the case of PPI5, the task duty is responsible since we are considering the person that actually does the review, not those that support her or approve it. Furthermore, attribute activityPrecondition allows one to specify a state condition that the activity must fulfill when the measure is taken (e.g., to be active), while attribute resourcePrecondition allows the specification of further constraints on the resource assignment of that activity (for instance, HAS ROLE Analyst) . In addition, for aggregated measures that aggregate resource measures, the aggregation function countDifferent should be used. It allows us to measure the different persons that performed certain task duty associated to an activity, in several process instances. Group by Resources. The other type of resource-aware PPI is based on grouping aggregated measures by certain resource selection, e.g. PPI4: Number of RRPs created per technician. For doing so attribute isGroupedBy of aggregated measures can be defined by means of a ResourceSelection (the user must ensure that the activity whose task duty is used to group coincides with the activity to which the PPI is applied). 5 Automated Resource-Aware Analysis of PPIs The automated analysis of PPIs is introduced in [3] as a means to investigate properties of PPI specifications and their relationships with other models. In particular, [3] focus on a relationship between PPIs and activities called involved in. An activity is involved in a PPI when it has an influence in the value of the PPI [3]. The automated analysis of this relationship is based on the idea that, although the activities involved in a PPI cannot always be directly inferred without run-time information, it is possible to leverage the definition of the PPI and the control flow of the BP to make a design-time estimation of the BP elements that may have an influence on the PPI (cf. Table 1).
7 In this paper, we build on this idea to define a new relationship called influenced by that relates PPIs and resources. A PPI is potentially3influenced by a person when she is potentially responsible of an activity involved in that PPI, except for PPIs defined on resource measures. In that case, the resources potentially influencing the PPI value are those that perform the specified taskDuty in the activity specified by the measure definition. For instance the resources potentially influencing the average lifetime of an RRP (PPI6) are all the people that may perform duty responsible in the activities whose duration make the average lifetime longer or shorter, i.e. activities Create RRP draft, Request report to CB,Request report to LD,Analyse report,Request external resolution,Review RRP,Sign, store & notify resolution. On the basis of relationship influenced by, two analysis operations can be defined: Resources potentially influencing a set of PPI(s) It takes a set of PPIs and the corresponding resource-aware BP model as input and returns the set of resources potentially influencing those PPIs. PPIs potentially influenced by a set of Resources It takes a set of resources (that can be only one resource), the corresponding reource-aware BP model and the PPIs model defined for that BP as input and returns the set of PPIs that are potentially influenced by those resources. This operation is the opposite of the previous one, The former operation is useful to find out which the resources whose performance have an influence in more PPIs are, or to identify those resources that are not being taken into consideration by the current set of PPIs, i.e. those that are not influencing any PPI. The latter operation can assist during the evolution of BPs. For instance, if part of the organisational model evolves and is modified (e.g., a person is fired), this operation allows one to identify which PPIs could be affected. These two operations can be automated using off-the-shelf DL reasoners by leveraging the formal foundation based on description logics (DL) of both PPINOT and RAL. On the one hand, in [3], the relationship involved in is formalised as a DL role inv in which inv(e, md)means that the BP element eis involved in the measure definition md. On the other hand, in [4], for each activity Aof the BP that has resources assigned, a DL concept AssignmentA is defined. This concept represents the people assigned to Aand is obtained from the RAL expression assigned to it. On the basis of these two elements, a new role inf can be defined for each measure definition md as follows: –If md is a resource measure or aggregates a resource measure, then: ∃inf.{md} ≡ ∃isP otentialResponsible(∃inv.{md})u ∃resourceP recondition−.{md} –Otherwise: ∃inf.{md}≡∃isP otentialResponsible(∃inv.{md}) Where isP otentialResponsible(p, a)means that P erson p can be responsible for Activity a (i.e., ∃isP otentialResponsible.{a} ≡ AssignmentA). 3We perform design-time analysis and before execution the actual activities’ performers are unknown.
8 Given inf, the relationship influenced by can be formalised as definition◦inf−v influencedBy, where definition(p, md)represents the relationship between a PPI p and its measure definition md. Finally, role influencedBy allows expressing the aforementioned analysis operations in terms of the DL reasoning operation individuals(C), which finds all individuals that are instances of concept C. In particular: –Finding the influencing resources of a set of PPIs PPI is the same as solving individuals(∃influencedBy−.P P I) where influencedBy−is the inverse role of influencedBy. –Similarly, the influenced PPIs of a set of persons Pis the same as solving: individuals(∃influencedBy.P ) 6 Conclusions and Future Work This paper presents an approach to support the definition and automated design-time analysis of resource-aware PPIs. Its main benefit is the holistic view that provides to performance evaluation, not only considering the resource-related information, but relating it also to control-flow, time or data information.We build our approach on top of two proposals vastly validated: PPINOT [3] and RAL [8]. As future work, we plan to validate this approach by applying it to real scenarios. Furthermore, the integration of these results into the existing software tools PPINOT and CRISTAL is also part of our future work in this line. References 1. Kronz, A.: Managing of Process Key Performance Indicators as Part of the ARIS Methodology. In: Corporate Performance Management: Aris in Practice. Springer Berlin Heidelberg (2006) 31–44 2. Chase, G., Rosenberg, A., Omar, R., Taylor, J., Rosing, M.: Applying Real-World BPM in an SAP Environment. SAP Press. Galileo Press (2011) 3. del Río-Ortega, A., Resinas, M., Cabanillas, C., Ruiz-Cortés, A.: On the Definition and Design-time Analysis of Process Performance Indicators. Inf. Syst. 38(4) (2013) 470–490 4. Cabanillas, C., Resinas, M., Ruiz-Cortés, A.: Defining and Analysing Resource Assignments in Business Processes with RAL. In: ICSOC. (2011) 477–486 5. Russell, N., van der Aalst, W.M.P., ter Hofstede, A.H.M., Edmond, D.: Workflow resource patterns: Identification, representation and tool support. In: CAiSE. (2005) 216–232 6. Blog: Lean Project Management Tool: RASCI. leanlogisticsblog.leancor.com/ 2013/01/30/lean-project-management-tool-rasci/ (2013) 7. Benavides, D., Segura, S., Ruiz-Cortés, A.: Automated analysis of feature models 20 years later: A literature review. Inf. Syst. 35(6) (2010) 615–636 8. Cabanillas, C., Resinas, M., Cortés, A.R.: RAL: A High-Level User-Oriented Resource Assignment Language for Business Processes. In: BPM Workshops. (2011) 50–61