logseq/pages/@LLM-assisted configuration of model-driven business process families.md

tags:: #zotero title:: @LLM-assisted configuration of model-driven business process families item-type:: journalArticle original-title:: LLM-assisted configuration of model-driven business process families language:: en authors:: Daniel Calegari, Andrea Delgado library-catalog:: Zotero links:: Local library, Web library

• Abstract
  • Business processes often include variations driven by specific business requirements, leading to the concept of a business process family. The management of such families can be streamlined using the Model-Driven Engineering (MDE) approach, which involves defining metamodels to express the process family and applying transformations to support the required management activities, such as the configuration process of a specific process variant. The vast range of potential variants within a BPF introduces several challenges, including the need for mechanisms to assist users in configuring specific process variants. In this article, we explore how an MDE-based business process family management approach could be combined with Large Language Models (LLMs) to define questionnaires that support the configuration of process variants. Although the results are promising and in line with previous findings on the use of LLMs for MDE, several aspects must be considered to bring their application to a reliable industrial environment.

• Attachments

  • PDF {{zotero-imported-file 9ZEW774P, "Calegari e Delgado - LLM-assisted configuration of model-driven business process families.pdf"}}

• Notes

  • I'm reviewing a research paper and I took the following notes:

    Annotations

    (30/7/2025, 14:43:25)

    • “model-driven business process families” (Calegari general-and Delgado, p. 1) #5fb236

    • “specific business requirements, leading to the concept of a business process family” (Calegari general-and Delgado, p. 1) #a28ae5

    • “In this article, we explore how an MDE-based business process family management approach could be combined with Large Language Models (LLMs) to define questionnaires that support the configuration of process variants.” (Calegari general-and Delgado, p. 1) #5fb236

    • “This process is configurable, meaning that some elements are variable, and a configuration process must be carried out to derive a process variant.” (Calegari general-and Delgado, p. 1) #5fb236

    • “It requires using techniques such as questionnaires [9] to guide users in developing a configuration, which can then be used to generate the variants automatically.” (Calegari general-and Delgado, p. 1) #5fb236

    • “This article explores the integration of LLMs within an MDE-based proposal for managing BP families.” (Calegari general-and Delgado, p. 1) #e56eee

    • “The LLM would assist in developing questionnaires for end-users based on the information contained in the BP family model.” (Calegari general-and Delgado, p. 1) #e56eee

    • “These questionnaires are connected to the many configuration options of the BP family.” (Calegari general-and Delgado, p. 1) #5fb236

    • “Once a questionnaire is answered, a model transformation utilizes this configuration to generate a specific process instance.” (Calegari general-and Delgado, p. 1) #5fb236

    • “Questionnaires are based on an existing proposal from [9], but have been technologically updated and adapted to the MDE-based approach defined in [3].” (Calegari general-and Delgado, p. 1) #ffd400 It is necessary to expand this statement with more details.

    • “BUSINESS PROCESS FAMILIES MANAGEMENT” (Calegari general-and Delgado, p. 1) #5fb236

    • “a metamodel conceptualizing key elements for BP families” (Calegari general-and Delgado, p. 1) #2ea8e5

    • “a high-level management process supported by the Business Process Family Manager (BPFM) tool” (Calegari general-and Delgado, p. 1) #2ea8e5

    • “Business Process Family Manager (BPFM) tool [12].” (Calegari general-and Delgado, p. 1) #ffd400 The last commit to the tool seems to be done 4 years ago.

    • “A business process family (BPFamily) groups multiple process variants (ProcessVariant) that share a common base process (BaseProcess) while allowing variations (VariationPoint) on activities, routing nodes, or process fragments. These variation points determine where different variants (Variant) can be applied based on the context (Context), which defines context requirements (ContextRequirement) for variant selection. A specific process variant is derived by defining a configuration (Configuration) that satisfies these requirements.” (Calegari general-and Delgado, p. 2) #ffd400 To make the proposal more convincing and less abstract it is important to give earlier in the paper some illustrative examples of variants related to business process families. Can you make some explanatory examples?

    • “Figure 1: BP families metamodel (from [3])” (Calegari general-and Delgado, p. 2) #ffd400 The metamodel come from paper [3], another paper from the authors. It is important to stress the novelties of this paper in comparison with what was presented in [3]

    • “The BPFM tool supports this process by allowing the management of variability approaches that can co-exist within the tool in a homogenized way” (Calegari general-and Delgado, p. 2) #5fb236

    • “Within this approach, BP family languages and configurations must be expressed using metamodels to generate variants using model-to-model transformations, leveraging user-defined configurations.” (Calegari general-and Delgado, p. 2) #5fb236

    • “In [9], the authors propose an approach to capture system variability based on questionnaire models.” (Calegari general-and Delgado, p. 2) #5fb236

    • “The approach depicts variability independently of specific languages through facts representing the space of possible answers to a set of questions.” (Calegari general-and Delgado, p. 2) #5fb236

    • “Questions and facts can be connected through precedence or order dependencies, and facts may have domain” (Calegari general-and Delgado, p. 2) #ffd400 It is important to give some examples of questions to make the presentation concrete and help the reader to grasp the message.

    • “The configuration process is captured through a series of actions.” (Calegari general-and Delgado, p. 2) #5fb236

    • “C-EPC” (Calegari general-and Delgado, p. 2) #ffd400

    • “The tool not only allows the selection of the most pertinent questions based on the current state of the configuration, but also makes use of a logical expression manipulation application to verify in real-time that the answers comply with the domain constraints, avoiding inconsistent or invalid configurations.” (Calegari general-and Delgado, p. 3) #5fb236

    • “Additionally, its automatic variant generation process is tied to a specific language for BP family modeling” (Calegari general-and Delgado, p. 3) #5fb236

    • “QML for questionnaires” (Calegari general-and Delgado, p. 3) #2ea8e5

    • “DCL for specifying configurations.” (Calegari general-and Delgado, p. 3) #ffd400 What are the configurations that are needed? Can you explain what's the usge of the elements given in the DCL metamodel in Fig. 4.b?

    • “LLM-ASSISTED GENERATION OF QUESTIONNAIRES” (Calegari general-and Delgado, p. 3) #5fb236

    • “LLM uses it to derive a questionnaire model that conforms to the QML metamodel depicted in Figure 4a.” (Calegari general-and Delgado, p. 3) #5fb236

    • “The prompt is composed of three parts, as detailed in Table I:” (Calegari general-and Delgado, p. 3) #ffd400 I would include illustrative examples for each of the three parts.

    • “Task Description. A” (Calegari general-and Delgado, p. 3) #2ea8e5

    • “Input Requirements.” (Calegari general-and Delgado, p. 4) #2ea8e5

    • “Output Requirements.” (Calegari general-and Delgado, p. 4) #2ea8e5

    • “(A) to assess the degree to which the LLM could resolve the problem using a zero-shot strategy, without any feedback loop;” (Calegari general-and Delgado, p. 4) #2ea8e5

    • “(B) to compare the results with those of other available LLM solutions and their reasoning capabilities;” (Calegari general-and Delgado, p. 4) #2ea8e5

    • “(C) to determine whether it is possible to improve the results based on a conversational interaction with the LLM, closer to the usual way of working in a real environment with domain experts.” (Calegari general-and Delgado, p. 4) #2ea8e5

    • “A. Zero-shot experiment” (Calegari general-and Delgado, p. 4) #ffd400 This section is verbose and is missing some concrete examples. It's difficult to follow without them.

    • “Metrics are based on a semantic equivalence between questions, facts, and dependencies of the ground-truth model and the derived ones.” (Calegari general-and Delgado, p. 5) #ffd400 How was the semantic equivalence assessed?

    • “It presents a method where LLMs assist in generating useroriented questionnaires that support the configuration of process variants based on a metamodel-driven framework.” (Calegari general-and Delgado, p. 10) #ffd400 How are these configurations "consumed"?

    COnsider that those that are tagget with #5fb236 are just highlights, those that are tagged with #e56eee and #a28ae5 are imporant sentences. Please pay attention instead to the notes that are tagged with #ffd400. Those that are tagged with #ff6666 are typos or errors. Could you please draft a review by organizing it as follows: SUMMARY: Just a few sentence to summarize the work COMMENTS: Organize the notes especially those that contain issues or typos. Please do not make an extrause of bullet points. Make the comments fluent without being too verbose