logseq/pages/@A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems.md

tags:: #zotero date:: 2017 title:: @A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems item-type:: journalArticle original-title:: A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems language:: en library-catalog:: Zotero links:: Local library, Web library

• Abstract
  • Smart Human-centric Ecosystems (SHEs), such as smart cities, emerge from the interaction among independently-owned systems and humans, who are active components and not mere users of the ecosystems. While smart cities and more generally SHEs are becoming common in our society, their verification remains a critical challenge, as traditional testing methods cannot adequately capture the emergent, adaptive and sometime conflicting behavior arising from human, digital and physical components.

• Attachments

  • PDF {{zotero-imported-file 382QWRQF, "2017 - A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems.pdf"}}

• Notes

  • I'm reviewing a research paper and I took the following notes:

    Annotations

    (18/09/2025, 00:29:35)

    • “interaction among independently-owned systems and humans, who are active components and not mere users of the ecosystems” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “their verification remains a critical challenge, as traditional testing methods cannot adequately capture the emergent, adaptive and sometime conflicting behavior arising from human, digital and physical components.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #a28ae5

    • “Multi-Agent Architectural approach for digital twins of SHEs” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “Multi-Agent Architecture Digital Twin of San Francisco,” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “virtual systems-of-systems” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #2ea8e5

    • “ultra-large-scale systems” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #2ea8e5

    • “continuous evolution, and the contradicting requirements of the systems in the ecosystem” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “autonomy of the systems that dynamically enter and exit the SHE” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “implicit interactions among human and systems that adapt to evolving human behaviors and scenarios that emerge in the cyber-physical environment” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “intrinsic contradictions that can lead to unavoidable SHE failures even when all systems behave according to their specifications” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “defined a new concept of health, that captures the intuitive concept of quality of SHEs in the absence of precise specifications of the SHE as a whole.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “challenge of verifying such ecosystems remains largely underexplored.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #a28ae5

    • “Failures may still occur, not because of faults within any single component, but due to unforeseen interactions among components that respond and adapt to human behavior in unpredictable ways” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #a28ae5

    • “For example, in a smart city, even if traffic lights, ride-sharing platforms, and public transportation systems are individually tested, their combined response to a spontaneous large-scale event (for instance, an unpredictably large flash mob or an extremely urgent stadium evacuation) may produce emergent congestion patterns that no single component anticipates.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #a28ae5

    • “new verification strategies that support continuous observation, behavioral simulation, adaptive analysis, and predictive reasoning. In this context, the Digital Twin (DT) paradigm offers the foundation technology for modeling and reasoning about the state and evolution of human-centric ecosystems, enabling real-time monitoring, exploratory simulation, and predictive diagnostics [27, 42].” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #a28ae5

    • “DTs with centralized architectures badly adapt to SHEs [7, 33]. The definition of a suitable architectural approach of DTs for SHE is still a largely open problem” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 1) #5fb236

    • “Current DTs architectures model humans as static parameters or passive data providers, rather than as autonomous, adaptive and goal-oriented elements within the SHEs, and largely miss the sociotechnical interactions that are fundamental in SHEs” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #a28ae5

    • “state-of-the-art approaches lack the expressiveness needed to model the complexity of SHEs, ultimately limiting their utility for effective monitoring, analysis and testing” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #e56eee

    • “Multi-agent Architectural approach for Digital Twins” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “MAD, a Multi-agent Architectural approach for Digital Twins that addresses the decentralized, dynamic and heterogeneous nature of SHEs.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “To the best of our knowledge, this is the first concrete architectural solution in which agents form the structural foundation of the DT itself.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “Our approach integrates both human and cyber agents, capable of perceiving their physical counterpart, reasoning about their goals, and acting within a context-aware environment.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #ffd400 Ok, not clear yet what's the novelty with respect to autonomous systems and CPS in general.

    • “responsiveness, fidelity, adaptability and robustness of MADSF .” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “decentralized, dynamic, and autonomous nature” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “The Data Exchange, Digital Model, Service, and Data Management composite components comprise the DT, while the Smart Human-centric Ecosystem (SHE composite component in the figure) is the actual ecosystem augmented with the DT.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “SHE Smart Human-Centric Ecosystem The cyber-physical systems, the humans and the environment in which they operate are the main parts of the Smart Humancentric Ecosystem to be digitally twinned. A SHE can be formally defined as: SHE = ⟨C, H, E⟩ (1) where (i) C is the set of Cyber-Physical systems, including digital platforms and sensorized infrastructures (for instance, traffic monitoring systems, transport control units, utility platforms of a smart city), (ii) H is the set of Humans, whose behaviors and decisions influence and are influenced by the SHE (for instance, citizens, taxi drivers, and tourists in a smart city), and (iii) E is the Environment, that is, the infrastructural context comprising physical spaces and networks where digital and human entities interact (for instance, roads, pa” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 2) #5fb236

    • “Belief-Desire-Intention (BDI) paradigm [47], where belief represents the agent’s knowledge or perception of the current world state, desire denotes the goals of the agent, and intention defines the plans and strategies to achieve its goals.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 3) #e56eee

    • “MADSF , Multi-agent Architecture Digital Twin of San Francisco, a prototype implementation of a DT that we develop to validate the responsiveness, fidelity, adaptability, and robustness of MAD,” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 4) #ffd400 This sentence is a bit strange. IN Figure 1 you present an architecture, which is an abstract representation of a system consisting of different components. How can you validate properties that refer to the way the architectures is implemented, deployed, etc.? How can you assess the responsiveness of an architecture? What can you say about the robusteness of fidelity of an architecture? Please, clarify and make this concrete!

    • “since it does not devise any feedback generation toward the physical SHE” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 4) #ffd400 So it means, we are talking about a simplification of Fig 1, because we have monodirectional connections, i.e., from physical to cyber worlds.

    • “Responsiveness” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 6) #ffd400 But this depends on the implemention and not on the architecture per se. Isn't it?

    • “RQ2. Fidelity: Does MAD accurately model the behavior of SHE? Rationale: Accurately reflecting the behavior of the SHE is critical for reliable analysis, detection and prediction. Metrics: We assess MAD fidelity by computing both the accuracy and GEH7 values for vehicular traffic flow, passenger pick-ups and drop-offs of MADSF , and compare them with SUMO baseline. RQ3. Adaptability: Does MAD adapt to the evolving nature of SHE? Rationale: As the SHE continuously evolves, maintaining adaptive alignment is essential to keep the DT effective. Metrics: We evaluate the adaptability of MAD in terms of the impact of a new agent entering MADSF both statically on the structure of the DS and dynamically on the responsiveness and fidelity of the DS. RQ4. Robustness: Does MAD sustain increasing or abnormal workload conditions? Rationale: Given the evolving nature of SHE, MAD should remain stable even during unexpected workload peaks to ensure continuous effectiveness and resilience. Metrics: We evaluate the robustness of MAD by measuring how responsiveness and fidelity degrade under anomalously high workload peaks.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 6) #ffd400 I'm confused. Are we discussing the implementation of the architecture? The research questions are about a concrete implemenation!?!?!

    • “RQ1 Findings: MAD keeps aligned with SHE over time, significantly reducing total execution time compared to real-world constraints. It maintains consistent simulation speed across increasingly long intervals, staying in synchronization with the SHE.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 8) #ffd400 How these findings are related to the architecture shown in Fig 1 and/or to the implementation you have done of it? What are the general aspects that can be applied to other implementations/applications?

    • “RQ2 Findings: MAD accurately replicates the SHE, with over 99% fidelity for traffic flow, passenger pick-ups and drop-offs, and GEH values are consistently under 5.0 threshold.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 8) #ffd400 Again, this depends on the way you have implemented the prototype. The same comment applies also to the other RQ findings.

    • “RQ3 Findings: MAD adapts to the evolutions of the agents in the SHE with minimal impact on fidelity and responsiveness.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 8) #ffd400

    • “RQ4 Findings: MAD demonstrates strong robustness under high workload and disruptive scenarios. Responsiveness of MAD remains consistently below real-time threshold, and fidelity remains high across all conditions.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 9) #ffd400

    • “There is a huge literature on Digital Twins in various domains [35]. Here, we overview the most relevant studies on Digital Twins for SHE and multi-agent approaches for DTs. Digital Twins for SHE Some recent conceptual studies explore the requirements for DTs in complex and evolving socio-technical environments [7, 13, 17, 33]. Michael et al. [33] emphasize the need of the DT to co-evolve with the SHE to be relevant. David et al. [13] propose a taxonomy that identifies some critical capabilities for DT evolution, such as, runtime model reconciliation and system reconfiguration. Bonetti et al. [7] focus on the socio-technical nature of SHEs and advocate for model-driven engineering to better integrate human and technological dimensions. Several studies discuss the benefits of DTs for ecosystems in domain-specific applications: healthcare DTs for predictive diagnostics [14], smart grids DTs for fault detection [39], smart buildings DTs for energy optimization [23], smart cities DTs for urban mobility, transportation management, and planning [46]. The current approaches for DTs propose centralized architectures that miss the distinctive characteristics of SHEs as ecosystems that emerge from the sometimes implicit interactions between humans and independently-owned systems. Wang et al. [44] propose a mobility DT that integrates humans, infrastructure, and vehicles, however they model humans merely as traffic data points. Dembski et al. [16] incorporate citizens feedback into participatory urban planning, however they consider humans as external participants. Xu et al. [49] and Irfan et al. [26] design traffic DTs driven by centralized analytics without modeling human interactions. Biagiola et al. [6] focus on testing autonomous vehicles, and exclude human-system dynamics. Michael et al. [33] explicitly address the co-evolution of human and technological systems, yet their work remains at a conceptual level and falls short of delivering practical engineering solutions. Architectural proposals that claim to support ecosystem-wide DTs [8, 29, 30] focus on isolated or domain-specific subsystems, often under centralized control. As a result, current works on DTs for SHEs fall short of supporting new behaviors, conflicting goals, and continuous co-evolution between humans, cyber-systems and environment. Multi-Agent Approaches for DTs Recent research increasingly studies multi-agent modeling as a promising strategy for addressing the engineering challenges of DTs for SHEs. However, the work presented so far remains narrowly scoped and does not adequately address the architectural concerns of SHEs. Current agent-based DT solutions are typically applied to single-domain and well-structured systems. Pretel et al.’s MAS4DT framework [37] provides a rigorous mapping between DTs properties and multi-agent constructs, but it is designed for centralized cyber-physical systems with uniform stakeholders. Hussein and Challenger’s MADTwin [25] approach synchronizes physical and digital agents within a smart warehouse context. While it confirms the operational feasibility of agent-based DT, it does not support the modeling of diverse agent behaviors. Pretel et al.’s systematic review [36] confirms the limitations of both agent-based systems that act as consumers of DT services and agent-based systems in which agents constitute the structural foundation of the DT. We address the limitations of current approaches by proposing MAD, a multi-agent DT architecture that explicitly models both cyber and human entities as agents. MAD agents perceive, reason, and act according to their beliefs and goals, and operate within a shared digital environment that enables decentralized coordination and supports the co-evolution of autonomous components.” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 10) #ffd400 The novelty of your approach is not clear with respecto to what already existing. Moreover, since you are also talking about autonomous systems, it is important to refer peculiar architectural patterns, like the MAPE-K that are completely nelected in the paper.

    • “We validate MAD with MADSF , a level-2 DT of ride-hailing ecosystems that we instantiate on the city of San Francisco” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 10) #ffd400 When you say "validate" you have actually implemented a DT by following the proposed architecture, and the findings are related to that specific implementations. It is not clear what are the take-away messages or general insights that can be applied to any other potential implementations of the proposed architecture.

    • “We provide a comprehensive usage guide, data and code to run MADSF in our replication package, along with the experiments’ results.11” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 10) #5fb236

    • “Replication package available at https://anonymous.4open.science/r/sfdigitalshadow” (“A Multi-Agent Approach for Engineering Digital Twins of Smart Human-Centric Ecosystems”, 2017, p. 10) #5fb236

    COnsider that those that are tagget with #5fb236 are just highlights, those that are tagged with #e56eee and #a28ae5 are imporant sentences. Please pay attention instead to the notes that are tagged with #ffd400. Those that are tagged with #ff6666 are typos or errors. Could you please draft a review by organizing it as follows:

    SUMMARY: Just a few sentence to summarize the work

    STRENGHTS:

    WEAKNESSES:

    COMMENTS: Organize the notes with respect to the following criteria:

    Novelty

    Rigor

    Relevance (of the contribution)

    Verifiability and Transparency

    Presentation

    And then add a Detailed Comments section to report the notes that contain issues or typos. Can you also formulate three explicit questions by considering the comments above?