scieee AI-readable full text Open interactive document viewer

Data Integration System (BETA Version)

ORTIZ ARAGON, JAIME; PANIELLO, XAVIER; LARIZGOITIA, IKER; VARVERIS, MARCOS

Abstract

BETA Version of the Data Integration System (DIS) Tool that integrates the different systems developed.

Full text

D1.10. A2C Data Integration System BETA version July 2025 Authors: CETEC, EQUMETRICS, EVRYTHNG, EXUS SOFTWARE Ref. Ares(2025)6287969 - 01/08/2025 Page 2 І33 A2C – Deliverable D1.10v2.0 Technical references Project Acronym Agro2Circular Project Title TERRITORIAL CIRCULAR SYSTEMIC SOLUTION FOR THE UPCYCLING OF wasteS FROM THE AGRIFOOD SECTOR Project Coordinator Fuensanta Monzó CETEC [email protected] Project Duration October 2021 – September 2024 (36 months) Deliverable No. D1.10 Dissemination level* PU Work Package WP1 - A2C Specifications, wastes Management and Data Integration System Task T1.5. - A2C Data Integration System (DIS) Lead beneficiary 1 (CETEC) Contributing beneficiary/ies 34 (EQU), 35 (EXUS), 36 (EVRY) Due date of deliverable 31 May 2023 Actual submission date 30 May 2023 * PU = Public PP = Restricted to other programme participants (including the Commission Services) RE = Restricted to a group specified by the consortium (including the Commission Services) CO = Confidential, only for members of the consortium (including the Commission Services) Document history V Date Comments v0.1 11/05/2023 First draft of document v0.2 29/05/2023 Revised version based on the comments of –Alejandro Viso-CETEC and Jose Cano-GWC v1.0 29/05/2023 First final version, approved by the WP leader and the project coordinator, (will be) submitted to EC. v2.0 01/08/2025 Second final version, approved by the WP leader and the project coordinator, (will be) submitted to EC. Page 3 І33 A2C – Deliverable D1.10v2.0 Document Distribution Log Version Date Distributed to v0.1 11/05/2023 Alejandro Viso-CETEC and Jose Cano-GWC V0.2 29/05/2023 Fuensanta Monzó-Coordinator V 2.0 01/08/2025 WP leader and coordinator Verification and approval Name Date Verification Final Draft by WP leader Jaime Ortiz 01/08/2025 Approval Final Deliverable by coordinator Fuensanta Monzó 01/08/2025 Disclaimer and acknowledgement This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101036838 Disclaimer This document reflects only the views of the author(s) the European Research Executive Agency (REA) is not responsible for any use that may be made of the information it contains. Whilst efforts have been made to ensure the accuracy and completeness of this document, the A2C consortium shall not be liable for any errors or omissions, however caused. Page 4 І33 A2C – Deliverable D1.10v2.0 Table of contents 1. Executive summary 6 2. User guide 7 2.1 Traceability Tool 7 2.1.1 Home page 7 2.1.2 Login 7 2.1.3 Dashboard 8 2.1.4 Operative modules 9 1. Admin 9 2. Plastic waste producer 9 3. Plastic waste manager 11 4. Plastic manufacturer 14 5. Aluminium separation 15 6. Agrifood waste manager 16 7. Biotechnological routes: CetecBio 18 2.2 QR identification App 20 2.2.1 Introduction 20 2.2.2 Basic User’s Guide: 20 2.3 Decision Tool 24 2.3.1 Dashboard Overview 25 3. Future user support and maintenance 28 3.1 Frequently Asked Questions (FAQ) - Annex 28 3.2 Technical support contact point 28 Annex 1 29 FAQ 29 Page 5 І33 A2C – Deliverable D1.10v2.0 List of abbreviations Abbreviation Definition A2C Agro2Circular DIS Data Integration System ICT Information and communication technology FAQ Frequently Asked Questions Page 6 І33 A2C – Deliverable D1.10v2.0 1. Executive summary The following document serves as a user guide for the A2C Data Integration System online platform. This platform is designed to provide end-to-end traceability of materials, from their origin to their final disposal, with the use of different ICTs. The DIS platform integrates several cutting-edge technologies such as cloud technology, Quick Real-QR for identifying the information, Big Data and Artificial Intelligence for data processing and statistics, and Blockchain for data security and immutability. These technologies ensure the highest level of security and reliability for the information processed on the platform. The primary objective of the DIS platform is to facilitate the selection of the best upcycling option for each material from the existing alternatives. The platform provides users with a predictive tool that analyzes the data collected from the traceability process and identifies the most suitable upcycling option based on various criteria, such as environmental impact, cost-effectiveness, and availability. Moreover, the DIS platform enables effective communication among stakeholders involved in the material traceability process. This communication helps to improve the overall sustainability of the supply chain by identifying inefficiencies, improving waste reduction, and optimizing the use of resources. In conclusion, the DIS platform for traceability, prediction, and communication is an essential tool for organizations that seek to improve their sustainability practices. This user guide provides a comprehensive overview of the platform's capabilities, features, and functionalities to help users leverage its full potential. Page 7 І33 A2C – Deliverable D1.10v2.0 2. User guide 2.1 Traceability Tool 2.1.1 Home page The welcome page displays information about the different types of waste being tracked in the system. There are three cards, each representing a different type of waste. The cards display the total amount of waste in kilograms, along with a title and subtitle describing the type of residue being measured. The only functionality found here is the login, which is explained next. 2.1.2 Login 1. Click on the top right corner "Login" button. 2. You will be redirected to the Keycloak login page. 3. Enter your Keycloak username and password and click on the "Sign in" button. 4. Once you have successfully logged in, you will be redirected back to the web application and will be able to access its resources. Page 8 І33 A2C – Deliverable D1.10v2.0 2.1.3 Dashboard The view displays different cards with statistics, such as the last received and delivered quantities, total quantities received and delivered, and weekly received and delivered amounts. The user can see the values displayed in each card, which are fetched from the database. The view also shows a table with the details of the last received entries, such as ID, resource type, and quantity in kilograms. This page is only accessible to users with specific roles, as defined by the conditional statements in the code. By this way, it is confirmed that the user will only see data relative to his organization. The displayed information is shown by the administrator, who has access to all data. Page 9 І33 A2C – Deliverable D1.10v2.0 2.1.4 Operative modules Each operative module is explained related to the user privilege roles in detail as follows: 1. Admin Access to all data of the value chain. Users are technological partners who developed the tool. This can be seen in the dashboard sidebar. The only option which can not be done by any other user is the possibility to sign up new actors in the value chain, as a consortium. If terms are agreed with foreign partners, they will be included and will have access to their module. The rest of the functionalities described below can also be developed by the admin user. 2. Plastic waste producer The plastic waste producer operability is gathered in the “Residue identification” sidebar option. Waste producers can identify their residue expeditions by setting: 1. Moving operator (by NIF or name) 2. Origin of the waste(by CIF + name, address and NIMA) 3. Residue identification: 4. Type of plastic ● LER code Page 16 І33 A2C – Deliverable D1.10v2.0 ● Client ● Type of material. ● Date 6. Agrifood waste manager 1. Classification: Identification of the organic residue taking into account: ● Origin ● Date ● Type of residue (crop) ● Variety ● Campaign ● Weight Page 17 І33 A2C – Deliverable D1.10v2.0 2. Extraction: Form to prepare the extraction. There are 2 types of extractions, selected in the “technology” input. Other options selected here are the solvents used and the weight used from the residue. The system automatically generates an extract id. 3. Waste water delivery: Waste waters from the extraction process are recognized as residues by its content. These are treated on the biotechnological routes, which are explained in the next section. 4. Purification: Sort the obtained phase of the extraction process. Page 18 І33 A2C – Deliverable D1.10v2.0 5. Validation: Identification of the final product with: ● Resultant net weight ● Validation identification ● Date ● Percentage of fibers ● Percentage of polyphenols 6. Delivery: Expedition form with: ● Assigned delivery identification ● Weight of the product delivered ● Client (formulator) ● Date This delivery generates a traceability report with the information of the product and a QR for traceability. 7. Biotechnological routes: CetecBio 1. New ingredient: Possibility to sign up ingredients and raw materials used in the process. The indicated inputs are: ● Date ● Raw material type ● Composition ● Lot identification ● Concentration ● Product reference ● Trading house ● Volume Page 19 І33 A2C – Deliverable D1.10v2.0 2. Acceptance: This operation will be done at the mobile app. On this BETA version, it is under development, but the idea is the same as the manufacturer classification. 3. Classification: Confirm the accepted residue and sort it. 4. Process: Select different attributes related to the chemical properties choosing the ingredients which contribute to generate the product: ● Sources ● Salts ● Inoculums ● Forefathers 5. Storage: The most important term is the type of product generated (carotenoids/PHBV) and its quality. 6. Delivery: Expedition form with: ● Assigned delivery identification ● Volume of the product delivered ● Client ● Date Page 20 І33 A2C – Deliverable D1.10v2.0 2.2 QR identification App 2.2.1 Introduction The App of the A2C waste management project is currently in an active BETA testing situation, with part of the processes accessible and others under development. The A2C app is already available, as BETA, on the Google Play platform for Android for download on mobile devices. Now, its use is restricted, it is only active for users authorized by the WP1 managers of the project. It is being used as a performance testing system with the first processes already activated on the A2C platform. This way, although it is not publicly displayed, users with authorized Gmail accounts can download the latest version. As it is operational with limited access for test operation, it has been tested with the introduction of data in WASTE ACCEPTANCE for an intermediate collection operator. Right now, it allows entering basic data for each batch of waste, as well as the date and signature of the operator involved in the process. Currently the app consists of multiple operational screens, both for anonymous users and registered agents involved in the processing of materials. 2.2.2 Basic User’s Guide: Once the application is downloaded (currently under authorization), the A2C icon will appear for direct access. The app starts with an animation introducing the A2C logo. Anonymous Users (General Public Access): Page 21 І33 A2C – Deliverable D1.10v2.0 Upon completion, a screen is displayed with a graphic button for scanning by anonymous users. Clicking on this button launches the device's camera and detects the presence of QR codes in the focused area. When scanning a QR code, it is checked if it is a web URL, in which case it is launched in the browser of the device. Once the exact format of these codes and their content are defined, a filter can be implemented so that only the results of products involved in the project are launched. Registered Users (A2C Professional Users): In the upper right corner of the screen there is a discreet "Access" button, clicking on it makes the app advance to the login screen for registered users. LOGIN SCREEN: This screen shows the username and password fields, and a button to confirm the credentials entered. Upon confirmation, these credentials are consulted with the A2C server. If they are valid, it advances to the main menu for authorized users. If they are not, an error message is displayed. The credentials are stored for easy access at future times. Also, if you have successfully logged in at least once, the next time the app is launched, it will automatically advance to the login screen, saving operators unnecessary keystrokes. Page 22 І33 A2C – Deliverable D1.10v2.0 OPERATIVE BUTTONS MENU: The menu for authorized users currently consists of multiple buttons in anticipation that, depending on the role of the user who has accessed, some possible actions or others are shown. Currently only the first action: "Aceptación de Residuos” (Acceptance of waste) is available. APP CALLING FOR THE QR SCAN: Clicking on this button launches the camera for QR scanning in a similar way to scanning for anonymous users. However, when scanning a valid QR code, what the app does is check if the code complies with the proper format, in which case it checks the code with the A2C server. If the code has the valid format and the A2C server returns information associated with said code, the app advances to the waste acceptance confirmation form. Otherwise, it displays an error message. LOT DATA SCREEN: In this case, the Waste Reception has been selected, and the lot code has been scanned. The lot data are opened, and it must be confirmed. Page 23 І33 A2C – Deliverable D1.10v2.0 In the waste acceptance confirmation form. Currently, the more than forty data that this action may require are displayed. A confirmation button is displayed at the bottom of the screen. WASTE ACCEPTATION SCREEN: The screen of waste acceptance is opened, and the receiver must decide if he accepts the lot, why and any new data about the lot characteristics. Once the lot has been accepted and all their data introduced, the system accepts the lot as received and all the data transmitted to the database. One message appears on the screen as “Acceptation successfully done” and the user is returned to the main menu. Otherwise, an error message is displayed, allowing you to modify the values and reconfirm the shipment without repeating the process from the beginning. Page 24 І33 A2C – Deliverable D1.10v2.0 2.3 Decision Tool The purpose of the predictive decision aid tool is to collect data and process data derived from industrial activities in the WP3 workflow and provide the following: - Big Data Statistic Indicators which provide associated predictive information useful for improving the process for each company through specific predictive models. - Multi-criteria Decision Aid powered by Fuzzy Logicwhich will analyses and calculates the available alternatives for the valuation of raw materials in the industry and will select the most appropriate options considering social, economic and environmental aspects. An overview of the different components that comprise the Decision Aid Tool are presented below: - Component 1: ETL It is responsible for retrieving GWC raw data from the traceability tool database (using their REST API endpoints) and manipulating them to be consumed by the other components of the predictive decision aid tool. - Component 2: Descriptive Analytics It is responsible for consuming the data from ETL and compute descriptive analytics on those. Specifically, given a time window (weekly and monthly) it computes the moving average and the standard deviation of the: ▪ GWC’s aggregate net weight of raw input material (in KGs); ▪ GWC’s aggregate production (in KGs) - Component 3: Predictions While the previous component gives a quick glance of what is actually happening inside the GWC production chain, this component is responsible to project this view in the near future. Specifically, it predicts for the next weeks (or months) the: ▪ GWC’s aggregate net weight of raw input material (in KGs); Page 25 І33 A2C – Deliverable D1.10v2.0 ▪ GWC’s aggregate production (in KGs) - Component 4: Multi-criteria evaluation of raw materials o It is responsible for evaluating the different type of plastic that GWC consumes and provides the “best one” (the most convenient one) accordingly to different factors, such us: ▪ Economic variables ▪ Environmental variables ▪ Social variables Those factors or indicators and their relation will be provided by a domain expert and the computation will be performed using a Fuzzy evaluation method. - Component 5: Dashboard o It is responsible to visualising all the results from the components 2,3 and 4 in a single intuitive yet technical web-page. 2.3.1 Dashboard Overview The dashboard of the predictive decision aid tool is the interface which users interact with, providing a comprehensive overview of one of the core steps of the plastic waste recycling process, such as the moment when plastic is gathered and transformed into a reusable material by end users, which in this case is GWC and their production chain. Currently, the Dashboard is running off data provided through the ETL component and displaying both Descriptive and Predictive analytics. Overall, the dashboard is a valuable tool for GWC and its stakeholders because it provides a transparent picture of how much plastic is being recycled during the time and in the meantime allows GWC to make data-driven decision to improve their operation. For example, stakeholders can use the dashboard to check the progress towards economical\sustainability goals. This can help to build trust and credibility and slowly position GWC as a leader in the plastic waste recycling industry. Furthermore, it is important to mention that the replication of this approach in other companies similar to GWC will allow Page 32 І33 A2C – Deliverable D1.10v2.0 Q: How does the tool support better decision-making? A: It offers: ● Operational forecasts to optimize planning ● Visual analytics to detect trends and outliers ● Material evaluations to select the most sustainable, compliant, or cost-effective options. Q: How are materials evaluated? A: The tool applies a fuzzy logic system that incorporates multiple criteria such as: economic costs, environmental impacts and regulatory requirements. This enables dynamic, criteriabased recommendations. Q: How often is the data updated? A: The system automatically schedules data checks for new information. When available, new datasets (e.g., updated CSV files) are processed and visualized via the dashboard. Q: Can other companies or industries use this tool? A: Yes. The tool has been designed for scalability and replicability, so it can be adapted by other sectors with similar needs, provided they connect their own data and criteria systems. Q: What if the data seems inaccurate or outdated? A: As the tool evolves, prediction accuracy improves through retraining using real operational data. Users are advised to review early-stage results with caution if synthetic data is involved. Q: How will the tool be maintained after the project ends? A: The tool is deployed on a cloud-based infrastructure and will remain operational as long as the hosting server is maintained. Data processing and visualization modules will continue to run with automatic updates as new data becomes available. Q: How can I get support or contact the DIS team? A: For technical issues, questions or support requests, please contact the DIS support team via the email address provided on the official platform: [email protected] Q: What is a blockchain and how it integrates in DIS? A: Blockchain is a secure, decentralised digital ledger that records transactions in a way that is transparent and tamper-proof. In the context of traceability for DIS, it ensures that every step in a product’s lifecycle—from origin to end-of-life—is recorded and verifiable. This enhances trust, prevents fraud, and supports compliance with sustainability and regulatory standards. Q: How is my data integrated in the blockchain? A: When data is registered by a user in DIS in the form of traceability events, a verifiable hash (not the actual data) is anchored in the blockchain. This process is transparent to the DIS user, but it will be made apparent when scanning the products QR code and the Digital Product Passport is requested, where data is validated. Page 33 І33 A2C – Deliverable D1.10v2.0 Q: What is a Digital Product Passport? A: Digital Product Passport (DPP) is a structured digital record that contains key information about a product’s origin, composition, lifecycle, and sustainability attributes. It enables traceability by allowing stakeholders across the value chain to access verified data about the product, supporting transparency, circularity, and regulatory compliance. DPPs are especially useful in sectors like recycling, textiles, and electronics, where tracking materials and processes is essential for sustainable resource management. Q: How is my data managed in the blockchain? A: Instead of storing full datasets, our solution anchors data by recording a cryptographic hash of the original data. This hash acts as a secure fingerprint, allowing anyone to verify the integrity and authenticity of the data without exposing its contents (critical for sensitive information). Anchoring ensures that the data remains tamper-proof and traceable, while the actual information is stored off-chain in more protected environments. This approach combines the security and transparency of blockchain with the efficiency of traditional data storage, making it ideal for traceability in complex supply chains. Q: How is my data verified in the blockchain? A: To verify the data, the system or any party with granted access recalculates the hash from the current version of the off-chain data and compares it to the hash stored on the blockchain. If the hashes match, the data is authentic and unchanged. This method ensures data integrity and trustwithout storing large datasets directly on the blockchain. Because blockchain is decentralised, no single entity controls the ledger—multiple nodes validate and store the hash, making it tamper-resistant and transparent. Access to the offchain data is managed through secure platforms or APIs (DIS in our case), controlled by the data owner or service provider.