Orfeon: an AIOps framework for the goal-driven operationalization of distributed analytical pipelines
| dc.contributor.author | Díaz de Arcaya Serrano, Josu | |
| dc.contributor.author | Torre Bastida, Ana Isabel | |
| dc.contributor.author | Miñón Jiménez, Raúl | |
| dc.contributor.author | Almeida, Aitor | |
| dc.date.accessioned | 2024-11-07T10:24:47Z | |
| dc.date.available | 2024-11-07T10:24:47Z | |
| dc.date.issued | 2023-03 | |
| dc.date.updated | 2024-11-07T10:24:47Z | |
| dc.description.abstract | The use of Artificial Intelligence solutions keeps raising in the business domain. However, this adoption has not brought the expected results to companies so far. There are several reasons that make Artificial Intelligence solutions particularly complicated to adopt by businesses, such as the knowledge gap between the data science and operations teams. In this paper, we tackle the operationalization of distributed analytical pipelines in heterogeneous production environments, which span across different computational layers. In particular, we present a system called Orfeon, which can leverage different objectives and yields an optimized deployment for these pipelines. In addition, we offer the mathematical formulation of the problem alongside the objectives in hand (i.e. resilience, performance, and cost). Next, we propose a scenario utilizing cloud and edge infrastructural devices, in which we demonstrate how the system can optimize these objectives, without incurring scalability issues in terms of time nor memory. Finally, we compare the usefulness of Orfeon with a variety of tools in the field of machine learning operationalization and conclude that it is able to outperform these tools under the analyzed criteria, making it an appropriate system for the operationalization of machine learning pipelines. | en |
| dc.description.sponsorship | The work presented in this research was partially supported by the SPRI–Basque Government through their ELKARTEK program (B-Ind5 g, ref.KK-2021/00026). Aitor Almeida's participation was supported by the Spanish Ministry of Science, Innovation and Universities through their “Retos Investigación” program (FuturAALEgo, ref.RTI2018-101045-A-C22) | en |
| dc.identifier.citation | Díaz-de-Arcaya, J., Torre-Bastida, A. I., Miñón, R., & Almeida, A. (2023). Orfeon: An AIOps framework for the goal-driven operationalization of distributed analytical pipelines. Future Generation Computer Systems, 140, 18-35. https://doi.org/10.1016/J.FUTURE.2022.10.008 | |
| dc.identifier.doi | 10.1016/J.FUTURE.2022.10.008 | |
| dc.identifier.issn | 0167-739X | |
| dc.identifier.uri | http://hdl.handle.net/20.500.14454/1686 | |
| dc.language.iso | eng | |
| dc.publisher | Elsevier B.V. | |
| dc.rights | © 2022 Elsevier B.V. | |
| dc.subject.other | AIOps | |
| dc.subject.other | Analytical pipelines | |
| dc.subject.other | Edge computing | |
| dc.subject.other | Machine learning operationalization | |
| dc.subject.other | MLOps | |
| dc.title | Orfeon: an AIOps framework for the goal-driven operationalization of distributed analytical pipelines | en |
| dc.type | journal article | |
| dcterms.accessRights | metadata only access | |
| oaire.citation.endPage | 35 | |
| oaire.citation.startPage | 18 | |
| oaire.citation.title | Future Generation Computer Systems | |
| oaire.citation.volume | 140 |