prikaz prve stranice dokumenta Scalable data processing model of the ALICE experiment in the cloud
  Download
PDF 5.72 MB
doctoral thesis
Scalable data processing model of the ALICE experiment in the cloud
2023. urn:nbn:hr:179:516445
Lončar, Petra
University of Split
Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture
Department of Electronics and Computing

Cite this document

Lončar, P. (2023). Scalable data processing model of the ALICE experiment in the cloud (Doctoral thesis). Split: University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture. Retrieved from https://urn.nsk.hr/urn:nbn:hr:179:516445

Lončar, Petra. "Scalable data processing model of the ALICE experiment in the cloud." Doctoral thesis, University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, 2023. https://urn.nsk.hr/urn:nbn:hr:179:516445

Lončar, Petra. "Scalable data processing model of the ALICE experiment in the cloud." Doctoral thesis, University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, 2023. https://urn.nsk.hr/urn:nbn:hr:179:516445

Lončar, P. (2023). 'Scalable data processing model of the ALICE experiment in the cloud', Doctoral thesis, University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, accessed 03 May 2024, https://urn.nsk.hr/urn:nbn:hr:179:516445

Lončar P. Scalable data processing model of the ALICE experiment in the cloud [Doctoral thesis]. Split: University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture; 2023 [cited 2024 May 03] Available at: https://urn.nsk.hr/urn:nbn:hr:179:516445

P. Lončar, "Scalable data processing model of the ALICE experiment in the cloud", Doctoral thesis, University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, Split, 2023. Available at: https://urn.nsk.hr/urn:nbn:hr:179:516445

Please login to the repository to save this object to your list.
Metadata
TitleScalable data processing model of the ALICE experiment in the cloud
Title (croatian)Model skalabilne obrade podataka ALICE eksperimenta u oblaku
AuthorPetra Lončar https://orcid.org/0000-0001-6486-2230
MentorSven Gotovac (mentor)
Committee memberEugen Mudnić (predsjednik povjerenstva)
Committee memberJosip Knezović (član povjerenstva)
Committee memberGoran Martinović https://orcid.org/0000-0002-7469-6018 (član povjerenstva)
Committee memberLinda Vicković (član povjerenstva)
Committee memberDunja Božić-Štulić (član povjerenstva)
GranterUniversity of Split
Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture
(Department of Electronics and Computing)
Split
Defense date and country2023-06-09, Croatia
Scientific / art field,
discipline and subdiscipline		TECHNICAL SCIENCES
Computing
Information Systems
Universal decimal classification
(UDC)		621.3 - Electrical engineering
Abstract
This thesis proposes an optimisation strategy for scalable Big Data processing in a heterogeneous Cloud. The resource needs of A Large Ion Collider Experiment (ALICE) at the European Organization for Nuclear Research (CERN) are reviewed as a motivating example. The thesis examines how to efficiently process and optimise the processing of resourceintensive tasks on a heterogeneous Cloud infrastructure distributed in five data centres to meet the needs of the ALICE experiment at the Tier 2 level. The objective was to perform research on a much larger number of tasks and resources of a significantly larger capacity than prior studies, which focused on a smaller number of tasks and resources with a lower capacity. The proposed and developed processing model for ALICE Monte Carlo production is based on a centralised software-defined management approach for the use of heterogeneous resources. Algorithms for assigning tasks to heterogeneous virtual resources have been analysed and proposed. The proposed algorithms are based on the selected Evolution Strategies metaheuristic that has not yet been used in this domain, namely Evolution Strategies algorithm, Evolution Strategies algorithm with Longest Job First broker policy, and Evolution Strategies algorithm with Shortest Job First broker policy. The Cloud system model is implemented using the open-source CloudSim simulator. ALICE Monte Carlo production job requirements are imported into the simulation model as a workload created in Standard Workload Format (SWF) adapted for the Cloud simulator. The results of the simulation performance of the reference implementation under different loads were analysed and compared with the Genetic Algorithm from the same group of algorithms. The obtained results show multiple improvements. The proposed data processing model enables centralised software management of heterogeneous Cloud infrastructure, optimises measured metrics, improves resource usage, and achieves the system's scalability.
Abstract (croatian)
Ova disertacija predlaže strategiju optimizacije za skalabilnu obradu velikih podataka u heterogenom oblaku (engl. Cloud). U radu se kao motivirajući primjer razmatraju potrebe za resursima Eksperimenta na velikom ionskom sudaraču (engl. A Large Ion Collider Experiment, ALICE) na Europskoj organizaciji za nuklearna istraživanja (engl. European Organization for Nuclear Research, CERN). Rad istražuje kako učinkovito obraditi i optimizirati obradu resursno-intenzivnih zadataka na heterogenoj infrastrukturi u oblaku raspoređenoj u pet podatkovnih centara kako bi se zadovoljile potrebe na Tier 2 razini ALICE eksperimenta. Cilj je bio provesti istraživanje za višestruko veći broj zadataka i resurse znatno većeg kapaciteta u odnosu na dosadašnja istraživanja koja su provođena na manjem broju zadataka i resursima manjih kapaciteta. Predloženi i razvijeni model obrade za ALICE Monte Carlo produkciju temelji se na centraliziranom softverski definiranom pristupu upravljanja korištenjem heterogenih resursa. Analizirani su i predloženi algoritmi za dodjelu zadataka heterogenim virtualnim resursima. Predloženi algoritmi temelje se na odabranoj metaheuristici evolucijskih strategija (engl. Evolution Strategies) koja dosad nije korištena u ovoj domeni, a to su algoritam evolucijskih strategija, algoritam evolucijskih strategija s broker politikom kod koje prioritet izvođenja imaju najdulji zadaci (engl. Longest Job First) i algoritam evolucijskih strategija s broker politikom koja prioritet izvođenja daje najkraćim zadacima (engl. Shortest Job First). Model računalnog oblaka implementiran je pomoću CloudSim simulatora otvorenog koda. Zahtjevi ALICE Monte Carlo produkcijskih poslova uneseni su u simulaciju modela u obliku kreiranog radnog opterećenja u standardnom formatu radnog opterećenja (engl. Standard Workload Format, SWF) prilagođenom za rad u odabranom simulatoru. Analizirani su rezultati izvedbe simulacije referentne implementacije pod različitim opterećenjima i uspoređeni su s genetskim algoritmom (engl. Genetic Algorithm) iz iste skupine algoritama. Dobiveni rezultati pokazuju višestruka poboljšanja. Ovdje predložen model obrade podataka omogućava centralizirano softversko upravljanje heterogenom infrastrukturom u oblaku, optimizira mjerene metrike, poboljšava korištenje resursa i postiže skalabilnost sustava.
Keywords
Keywords (croatian)
Languageenglish
URN:NBNurn:nbn:hr:179:516445
Promotion2023
Study programmeTitle: Electrical Engineering and Information Technology
Study programme type: university
Study level: postgraduate
Academic / professional title: doktor/doktorica znanosti, područje tehničkih znanosti, polje računarstvo (doktor/doktorica znanosti, područje tehničkih znanosti, polje računarstvo)
Type of resourceText
Extent115 str.
File originBorn digital
Access conditionsOpen access
Terms of useLicence In copyright icon
Created on2023-07-05 12:46:46