forked from expand-arcos/expand-arcos.github.io
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.html
More file actions
330 lines (294 loc) · 15.7 KB
/
index.html
File metadata and controls
330 lines (294 loc) · 15.7 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
<!doctype html>
<html lang="es">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Expand Parallel File System</title>
<link href="bootstrap.min.css" rel="stylesheet">
<script src="bootstrap.bundle.min.js"></script>
<link href="base.css" rel="stylesheet">
</head>
<body>
<!-- Header -->
<header class="py-3 sticky-top bg-white w-100">
<div class="container mx-auto row align-items-center">
<div class="col-md-2 text-center text-md-start pr-2">
<img src="xpn-logo.svg" alt="Logo" class="img-fluid">
</div>
<div class="col-md-8 text-center text-md-center">
<h1 class="text-primary">The Expand Parallel File System</h1>
</div>
<div class="col-md-2 text-center text-md-start px-0">
<img src="miccin-300x96.png" alt="Logo" class="img-fluid">
</div>
</div>
<div class="row mt-3 bg-black ">
<div class="col">
<nav class="navbar navbar-expand-lg navbar-dark bg-dark pt-2 border-top">
<div class="container-fluid">
<div class="collapse navbar-collapse justify-content-center">
<ul class="navbar-nav">
<li class="nav-item">
<a class="nav-link text-white dropdown-closer" href="#sponsors">Sponsors</a>
</li>
<li class="nav-item">
<a class="nav-link text-white dropdown-closer" href="#objetivos">Objectives</a>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle text-white" href="#paquetestrabajo"
role="button" data-bs-toggle="dropdown" data-bs-hover="dropdown" aria-expanded="false">Work packages</a>
<ul class="dropdown-menu dropdown-menu-dark" aria-labelledby="paquetestrabajo">
<li><a class="dropdown-item" href="#wp1">WP 1. XPN prototype</a></li>
<li><a class="dropdown-item" href="#wp2">WP 2. XPN release</a></li>
<li><a class="dropdown-item" href="#wp3">WP 3. Validation</a></li>
<li><a class="dropdown-item" href="#wp4">WP 4. Scheduling</a></li>
</ul>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle text-white" href="#entregables" id="entregables"
role="button" data-bs-toggle="dropdown" data-bs-hover="dropdown" aria-expanded="false">Deliverables</a>
<ul class="dropdown-menu dropdown-menu-dark" aria-labelledby="entregables">
<li><a class="dropdown-item" href="#d11">D 1.1</a></li>
<li><a class="dropdown-item" href="#d21">D 2.1</a></li>
<li><a class="dropdown-item" href="#d22">D 2.2</a></li>
<li><a class="dropdown-item" href="#d31">D 3.1</a></li>
<li><a class="dropdown-item" href="#d32">D 3.2</a></li>
<li><a class="dropdown-item" href="#d41">D 4.1</a></li>
<li><a class="dropdown-item" href="#d42">D 4.2</a></li>
</ul>
</li>
<li class="nav-item">
<a class="nav-link text-white dropdown-closer" href="#codigo">Expand release</a>
</li>
<li class="nav-item">
<a class="nav-link text-white dropdown-closer" href="#diseminacion">Dissemination</a>
</li>
<li class="nav-item">
<a class="nav-link text-white dropdown-closer" href="#contact">Contact</a>
</li>
</ul>
</div>
</div>
</nav>
</div>
</div>
</header>
<!-- Main -->
<main class="container mx-auto" data-bs-spy="scroll" data-bs-target="#navbar-example2" data-bs-smooth-scroll="true" tabindex="0">
<h3 id="sponsors">Sponsors</h3>
<p>
<img src="miccin-300x96.png" style="max-height: 12vh; max-width: auto;" class="ms-4">
</p>
</br><!-- br -->
<h3 id="objetivos">Objectives</h3>
<ul>
<p>
The objective of the project is to develop and release an open-source high-performance parallel and distributed file system for HPC and Big Data environments, both for clusters and hybrid clouds.
The goal is to transform the Expand parallel file system, researching and developing new mechanisms, in order to obtain a new technology that is distributed as open-source,
and that can be used in operation in companies and research centres with HPC and Big Data applications.
This project also aims to make Expand a high-performance file system suitable for use in both HPC and Big Data environments,
in a way that differentiates it from existing products that are either adapted to the Big Data ecosystem, such as HDFS, or are adapted to HPC environments,
as for example Lustre parallel file system. The objective is to obtain a product for addressing the fundamental I/O gap on current HPC and Big Data infrastructures,
both for clusters and hybrid clouds, reducing installation, administration, and maintenance costs.
<p></p>
To achieve the former general goal, the project will pursue the following specific goals:
<ul>
<li>
<b>O1.</b> Improving the current prototype by including fault tolerance techniques and mechanisms for use in both HPC and Big Data environments.
</li>
<li>
<b>O2.</b> Transforming the prototype into a system that can be used in production and real applications in companies and research centres with storage and high-performance needs in the input/output.
</li>
<li>
<b>O3.</b> Evaluating the feasibility of the final version of Expand through relevant use cases.
</li>
<li>
<b>O4.</b> Planning and coordinating project activities and to promote the use of Expand and to increase impact.
</li>
</ul>
</p>
</ul>
</br><!-- br -->
<h3 id="paquetestrabajo">Work packages</h3>
<ul>
<a id="wp1"></a>
<h5>WP1. Expand prototype for HPC and Big environments</h5>
<p>
O1. Design and develop new functionalities and API libraries for improving the current prototype of Expand with techniques for fault tolerance support,
and mechanisms for use Expand in both HPC and Big Data environments, and new techniques for dynamic change in partition size.
</p>
<a id="wp2"></a>
<h5>WP2. Production release of Expand</h5>
<p>
O2. To transform the prototype into a system that can be used into production in companies and research centres with storage and
high-performance needs in the input/output.
</p>
<a id="wp3"></a>
<h5>WP3. Final validation</h5>
<p>
O3. Evaluate the feasibility of the final version of Expand through relevant use cases. As use cases we propose to use the results obtained
in the project entitled "Multi-source and multi-method prediction to support COVID-19 policy decision making".
This project is a multidisciplinary project funded by the Community of Madrid in which several research teams from the Universidad Carlos III de Madrid,
including the ARCOS group, participate. Within this project different HPC and Big Data applications are being developed that make intensive use of
large volumes of data to model different COVID-19 propagation scenarios.
</p>
<a id="wp4"></a>
<h5>WP4. Coordination and scheduling of activities</h5>
<p>
O4. To plan and coordinate project activities and to promote results dissemination to increase impact.
</p>
</ul>
</br><!-- br -->
<h3 id="entregables">Deliverables</h3>
<ul>
<a id="wp1"></a>
<h5>WP1. Expand prototype for HPC and Big environments</h5>
<ul>
<a id="d11"></a>
<li><a href="deliverables/TED_Expand_D1_1.pdf">D1.1. Report on new prototype of Expand with fault tolerance support for Big Data and HPC applications</li>
</ul>
<br/>
<a id="wp2"></a>
<h5>WP2. Production release of Expand</h5>
<ul>
<a id="d21"></a>
<li><a href="deliverables/TED_Expand_D2_1.pdf">D2.1. Final architecture of Expand</a></li>
<a id="d22"></a>
<li><a href="deliverables/TED_Expand_D2_2.pdf">D2.2. Installation and manual user guide</a></li>
</ul>
<br/>
<a id="wp3"></a>
<h5>WP3. Final validation</h5>
<ul>
<a id="d31"></a>
<li><a href="deliverables/TED_Expand_D3_1.pdf">D3.1. Report on use cases and benchmarks</a></li>
<a id="d32"></a>
<li><a href="deliverables/TED_Expand_D3_2.pdf">D3.2. Report on final Evaluation</a></li>
</ul>
<br/>
<a id="wp4"></a>
<h5>WP4. Coordination and scheduling of activities</h5>
<ul>
<a id="d41"></a>
<li><a href="deliverables/TED_Expand_D4_1.pdf">D4.1. Intermediate Project Report</a></li>
<a id="d42"></a>
<li><a href="deliverables/TED_Expand_D4_2.pdf">D4.2. Final report of the project and conclusions</a></li>
</ul>
</ul>
</br><!-- br -->
<h3 id="codigo">The source code of the Expand Parallel File System</h3>
<p>
<ul>
The source code can be reached from the GitHub repo: <br>
<a href="https://github.com/xpn-arcos/xpn">https://github.com/xpn-arcos/xpn</a>
</ul>
</p>
</br><!-- br -->
<h3 id="diseminacion">Publications</h3>
<p>
<ul>
<li>2025</li>
<ul>
<li><a href="https://doi.org/10.1007/s10586-025-05575-8"><b>Malleability and fault tolerance in ad-hoc parallel file systems</b></a>,<br>
Authors: Dario Muñoz-Muñoz, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos, Jesus Carretero<br>
Journal paper: Cluster Computing
</li>
<li><a href="https://doi.org/10.1016/j.future.2025.107931"><b>Hierarchical and distributed data storage for Computing Continuum</b></a>,<br>
Authors: Elias Del-Pozo-Puñal, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos,<br>
Journal paper: Future Generation Computer Systems
</li>
<li><b>Evaluación del sistema de ficheros Expand Ad-Hoc con aplicaciones de uso intensivo de datos</b> <a href="">DOI in progress...</a>,<br>
Authors: Diego Camarmas-Alonso, Felix Garcia-Carballeira, Alejandro Calderon-Mateos, Darío Muñoz-Muñoz, Jesus Carretero,<br>
Conference paper: XXXV Jornadas de Paralelismo (JP25)
</li>
<li><b>Sistema de almacenamiento para computing continuum: aplicación a sistemas de información ferroviaria</b> <a href="">DOI in progress...</a>,<br>
Authors: Elías Del-Pozo-Puñal, Félix García-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos,<br>
Conference paper: XXXV Jornadas de Paralelismo (JP25)
</li>
<li><b>Optimización de entornos de Big Data Analytics mediante sistemas de ficheros paralelos Ad-hoc</b> <a href="">DOI in progress...</a>,<br>
Authors: Gabriel Sotodosos-Morales, Félix García-Carballeira, Diego Camarmas-Alonso, Alejandro Calderón-Mateos, Darío Muñoz-Muñoz, Jesús Carretero,<br>
Conference paper: XXXV Jornadas de Paralelismo (JP25)
</li>
</ul>
<li>2024</li>
<ul>
<li><a href="https://doi.org/10.1007/978-3-031-69766-1_5"><b>Fault tolerant in the Expand Ad-Hoc parallel file system</b></a>,<br>
Authors: Dario Muñoz-Muñoz, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos, Jesus Carretero,<br>
Conference paper: 30th International European Conference on Parallel and Distributed Computing (Euro-Par)
</li>
<li><a href="https://doi.org/10.1007/978-3-031-90200-0_26"><b>Malleability in the Expand Ad-Hoc parallel file system</b></a>,<br>
Authors: Dario Muñoz-Muñoz, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos, Jesus Carretero,<br>
Conference paper: 3rd EuroHPC Workshop on Dynamic Resources in HPC. Euro-Par 2024
</li>
<li><a href="http://dx.doi.org/10.5281/zenodo.12743582"><b>Tolerancia a fallos en el sistema de ficheros paralelo Expand Ad-Hoc</b></a>,<br>
Authors: Dario Muñoz-Muñoz, Diego Camarmas-Alonso, Felix Garcia-Carballeira, Alejandro Calderon-Mateos, Jesus Carretero,<br>
Conference paper: XXXIV Jornadas de Paralelismo (JP24)
</li>
<li><a href="http://dx.doi.org/10.5281/zenodo.12094741"><b>Evaluación del rendimiento de un sistema de ficheros para sistemas IoT</b></a>,<br>
Authors: Elias Del-Pozo-Puñal, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos,<br>
Conference paper: XXXIV Jornadas de Paralelismo (JP24)
</li>
</ul>
<li>2023</li>
<ul>
<li><a href="http://dx.doi.org/10.1109/ISPDC59212.2023.00015"><b>A new Ad-Hoc parallel file system for HPC environments based on the Expand parallel file system</b></a>,<br>
Authors: Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos, Jesus Carretero,<br>
Conference paper: 22nd International Symposium on Parallel and Distributed Computing (ISPDC)
</li>
<li><a href="http://dx.doi.org/10.5281/zenodo.8378956"><b>Evaluación de rendimiento del sistema de ficheros paralelo Expand Ad-Hoc en MareNostrum 4</b></a>,<br>
Authors: Diego Camarmas-Alonso, Felix Garcia-Carballeira, Alejandro Calderon-Mateos, Jesus Carretero,<br>
Conference paper: XXXIII Jornadas de Paralelismo (JP23)
</li>
<li><a href="http://dx.doi.org/10.5281/zenodo.10706248"><b>Sistema de Ficheros Distribuido para IoT basado en Expand</b></a>,<br>
Authors: Elias Del-Pozo-Puñal, Felix Garcia-Carballeira, Diego Camarmas-Alonso, Alejandro Calderon-Mateos,<br>
Conference paper: XXXIII Jornadas de Paralelismo (JP23)
</li>
</ul>
</ul>
</p>
</br><!-- br -->
<h3 id="contact">Contact</h3>
<p>
<ul>
Welcome to our contact page for the Expand Parallel File System Project! <br>
We appreciate your interest in our work and look forward to hearing from you.<br>
<br/>
Whether you have a question, a suggestion, or just want to point something out, we invite you to get in touch with us. <br>
You can reach us via email at expand.arcos.inf.uc3m.es@gmail.com,
and we will do our best to respond to your message as quickly as possible. <br>
<br/>
Thank you again for your interest in our Expand Parallel File System Project !<br>
</ul>
</p>
</br><!-- br -->
<p></p>
</main>
<!-- Footer -->
<footer class="fixed-bottom">
<div class="container">
<p class="mb-0">The Expand Parallel File System Project (2022-2025)</p>
</div>
</footer>
</body>
<script>
let dropdowns = document.querySelectorAll('.dropdown-toggle')
dropdowns.forEach((dd)=>{
dd.addEventListener('mouseover', function (e) {
let alldd = document.querySelectorAll('.dropdown-menu')
alldd.forEach((ddi)=>{
ddi.classList.remove('show');
});
this.nextElementSibling.classList.add('show')
});
})
let ddc = document.querySelectorAll('.dropdown-closer')
ddc.forEach((dd)=>{
dd.addEventListener('mouseover', function (e) {
let alldd = document.querySelectorAll('.dropdown-menu')
alldd.forEach((ddi)=>{
ddi.classList.remove('show');
});
});
})
</script>
</html>