Please use this identifier to cite or link to this item: http://repositorio.unicamp.br/jspui/handle/REPOSIP/329307
Type: Artigo
Title: Py-pits: A Scalable Python Runtime System For The Computation Of Partially Idempotent Tasks
PY-PITS : a scalable python runtime system for the computation of partially idempotent tasks
Author: Borin, Edson
Benedicto, Caian
Rodrigues, Ian L.
Pisani, Flávia
Tygel, Martin
Breternitz Jr., Mauricio
Abstract: The popularization of multi-core architectures and cloud services has allowed users access to high performance computing infrastructures. However, programming for these systems might be cumbersome due to challenges involving system failures, load balancing, and task scheduling. Aiming at solving these problems, we previously introduced SPITS, a programming model and reference architecture for executing bag-of-task applications. In this work, we discuss how this programming model allowed us to design and implement PY-PITS, a simple and effective open source runtime system that is scalable, tolerates faults and allows dynamic provisioning of resources during computation of tasks. We also discuss how PY-PITS can be used to improve utilization of multi-user computational clusters equipped with queues to submit jobs and propose a performance model to aid users to understand when the performance of PY-PITS scales with the number of Workers.
The popularization of multi-core architectures and cloud services has allowed users access to high performance computing infrastructures. However, programming for these systems might be cumbersome due to challenges involving system failures, load balancin
Subject: Arquitetura de computador
Computação distribuída
Computação de alto desempenho
Computação em nuvem
Python (Linguagem de programação de computador)
Country: Estados Unidos
Editor: Institute of Electrical and Electronics Engineers
Citation: 2016 28th Ieee International Symposium On Computer Architecture And High Performance Computing Workshops (sbac-padw). Ieee, p. 7 - 12, 2016.
Rights: fechado
Fechado
Identifier DOI: 10.1109/SBAC-PADW.2016.10
Address: https://ieeexplore.ieee.org/document/7803668
Date Issue: 2017
Appears in Collections:IC - Artigos e Outros Documentos
IMECC - Artigos e Outros Documentos

Files in This Item:
File SizeFormat 
2-s2.0-85014138146.pdf739.74 kBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.