Home // ALLDATA 2017, The Third International Conference on Big Data, Small Data, Linked Data and Open Data // View article


Flexible Management of Data Nodes for Hadoop Distributed File System

Authors:
Wooseok Ryu

Keywords: Hadoop; HDFS; flexibility; node management

Abstract:
Hadoop Distributed File System (HDFS) is a file system, which stores big data in a distributed manner. Although HDFS cluster provides a great scalability, it requires numerous dedicated data nodes, which makes it difficult for a small business enterprise to construct a big data system. This paper presents a novel mechanism for flexible management of data nodes in the HDFS cluster. A block replication scheme is also presented to ensure availability of data. Using the proposed scheme, storage capacity of HDFS cluster can be dynamically increased by using existing hardware systems.

Pages: 1 to 2

Copyright: Copyright (c) IARIA, 2017

Publication date: April 23, 2017

Published in: conference

ISSN: 2519-8386

ISBN: 978-1-61208-552-4

Location: Venice, Italy

Dates: from April 23, 2017 to April 27, 2017